This weekend, on June 28, NASA and Microsoft were supposed to send the mixed reality headset HoloLens into space, on the Space X resupply mission.
The Project Sidekick, in which the two companies collaborate, was designed to facilitate the research onboard the International Space Station. The Project involves an experiment designed to provide holographic images to astronauts on their mission on the ISS. The holographic visuals will be projected in their field of view and could help astronauts in their research, for example, by offering them a full demo of the performed experiment.
Mixed reality devices such as HoloLens make use of such innovative cutting edge technologies that can be applied to space exploration. Critical science experiments conducted on the International Space Station can take advantage of the new capabilities provided by the Microsoft HoloLens gadget. In the near future, this kind of technology can also be applied to help future explorers achieve a greater autonomy in their exploration journey to planet Mars.
For the moment, the Project Sidekick has two applications. Procedure Mode provides an augmented reality experience. The astronauts can see in this mixed reality mode certain holographic information projected atop of real objects. This technology can help reducing the time spent on astronauts' training as well as having a positive effect on reducing the communication delays.
By using the Microsoft HoloLens device in training, the astronauts will not need as much training as before in order to go into space. Previously, only voice instructions were available to astronauts, but with the Project Sidekick, the space crew can receive diagrams, notes, and other direct visuals. The holographic mixed reality technology can become a precious tool for the space exploration.
Another applicatiuon is the Remote Expert Mode which provides communication between the ground crew and the onboard astronauts through Skype. In order to better understand the issues at hand and find appropriate solutions, via the HoloLens, the crew on ground will be able to see what the astronauts see. By using the mixed virtual reality technology, the on ground crew can project notes in the field of view of the astronaut, assist the astronaut in real time, and demonstrate through diagrams.
Unfortunately, the unmanned SpaceX Falcon 9 rocket launched Sunday, on June 28, from Cape Canaveral, Florida, exploded about two minutes after liftoff, destroying the cargo ship containing the HoloLens device bound for the International Space Station.
Microsoft and NASA are not at their first collaboration. In the past, the two companies have been working together on Project OnSight, designed to help NASA scientists to see simulations of planet Mars.
