How space agencies are driving XR adoption and creating new opportunities for innovators

Driving the infrastructure for the next generation of XR

After more than two decades of experimentation and development, ESA is moving XR from a collection of individual projects into a coordinated capability that could transform training, engineering, operations and exploration, both in space and on Earth.

While virtual reality (VR), augmented reality (AR) and mixed reality (MR) are often associated with immersive experiences, their wider adoption depends on something less visible: connectivity. As XR applications become more sophisticated, they increasingly rely on fast, reliable networks capable of supporting real-time collaboration, remote assistance and data-intensive experiences.

According to Talbot, developments in 5G Non-terrestrial Networks (NTNs) are helping to create the conditions for that growth.

Currently, 5G NTNs use satellites and other airborne systems to extend mobile coverage into places where traditional phone masts cannot reach. This allows people to stay connected in remote locations, whether at sea, in rural communities or in polar regions. As satellite and ground-based networks become more closely integrated, they will provide the connectivity needed to support immersive applications wherever people are working.

“With the advent of 5G Non-terrestrial Networks (NTN) and the coming integration of those networks with terrestrial ecosystems, the use case for XR is becoming relevant for space-related technology developments here on Earth,” he explains.

The implications extend far beyond the space sector. As connectivity improves, specialists could use XR technologies to provide training, operational support and expertise from almost anywhere. Whether supporting engineering projects, emergency response teams or healthcare services in hard-to-reach locations, XR has the potential to make specialist knowledge more accessible.

This ability to connect people, expertise and immersive technologies across distances is one reason why space agencies are focusing on the field.

Why XR, AI and robotics are converging

Connectivity is only part of the story.

Talbot believes advances in artificial intelligence and robotics are also reshaping what XR can achieve and how people interact with digital systems.

“XR is also developing due to AI advancements in recent years, and embodied AI through robotics is on the cusp of changing the way all of us interact with computers and machines.”

As AI systems become more capable, XR is increasingly being viewed as the interface through which people can interact with those technologies. Rather than relying on screens, keyboards or traditional controls, users can engage with information, environments and intelligent systems in ways that feel more intuitive and natural.

This is particularly relevant in space exploration, where people and machines must often work together in challenging environments. Future missions are expected to rely heavily on autonomous and semi-autonomous robotic systems to perform inspections, undertake maintenance activities and support human crews.

XR can help bridge the gap between people and those systems, allowing operators to visualise complex environments, collaborate remotely and interact with robotic technologies more effectively. Combined with future hybrid terrestrial and non-terrestrial networks, these capabilities have the potential to transform the way humans work with machines both in space and on Earth.

How ESA is putting XR into practice

ESA’s interest in XR is not solely focused on future possibilities. The agency has been exploring immersive technologies since the early 2000s and has already undertaken more than 80 XR-related activities.

Today, those activities span astronaut training, digital twin development, mission planning, operations support and public engagement. More recently, ESA established a dedicated Extended Reality Competence Centre (XR-CC) to bring together expertise, knowledge sharing and strategic direction across its programmes.

At the European Astronaut Centre, XR technologies have long been used to support astronaut care and training. Virtual environments allow astronauts and mission specialists to practise procedures, repeat complex tasks and prepare for missions in realistic and controlled settings.

The technology also plays an important role in engineering and design. Immersive environments allow teams to visualise spacecraft, habitats and infrastructure before they are physically built. Engineers can interact with virtual models, identify potential challenges earlier and collaborate across locations more effectively.

For ESA, the value of XR extends across the entire lifecycle of a mission, from early design and planning through to operational support and future exploration. The agency’s long-term vision is for XR to become a core operational capability, supporting everything from mission preparation and decision-making to remote operations and collaboration.

From space applications to real-world impact

Although many of these developments are being driven by the needs of space exploration, their potential applications reach far beyond the sector, providing opportunities for innovators such as those on the Mindset-XR Innovation Support programme.

Talbot highlighted healthcare as one area where XR could have a significant impact. Immersive technologies could support mental health interventions, help patients better understand procedures and enable more informed decision-making through interactive experiences.

The same principles can also be applied in other environments where access to expertise is limited. XR could support remote training, diagnostics and operational assistance across industries, helping organisations connect people with specialist knowledge regardless of their location.

Much like innovations originally developed for Formula One have eventually found their way into everyday vehicles, technologies developed for space often find practical applications elsewhere. As XR, AI and connectivity technologies continue to mature together, the opportunities for wider adoption are likely to grow.

At the same time, XR devices are becoming smaller, more affordable and more capable.

“The use of XR and its varied forms will continue to improve in device compatibility, size and cost, which will drive adoption and proliferate the need for connected XR throughout industry, academia and the healthcare sectors.”

Collaborating with innovators

Alongside developing its own XR capabilities, ESA is also looking outward.

To help accelerate innovation, the agency is developing a new AI Hub at Harwell in the UK. The facility will enable industry and academia to test and demonstrate AI-enabled connectivity solutions and support innovation across satellite communications, artificial intelligence and immersive technologies.

For organisations working at the intersection of XR, AI and connectivity, Talbot believes there are significant opportunities to collaborate.

“We would like to hear from interested persons looking to expand their 5G NTN and AI capabilities in XR through the AI Hub.”

That invitation reflects a broader shift taking place across ESA’s XR activities. After two decades of research and development, immersive technologies are no longer being viewed as experimental tools. They are becoming a strategic capability with applications spanning engineering, robotics, healthcare, training and exploration.

As connectivity, AI and XR continue to converge, space agencies are helping to create the infrastructure, partnerships and opportunities that could shape the next generation of immersive innovation.

Find out more

For more information about the AI Hub and opportunities for collaboration, contact ai-hub@esa.int