Bridging virtual and physical worlds through AI

Carrara F.

XR  AI  Virtual worlds  Open-vocabulary  Semantic reconstruction 

Immersive and user-friendly experiences will win the Extended Reality (XR) game in the long run. However, setting up good VR/AR scenarios often requires manual asset authoring, which is realistic just when dealing with a limited number of predefined objects and scenes. The Social and hUman ceNtered (SUN) XR project is investigating low-cost, yet effective, solutions to create links between a physical environment and its corresponding one in the virtual world.

Source: ERCIM NEWS, vol. 2024 (issue 137), pp. 17-18