Thesis Project Form

In immersive Virtual Reality (VR), when using an head-mounted display (HMD), typically the users do not see the real environment surrounding them. Instead, Augmented Virtuality paradigm opens the possibility of interacting with real objects, by seeing virtual elements and touching the corresponding real ones.

This thesis's main goal is to develop an immersive Augmented Virtuality system that implements an ecological object substitution technique. Objects in a room will be detected, and their approximate shape and position recovered (e.g., by using RGBD sensors). The VR scene will be enriched with objects having the same shape and position as real ones, but contextualized with the VR environment. The real objects (and thus the corresponding virtual ones) will be tracked to allow the physical interaction between the users’ hands and the objects. Experimental sessions will be performed to validate the system in interactive scenarios and to compare it with existing techniques in the state of the art.

1) To improve and analyze an existing system that substitutes real objects with virtual ones.
2)To implement a technique to substitute objects by taking into consideration the semantic.
3)To implement some existing techniques in order to build a reference for further comparisons.
4)To track specific real objects (and the corresponding real ones)
5)To devise an interactive scenario to validate the technique