Units

LISA - Virtual Reality

Person in charge of the Unit : Oui

LISA (Laboratory of Image Synthesis and Analysis) brings together expertise in image processing and analysis, pattern recognition, image synthesis and virtual reality. 
LISA-VR studies advanced Computational Imaging techniques to capture and render natural scenes in 3D for Virtual Reality (cf. attached pictures 1 & 2) and Holography (cf. attached pictures 3 & 4). Instead of explicitly modeling the scene with 3D models as is typically done in 3D video games, we aim at low-cost light-field solutions, characterizing not only the light intensity, but also the light direction in each point in space, aka the plenoptic function. To obtain a specific view to the scene, only a subset of the various light directions is rendered, using so-called Depth Image-Based Rendering techniques that only use images to create proper 3D perspective illusions. Their principles are know for a long time, but it remains challenging to make them work in practical settings; in particular the depth sensing/estimation, the disocclusion handling and the camera architectural settings remain open research questions. The ultimate goal is to be able to properly capture the 3D scene's light field with as little equipment as possible, while reaching high-resolution virtual views of the scene for Holographic portraiting and Virtual Reality, the latter also imposing stringent real-time rendering constraints.

Projetcs

COLiBR²IH

The COLiBR²IH project targets the Camera Optimisation (architecture and position) for capturing Light Bundles in Rendering Reality Interactively and Holographically

3DLicorneA

3DLicorneA = 3D Live Capturing, Compression and Omnidirectional Reconstruction/Rendering of Natural Environments and Actors.
3DLicorneA proposes a solution for real-time multi-directional capturing of natural environments and actors, compression of the generated data, as well as the reconstruction and rendering of the 3D environment.

Holographic Vision for Immersive Tele-Robotic OperatioN

The EU-funded HoviTron project aims to develop hardware and software modules to replace stereoscopic head mounted displays (HMD) with holographic ones, as well as designing accompanying multi-camera acquisition systems for real scenery. Within this scope, a light field HMD will provide holographic vision; thanks to this system, eye accommodation will be eased and will allow vergence for ergonomic and immersive telerobotic operations. When the robot operates, conventional or light field cameras will recreate the proper light field in the HMD of the tele-operator that will steer the robot. Eventually, the project will evaluate the benefits of such light field HMD for the tele-operator, whose work is expected to become more comfortable.