INTROSPECT: Introspection of Archaeological Data in the Digital Age

The INTROSPECT project is a research collaboration between researchers in computer science and archeology made up of about fifteen people from France (the IRISA and CReAAH laboratories, Inrap and the company Image ET), Université Laval and INRS-ETE. It is supported financially by the French National Research Agency and the Fonds...

VERARE : virtual reality at the service of the rehabilitation of patients with Covid-19

After hospitalization in ICU, about 50% of patients develop neuromyopathy, i.e. damage to nerves and muscles as a result of immobilization and the treatments used. Amongst patients affected by Covid-19 and hospitalized in ICU for several weeks, this pattern is similar or even higher. Neuromyopathy will delay their return to...

SUNSET Project

SUNSET aims at developing an innovative training software suite based on immersive and collaborative virtual reality technology for training and evaluating non-technical skills. This approach will be implemented and evaluated in the context of training neurosurgical scrub nurses. We will notably integrate methods and systems developed in the S3PM project...

The Six-Finger Illusion

With the increasing demand in virtual reality applications and games, the need to understand how users perceive their virtual representation (avatar) is becoming more and more important. In particular, with the potential of virtual reality to alter and control avatars in different ways, the user representation in the virtual world...

Bimanual Passive-Haptic Interaction

The Virtual Mitten is a novel visuo-haptic interaction paradigm for simulating the 3D manipulation of objects. Our approach introduces an elastic hand-held device that provides a passive haptic feedback through the fingers and a mitten interaction metaphor that enables to grasp and manipulate objects. The grasping performed by the mitten...

Brain Computer Interfaces

One of the main research interests of hybrid is the design of brain-based interaction in virtual reality. This calls for 3D user interfaces based on brain-computer interfaces, and mind-based control. Hybrid explores its applicability on different use-case scenarios. Here we show some examples: The MindShooter videogame Brain-Computer Interfaces became more...

Presentation

Hybrid is a research team created January 1, 2013 in Rennes, France, and hosted jointly at Inria and IRISA (UMR CNRS 6074). Hybrid members are affiliated with either Inria, INSA Rennes or University of Rennes 1.

The scientific fields of Hybrid are Virtual Reality and 3D interaction with virtual environments. Hybrid research focuses on multiple user inputs, and intends to exploit both motor activity (motion-tracking) and mental activity (brain-computer interfaces). We want to create novel “body-based” and “mind-based” controls of virtual environments, and reach in both cases immersive and efficient 3D user interfaces. We also want to introduce a “hybrid approach” which will mix mental and motor activities in virtual reality. Hybrid applications are in the field of industry (virtual prototyping), medicine (surgical simulation, rehabilitation), design (architectural mock-ups), digital art, or videogames.

Research Project

Our research project belongs to the scientific field of Virtual Reality (VR) and 3D interaction with virtual environments. VR systems can be used in numerous applications such as: industry (virtual prototyping, assembly or maintenance operations, data visualization), entertainment (video games, theme parks), arts and design (interactive sketching or sculpture, CAD, architectural mock-ups), education and science (physical simulations, virtual classrooms), or medicine (surgical training, rehabilitation systems). A major change that we foresee in the next decade concerning the field of Virtual Reality relates to the emergence of new paradigms of interaction (input/output) with Virtual Environments (VE).

As for today, the most common way to interact with 3D content still remains by measuring user’s motor activity, i.e., his/her gestures and physical motions when manipulating different kinds of input device. However, a recent trend consists in soliciting more movements and more physical engagement of the body of the user. We can notably stress the emergence of bimanual interaction, natural walking interfaces, and whole-body involvement. These new interaction schemes bring a new level of complexity in terms of generic physical simulation of potential interactions between the virtual body and the virtual surrounding, and a challenging “trade-off” between performance and realism. Moreover, research is also needed to characterize the influence of these new sensory cues on the resulting feelings of "presence" and immersion of the user.

Besides, a novel kind of user input has recently appeared in the field of virtual reality: the user’s mental activity, which can be measured by means of a “Brain-Computer Interface” (BCI). Brain-Computer Interfaces are communication systems which measure user’s electrical cerebral activity and translate it, in real-time, into an exploitable command. BCIs introduce a new way of interacting “by thought” with virtual environments. However, current BCI can only extract a small amount of mental states and hence a small number of mental commands. Thus, research is still needed here to extend the capacities of BCI, and to better exploit the few available mental states in virtual environments.

Our first motivation consists thus in designing novel “body-based” and “mind-based” controls of virtual environments and reaching, in both cases, more immersive and more efficient 3D interaction.

Furthermore, in current VR systems, motor activities and mental activities are always considered separately and exclusively. This reminds the well-known “body-mind dualism” which is at the heart of historical philosophical debates. In this context, our objective is to introduce novel “hybrid” interaction schemes in virtual reality, by considering motor and mental activities jointly, i.e., in a harmonious, complementary, and optimized way. Thus, we intend to explore novel paradigms of 3D interaction mixing body and mind inputs. Moreover, our approach becomes even more challenging when considering and connecting multiple users which implies multiple bodies and multiple brains collaborating and interacting in virtual reality.

Our second motivation consists thus in introducing a “hybrid approach” which will mix mental and motor activities of one or multiple users in virtual reality.

Research Axes

Hybrid follows three main axes of research:

  • Body-based interaction in virtual reality (real-time physical simulation of complex interactive phenomena, haptic and pseudo-haptic feedback)
  • Brain-based interaction in virtual reality (3D user interfaces based on brain-computer interfaces and mind-based control)
  • Hybrid and collaborative 3D interaction (Collaborative virtual environments with multiple users, and shared systems with body and mind inputs).