Haptics and multisensory interfaces
Comment
Stakeholder Type

Haptics and multisensory interfaces

1.5.4

Sub-Field

Haptics and multisensory interfaces

Current XR technology is primarily audio-visual, but this is unlikely to remain the case in the future. Emerging haptic technology promises to boost immersion by adding a variety of new sensory experiences to virtual environments.53

Future Horizons:

×××

5-yearhorizon

XR experiences are commonly multisensory

Lightweight and power-efficient wearable haptic devices, combined with increasingly compact mid-air haptic set-ups, make it commonplace for XR experiences to be multisensory. Olfactory stimuli are increasingly used to deepen immersion in XR environments by replicating some of the distinctive smells associated with specific locations.

10-yearhorizon

Virtual and real experiences become increasingly similar

Advances in haptics and multisensory interfaces provide senses of touch, force feedback and smell that are so realistic that virtual experiences are increasingly indistinguishable from real ones. Haptic feedback is provided by a combination of wearable devices and robots that dynamically reconfigure the user’s physical environment. Researchers codify the “language” of smell and taste, making it possible to use these senses to evoke nuanced and highly personal emotional responses in users.

25-yearhorizon

Brain-computer interfaces evoke realistic multisensory experiences

The advent of XR mediated by brain‑computer interfaces allows direct control of the user’s senses. This makes it possible to evoke multisensory experiences that are identical to those experienced in the real world. It may even be possible to achieve heightened levels of sensory experience not accessible in everyday life.

A wide range of wearable haptic devices has been developed to simulate various tactile sensations such as pressure, texture and temperature.54 These include gloves, vests and bracelets that rely on a variety of approaches to generate tactile illusions such as vibrating electromechanical devices, electrical stimulation or shape-changing materials. These devices can be cumbersome, though, which is spurring growing interest in “mid-air haptics”, which uses ultrasound beams to stimulate the skin and generate highly modifiable tactile sensations without physical contact.55,56 Another emerging approach involves using mobile robots to simulate virtual objects57 or even reconfiguring physical environments to match the virtual one.58

Simulating the chemical senses of taste and smell is now becoming feasible. So-called gustatory interfaces are making it possible to recreate taste sensations in virtual experiences.59,60 Olfactory interfaces can be combined with software that is able to recreate how smells evolve over space and time.61,62

In the near term, haptic technology could play an important role enhancing the realism of mixed-reality training in fields like medicine.63 But in the future it could also make XR experiences more immersive and boost their emotional depth.64,65,66 However, this will require us to move away from using isolated haptic stimuli as an accessory to audio-visual experiences and instead work out how sequences of sensations can be combined to compose multisensory narratives.

Haptics and multisensory interfaces - Anticipation Scores

The Anticipation Potential of a research field is determined by the capacity for impactful action in the present, considering possible future transformative breakthroughs in a field over a 25-year outlook. A field with a high Anticipation Potential, therefore, combines the potential range of future transformative possibilities engendered by a research area with a wide field of opportunities for action in the present. We asked researchers in the field to anticipate:

  1. The uncertainty related to future science breakthroughs in the field
  2. The transformative effect anticipated breakthroughs may have on research and society
  3. The scope for action in the present in relation to anticipated breakthroughs.

This chart represents a summary of their responses to each of these elements, which when combined, provide the Anticipation Potential for the topic. See methodology for more information.