SCUBA simulator advances the field of virtual reality while exploring the relationship between diving and disability

April 12, 2016 by Sharon Lacey
The Amphibian SCUBA diving simulator, a research project from the MIT Media Lab, lets users experience the underwater world through a high presence virtual reality system. The system includes a motion platform, Oculus Rift head-mounted display, snorkel with sensors, leg-motion sensors, and gloves that enable motion detection, temperature simulation, and physical feedback of objects. Captured sensor data is fed into a processing unit that converts the users physical motion into virtual movement in the Oculus app. Credit: James Day

"My diving bell becomes less oppressive, and my mind takes flight like a butterfly," Jean-Dominique Bauby wrote in his agonizingly beautiful account of living with severe disabilities, The Diving Bell and the Butterfly. Holding these contrasting images of physical submersion and mental liberation in your mind is a useful way to approach Dhruv Jain's virtual reality project, Amphibian. Jain, a master of science candidate in the MIT Media Lab's Living Mobile Group who is partially deaf, created this SCUBA diving simulator to help abled people understand in an artistic way the liberating effects of disabilities, which he likens to the experience of being underwater.                                          

"Underwater, our vital senses are dulled and warped. Visual range is limited and magnification is distorted. The senses of smell, taste and touch are severely muted. Hearing is distorted too, since sound travels five times faster in the water," he says. "But in these conditions, I experienced the kind of peace one can only expect to feel with the freedom of weightlessness. Having done 54 dives in the last 10 months, I can call myself a good diver now. And yet every time I dive, I find the underwater experience to be rejuvenating; it is emotional and almost spiritual."                   

These experiences compelled him to explore the connection between diving and disability. While he finds diving to be a peaceful endeavor, he realized it is too physically and mentally challenging for many people. So, he resolved to build an "experience machine" that places people in an ocean environment without their having to leave dry land. Under his faculty advisor, principal research scientist and Living Mobile Group head Chris Schmandt, Jain and his team constructed Amphibian. As the name suggests, the project allows users to straddle aquatic and terrestrial worlds by providing an immersive SCUBA diving experience through a water-free simulator.  

MIT Media Lab researchers Dhruv Jain (left) and Misha Sra are creators of the Amphibian SCUBA diving simulator. Credit: James Day

Most existing SCUBA diving simulations in virtual reality (VR) are limited to visual and aural displays. Amphibian advances the field of VR by engaging additional sensory modalities like thermoception (sense of temperature), equilibrioception (sense of balance), and proprioception (sense of spatial orientation and movement). Users lie on their torsos on a motion platform with outstretched arms and legs placed in a suspended harness. An Oculus Rift head-mounted display and headphones allow them to see and hear the underwater environment. Various sensors are used to simulate buoyancy, drag, and temperature during the simulation. For example, Peltier modules attached to participants' wrists through motion tracking gloves simulate temperature changes as they dive deeper into the water. An inflatable airbag placed under the torso allows the user to control ascent or descent through breathing; inhaling makes the airbag inflate and exhaling makes it deflate. The virtual body rises up and down in sync. This is done using a gas sensor attached to a snorkel that measures the amount of air inhaled or exhaled.

To navigate in the virtual world, the user wears gloves with embedded flex sensors and inertial measurement units (IMUs) that track each hand's movement. Leg motion is also tracked via IMUs, and users swim forward by kicking their legs up and down. All sensor data is fed into a processing unit that converts the physical motion of hands and legs into virtual movement in the Oculus app. Another novel contribution of the system is a two-way interaction between the user and the underwater virtual world. For example, users can grasp underwater objects such as rocks or crabs using their hands in a grab gesture and sense physical feedback. The sensation of picking up something is conveyed through an inflatable pad on the palm of each glove, which simulates the texture and shape of the object grabbed.

The video will load shortly

By combining available technologies in a unique way to accommodate multiple senses, the system has the potential to offer a high degree of presence in VR. ("Presence" refers to that function of immersion that increases the user's sense of "being there.") One of Jain's team members, Misha Sra, reflects on how she overcame her petrifying fear of water because of Amphibian's verisimilitude. After a traumatic experience in a pool in college, just being near water filled her with dread. She says, "I wished I could dive but to do that, I first had to get over my fear of water and learn how to swim, which seemed like an insurmountable hurdle. Amphibian was a great middle ground."

Amphibian is not Jain's first technological system to simulate sensory deprivation nor his first artwork designed to generate empathy for disabled persons. For one of his previous projects, Blind Emporium, he created a room in which outside sound and light were completely blocked, forcing participants to navigate using touch and following sounds emitted from selected objects. He found that in projects that "explore absence," people still tended to focus on what they lacked instead of what they might gain, so he decided to alter his approach with Amphibian. "People have a negative view of blindness or deafness, thinking that they would find it too difficult to navigate in the world, but my goal was to make people realize that disability is also liberating. When I turn off my hearing aid and close my eyes, I go into a deep meditative state," Jain says. "Being underwater is so freeing, I thought through diving I could make people better understand the effect of disabilities."

A user experiences the underwater world using Amphibian SCUBA diving simulator. The user is resting on a suspension system wearing Oculus Rift, a snorkel with breathing sensor, and gloves for motion detection. Credit: James Day

“Being underwater is so freeing, I thought through diving I could make people better understand the effect of disabilities,” says MIT Media Lab graduate student Dhruv Jain. Credit: James Day

Explore further: Turns out the answer to virtual reality sickness is right in front of your face

Related Stories

Experts offer diving safety tips

July 12, 2015

(HealthDay)—It's tempting to dive into pools, lakes and other bodies of water when you're trying to cool off on a hot summer day, but it can be dangerous if you don't take proper safety precautions, experts warn.

A look at how Oculus compares to Vive and PlayStation VR

March 24, 2016

After four years of hype, high-end virtual reality is coming to consumers' living rooms next week with the release of the consumer edition of the Oculus Rift. The debut will be followed by the introduction of similar high-fidelity ...

Recommended for you

Making animated characters jump just got easier

July 28, 2017

The way a videogame character jumps, kicks, walks, runs or even breathes is determined by a loop of frames known as a motion cycle. Also critical for producing animated films, motion cycles are as important as they are difficult ...

World gears up for electric cars despite bumps in road

July 26, 2017

Technological advances mean fossil fuel in cars could be phased out within decades but switching to electric carries its own environmental and economic concerns as more and more countries announce radical plans.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.