Startup creates underwater robotics with a human touch

April 8, 2014 by Clare Lafond
Undergraduates are a key part of the BluHaptics team.

It should be just as easy to use a robotic arm as it is to use your own hand. That's the thinking behind University of Washington startup BluHaptics, which is taking telerobotics—controlling robots from a distance—to a new level: underwater.

Using developed by Dr. Howard Chizeck's lab in the UW Department of Electrical Engineering, a team of UW scientists and engineers working at the Applied Physics Laboratory (APL) is creating a control system for underwater Remotely Operated Vehicles (ROVs). ROVs can perform a variety of undersea tasks too dangerous – or even impossible – for humans, ranging from oil and , biohazard clean-up and mining, to environmentally sensitive scientific research.

The UW research team is working with a "submersible manipulator test bed" at APL, which is comprised of specialized, submersible equipment similar to what's used in the oil & gas industry for offshore operations. This equipment is submerged in a large water tank for a realistic test environment.

"Essentially, we're combining the spatial awareness of a computer system with the perceptive capability of a human operator," explained Andy Stewart, a senior engineer in the Ocean Engineering department and part of the BluHaptics team. "To do this, we use what's called a haptic device."

Haptics describes feedback technology that takes advantage of the sense of touch by applying forces, vibrations or motions to the user. The haptic device is used to both control the robot and to provide force feedback to the user. This feedback guides the human operator to the desired location, pushing back on the hand to avoid collisions or other mistakes. The haptic input device is similar to using a mouse with a computer, Stewart explained, "but it's giving three-dimensional input, so you're actually defining a point in space where you want the to go."

This video is not supported by your browser at this time.

"Haptics does for the sense of touch what computer graphics do for vision," explained Chizeck, who co-directs the UW Bio-Robotics Lab and is the Principal Investigator of this effort. "APL brought us expertise in underwater operations, underwater sensors and underwater robotics that we could combine with our haptic technology."

The technology creates a virtual representation based on a combination of sonar, video and laser inputs – sensory feedback that enhances the human-robotic interface and speeds up operations. This translates into tackling the task at hand safely and more efficiently, while greatly reducing the risk of damage to the environment.

The BluHaptics robotic control system is based on key algorithms developed by Dr. Fredrik Ryden in the UW Department of Electrical Engineering, as part of his PhD. This work was originally directed to robotic surgery, which allows surgeons to operate remotely via a computer connected to a robot – a surgical alternative for certain medical procedures that can mean enhanced precision and less trauma for the patient, and decreased fatigue for the surgeon. BluHaptics is now applying and modifying these same algorithms to underwater robotics.

C4C provided the team with $50k of Commercialization Gap Funding to move the technology from the lab to a commercial product. This funding also has been used to employ UW entrepreneurial undergraduates to work on the project.

C4C has also granted Ryden a Commercialization Post-Doctoral Fellowship that gives him a year to work on the technology, explore the business issues and figure out what the ideal product should be.

Andy Stewart demonstrates the BluHaptics robotic arm.

"The coolest thing about this project is that we're taking technology developed in a University of Washington lab and we're actually commercializing it," Ryden said. "And there are multiple areas of research involved – computer vision, sensor fusion, control theory and ocean engineering – that allow us to be able to package this in a robust system that can operate at deep ocean depths."

"BluHaptics chose the underwater market to be our first commercialization opportunity because there are over a thousand ROVs operating today in the oil and gas industry," explained Mark Lunde, a veteran industry expert and mentor who C4C helped introduce to the team to guide them through the commercialization process. "And that number has grown 27 % in the past five years. Additionally, there is $1.7 billion a year being invested in this industry." Lunde now serves as President of BluHaptics.

"By bringing the human sense of touch back from the robot to the hand, BluHaptics is making it easier, safer and more reliable to use remote robots," Chizeck said. And while the company's current focus is on guiding precision operations deep undersea, this remote telerobotics technology holds promise for a number of future potential markets as well.

Deep water tank in the APL for testing underwater conditions.

"This has implications for search and rescue, infrastructure inspection, remote maintenance, homeland security and anti-pollution activities," Chizeck said.

Explore further: New underwater robot swims and senses like a fish

Related Stories

New underwater robot swims and senses like a fish

July 18, 2013

In recent years, robotic underwater vehicles have become more common in a variety of industrial and civil sectors. They are used extensively by the scientific community to study the ocean. For example, underwater robots have ...

Kinect 2 with Oculus Rift gets NASA robotic arm workout

December 30, 2013

( —NASA engineers like what they see in Microsoft Kinect 2 as they continue to work on space robots. A NASA video released earlier this month shows how it is leveraging a combination of Kinect 2 along with Oculus ...

Designing robots for Earth and space

January 27, 2014

In a remote corner of the Cleveland Police Museum, a famous robot languished gathering dust. In its glory days, this robot was part of the fight in the 1970s against Mafia domination in Cleveland.

Robotic fish aids understanding of how animals move

February 15, 2014

The weakly electric black ghost knifefish of the Amazon basin has inspired Northwestern University's Malcolm MacIver and an interdisciplinary team of researchers to develop agile fish robots that could lead to a vast improvement ...

Touchy-feely joystick heading to Space Station

February 27, 2014

Stowed inside ESA's next supply ship to the International Space Station will be one of the most advanced joysticks ever built, designed to test the remote control of robots on the ground from up in orbit.

Recommended for you

Roboticists learn to teach robots from babies

December 1, 2015

Babies learn about the world by exploring how their bodies move in space, grabbing toys, pushing things off tables and by watching and imitating what adults are doing.

Xbox gaming technology may improve X-ray precision

December 1, 2015

With the aim of producing high-quality X-rays with minimal radiation exposure, particularly in children, researchers have developed a new approach to imaging patients. Surprisingly, the new technology isn't a high-tech, high-dollar ...

Making 3-D imaging 1,000 times better

December 1, 2015

MIT researchers have shown that by exploiting the polarization of light—the physical phenomenon behind polarized sunglasses and most 3-D movie systems—they can increase the resolution of conventional 3-D imaging devices ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.