Design tool enables novices to create bendable input devices for computers

May 6, 2016, Disney Research

A software tool developed collaboratively by Disney Research and ETH Zurich makes it possible for non-experts to design and build flexible objects that can sense when they are being deformed and thus be used to control games, provide feedback for toys or otherwise provide input to a computer.

Creating a bendable object with customized appearance and shape already is possible with today's 3-D printers. The new tool, called DefSense, enables designers to give those objects deformation-sensing functionality, even if the designers lack expertise in this complex task.

The research team, which also includes collaborators from McGill University and IST Austria, will present their optimization-based algorithm May 11 at the ACM Conference on Human Factors in Computing Systems, CHI 2016, in San Jose, Calif.

"3D-printed objects that can sense their own deformation will open the door to a range of exciting applications, such as personalized toys, custom game controllers and electronic musical instruments," said Markus Gross, vice president at Disney Research.

The objects are able to sense when they are bent because the researchers introduce piezoresistive materials into their construction. The electrical resistivity of these wires changes when they are bent, so it's possible to infer the amount of deformation based on changes in measured resistivity.

But ensuring that the changes in resistivity correctly reflect the amount and type of deformation—whether the object is being twisted, stretched or bent - depends on proper placement of the sensor wires within the object, said Moritz Bächer, research scientist at Disney Research.

"In an object with a moderately complex shape, even simple interactions can cause internal deformation fields that can seem counterintuitive," Bächer explained. "Determining how to route the sensors within the object and how to interpret their readings is a complex design problem in all but the most trivial cases."

The researchers developed a design process in which the user not only creates the shape of the object, but specifies the deformations that need to be sensed. An optimization algorithm then computes sensor layouts based on those example deformations and iteratively guides the designer in placing the wires within the object. The algorithm optimizes the sensor layout to minimize reconstruction error.

The objects are produced in the 3-D printer in layers, so that the prefabricated piezoresistant wires can be positioned between them. After fabrication, a machine learning algorithm recovers 3-D deformations in real time, despite material imperfections or modeling errors. The deformation signals can be used to control a virtual version of the object or to provide any sort of control that the user wishes.

The researchers produced several examples, including an action figure, a bar, a sheet and an object resembling organ pipes. They found their method outperformed best-guess manual versions by significant margins and that the reconstruction error predicted by DefSense was a good indicator of real-world performance.

Explore further: Process designs tops and yo-yos with stable spins despite asymmetric shapes

More information: "DefSense- Computational Design of Customized Deformable Input Devices-Paper" [PDF, 10.72 MB]

Related Stories

Replication of colored 3-D models simplified

May 3, 2016

Researchers at ETH Zurich and Disney Research Zurich have developed a new technique called Computational Thermoforming. It enables them to manufacture plastic replicas of digital 3-D models, in which the shape and colour ...

New computer vision algorithm predicts orientation of objects

February 11, 2016

Seen from any angle, a horse looks like a horse. But it doesn't look the same from every angle. Scientists at Disney Research have developed a method to help computer vision systems avoid the confusion associated with changes ...

Recommended for you

Pushing lithium ion batteries to the next performance level

December 13, 2018

Conventional lithium ion batteries, such as those widely used in smartphones and notebooks, have reached performance limits. Materials chemist Freddy Kleitz from the Faculty of Chemistry of the University of Vienna and international ...

Uber filed paperwork for IPO: report

December 8, 2018

Ride-share company Uber quietly filed paperwork this week for its initial public offering, the Wall Street Journal reported late Friday.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.