Flexpad: Moveable displays made of paper (w/ Video)

Sep 12, 2013
Body-based navigational aid: With Flexpad, IT experts in Saarbrücken are able to better analyse images, such as computer tomography, as moving the paper or other flexible material calls up different images onto the material, which also functions as the monitor. Credit: Jürgen Steimle

Recently at the 2013 IFA international trade show for consumer electronics and home appliances in Berlin, major electronics manufacturers displayed new types of displays that are thin, and even curved, but expensive. IT experts in Saarbrücken have gone a step further. Their more cost-effective approach, called Flexpad, allows a simple, standard sheet of paper to be transformed into a moveable, flexible display. Already today, this could help patients better review the results of a computer tomography, for example. In the long term, the IT experts want to discover what new applications are viable in future for ultra-thin, deformable, mobile end devices, and how they can best be operated.

Human organs shimmer in red on a sheet of displaying a longitudinal view of the human abdomen. The and pelvic bones form contrasting yellow islands. As the sheet of paper is bent downwards at the ends, the bones appear to come into the foreground while the soft tissue recedes (see video). What appears to be science fiction at first glance, is the result of the "Flexpad" research project developed under the leadership of Jürgen Steimle in the Media Lab at the Massachusetts Institute of Technology in the US and the Max Planck Institute for Informatics in Saarbrücken, in cooperation with Kiel University. In the meantime, Steimle heads the Embodied Interaction research group at the Multimodal Computing and Interaction Cluster of Excellence.

"We routinely deform objects intuitively in many different ways. We bend back pages in books, deflate balls, fold paper, and sculpt clay", explains Jürgen Steimle. "And by projecting user interface elements onto tangible, deformable objects we can control computers and other technical devices better and more easily."

A depth camera records the motions of hands and paper

In order for his ideas to function in the digital world, only a small amount of technology is required meanwhile - however, all the more programming and brain work. "For one thing, we use a projector that reproduces an image or a video on a sheet of paper", says Steimle, describing the approach. "For another, we work with a Kinect sensor from Microsoft. The depth camera permits people to use their movements to control computer games. In our case, it records the hands and paper to determine their position in space." To capture the movements of their hands and the paper, the projector and camera are mounted in the ceiling above the user.

This video is not supported by your browser at this time.

Flexpad thereby works as follows: The motion sensor records the user and the paper, capturing the paper's deformation and movement. So that the recording takes place precisely and in real time despite the rather coarse image data from the Kinect camera, the researchers have developed and implemented two algorithms. The first initially subtracts out the interference caused by the fingers and hands of the user. If the user moves the paper - whether left or right, or bends it into an arc or wavy form - the camera senses this. A specially developed computer model subsequently describes these movements in fractions of a second, so that the projector can reproduce it on the sheet in near real time.

With Flexpad, diagnosis consultations become simpler

Nevertheless, Flexpad has certain limits: The user must stand in a particular area under the camera and projector for the system to work properly. Therefore, the user cannot move freely around the room.

"The paper takes on two simultaneous functions in our system", explains Steimle. "It is input device and display at the same time." The user can interact with the device in a similar way to using a mouse for controlling a computer. Other materials besides paper are also suitable, for example sheets of plastic or other deformable materials. The only important thing is that they possess a certain malleability and flexibility.

Active flexible displays, as they are referred to, go one step further. According to the study "OE-A Roadmap for Organic and Printed Electronics" from the Organic and Printed Electronics Association, these will be available for end users in just ten years. "Our concepts, which we are researching using Flexpad, can be transferred to this new type of display", explains Steimle. However, applications based on the cost-effective technology are already conceivable. "In medical diagnostics, the physician can quickly and easily discuss for instance the results of with the patient. In addition, the system can operate as a kind of interactive children's book in which certain figures, like a goldfish, can move", says Steimle.

Explore further: Dynamically reconfiguring images with flexible OLED FlexCam (w/ Video)

More information: — Jürgen Steimle, Andreas Jordt & Pattie Maes, Flexpad: Highly Flexible Bending Interactions for Projected Handheld Displays, 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, embodied.mpi-inf.mpg.de/files/2012/11/CHI2013-Flexpad.pdf


Related Stories

ShakeID tracks touch action in multi-user display

Jun 03, 2012

(Phys.org) -- How do you determine who is doing the touching with a multi-user touch display? Microsoft Research has published a paper that presents a technique for doing so. The researchers make their attempt ...

Recommended for you

Patent talk: Google sharpens contact lens vision

Apr 16, 2014

(Phys.org) —A report from Patent Bolt brings us one step closer to what Google may have in mind in developing smart contact lenses. According to the discussion Google is interested in the concept of contact ...

Neuroscientist's idea wins new-toy award

Apr 15, 2014

When he was a child, Robijanto Soetedjo used to play with his electrically powered toys for a while and then, when he got bored, take them apart - much to the consternation of his parents.

Land Rover demos invisible bonnet / car hood (w/ video)

Apr 14, 2014

(Phys.org) —Land Rover has released a video demonstrating a part of its Discover Vision Concept—the invisible "bonnet" or as it's known in the U.S. the "hood" of the car. It's a concept the automaker ...

User comments : 2

Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Sep 12, 2013
Its just a projector on to paper! Noy much use on the bus!
not rated yet Sep 12, 2013
So? How often do you watch CT scans on a bus?

Your argument boils down to: "Fire is no good, because it won't work under water!"

It's a technically correct argument - but not one that detracts from the usefulness of the technology.

Being able to look through a CT dataset by orienting a sheet of paper would be enormously better than what we have today (usually three separet, axially aligned views that you need to scroll through one at a time)

More news stories

Ex-Apple chief plans mobile phone for India

Former Apple chief executive John Sculley, whose marketing skills helped bring the personal computer to desktops worldwide, says he plans to launch a mobile phone in India to exploit its still largely untapped ...

Airbnb rental site raises $450 mn

Online lodging listings website Airbnb inked a $450 million funding deal with investors led by TPG, a source close to the matter said Friday.

Health care site flagged in Heartbleed review

People with accounts on the enrollment website for President Barack Obama's signature health care law are being told to change their passwords following an administration-wide review of the government's vulnerability to the ...

NASA's space station Robonaut finally getting legs

Robonaut, the first out-of-this-world humanoid, is finally getting its space legs. For three years, Robonaut has had to manage from the waist up. This new pair of legs means the experimental robot—now stuck ...

Filipino tests negative for Middle East virus

A Filipino nurse who tested positive for the Middle East virus has been found free of infection in a subsequent examination after he returned home, Philippine health officials said Saturday.

Egypt archaeologists find ancient writer's tomb

Egypt's minister of antiquities says a team of Spanish archaeologists has discovered two tombs in the southern part of the country, one of them belonging to a writer and containing a trove of artifacts including reed pens ...