Augmented reality helps in industrial troubleshooting

Aug 28, 2014 by Monika Landgraf
Augmented reality helps in industrial troubleshooting
Sensor data are imported into a camera shot of the plant in real time: This allows for more efficient troubleshooting. Credit: Matthias Berning, KIT

At a "smart" factory, machines reveal a number of data about themselves. Sensors measuring temperature, rotating speed or vibrations provide valuable information on the state of a machine. On this basis, worn parts can be exchanged in due time. A software developed by the Institute of Telematics of Karlsruhe Institute of Technology (KIT) helps the maintenance staff allocate the information transmitted by the sensor in a wireless manner to the point of measurement in the camera image. The sensor data are imported into the latest camera shot of the real machine.

Machine tools and production plants frequently are operated for several decades. Predictive maintenance is aimed at preventing an undesired outage, if possible. Wireless sensors in the machine help detect faulty parts at an early stage. They measure and transmit that allow conclusions to be drawn by the maintenance technician as to whether gearwheels are worn, ball bearings are uneven or the pipe of a pump is plugged. "The operation concept allows for efficient direct troubleshooting," KIT scientist Matthias Berning says. His development for user-friendly data access makes the , such as the vibration frequency, acceleration or temperature of a component, visible on the screen in real time. The data are displayed in the camera shot. Connecting lines show the point of measurement in the machine component. When the camera pans, these connecting lines follow. For this purpose, the electrical engineer specialized in uses augmented reality (AR): Images of the real world are complemented by computer-supported information.

When looking at the display of his tablet computer or smartphone, the engineer can directly allocate the data measured to the respective component. By a click, the data measured are represented in the form of tables or diagrams. In addition, the data are classified depending on which information is needed. As a rule, data of various measurement points have to be compared in order to detect a failure in complex machines. Direct spatial representation spares the engineer the trouble of allocating sensors and components using numbers or letters.

The major question in Berning's research project is: "How can the data obtained at the interface of man and computer be used such that man understands them?" Berning develops the operation concept within the framework of his doctoral thesis at the Chair of Pervasive Computing Systems headed by Professor Michael Beigl. Here, work focuses on the development and integration of modern information and communication technologies into the physical environment. The TECO research group that closely cooperates with industry to advance research and development of applied telematics is also part of this chair. Berning's industry partner is the ABB Corporate Research Center. "The prototypes demonstrate that utilization of the data by interlinkage with the camera shot is feasible and reasonable," Berning says. In view of growing amounts of data supplied by the "internet of things", it is even more important now to adapt the wealth of information to the respective task in a user-friendly manner.

Explore further: From a distance: New technique for repair work

add to favorites email to friend print save as pdf

Related Stories

From a distance: New technique for repair work

Feb 20, 2014

Numerous German companies are operating globally these days: They develop products domestically, but production is done in other countries like China, Brazil or the Czech Republic. If maintenance or repair ...

Measuring fine dust concentration via smartphone

May 26, 2014

Big cities in the smog: Photos from Beijing and, more recently, Paris clearly illustrate the extent of fine dust pollution. But what about our direct environment? What is the pollution concentration near ...

Sensors that improve rail transport safety

Jul 31, 2014

A new kind of human-machine communication is to make it possible to detect damage to rail vehicles before it's too late and service trains only when they need it – all thanks to a cloud-supported, wireless ...

Pocket-size data recorder

Aug 14, 2014

A very compact device from Siemens is simplifying common sound and vibration measurements in industry. Until now, acceleration sensors and microphones have been attached to box-shaped devices connected to a computer. By contrast, ...

Intelligent machines for tomorrow's factory

Jun 05, 2014

Mass production of industrial goods, such as furniture, clothing or ball pens, is inexpensive. In the future, even small series of individualized products might be manufactured rapidly and efficiently by ...

Recommended for you

A spray-on light show on four wheels: Darkside Scientific

8 hours ago

Darkside Scientific recently drew a lot of gazes its way in its video release of a car treated to the company's electroluminescent paint called LumiLor. Electroluminescence (EL) is a characteristic of a material ...

Research project on accident-avoiding vehicle concluded

Sep 12, 2014

PRORETA 3 is completed after three and a half years of research work: The comprehensive driver assistance and automated maneuver concept supports the driver in keeping the vehicle in a safe driving corridor- ...

Making drones more customizable

Sep 12, 2014

A first-ever standard "operating system" for drones, developed by a startup with MIT roots, could soon help manufacturers easily design and customize unmanned aerial vehicles (UAVs) for multiple applications.

User comments : 0