Teaming up with robots

Mar 27, 2013
With the aid of camera systems, the “Link4Save” software scans the production hall and can immediately stop robots in critical situations. Credit: Fraunhofer IDMT

Critical situations are occurring with greater frequency at industrial workplaces – situations that could lead to serious job-related accidents. With the "4Save" toolbox from Fraunhofer, these dangers do not arise at all. Researchers exhibit the latest version of the safety system, with "Eye4Save" visual surveillance, at the Hannover Messe from April 8 to 12, 2013.

Robots are taking over a greater number of tasks in industrial production: They weld and screw together components with millimeter precision, transport materials weighing several tons and package, palette and stack the finished products. Even their numbers are steadily rising. Germany – together with Japan and South Korea – has meanwhile become one of the countries with the world's highest density of robots. The space in factory halls is getting increasingly tighter. Electronic machines, and the technical staff in charge of them, are regularly getting in the way on the assembly lines and robotic pathways. That leads to an increased risk of accidents to the employees. Work areas that are tough to see into, or blind spots, hide the greatest risk potential. Thus security systems that also ensure increased employee safety are in demand as the robot population and the pace of work continue to rise.

Software prevents workplace accidents and unnecessary production stops

Researchers at the Fraunhofer Institute for IDMT in Ilmenau present the latest version of their "4Save" technologies at the Hannover Messe Digital Factory (Hall 7, Booth B10). The institute jointly developed this technology with Thüringen-based companies through the "BildRobo" collaborative project of the European Regional Development Fund (ERDF). It consists of the "Sim4Save" , the "Link4Save" software platform and the new "Eye4Save" surveillance system, made by the Zentrum für Bild- und Signalverarbeitung e.V. Ilmenau (ZBS). "The interaction between the individual components not only elevates safety, but also the efficiency of robot-supported workstations at the same time. This makes it possible to reduce work-related accidents and unnecessary production stops to a minimum," says Peter Pharow, Head of "Data Representation and Interfaces" at IDMT and co-developer of the "4Save" technology components, summarizing the advantages.

The core of the security system is the "Link4Save" . It analyzes signals from linked visual, acoustic and tactile surveillance systems in real time, and stops the equipment in before a collision could occur. Because it is often the minor inadvertent actions, like stumbling, that could lead to serious accidents with robots. The system precisely monitors how the individual equipment is moving, and steps in if the safe distance between human and robot is undercut. Depending on the power and speed of the operating equipment, the responses range from acoustic warning signals or slowing down the job process, to stopping the robot immediately.

Among other things, it incorporates data from the new "Eye4Save" visual . "Eye4Save" uses the images from synchronized stereo cameras to record objects in rooms in three dimensions. In the current configuration, four pair of stereo cameras are used, which are mounted in the upper corners of the room, and monitor the room from an oblique viewpoint. In an initial calibration process, the stereo camera pairs are calibrated both in terms of geometry and with respect to color. A miniature spectrometer from ZBS, which will also be presented at the trade show, acts as a tool here.

Camera system also recognizes occluded objects

Analogous to human depth perception, the depth information is taken from each pair of the stereo cameras for their respective viewpoint. The perception of objects in a space relates to the analysis of this depth information in combination with the recorded color values. As a reference, each stereo camera pair uses a distance-based, color-adaptable background model that it learns in advance. The foreground objects, detected from the various viewpoints, are put together and mapped out in the three-dimensional form of their visual hulls. "The more of the cameras see an object, the better the hulls represent the appearance of the object's actual shape. If there is any doubt – for instance, if a camera cannot see an object completely, because it is covered up by another object – the hull remains the same size. That means that occlusions are always treated in favor of the safety," explains Daniel Kapusi of ZBS, which is cooperating with IDMT.

The optimal number of cameras and sensors as well as their ideal positioning and orientation are determined interactively with the aid of the "Sim4Save" simulation tool. This tool simulates the production hall in three dimensions, and ensures the optimal coverage of the entire work area with safety technology. "Occluded objects or excessive distances often diminish the quality of camera recordings. These situations are taken into consideration with the simulation. 'Sim4Save' makes blind spots and obscured work areas a thing of the past," explains Pharow.

The "4Save" technologies could be used both in synergy as well as individually. While architects and planners of new factory buildings can use "Sim4Save" as a separate service, the "Link4Save" platform also works without the other elements of the "4Save" Toolbox, but not without upstream sensors. "Eye4Save" can be coupled with "Link4Save," but also operated on a platform-independent basis.

Explore further: SensaBubble: It's a bubble, but not as we know it (w/ video)

add to favorites email to friend print save as pdf

Related Stories

'Good-bye, blind spot' -- man and machine always in view

Mar 22, 2011

Particular care must be taken in a production hall where robots and men work together, where even minor carelessness could result in serious accidents or stop production. At the Hannover Messe trade fair that ...

Robotics: Safety without protective barriers

Jul 08, 2011

The modern working world is no longer conceivable without robots. They assist humans in manufacturing, laboratories or medicine. In the future, a new projection and camera-based system will prevent collisions ...

Vigilant camera eye

Sep 20, 2010

An innovative camera system could in future enhance security in public areas and buildings. Smart Eyes works just like the human eye. The system analyzes the recorded data in real time and then immediately ...

Care-O-bot 3: Always at your service

Jul 01, 2008

Who doesn’t long for household help at times? Service robots will soon be able to relieve us of heavy, dirty, monotonous or irksome tasks. Research scientists have now presented a new generation of household ...

3D television without glasses

Sep 01, 2011

When the boundaries merge between the action and the viewer, television becomes a special experience. Fraunhofer research scientists are optimizing the technologies that make it possible to watch TV in 3D ...

Recommended for you

A smart prosthetic knee with in-vivo diagnoses

Apr 22, 2014

The task was to develop intelligent prosthetic joints that, via sensors, are capable of detecting early failure long before a patient suffers. EPFL researchers have taken up the challenge.

Old tires become material for new and improved roads

Apr 22, 2014

(Phys.org) —Americans generate nearly 300 million scrap tires every year, according to the Environmental Protection Agency (EPA). Historically, these worn tires often end up in landfills or, when illegally ...

Students take clot-buster for a spin

Apr 21, 2014

(Phys.org) —In the hands of some Rice University senior engineering students, a fishing rod is more than what it seems. For them, it's a way to help destroy blood clots that threaten lives.

User comments : 0

More news stories

FCC to propose pay-for-priority Internet standards

The Federal Communications Commission is set to propose new open Internet rules that would allow content companies to pay for faster delivery over the so-called "last mile" connection to people's homes.

SK Hynix posts Q1 surge in net profit

South Korea's SK Hynix Inc said Thursday its first-quarter net profit surged nearly 350 percent from the previous year on a spike in sales of PC memory chips.

Brazil enacts Internet 'Bill of Rights'

Brazil's president signed into law on Wednesday a "Bill of Rights" for the digital age that aims to protect online privacy and promote the Internet as a public utility by barring telecommunications companies ...

Is nuclear power the only way to avoid geoengineering?

"I think one can argue that if we were to follow a strong nuclear energy pathway—as well as doing everything else that we can—then we can solve the climate problem without doing geoengineering." So says Tom Wigley, one ...

When things get glassy, molecules go fractal

Colorful church windows, beads on a necklace and many of our favorite plastics share something in common—they all belong to a state of matter known as glasses. School children learn the difference between ...

Rising role seen for health education specialists

(HealthDay)—A health education specialist can help family practices implement quality improvement projects with limited additional financial resources, according to an article published in the March/April ...