Autonomous drones that can 'see' and fly intelligently

February 6, 2019, Freshscience
Jiefei has created a system for the drones to become completely autonomous. Credit: Jiefei Wang

Drones have been given 'eyes' and a new algorithm to help them fly intelligently, reaching their target position when GPS is not available.

Dr. Jiefei Wang, a researcher from UNSW Canberra Trusted Autonomy Group, used an Xbox Kinect sensor as an input camera to help drones 'see' their environment.

Jiefei developed algorithms to process the video footage image by image, to help the drones know their own speed, motion, and to detect obstacles so they can reach their target position—a completely autonomous system.

"Depth information is crucial for locating objects," Jiefei says.

"Human beings can use one eye to see the world but need two eyes to locate. For example, try closing one eye, then point your index fingers towards each other and bring them together. Most people will find this difficult."

Jiefei's algorithm uses the images the 'sees' and compares the same pixel in one image with the previous one to find the difference. Detecting the differences in 2-D images allows it to then calculate the speed and location of drones in 3-D space.

"As the RGB-D cameras (such as the Kinect sensor) are still in their infancy, they still suffer from performance drawbacks such as limited operational range and relatively low resolution," Jiefei says.

Autonomous drones that can ‘see’ and fly intelligently
Credit: Jiefei Wang
"So, in the future, the impact of more accurate RGB-D cameras could be explored. If I have the chance in the future, I would like to come back to this. I cannot stop the wars and disasters, but as an engineer I believe in the power of technology, and we are experiencing the way how it changes our lives right now.

"In future, we may be able to use the drones to help rescue people from earthquakes, help mining industries with underground detection without risking lives, and more."

Explore further: Drones can almost see in the dark

Related Stories

Drones can almost see in the dark

September 20, 2017

UZH researchers have taught drones how to fly using an eye-inspired camera, opening the door to them performing fast, agile maneuvers and flying in low-light environments. Possible applications could include supporting rescue ...

Using a camera to spot and track drones

August 17, 2017

EPFL researchers have shown that a simple camera can detect and track flying drones. Plus, the lightweight, energy-efficient and inexpensive technology could be installed directly on the drones themselves and enhance safety ...

Fleets of drones could aid searches for lost hikers

November 2, 2018

Finding lost hikers in forests can be a difficult and lengthy process, as helicopters and drones can't get a glimpse through the thick tree canopy. Recently, it's been proposed that autonomous drones, which can bob and weave ...

Recommended for you

Archaeologists discover Incan tomb in Peru

February 16, 2019

Peruvian archaeologists discovered an Incan tomb in the north of the country where an elite member of the pre-Columbian empire was buried, one of the investigators announced Friday.

Where is the universe hiding its missing mass?

February 15, 2019

Astronomers have spent decades looking for something that sounds like it would be hard to miss: about a third of the "normal" matter in the Universe. New results from NASA's Chandra X-ray Observatory may have helped them ...

What rising seas mean for local economies

February 15, 2019

Impacts from climate change are not always easy to see. But for many local businesses in coastal communities across the United States, the evidence is right outside their doors—or in their parking lots.

The friendly extortioner takes it all

February 15, 2019

Cooperating with other people makes many things easier. However, competition is also a characteristic aspect of our society. In their struggle for contracts and positions, people have to be more successful than their competitors ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.