Binocular vision-based UAVs autonomous aerial refueling platform—pilots are no longer needed

May 16, 2016
Architecture of binocular vision-based UAVs autonomous aerial refueling platform. Credit: ©Science China Press

Unmanned aerial vehicles (UAVs) are invaluable in today's military and civilian initiatives. However, most unmanned systems are being designed to execute the long-running mission. Thus, it is necessary for UAVs to return to the base for refueling. Autonomous aerial refueling (AAR) is therefore an important capability for the future deployment of UAVs. Vision-based sensor and navigation system are widely used in AAR, while experiments are done for both probe-and-drogue refueling system and boom approaches.

Researchers developed a platform to simulate AAR via real-time simulation. The system includes an octocoptor serving as a tanker UAV and a hexacoptor serving as receiver. When the receiver appears in the visual field of the cameras on the tanker (about 5 meters), the binocular vision system captures the marker on the receiver. The onboard "next-unit of computing" processor (NUC) analyzes the images and estimates the position of the receiver. Then the visual information obtained from the vision system is transferred to the flight controller and boom controller to control the flight of the UAVs and the movement of the boom towards receptacle. Figure 1 shows the configuration of our binocular vision-based UAVs autonomous aerial refueling platform.

The binocular vision system controls two primary procedures: feature extraction and pose estimation. The pixel coordinates of red markers painted on the receiver UAV are generated after feature extraction. The generated pixel coordinates are utilized in the position estimation process. The position estimation procedure calculates the relation matrix between the system and marker coordination system.

The left frames captured on-board and the reprojection result on the corresponding right frame. (a) and (c) the feature extraction results on images captured with left camera; (b) and (d) relative projection result on images captured with right camera. Credit: ©Science China Press

To verify the effectiveness of the boom approach vision algorithm, researchers developed a mimical refueling boom system. After achieving the frame sequences of the marker on the receiver, the NUC conducts pose and position estimation. An arm microcontroller obtains the results, and figures out the level to control steering engines. The refueling boom points at the receptacle in the resolved pose and position, and implements connection in air. Figure 2 shows the experimental results of the binocular algorithm.

A series of out-door flight tests were conducted in various environments to verify the feasibility and effectiveness of this platform, including strong and poor light conditions. Considering the safety and easy observation, the flight height of the UAVs is about 10 meters. The experimental results verified the feasibility and effectiveness of the UAVs boom approach AAR platform.

Explore further: Update to Phantom 2 Vision and Vision+ UAVs allows for autonomous flights

More information: Haibin Duan et al, A binocular vision-based UAVs autonomous aerial refueling platform, Science China Information Sciences (2016). DOI: 10.1007/s11432-016-5553-5

Related Stories

45,000 feet: Future UAVs may fuel up in flight

October 8, 2012

Currently global military aviation relies on a key enabler – aerial refueling. Fighters, bombers, reconnaissance and transport aircraft use "flying gas stations" to go the extra mile. Increasingly, UAVs are conducting combat ...

Autonomous, swarming UAVs fly into the future

April 14, 2015

A new era in autonomy and unmanned systems for naval operations is on the horizon, as officials at the Office of Naval Research (ONR) announced today recent technology demonstrations of swarming unmanned aerial vehicles (UAVs)—part ...

Drones give scientists a new self-service approach

February 12, 2016

Earth and environmental scientists have often had to rely on piloted aircraft and satellites to collect remote sensing data, platforms that have traditionally been controlled by large research organizations or regulatory ...

Recommended for you

A not-quite-random walk demystifies the algorithm

December 15, 2017

The algorithm is having a cultural moment. Originally a math and computer science term, algorithms are now used to account for everything from military drone strikes and financial market forecasts to Google search results.

US faces moment of truth on 'net neutrality'

December 14, 2017

The acrimonious battle over "net neutrality" in America comes to a head Thursday with a US agency set to vote to roll back rules enacted two years earlier aimed at preventing a "two-speed" internet.

FCC votes along party lines to end 'net neutrality' (Update)

December 14, 2017

The Federal Communications Commission repealed the Obama-era "net neutrality" rules Thursday, giving internet service providers like Verizon, Comcast and AT&T a free hand to slow or block websites and apps as they see fit ...

The wet road to fast and stable batteries

December 14, 2017

An international team of scientists—including several researchers from the U.S. Department of Energy's (DOE) Argonne National Laboratory—has discovered an anode battery material with superfast charging and stable operation ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.