Bug's eye inspires hemispherical digital camera that delivers unmatched field of view

May 01, 2013
Credit: John A. Rogers, University of Illinois at Urbana-Champaign

Inspired by the complex fly eye, an interdisciplinary team led by researchers at the University of Illinois at Urbana-Champaign and Northwestern University has developed a hemispherical digital camera with nearly 200 tiny lenses, delivering exceptionally wide-angle field of view and sharp images.

Humans capture pictures using the two lenses of our relatively flat eyes, while a top-of-the-line SLR camera has just one flat lens. The new camera—a rounded half bubble, similar to a bulging fly eye—has 180 microlenses mounted on it, allowing it to take pictures across nearly 180 degrees. Only a camera shaped like a bug's eye can do this.

With this wide-angle field of view, the new technology could be used in future surveillance devices or for imaging in . The researchers say it would be simple enough to combine two of the hemispheres they've demonstrated to get a 360-degree view.

Details of the bio-inspired camera, which required experts in optics, electronics, fabrication, and modeling and design theory, will be published in the May 2 issue of the journal Nature.

"What we have, in a sense, is many small eyes on one big eye," said Northwestern's Yonggang Huang, a senior author of the paper. "Each small eye, composed of a microlens and a microscale , is a separate , but when they are all taken together, the camera can take a clear picture, with just one snap, of nearly 180 degrees.

"The interface of different fields generates interesting new devices that never existed before," he said. Huang is the Joseph Cummings Professor of Civil and Environmental Engineering and Mechanical Engineering at the McCormick School of Engineering and Applied Science.

Huang's lab was responsible for the modeling and design theory for the project, which took the whole team three years to complete.

The digital camera is just the latest innovation in a long and fruitful collaboration between two engineers—Huang and John A. Rogers at the University of Illinois at Urbana-Champaign—that has developed stretchable electronics and various devices using the technology, including an earlier digital camera, advanced surgical tools and health/wellness monitors.

Their electronics, which can bend, twist and stretch without breaking, were well suited to the challenge of developing a hemispherical camera.

Full 180 degree fields of view with zero aberrations can only be accomplished with image sensors that adopt hemispherical layouts. Credit: John A. Rogers, University of Illinois at Urbana-Champaign

"Full 180-degree fields of view with zero aberrations can only be accomplished with image sensors that adopt hemispherical layouts—much different than the planar CCD chips found in commercial cameras," said Rogers, a Swanlund Chair Professor, of the new camera.

"When implemented with large arrays of microlenses, each of which couples to an individual photodiode, this type of hemispherical design provides unmatched field of view and other powerful capabilities in imaging," he said. "Nature has developed and refined these concepts over the course of billions of years of evolution."

Eyes in arthropods use compound designs, in which arrays of smaller eyes act together to provide image perception. Each small eye, known as an ommatidium, consists of a corneal lens, a crystalline cone and a light-sensitive organ at the base. The entire system is configured to provide exceptional properties in imaging, many of which lie beyond the reach of existing man-made cameras.

The 180 microlenses of Roger and Huang's camera is comparable to the eye of fire ants and bark beetles, but less than the fly eye, which has thousands of small eyes.

"Existing camera imaging technology is flat, and we made a system that is curvilinear," Huang said. "Making a stretchable array of photodetectors was easy—that's what we do. The difficult part was making a hemispherical lens. We needed to make sure the lens experienced as little strain as possible when stretched."

The researchers developed new ideas in materials and fabrication strategies allowing construction of artificial ommatidia in large, interconnected arrays in hemispherical layouts. Building such systems represents a daunting task, as all established camera technologies rely on bulk glass lenses and detectors constructed on the planar surfaces of silicon wafers which cannot be bent or flexed, much less formed into a hemispherical shape.

"A critical feature of our fly eye cameras is they incorporate integrated microlenses, photodetectors and electronics on hemispherically curved surfaces," said Jianliang Xiao, an assistant professor of mechanical engineering at University of Colorado Boulder and coauthor of the study. "To realize this outcome, we used soft, rubbery optics bonded to detectors/electronics in mesh layouts that can be stretched and deformed, reversibly and without damage."

The new digital cameras exploit large arrays of tiny focusing lenses and miniaturized detectors in hemispherical layouts, just like eyes found in arthropods. Full 180 degree fields of view with zero aberrations can only be accomplished with image sensors that adopt hemispherical layouts. Credit: John A. Rogers, University of Illinois at Urbana-Champaign

Xiao is a former doctoral student of Huang's at Northwestern who then went on to work as a postdoctoral researcher in Rogers' lab at Illinois.

The fabrication starts with electronics, detectors and lens arrays formed on flat surfaces using advanced techniques adapted from the semiconductor industry, Xiao said. The lens sheet—made from a polymer material similar to a contact lens—and the electronics/detectors are then aligned and bonded together. Pneumatic pressure deforms the resulting system into the desired hemispherical shape, in a process much like blowing up a balloon, but with precision engineering control.

The individual electronic detectors and microlenses are coupled together to avoid any relative motion during this deformation process. Here, the spaces between these artificial ommatidia can stretch to allow transformation in geometry from planar to hemispherical. The electrical interconnections are thin and narrow, in filamentary serpentine shapes; they deform as tiny springs during the stretching process.

According to the researchers, each microlens produces a small image of an object with a form dictated by the parameters of the lens and the viewing angle. An individual detector responds only if a portion of the image formed by the associated microlens overlaps the active area. The detectors stimulated in this way produce a sampled image of the object that can then be reconstructed using models of the optics.

Explore further: Wireless sensor transmits tumor pressure

More information: The paper is titled "Digital Cameras With Designs Inspired By the Arthropod Eye." dx.doi.org/10.1038/nature12083

Related Stories

Better than the human eye

Jan 17, 2011

(PhysOrg.com) -- Researchers from Northwestern University and the University of Illinois at Urbana-Champaign are the first to develop a curvilinear camera, much like the human eye, with the significant feature ...

Researchers make new electronics -- with a twist

Nov 19, 2008

They've made electronics that can bend. They've made electronics that can stretch. And now, they've reached the ultimate goal -- electronics that can be subjected to any complex deformation, including twisting.

Gadget Watch: Samsung lens flips from 2-D to 3-D

Jan 07, 2013

Cameras that can record in 3-D are usually pretty complicated, sporting two lenses instead of one, to mimic human binocular vision. Samsung says it has a more elegant solution: a single lens that can go from ...

Recommended for you

Wireless sensor transmits tumor pressure

Sep 20, 2014

The interstitial pressure inside a tumor is often remarkably high compared to normal tissues and is thought to impede the delivery of chemotherapeutic agents as well as decrease the effectiveness of radiation ...

Seeing through the fog (and dust and snow) of war

Sep 19, 2014

Degraded visibility—which encompasses diverse environmental conditions including severe weather, dust kicked up during takeoff and landing and poor visual contrast among different parts of terrain—often ...

The oscillator that could makeover the mechanical watch

Sep 18, 2014

For the first time in 200 years the heart of the mechanical watch has been reinvented, thereby improving precision and autonomy while making the watch completely silent. EPFL researchers have developed an ...

User comments : 8

Adjust slider to filter visible comments by rank

Display comments: newest first

baudrunner
2.3 / 5 (3) May 01, 2013
Who was the idiot who wired up that cable to the circuit board? Now a huge part of that 180 degree field of view is incumbered by that insidious gray obstruction! Nice play, Shakespeare! Bend it the other way, already.
Whydening Gyre
1 / 5 (2) May 01, 2013
I guess the next step is to have one camera and multiple lenses focusing on that.
Silverhill
3 / 5 (2) May 01, 2013
baudrunner, calm down. I think it likely that the cable, circuit board, etc. will be concealed in the camera housing once they move it from prototype to production. The housing will be designed to not intrude on the 180° viewfield.
Tri-ring
not rated yet May 01, 2013
They could develop a single transparent concave structures with many bulges on the structure that acts as a lens with a miniature CCD at the bottom of each bulge and wire them together in the same way.
I don't think you need a large amount of pixels for each CCD so you can miniaturize each CCD.
This would be the ultimate optical tracking device on a stealth plane that can give full field of sight with only two pieces fit on each side of the plane.
KeithMcC
5 / 5 (4) May 02, 2013
Sample photos, please.
TheKnowItAll
1.5 / 5 (2) May 02, 2013
I can see this being useful in motion sensors or fire sensors. Using two of those to detect motion and help direct a high res/speed camera onto the subject would make for an interesting gadget.
Mike_Massen
2 / 5 (4) May 02, 2013
baudrunner is so adept at blurting first and often without thinking
Who was the idiot who wired up that cable to the circuit board? Now a huge part of that 180 degree field of view is incumbered by that insidious gray obstruction! Nice play, Shakespeare! Bend it the other way, already.
Do you really expect an answer ?
Have you considered the photo which shows the mounting hasnt got the best depth of field ?
Also it should be obvious this is a prototype with various compromises, yet you blurt out criticism like a petulant child.

Baudrunner take your meds before posting, better yet, don't post.
rsklyar
1 / 5 (2) May 02, 2013
Beware on cheating ability of some professors-godfathers at Northwestern University - http://issuu.com/...ivaldi/1 !