Latest 3D TV Technology Offers Interactive Control

Latest 3D TV Technology Offers Interactive Control
The live 3D TV system consists of (left) an array of 64 cameras that captures multi-view videos of a live scene and (right) an integral photography display with 60 viewing directions that reproduces an autostereoscopic 3D video of the scene. Image credit: Taguchi, et al. ©2008 IEEE.

( -- Three-dimensional TV is now closer than ever to becoming a reality for consumers, and the latest research is investigating the full extent of 3D TV’s possibilities. In a recent study, researchers at the University of Tokyo and Hitachi, Ltd., have presented a 3D TV system that captures a live scene in real time and reproduces it on an autostereoscopic display. The system also offers interactive control, allowing viewers to adjust viewing parameters such as cropping a scene and reproducing an appropriate amount of depth.

“The greatest advantage of our system is to provide of the ,” lead author of the study Yuichi Taguchi, a Ph.D. student at the University of Tokyo, told “The interactive control is essential for reproducing a dynamic 3D scene with desirable conditions, which depend on the contents of the scene, the viewer's preference, and the specifications.”

The 3D , called TransCAIP, captures a live scene using an array of 64 video cameras that are all connected via Ethernet cables to one PC, which converts images from all the video cameras into images for the display. Each contains a built-in HTTP server, which sends motion JPEG sequences to the PC.

The PC then converts the 64 input views captured by the cameras to an “ image” made of 60 views, which correspond to the viewing directions of the display. Using an image-based rendering technique, the PC converts the images in real-time, and then arranges the pixels to produce the integral photography image. The entire process, called light , is implemented on the single PC in real-time, requiring a few hundred milliseconds per frame.

Like all autostereoscopic displays, the new 3D TV system doesn’t require viewers to wear special glasses. Instead, the display reproduces various viewpoint images, allowing viewers to see a different image in each eye or by moving their head (the parallax effect). Although the basic principles of autostereoscopic 3D displays were developed more than a century ago, only with recent technological advances has it been possible to actually build autostereoscopic displays since they require such a large number of light rays (the resolution of a view times the number of viewpoints).

The integral photography display works by integrating tiny images each with their own tiny lenses to convey a 3D image. An integral photography display has the advantage that it can provide both horizontal and vertical parallax. Other 3D TV displays, such as lenticular lens arrays, can only provide either horizontal or vertical parallax.

The researchers’ conversion method, which converts the different viewpoint layouts between the input and output devices, also offers advantages. For one thing, it enables viewers to control the viewing parameters based on their individual preferences or to help sharpen a scene. Using only the software, viewers can control the amount of depth on the display as well as choose a smaller viewing angle to view only a targeted location. Also, the light field conversion technique doesn’t require the capture system to have large lenses or long imaging distances, as some existing systems do.

As the researchers explain, the main technical challenge for their 3D TV system is the fast and flexible conversion of the input images from the 64 cameras to the 60 images in the integral photography format. In this study, their light field conversion method shows that real-time conversion is possible. In the future, the researchers plan to improve the visual quality of the system, such as by reducing blur and other unwanted artifacts caused by depth reproduction.

“Systems reproducing higher-resolution images are desirable for commercialization,” Taguchi added. “Further advances in hardware technology could make possible the development of such systems over the next 5 to 10 years.”

More information: Taguchi, Yuichi; Koike, Takafumi; Takahashi, Keita; Naemura, Takeshi. “TransCAIP: A Live 3D TV System Using a Camera Array and an Integral Photography Display with Interactive Control of Viewing Parameters.” IEEE Transactions on Visualization and Computer Graphics. To be published.

Copyright 2009
All rights reserved. This material may not be published, broadcast, rewritten or redistributed in whole or part without the express written permission of

Citation: Latest 3D TV Technology Offers Interactive Control (2009, March 19) retrieved 29 February 2024 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Epson Develops New High-Resolution 3D LCD Display


Feedback to editors