Pico projector used in eye based video gaming system

May 3, 2011 by Katie Gatto, Phys.org weblog

(PhysOrg.com) -- Students at the University of Texas in Austen are playing video games. Honestly, that is really not news. Students all over the country are playing video games, usually when they should be studying. In this case however, they are not goofing off, they are creating some serious science, and perhaps the next generation of video game controllers. Ones that do not require users to have a controller in their hand.

With the use of a Pico the students have created an eye-tracking camera which, when paired with a gaming setup, allows the system to track the eye movement of the user, and translate that to actions in the game world. Basically, this creates an effect that is very similar to looking around in the real world. As the player moves their view from location to location, the view of the world changes. The system relies on no traditional controllers and connects to no on the player at all.

A similar system, called Kinect, is currently in use with the video game system. The major difference is that the Kinect system uses a set of cameras to use the players whole body as a controller. This system, if implemented, would bring these types of systems to a new level.

The students have been testing the system with both a flight simulation, and a first person shooter. In the flight simulation testing players were able to control both the pitch and the roll of the virtual aircraft by moving only their heads.

The system currently features a small screen, but if future versions go commercial, the screen would be up sized.

Explore further: Kinect to help the blind 'see' in augmented reality

Related Stories

Kinect to help the blind 'see' in augmented reality

March 18, 2011

(PhysOrg.com) -- It seems like there are no shortage of uses for the Kinect system. The device, which was initially created by Microsoft as an add-on to its popular Xbox 360 video game console, to allow users to ditch the ...

Consumer Reports: Kinect not 'racist'

November 5, 2010

(AP) -- Looking to debunk a report that Microsoft's new motion-sensing video game controller might be racist, Consumer Reports says it found no evidence that Kinect has problems recognizing users with darker skin.

Gift guide: Consoles to bring out the gamer in you

December 7, 2010

(AP) -- With two new motion controllers out this fall, video game companies are giving even the most hand-eye-coordination challenged of us a chance to find our inner gamer. And for those who already have, lower-priced console ...

Microsoft links new smart phones to Xbox Live

August 17, 2010

(AP) -- Microsoft Corp. is bringing its video-game expertise to the forthcoming Windows Phone 7 line, an attempt to capitalize on the success of the Xbox 360 as the software maker tries to compete with Apple Inc.'s iPhone.

Recommended for you

Researchers find tweeting in cities lower than expected

February 20, 2018

Studying data from Twitter, University of Illinois researchers found that less people tweet per capita from larger cities than in smaller ones, indicating an unexpected trend that has implications in understanding urban pace ...

Augmented reality takes 3-D printing to next level

February 20, 2018

Cornell researchers are taking 3-D printing and 3-D modeling to a new level by using augmented reality (AR) to allow designers to design in physical space while a robotic arm rapidly prints the work.


Adjust slider to filter visible comments by rank

Display comments: newest first

5 / 5 (1) May 03, 2011
It's about time we transcend the mouse/keyboard paradigm. EEGs anyone?
4.3 / 5 (3) May 03, 2011
It's about time we transcend the mouse/keyboard paradigm. EEGs anyone?

Mice, Keyboards, and even the old SNES controller are just fine, thank you.

The best games are from about 15 to 20 years ago, when they actually put work into the music, gameplay, and story, instead of 90% on graphics like they do now.
not rated yet May 03, 2011
Austen? Try Austin, Nimrod. Stay out of the reporting biz. It ain't your thing.
not rated yet May 03, 2011
I can see this having a lot of potential for folks unable to use a keyboard or other manual input device. Display keyboard on screen, look at letter, blink to select, or something similar.

As an FPS player, I can't see it working as a practical control system, nothing beats kb/mouse combo for moving and looking (and shooting :)

QC, 15 - 20 years ago most PC games were still DOS based, and most looked crap. I know, because I played them, Castle Wolfenstein, Doom, Duke Nukem 3D, Quake etc. One stands out though, Unreal. Had amazing graphics for it's day, great music and a decent storyline. Many of todays games are, imo, crap rail shooters with 6-8 hours playtime, but there are some standouts, Morrowind and Oblivion were fantastic, the Stalker series offer probably the best open ended experiences of any games, and online, Team Fortress 2 is incredible fun. Speaking of which, it's time to hit a server :)
not rated yet Jun 03, 2011
But that means ill have to move my eyes to play the game, cant they make a system where i dont have to do anything at all?

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.