The city, 2.0. (w/ Video)

Jul 16, 2010

Augmented reality tours of real monuments, instant visualisation of virtual objects on living cityscapes and user-generated, digital story telling around famous landmarks are just some of the new applications made possible by breakthrough European research into mixed reality. This is the city, 2.0.

You are walking through modern-day Cologne on a beautiful morning radiant with the promise of summer. Abruptly, you are approached by a short, elf-like character.

Instantly, the cityscape morphs strangely and you now stand, in the same street, before a tent that obviously dates from Medieval times. You have entered a time warp. To escape the various time periods you must complete a series of challenges posted by the elves.

This was the augmented experience of around 60 volunteers at the TimeWarp field trial held in real-world Cologne in January 2010. The trial was a test and a demonstrator of one of the applications developed by European researchers at the IPCity project.

It had a surprising impact. The media were fascinated, the participants enthralled and the passers-by mystified: 'Why were these cyborgs bursting with technology and gesturing oddly at empty space?'

The IPCity project coordinator, Rod McCall, explains: "The users quickly got used to the augmented reality technology that they carried, and they would act in odd ways. Passers-by were often confused about what exactly was going on and even intervened, but it was a convincing and fun experience for the participants."

This video is not supported by your browser at this time.

Real, virtual experiences

It is a very unusual concept; it was a real experience, the users did interact with elves that were invisible to the rest of the world. It happened in a world that mixed virtual people and objects with modern streetscapes in a new cross-reality. For the users, it was a new fusion between real and virtual worlds.

TimeWarp is a mobile augmented reality game originally played in the Old Town of Cologne by two players. They take on the role of agents working for the so-called ChronoGuard, investigating breaches in the time-space continuum. Their task is to locate little gnome-like robots called ‘Heinzelmännchen‘, inspired by the real Heinzelmännchen legend from Cologne.

To complete the task, players use their ultra-mobile PCs (UMPCs) to travel into different time periods, evoked by a mix of music, sound-effects and virtual 3D objects and characters superimposed onto reality via VR glasses.

In this way, players visit Roman, Medieval and future versions of the surrounding city where they are confronted with different tasks and dilemmas. In addition, the UMPC has a motion sensor which allows players to interact with the game more intuitively.

While the hardware elements are fairly standard, it is their combination with subtle effects that created an engaging and enjoyable experience for users.

"It also brings them into contact with the history and culture of the city, so it has an educational and participative element, too," notes McCall.

Presence, interaction, experience

That was a crucial element of all IPCity's work. The applications revolved around presence, interaction and experiences with the city, though many of the techniques and technologies could be adapted to other scenarios.

The City Tales application, for example, sought to place a user-generated digital layer over the physical fabric of the city, a bit like a Facebook of the physical world, where users could post personal stories about the city based on a physical element rooted at a specific point in the landscape.

Storytelling is a particularly interesting example of IPCity's work, because it demonstrates the range of tasks the project had to execute. For example, GPS is not nearly accurate enough to map virtual contents accurately into the cityscape, therefore alternative approaches had to be developed.

For example, IPCity developed a localisation technology driven by computer vision. It automatically recognises real-world elements based on captured images from the user’s location. For example, users can leave virtual graffiti on real-world locations - without incurring the wrath of city authorities.

Other work included authoring tools, so companies or city authorities can easily set up services and create appropriate content for it. The authoring tools work with all the applications developed by the project.

Furthermore, device integration and software interfaces had to be developed for each application, and fundamental to all applications was the theoretical and analytical work that defined the rules for creating engaging mixed reality experiences.

Through the looking glass

In some respects the work of IPCity represents a radical shift in direction for digital technologies. For much of the history of the internet, people entered deeper and deeper into the , through social networking, gaming and virtual reality.

But in IPCity, ‘virtuality’ reverses direction, bringing internet concepts into the real world, with objects in the streetscape unlocking virtual characters, messages and information. Instead of people entering the digital landscape of the internet, digital objects are beginning to colonise the real world. So, prepare to be V-Ex’d!

This is the second of a two-part special feature on IPCity appearing on ICT Results. Part 1. phys.org/news198306374.html

Explore further: Innovative new supercomputers increase nation's computational capacity and capability

More information: IPCity project - www.ipcity.eu/

add to favorites email to friend print save as pdf

Related Stories

Mixed reality cookbook

Jul 14, 2010

What we perceive in the world is highly influenced by what we are looking for. That is old news. Now European researchers have used this theory to create a convincing and engaging 'mixed reality', and they ...

Virtual applications reach out to real world

Aug 14, 2008

(PhysOrg.com) -- European researchers have developed a series of very clever tools to break through the bottlenecks stalling the widespread adoption of virtual reality. But the compelling applications designed for the system ...

Pervasive games promise to spice up daily life

Sep 11, 2008

(PhysOrg.com) -- In the movie The Game, the character is hounded by villains and left for dead in Mexico in an intense version of an alternative reality game. Minus the Hollywood bravado, games that merge ...

Pendulum Finds Virtual Soulmate

Jun 14, 2007

What's nerdier than creating an online avatar that fights dragons and raids strongholds? Creating a virtual pendulum that you can sync up to your real-life pendulum. Leave it to physicists to do just that, resulting in a ...

Recommended for you

Forging a photo is easy, but how do you spot a fake?

Nov 21, 2014

Faking photographs is not a new phenomenon. The Cottingley Fairies seemed convincing to some in 1917, just as the images recently broadcast on Russian television, purporting to be satellite images showin ...

Algorithm, not live committee, performs author ranking

Nov 21, 2014

Thousands of authors' works enter the public domain each year, but only a small number of them end up being widely available. So how to choose the ones taking center-stage? And how well can a machine-learning ...

Professor proposes alternative to 'Turing Test'

Nov 19, 2014

(Phys.org) —A Georgia Tech professor is offering an alternative to the celebrated "Turing Test" to determine whether a machine or computer program exhibits human-level intelligence. The Turing Test - originally ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.