Augmented and Mixed Reality Virtual and Mirror Worlds Charles Woodward January 20, 2009
Introduction (1) Virtual Reality CAVE Systems E.g. Lumeportti at VTT Back projected screens Polarized data glasses Magnetic tracker, other PC applications 3D CAD Computer Games On-Line Virtual Worlds
Introduction (2) Augmented Reality (AR) Mixes virtual objects with view of real world C.f. Virtual Reality (completely virtual worlds) Properties: real-time, interactive, 3D Tracking + rendering + display Related technologies Augmented Virtuality Mediated Reality Diminished Reality -> Mixed Reality (MR) Reality Augmented Reality Augmented Virtuality Virtual Reality Mixed Reality
Display Devices
Example Application ARCatalogue Viewing with data glasses / web camera Stereo 3D products appear from catalogue Based on marker detection from camera view Applications, e.g. B2B marketing by Lappset Group 3D viewing of isometric views by Pöyry Also, camera phones
Entertainment, Games
Interior Design Project AR-Sisustus Tekes TILA Duration 2008-2010 Partners: VividWorks, Floobs, UPCode, DeskArtes, Sensetrix, Kesko
Architecture
Mobile / Outdoors Google Earth on Earth
Production Sites
Augmented Assembly
Mobile Augmented Reality one of the technologies to most likely to alter industries, fields of research, and the way we live. - MIT s annual review 10 Emerging Technologies 2007 - Also, Gartner s Top Ten Disruptive Technologies 2008-2012
Technology Enablers and Drivers Smart mobile terminal Technology convergence to smart phones Incl. camera, 3D graphics, WLAN, WiMAX, 4G Up to accelerometer, compass, RFID, 3D displays E.g. Nokia N95-> 6210 (MARA), iphone Minituriarised data glasses E.g. Lumus see through h glasses MyVu video glasses for ipod Laster EnhancedView AR contact lenses?!
Technology Enablers and Drivers AR software technology Markerless tracking Content creation tools Game industry, e.g. Sony Eye Toy (gesture based AR) Eye of Judgment (marker-based AR) GestureTek (camera driven phone games) Commercial activities Intersense (USA) Metaio (Germany) Total Immersion (France) ARToolWare (New Zealand)
Virtual and Mirror Worlds Second Life, Habbo Hotel etc. Massively multi-user user online worlds Google Earth User-created content / geo-tagging Incl. 3D buildings, photos, panorama, etc. Microsoft PhotoSynth 3D reconstruction of the the world Nokia Image Space Point and Find Enablers for Mixed Reality Shared content, navigation, tracking
Mixed Reality Not just visualization Interface between digital and real worlds User-created Internet content, feedback Life logging, physical object logging Interoperability, devices and applications Digital World Applications, e.g. Google Earth <-> On Earth Second Life <-> Real Life 4D BIM <-> Construction site Digital factory <-> Real factory Augmented with 3D models, images, signs, tags, instructions, messages,... Virtuality Augmented Reality Augmented Virtuality Mixed Reality Reality Augmented with photos, videos, textures, messages, products, people,... Real World
Mixed Reality Projects at VTT
Project Mobile Mixed Reality National ICT-SHOK project Duration 2008-2010, budget 4,3 M Partners Nokia, Sesca, VTT, HUT, TUT Piloting in Ubiquitous Helsinki, Living Labs context Mixed Reality services, user created content at public spaces Mission Enable social ubiquitous media by linking global resources and local relevance often supplied directly by empowered users with visual discovery and interaction in the physical world and on-line, using mobile phones as gateway between physical and digital worlds
Project AR4BC Augmented Reality for Building and Construction Industrial partners incl. Pöyry, Tekla, Skanska,... Tekes VAMOS programme, 2008 2010 Augmented on-site visualization Comparing project plans (4D BIM) with actual situation on site Augmented site journaling Mobile feedback to BIM system Attach images, tags etc. to components in BIM model Augmented Virtuality
Project MR-Conference Mixed Reality Video Conference Teleconference btw real people and SL avatars Tekes TILA programme, partners VTT, TKK, Nokia, IBM One year, starting October 2008
KnowMan: Smart Factory Scheme Digital information represented at factory floor, for operation, training etc., using augmented reality Real factory machines products people Interoperation between digital and physical factory Intuitive visualization by Augmented Reality Feedback by natural HCI / Augmented Virtuality Digital factory 3D models, layouts simulations, processes plans, forecasts Feedback from real to digital factory, incl. silent information, methods e.g. motion capture, photos, videos (augmented virtuality)
Thank You! Prof. Charles Woodward VTT Technical Research Centre of Finland Vuorimiehentie 3, Espoo, Finland Tel: +358 20 722 5629 charles.woodward@vtt.fi http://www.vtt.fi/multimedia