AUGMENTED REALITY, FEATURE DETECTION Applications on camera phones Prof. Charles Woodward, Digital Systems VTT TECHNICAL RESEARCH CENTRE OF FINLAND
AUGMENTED REALITY (AR) Mixes virtual objects with view of real world - Instead of completely virtual world (VR) - Real-time, interactive, 3D Marker based tracking - Marker s 3D location is registered from video image - Virtual objects are augmented on marker Example: augmented interior design - Furniture is light to move around - Easy to try out different alternatives - No modelling of real environment required - Hardware: PC & web camera (& video glasses) -... or, just digital camera / camera phone!
AUGMENTED INTERIOR DESIGN - CONSUMER SOLUTIONS ARInterior - Single marker placed on floor - Digital camera images uploaded to computer - Virtual furniture selected and placed with menu/mouse - Features: lighting, shadows, hiding of marker - Potential also for Internet portal solution ARPhone - Placing virtual furniture on phone s camera image - Based on feature tracking - no markers required
CASE STUDY: DIGITALO Construction site (2003) VTT s new head offices - Digitalo = Digital Building History - Construction started Dec 2003 - Building ready Oct 2005 Various AR/VR methods used and tested - Still image visualisation - Immersive Virtual Reality - Mobile Augmented Reality - Augmented Web Camera - Augmented Scale Model One of the most comprehensive case studies in the world Illustration of Digitalo (still image, 2003)
VIRTUAL REALITY, AVATARS Walk through inside virtual Digitalo - Lumeportti - VTT s proprietary CAVE system for 3D data visualisation and collaboration - Utilises video projectors, networked PCs and low-cost VR technology - Provides steroscopic walk-through functionality with gesture-based interaction - Incorporates autonomous avatars walking around in the 3D scene
MOBILE AUGMENTED REALITY Outdoors visualisation of Digitalo - Commissioned in 2003, using PDA device - Lightweight, user friendly, inexpensive - Frozen view, multiple users, etc. Current implementation - Tablet PC, with optional video glasses - Local processsing, or streaming video - Markerless, feature based tracking Other applications, e.g. - Interior design, parks, landscapes - Industrial apps, production, mainentance - Consumer applications <-> camera phones!
AUGMENTED WEB CAMERA Digitalo augmented in live web camera image - Presentation for future users of building - Also, follow-up, comparison with original plans - View with or without virtual building - Real-time interaction (zoom, pan, etc.) - Viewing inside to the building - Building history stored on video
AUGMENTED SCALE MODEL Digitalo augmented on conference table - Viewing through video glasses (stereo) - Move around model, communicate with other people - Also, virtual reality tour utilising feature based tracking Features - Virtual menu for user interaction - Add, move and remove parts ( ARcatalogue ) - Realism: textures, reflections, shadows etc. - Interact with lighting conditions, etc.
DIGITALO / SUMMARY Still images - presentation, appearance Augmented Scale Model - for planning, collaboration Virtual Reality, Avatars - feeling of interior, space Mobile Augmented Reality - feeling of location, presence Augmented Reality - Webcam - remote presentation, follow-up Augmented Reality Interior Design - once building is (almost) ready...
THANK YOU! Prof. Charles Woodward charles.woodward@vtt.fi Tel. +358 20 722 5629 Videos and Demos availabe at: http://www.vtt.fi/multimedia