Integrated Research Roadmap Giannis Karaseitanidis Institute of Communication and Computer Systems European Commission DG Information Society FP6-funded Project 7/11/2007, Rome Alenia Spazio S.p.A. Network 7
Network of Excellence Technology/Methods Augmented Reality Evaluation & Testing Haptic VR/VETechnology Applications Aerospace Automotive Construction & Energy Engineering & Design Medicine & Neuroscience Entertainment & Culture Training and Education WG 2.12 WG 2.10 WG 2.8 WG 2.2 WG Leader group WG 2.1 WG 2.9 WG 2.4 WG 2.6 WG 2.7 WG 2.3 WG 2.11 Create a common understanding Knowledge Base Road Maps Position papers ToR 2
Roadmap Landscape Methodological research step list Application driven Methodological research step list Application driven Requirements WG 2.8 WG 2.9 WG 2.11 WG 2.1 WG 2.2 WG 2.4 WG 2.6 WG 2.10 Technology components Technology components Application driven Requirements WG 2.3 WG 2.12 WG 2.7 Difficult to balance different WG types Technology Methods Application Areas 3
Roadmap Process State of the Art summary Focal point identification Research position papers A roadmap template Structuring the field Workshops/Meetings on roadmaps WG Roadmap drafts as tool These drafts serve as foundation for the refinement of the general roadmap 4
WG Roadmap Structure Scope Background Barriers Vision / Scenarios Research Agenda Drivers Roadmap Table Research Agenda Research Areas Research Steps Dependent Scenarios Period Depends on TRL*(of outcome) As described As described above (shortened) Scenario(s), which ST = < 5 yrs Research steps L(1)-L3(3) above depend on the Research Step MT = 5-10 yrs mentioned in (shortened) or not applicable (n.a.) LT = >10 yrs this table or external or not applicable Display 1.1 HiResLCD/DLP ST External L3 Technology for Panels Immersive 1.2 HiSpeed Panels ST,MT External L3 Environments 1.3 HiRes Display ST 1.1 L3 1.4 HiSpeed Displays Collaboration Environment ST,MT 1.2 L3 L2 1.5 Large Scale Flat Panels Office and Home Environments MT L3 1.6 Wide FOV HMD Mobile and Augmented Environment MT 1.1 L3 1.7 Holographic Displays n.a. LT Entry TRL* (optional) L(1)-L3(3) 5
Top-Down Approach WG 2.3WG 2.6 WG 2.9 WG 2.12 WG 2.7 WG 2.10 WG 2.2 WG 2.1 WG 2.4 WG 2.8 WG 2.11 Methodological Research Topics Methodological Requirements Scenarios Technical Scenario Application Type Task Analysis Technological Requirements Technological Research Topics Mostly in application oriented WG s 6
Bottom-Up Approach WG 2.3WG 2.6 WG 2.9 WG 2.12 WG 2.7 WG 2.10 WG 2.2 WG 2.1 WG 2.4 WG 2.8 WG 2.11 Methodological Research Topics Methodological Requirements Scenarios Technical Scenario Application Type Task Analysis Technological Requirements Technological Research Topics Mostly in technology WG s 7
Roadmap Scenarios WG s collected 72 Scenarios A value in itself Is considered to be conserved in the Knowledge Base 8
Example Application Types Content activity Animated Environments Simulation, 3D TV Evaluation, Analysis Market research, CAD Evaluation Ergonomic Analysis Story Telling Edutainment Monitoring and Control Computational Steering, Telepresence Complete Interaction with Dynamic Content Games, Functional prototyping Training Behavior, Ergonomics, Treatment Presentation (multisensoric) Styling Review, CAD Review, SciVis, InfoVis Communication Virtual Meeting Object and Content Creation Shape Creation, Planning User activity 9
WG Roadmap Structure Scope Background Barriers Vision / Scenarios Research Agenda Drivers Roadmap Table Research Agenda Research Areas Research Steps Dependent Scenarios Period Depends on TRL*(of outcome) As described As described above (shortened) Scenario(s), which ST = < 5 yrs Research steps L(1)-L3(3) above depend on the Research Step MT = 5-10 yrs mentioned in (shortened) or not applicable (n.a.) LT = >10 yrs this table or external or not applicable Display 1.1 HiResLCD/DLP ST External L3 Technology for Panels Immersive 1.2 HiSpeed Panels ST,MT External L3 Environments 1.3 HiRes Display ST 1.1 L3 1.4 HiSpeed Displays Collaboration Environment ST,MT 1.2 L3 L2 1.5 Large Scale Flat Panels Office and Home Environments MT L3 1.6 Wide FOV HMD Mobile and Augmented Environment MT 1.1 L3 1.7 Holographic Displays n.a. LT Entry TRL* (optional) L(1)-L3(3) 10
VR/VE Barriers Highlights Simulation technology (hard and software) in necessary accuracy not real-time capable and vice versa Bandwidth not sufficient (resolution, contrast, accuracy, ) Usability (Unencumbered use of equipment impossible, no 3D-interaction-standards, ) New interfaces break with learned habits Lacking interoperability: data, applications, workflow, standards No valid general ROI evaluation 11
VR/VE Drivers Highlights Industry Request still there (Thank you!) Mass Market enters Game 3D-TV 3D Communities Visualisation is de-facto standard in communication 3D data is collected more and more (model creation wont be an issue in the future, but composing) Compute power still follows Moores Law (but how long?) 12
Research Areas Interface Technologies Components of multimodal interfaces Multimodal systems Content Technologies Realistic behaviour of VE s Representation of real and virtual humans Content creation and management System Integration Technologies Data integration in external systems or processes Interoperability Interaction Generic spatial interaction Application specific interactions Human Factors Basic Research Ergonomics and Design 13
Structuring the Field Interaction Concepts Multimodal Input Tracking Devices Speech Application Domain Knowledge, Domain specific integration Integration System Architectures, Sensor Fusion, Synchronization,... Content Technology Real-time Dynamics Intelligent Avatars Adaptive Worlds Multi Sensor Display Visual Audio Olfactoric Evaluation Technology Computing (ICT) Networking, OS, Compute Power 14
VR as Integration Point Seamless integration of user in information environment Integrated hardware and software interface Successful system has to master both Many different components => complex system Content SW-Interface HW-Interface Workplace 15
VR as Integration Point Mechanics Ergonomics Projection systems Electronics Hardware Devices Electronics Application Virtual Reality System Networking Device Driver Application development 3D-Data handling 3D-GUI-design Real-time VR-core-software Operating Software 16
Where do we go tomorrow? Toshiba 17
Roadmap Topics Integration Social Environment Workflow Physical Environment Integration - Interoperability Data Functionality Interaction Paradigms ICT Environment System 18
Roadmap Summary The Necessary : Integration - Data, Processes and Interfaces The Obvious : Improvement of existing technologies in terms of bandwidth (resolution, color-depth,...), accuracy and robustness More dynamic, physically correct, consistent and reactive real-time content Authoring and content management tools Still not solved or just started: True 3D interaction Immersive collaboration is important, but not well explored beyond shared view Surprisingly not much requested: BCI or neural interfaces 19
Updated roadmap Consensus on priority listing Knowledge Base WGs cross contribution March 2007 20
Acknowledgements Roland Blach, FhG-IAO WG leaders Consortium 21
Thank You Giannis Karaseitanidis gkara@iccs.gr Tel: +30 210 772 2280 www.intuition-eunetwork.net http://i-sense.iccs.gr 22