Extending X3D for Augmented Reality

Transcription

1 Extending X3D for Augmented Reality Seventh AR Standards Group Meeting Anita Havele Executive Director, Web3D Consortium Nov 8, 2012

2 Overview X3D AR WG Update ISO SC24/SC29 AR RM 3D Compression Object Upcoming events

3 Open Standards Portability Durability IP- independence ISO Approved

4 About the Web3D Consortium We are an International non- profit, member- funded, industry group Our members span business, academia, government and the military We maintain a royalty-

5 X3D - ISO Standard X3D an event and runtime model build for the Web

6 : the Standard Scene graph Scene graph for real- time interactive delivery of virtual environments over the web: Meshes, lights, materials, textures, shaders Integrated video, audio Animation Interaction Scripts & Behaviors Event ROUTE Sensor Multiple encodings (ISO = XML, VRML- Classic, Binary) Multiple Application Programming Interfaces (ISO = ECMA, Java) X3D Version 3.3 includes Volume rendering, CAD and Geospatial components.

7 Web3D Collaboration & Convergence XML HTML5 AR POI Web3DS CityGML KML Mpeg 4 WebGL Collada OPenGL N- D Presentation State Volume data VRML and X3D are important parts of other specifications We extend our standards to meet the needs of new use groups

8 Adoption

9 Motivation to extend X3D for AR/MR Going beyond basic geo-location based AR Virtual Objects MR Continuum Real Objects VR AR Virtual Reality (VR) Virtual objects/ data X3D is a well established application description language to express Virtual objects and their behaviors in 3D virtual environments Augmented Reality (AR) Virtual objects augmented by sensors X3D has partial functionality for AR (Sensor Nodes, Viewpoint node, Camera node) Mixed Reality (MR) Continuum between VR and AR X3D currently lacks features needed for MR - Extend X3D accommodate

10 Mixed Reality Real Environment Augmented Reality Virtual Reality Virtual Environment New/Extended X3D Nodes for AR/MR X3D existing Nodes

11 Our Approach to extend X3D for AR Extensible to existing frameworks - X3D (Scene graph) Extend Virtual Environment to implement AR - Location Representation General/Flexible Different AR platforms (platform independence) Mobile, Desktop and HMD Sensors and devices Event ROUTE Vision based, Marker based and Location based

12 X3D- AR Requirements Functional requirements Supporting image (camera) sensors Live video Background and textures Tracking camera motion Camera calibration Correct image synthesis Non- functional requirements Simplicity and extensibility of physical objects to be placed within the 3D scene.

13 X3D- AR Integration

14 X3D- AR Examples

15 X3D- AR and Relevant Standards AR-Framework AR Content AR Player HTML5 (images, videos) CSS3 (layout) JS (interaction) KML 3D Content X3D COLLADA Web Kit (Open Source Project for web browser development) Custom Applications

16 X3D into HTML (X3dom) Declarative 3D Integrating 3D content into HTML

17 ISO SC 24 Activities on AR Standardization JTC 1 Approval of SC 24 Scope Reorganization Augmented Reality Continuum (ARC) Includes VR, AR, and MR SC 24 AR Reference Model Broader systems perspective Used in all application areas No dependency on specific encoding systems

18 ISO SC24/SC29 AR RM ISO SC24 AR continuum includes VR, AR, and MR Scopes, coverage, and standard types are very different between the two SCs SC 24 is developing international standards, not Technical reports and pursues license-free policies SC 24 considers that AR reference models broader systems perspective used in all application areas without dependency on specific encoding systems SC 29 AR RM Technical Report (TR) could result in confusion because of the underlying MPEG-A technology Nov 8, 2012

19 3D Object Compression Develop a unique representation of a compressed 3D graphics object Reference a 3D object in a similar manner as an image in a 3D scene External resource (file/stream) representing the 3D Scene (e.g..jpg..) Currently, there are mechanisms available but not complete Identify 3D object requirements Geometry, Material properties, Surface appearance Animation Mesh Compression Texture Mapping View-Dependent Geometry Texture Scalability. Collaboration between SDOs with an MOU Agreement Context aware IPR aware

20 3DPIE and X3D OGC 3DPIE Report Published September 2012 OGC and Web3D Co Press Releases X3D aligns with 3DPIE visualization goals 3DPIE demonstrates X3D Value Web3D Member Contributions Virginia Tech 3D Blacksburg Project Bitmanagement BS Contact Browser Fraunhofer Instant Reality Browser MBARI

21 Align X3D with OGC Propose new X3D work to further OGC 3D portrayal Requirements Align with HTML5 approach using GeoLocation APIs Consider diverse location inputs to X3D scenes Consider X3D geospatial portability on mobile devices ARML WG collaboration in comparing AR proposals

22 Web3D Conference Co-sponsored by Web3D Consortium, ACM SIGGRAPH and Eurographics June, 20-22, 2013 in San Sebastian, Spain Highlights current Capabilities and trends in interactive 3D graphics AR Workshops and Tutorials Looking forward to participation from the AR Community

23 Visit us at: To Join: THANK YOU! Anita Havele Phone: