Extensible 3D (X3D) Graphics and X3D Earth for Web-Interoperable Modeling, Simulation and Visualization

Transcription

1 Extensible 3D (X3D) Graphics and X3D Earth for Web-Interoperable Modeling, Simulation and Visualization Demonstrating Potential for New Capabilities 21 July 2009 Don Brutzman Naval Postgraduate School Monterey California USA

2 Topics Motivation Extensible 3D (X3D) Graphics X3D Earth X3D Geospatial Examples Looking Ahead

3 Motivation Modeling, simulation and visualization need to become part of the warfighter repertoire Many diverse systems exist, connected via command and control (C4I) data streams Web-based XML data interoperability is key to world-wide interoperability X3D graphics meets these needs compatibly across wide range of competing technologies

4 theory = conceptual description of reality experiment = test theory in physical world Theory Analysis Experiment Scientific method, ፪፮th-፫፩th centuries Scientific method, 15th-20th centuries 4

5 model = formal representation of reality Scientific method, 1950-present simulation = behavior of model over time Model Simulation implements a corresponds to an Theory Analysis Experiment Scientific method, ፪፲፮፩-present Scientific method, 1950-present 5

6 running together model = formal representation of reality Scientific method, 1950-present simulation = behavior of model over time Modeling & Simulation Theory Analysis Experiment Scientific method, ፪፲፮፩-present Scientific method, 1950-present 6

7 Virtual environments can connect all models and simulations together Modeling & Simulation Theory Analysis Virtual Environments linked together via networking interfaces, shared semantics Experiment Scientific method, emerging ፫፪st century 7 Scientific method, emerging 21st century

8 Extensible 3D (X3D) graphics Open standard for the Web-based visualization

9 Historical background: VRML Virtual Reality Modeling Language (VRML) began in 1994, seeking to create 3D markup for Web Numerous candidates considered by an open community of interested practitioners SGI's OpenInventor won the initial competition VRML 1.0 developed over the next year VRML 2.0 restructured some nodes, added features VRML advanced to International Standard by ISO in 1997

10 XML file encoding The Extensible Markup Language (XML) is a plain-text format used by many Web languages Including Hypertext Markup Language (HTML) XML is used to define other data-oriented languages Thus XML is not a language by itself, rather it is a language about languages, a metalanguage Common XML basis enables better interoperability, opens a path of least resistance for data flow XML has many benefits and is well-suited for X3D

11 XML in 10 Points XML is for structuring data XML looks a bit like HTML XML is text, but isn't meant to be read XML is verbose by design XML is a family of technologies XML in 10 Points is a key reference for understanding the common underlying design principles underlying the great diversity of XML. Only 4 pages long essential reading. XML is new but not that new XML leads HTML to XHTML XML is modular XML is basis for RDF and the Semantic Web XML is license-free, platform-independent and well-supported

12 Web3D Consortium Web3D Consortium founded in 1998 to protect, support and advance the VRML specification Continued efforts on new technology by multiple working groups led its successor, X3D Non-profit organization of many stakeholders ensures that X3D remains royalty free, relevant Partnership of industry, agency, academic and professional members

13 February 2009 February 2009

14 June 2009 June 2009

15 X3D Specifications X3D graphics is defined by a set of specifications These specs are developed by working-group volunteers as part of the Web3D Consortium Nonprofit organization with business, nonprofit, academic and professional members Efforts include editing, implementing and evaluating Specification results reviewed and approved by International Organization of Standards (ISO)

16 Community rules Thanks to an open process, IPR-protection rules and steady innovation by Web3D members, new X3D features continue to evolve and grow into great capabilities Lots of working groups have formed, worked, faded, regrouped and succeeded Web3D members and public mailing lists still keep these successes building, year after year

17 Why is a 3D standard important? 1 There are many types of 3D graphics engines and plugins available. Best known: Computer graphics games Animated movies Well-kept secret: these are rarely interoperable Example: no 2 experts can run the other's demo Silly question: hey, let's mix 2 games together!... why should adding models together be so hard? Proprietary software actively prevents such mergers Interoperability over Web can change all that

18 Why is a 3D standard important? 2 Web standards let different companies do what they do well, then interoperate together Today there are many small islands of functionality Tomorrow might bring a much bigger playing field for 3D graphics to work with A shared Web is good for everyone Business, public, government, universities Best practices emerge, new business opportunities More information, more connectivity, more progress A rising tide lifts all boats

19 Intellectual property rights (IPR) Web3D and W3C have similar policies Any known patented technology must be declared by members prior to consideration in safe haven of working groups Any patented technology contributions must be licensed on a royalty-free (RF) basis for inclusion in an openly used Web standard Caveat: any legal problem can be solved, but only in advance

20 Open source: optional Open for any use, without license fees Free = freedom to innovate, free to fix! Not necessarily free cost More like free puppy, not free beer Common shared example implementations Can provide a self-sustaining business model for continued activity, improvement Can break logjams when company participants can t resolve technical issues

21 Digital rights management (DRM) X3D s XML and Compressed Binary encodings allow use of W3C s Security recommendations XML Encryption XML Digital Signature (for authentication) XML Public key infrastructure DRM is now feasible More uses than Hollywood-commercial exist See Sun s DReaM project

22 Google Lively no more July 2008 press release November 2008 web-page update! Does anybody want persistent archival 3D graphics now?

23 Interoperability - what s the difference? Multiple paths, but often confused as equal Standard: proven process for content interoperability, scalability, compatibility, licensing, growth, success Specification: Algorithm descriptions, necessary detail But: might hide royalty problems, such as GIF imagery debacle in 1990s Open source software: pile of (maybe repeatable) code But: usage licensing is not same as source-code licensing Market share dominance: biggest competitor wins? Companies (or at least investors) hope to own 3D But: many defunct companies, dead-end technologies Everyone ends up with much smaller market than the Web

24 IPR summary IPR = Intellectual Property Rights Open standards & open source: part of success Complements legacy approaches, traditional hierarchical stovepipes, provides stability Win-win approach for government, industry Both wins are needed for program success Standards organizations, IPR agreements provide a stable playing field for long term Welcome to another active playing field!

25 X3D case-study videos BitManagement Fraunhofer Darmstadt

26 X3D Earth Build a backdrop X3D model of planet Earth Use publicly available terrain datasets, imagery Use Extensible 3D (X3D) Graphics throughout Provide linkable locations for any place Open royalty-free ISO-approved Web standards Partnerships with Open Geospatial Consortium (OGC) and World Wide Web Consortium (W3C)

27 Example X3D Earth invocation Simple integration into any X3D scene

28 X3D Earth example globe image

29 X3D Earth OpenMap exemplar

30 X3D Earth OpenMap exemplar

31 Multiple capabilities X3D-Earth implementation progress Server-side tile generator Geospatial Data Rez, open-source Java jeospace, Java, GeoTools Globe model implementation Several Earth globe models Geospatial referencing X3D

32 X3D-Earth Globe Implementation Progress 2009 Ready to scale out and build full-resolution prepared X3D Earth archives 2008 Maximum Resolution X3D-Earth Globe November 2007 Earth Globe Model August 2007 Local Area Models Several Earth globe models Geospatial component Multi-resolution model with non-geospatial component Geospatial component for simple test model November 2006 Technical Requirement Workshop

33 Server-side Globe Generator Rez Open-source tool for translating geospatial data into different formats at multiple levels of resolution Convert images, cartography, terrain, bathymetry into X3D models for web browsing Dr. Chris Thorne

34 X3D Terrain Tile Production Input: Geospatial data Geospatial database Data acqusition Data enhancement Multi-resolution tile generation Final X3D archive Annotation & validation Database access interface USGS, NOAA, NGIC, et al. Data tool Global Mapper, ArcGIS Processing tool Rez Data archive X3D Earth server Edit tool X3D Edit Land terrain Ocean bathymetry Terrain data Terrain data Terrain tiles Imagery data Imagery data Imagery tiles Download Translate Convert Metadata Imagery tile Terrain tile Annotate Configuration file Satellite imagery Aerial imagery Check availability, select data source, region of interest, data type, resolution Convert projection, unit, spatial coordinate system, datum, file format, select data source, region of interest Version control, Web service Convert elevation model to.x3d, slice imagery into tiles Real-time Visualization Simulation tool Xj3D Remote sensing Output: Geo-referenced real-time simulation environment Inspect visual rendering HTTP Add document meta tags, SMAL terrain metadata to topmost X 3D scene, validate XML and X 3D, canonicalization X3D simulation

35 Local Area Models Multi-resolution X3D Models Multiple browsers: Xj3D, FreeWrl (Mac Unix), BS Contact Geo Flux Player (San Clemente Island, CA) BS Contact

36 High Resolution LOD Tile Generation LANSAT7 (30m) 1m Resolution High Resolution Urban Area Imagery (0.3m Resolution)

37 Rez Improvement Scene Graph Pattern Binary tree Quad tree Further improvements planned: flexible retrieval of any tile, in order to support alternative terrain-rendering algorithms and predictive caching

38 Naming Convention and Coordinate System GeoElevationGrid height array: Values are given in row-major order from west to east, south to north Image texture Elevation tile GeoGridOrigin World1-0.x3d World1-1.x3d 0, , 0 World0-0.x3d World0-1.x3d -90, , 0

39 Data Consistency Challenges Coordinate system Issue related with Data consistency Naming convention Direction of data description Etc Geospatial Referencing LOD tile chaining bundled with different tile sets X3D Earth unlocks interoperability for clients and server side

40 Issue with GeoOrigin Multiple-resource composition challenges: what if more than one GeoOrigin present?

41 Resolution of GeoOrigin issue Addressed during X3D-Earth workshop March 2009, MBARI, Moss Landing CA Extensive work by Chris Thorne laid out technical rationale, possible solutions GeoOrigin deprecated since it provides superfluous information, can be ignored Example implementation provided by Xj3D Standardization issue for X3D v3.3 Can now compose any X3D Earth models

42 X3D-Earth Globe Models 1 Blue Marble Imagery data: Blue Marble Elevation data: SRTM30 Plus Number of LoD: 7 levels for global archive, more levels for specific locations Generator: jeospace Creator: Rex Melton, Yumetech

43 X3D-Earth Globe Models 2 Earth Terrain and Bathymetry Imagery data: Color scale texture image Elevation data: 1 minute terrain, bathymetry Number of LoD: Two 7 level (0 to 6 levels quadtree) each for West, East sides of globe Generator: Rez Creator: Byounghyun Yoo NPS

44 X3D-Earth Globe Models 3 Blue Marble with LanSat Imagery data: Blue Marble + LANSAT7 Elevation data: SRTM30 Plus + NED (30m) Number of LoD: Two 7 level (0 to 6 levels quadtree) each for West, East sides of globe Generator: Rez Creator: Byounghyun Yoo NPS

45 New query page

46 New query page

47 Examples

48 X3D-Earth online resources Working group website, examples X3D Earth wiki pages X3D Plugfest X3D Resources, public specifications, etc.

49 Quality Assurance (QA) support X3D-Edit Authoring Support Editors and tooltips for all geospatial nodes X3D Examples Basic X3D archives: Geospatial examples Savage X3D archives: different locations Schematron scene validation Many XML-based tools now being knit together

50 Looking Ahead

51 Construct full-coverage, full-detail X3D-Earth globes at NPS Utilize Sun blade-based Hamming supercomputer NPS intranet, hamming.uc.nps.edu Linux Rocks cluster, 144 quad nodes, 120 TB Software Rez to generate terrain, imagery tiles Sun Grid Engine (SGE) for batch job choreography Datasets Digital Terrain Elevation Database (DTED) Digital Nautical Chart (DNC) and CADRG imagery Repeat for broad variety of geospatial datasets

52 Event calendar 2009 Web3D Member Meeting and X3D Earth Workshop Nasa Ames, Mountain View California, March 3 Moss Landing California, March 4-5 Web3D 2009 Symposium Darmstadt Germany June ISO Standards Committee 24 Annual Review London July 6-9» Open Geospatial Consortium (OGC) Oblique Imagery Inaugural meeting August tbd» SIGGRAPH 2009 and Cartographic BOF New Orleans Louisiana August 3-7» SIGGRAPH Asia 2009 Yokohama Japan December 16-19

53 Teleconferences every week X3D group alternates with X3D working group Wednesday mornings pacific, Germany time Progress reports by various implementers, also discuss current issues of common interest Other working groups: humanoid animaton, DICOM medical visualization, CAD export, Korea chapter, et al.

54 Support is welcome! All of this work is driven by practical projects. New projects are always welcome, let's discuss. Examples currently percolating: Virtual Environment Resource Repository Expeditionary Warfare Demonstrator (EWD) Anti-Submarine Warfare (ASW) Synthetic Environment for prosecutions, analysis Robot field-testing mission archives, ongoing Physics-based situational awareness to ground all DoD C4I-mediated operations

55 Conclusions, Recommendations Web-based technical approaches are becoming suitable for collaborative, complementary work Meaningful production and distribution of earth resources using X3D graphics is now feasible Royalty-free Web standards protect investments These capabilities are offered for your consideration, further discussion is welcome.

56 Creative Commons open-source license

57 Contact Don Brutzman Code USW/Br, Naval Postgraduate School Monterey California USA voice fax