MPEG Augmented Reality Application Format 5th AR Standards Community Meeting, March 19-20, Austin, US Marius Preda Institut TELECOM
ARAF Context
AR Game Example: PortalHunt Mul$- user game, geo- localized, AR view, catching portals by entering or surrounding them
What is to be specified? scene description media(s) remote access compression sensors communication
ARAF Specifications WD 2.0 of Augmented Reality Application Format Node name AcousticMaterial AcousticScene AdvancedAudioBuffer AudioBuffer AudioClip AudioChannelCoding AudioDelay AudioFX AudioMix AudioSource AudioSwitch Sound Sound2D SurroundingSound Transform3DAudio WideSound
ARAF Specifications WD 2.0 of Augmented Reality Application Format 9 Nodes for Image/Video Node name Bitmap CompositeTexture2D CompositeTexture3D DepthImage DepthImageV2 ImageTexture MovieTexture MultiTexture TextureTransform
ARAF Specifications WD 2.0 of Augmented Reality Application Format 9 Nodes for Image/Video 2 Nodes for Text and Font Node name FontStyle Text
ARAF Specifications WD 2.0 of Augmented Reality App. Format 9 Nodes for Image/Video 2 Nodes for Text and Font 36 Nodes for Graphics Appearance Box Circle Color ColorTransform Cone Coordinate Coordinate2D Cylinder Ellipse Extrusion Hierarchical3DMesh IndexedFaceSet IndexedFaceSet2D IndexedLineSet IndexedLineSet2D LineProperties Material Material2D MaterialKey MorphShape MultiTextureCoordinate Normal PointSet PointSet2D SBBone SBMuscle SBSegment SBSite SBSkinnedModel SBVCAnimationV2 Rectangle Shape Sphere SubdivisionSurface TextureCoordinate
ARAF Specifications WD 2.0 of Augmented Reality Application Format 9 Nodes for Image/Video 2 Nodes for Text and Font 36 Nodes for Graphics 1 Node for Programming Information Script
ARAF Specifications WD 2.0 of Augmented Reality Application Format 9 Nodes for Image/Video 2 Nodes for Text and Font 36 Nodes for Graphics 1 Node for Programming Information 13 Nodes for User Interactivity Anchor CylinderSensor DiscSensor InputSensor MediaSensor PlaneSensor PlaneSensor2D ProximitySensor ProximitySensor2D TimeSensor TouchSensor SphereSensor VisibilitySensor
ARAF Specifications WD 2.0 of Augmented Reality App. Format 9 Nodes for Image/Video 2 Nodes for Text and Font 36 Nodes for Graphics 1 Node for Programming Information 13 Nodes for User Interactivity 26 Nodes for Static Scenes ApplicationWindow Background Background2D Billboard Clipper2D Collision DirectionalLight DirectiveSound Fog Group Inline LOD Layer2D Layer3D Layout NavigationInfo OrderedGroup PointLight Shadow SpotLight Transform Transform2D TransformMatrix2D Viewpoint Viewport WorldInfo Switch
Technical Activity WD 2.0 of Augmented Reality Application Format 9 Nodes for Image/Video 2 Nodes for Text and Font 36 Nodes for Graphics 1 Node for Programming Information 13 Nodes for User Interactivity 26 Nodes for Static Scenes 14 Nodes for Dynamic Scenes AnimationStream ColorInterpolator CoordinateInterpolator CoordinateInterpolator2D Conditional NormalInterpolator OrientationInterpolator PathLayout PositionInterpolator PositionInterpolator2D ScalarInterpolator TemporalTransform TemporalGroup Valuator
Technical Activity WD 2.0 of Augmented Reality Application Format 9 Nodes for Image/Video 2 Nodes for Text and Font 36 Nodes for Graphics 1 Node for Programming Information 13 Nodes for User Interactivity 26 Nodes for Static Scenes 14 Nodes for Dynamic Scenes 4 Nodes on Compression and Communication BitWrapper MediaBuffer MediaControl ServerCommand
Technical Activity WD 2.0 of Augmented Reality Application Format Full Profile: 121 Nodes
Technical Activity WD 2.0 of Augmented Reality Application Format MPEG- V Sensor 1 MPEG- V Sensor 2 Sensors and Actuators Based on MPEG-V 6 sensors MPEG- 4 Scene InputSensor 1 InputSensor 2 MPEG- 4 Player Compositor Screen Acceleration Sensor Orientation Sensor Angular Velocity Global Position Sensor Altitude Sensor Camera Sensor MPEG- V Sensor 3 InputSensor 3 MPEG- 4 Player hw://camera/back Camera Camera Input Stream RAW Decoder Compositor Screen
Technical Activity WD 2.0 of Augmented Reality Application Format Sensors and Actuators Media Compression Media Type Compression tool name Reference standard Image JPEG ISO/IEC 10918 JPEG2000 ISO/IEC 15444 Video Visual ISO/IEC 14496-2 Advanced Video Coding (AVC) ISO/IEC 14496-10 Audio MP3 ISO/IEC-11172-3 Advanced Audio Coding (AAC) ISO/IEC 14496-3 3D Graphics Scalable Complexity Mesh Coding ISO/IEC 14496-16 Bone-based Animation ISO/IEC 14496-16 Scenes BIFS ISO/IEC 14496-11