"Advanced" Multimedia 1 Before HTML 5 Inclusion of MM elements in web pages Deprecated tag <embed> Audio Example: background music <embed src="s.mid" autostart="true" hidden="true"> Video Example: embedded video <embed src="budapest.avi"> The browser must have the proper plugin installed 2 1
A "universal" tag The <object> tag... Any multimedia elements should be included in web pages through the <object> tag Example: inclusion of the image img.png <object data="img.png" type="image/png"> Budapest panorama</object> the <object> tag should also be used for audio and video files, Java applets, Flash animations, ActiveX controls and even web pages (effect similar to frames) not all browsers fully support the <object> tag the value of the classid attribute indicates the "player" or the plugin to be used to play the multimedia file 3 A "universal" tag... the <object> tag Examples audio file: <object classid="clsid:22d6f312-b0f6-11d0-94ab- 0080C74C7E95"> <param name="filename" value="america.mid"> </object> video file: <object classid="clsid:22d6f312-b0f6-11d0-94ab- clsid:22d6f312 11D0 0080C74C7E95"> <param name="filename" value="budapest.avi"> </object> 4 2
A "universal" tag... the <object> tag Example web page: <object data="calgen.html" width="300" height="400"> Sorry, your browser does not support the OBJECT tag </object> 5 3D for the Web VRML VRML = Virtual Reality Markup Language (old) markup language to define "virtual worlds" not XML-based requires specific plugins (e.g. CosmoPlayer) Example of VRML code:... Transform { translation -7 0 0 children DEF THISCONE Shape{ appearance DEF aper Appearance { material Material { diffusecolor 0 1 0 } texture ImageTexture {url "earth.gif"} } geometry Cone { } } }... 6 3
3D for the Web QuickTime VR (QTVR) QTVR = Quick Time Virtual Reality technology created by Apple to build "3D panoramas" from photos (multiple views of the same object) 7 3D for the Web X3D vs. WebGL X3D (http://www.web3d.org/) ISO standard d (XML-based) d)file format for 3D web graphics; is considered the successor of VRML WebGL (www.webgl.org) the likely "winner": JavaScript API for rendering interactive 2D and 3D graphics within any compatible web browser without the need for a plugin (uses the HTML 5 <canvas> tag ) 8 4
"Automatic" creation of websites Content Management Systems Software that allows the creation and management of web content CMSs support server-side database interaction A dynamic website can be built (almost) without writing HTML, CSS, Javascript, PHP, etc. code Widespread open source CMSs: Wordpress, Drupal, Joomla 9 Not only the Web Offline multimedia (CD/DVD/ CD/DVD/Blu-Ray) Conceptually, there are few differences between online and offline content the various multimedia resources are surfed and accessed through links However, offline multimedia is less "constrained" inclusion of richer content images, animations, videos and audio (almost) without size limits richer interaction ti possibilities hard disk read/write, execution of external applications, use of input devices different from keyboard/mouse/touch (e.g. joystick), 10 5
Tools for offline multimedia Adobe Director One of the most widespread programs for offline content creation (but also suitable for online content) similar to Flash, but a little more complex Shockwave technology also a plugin for web browsers 11 The mobile world Smartphones: Web Apps or Apps? Web app RIA (rich internet application) run in the smartphone's browser App program natively run by the smartphone's processor usually, applications are more powerful and customizable Each smartphone/os has its own language Objective C language Java language C# language 12 6
Beyond reality Virtual reality Reference: http://www-vrl.umich.edu/intro/ Synthesis of an artificial environment simulated through 3D rendering of virtual objects Types of virtual reality non-immersive the virtual environment is well separated from the real environment (e.g. videogames) immersive the user is fully "immersed" in the virtual environment, e.g. through HMDs (Head Mounted Displays), glasses, gloves, etc. 13 Beyond reality virtual reality Examples Virtual driving Smart rooms Virtual environments (with avatars) 14 7
Real + Virtual Augmented Reality Reference: http://www.se.rit.edu/~jrv/research/ar/introduction.html Virtual elements are added to the real world artificial images overlapped with "real images" Problems correct matching between real and virtual objects Main difference compared to virtual reality the user maintains a connection with the real world 15 Real + Virtual augmented reality Tools for augmented reality to acquire information about the real world cameras, microphones for the augmented perception of reality monitors, HMDs, glasses Mixed reality broader concept that takes into account different levels of "reality" or "virtuality" Real world Augmented reality Augmented virtuality Virtual world 16 8
Real + Virtual augmented reality Application areas medical e.g. surgery military e.g. additional information for aircraft pilots production, repair and maintenance of industrial plants e.g. virtual view of internal components television/advertising e.g. chroma key furnishings, hairdressing, plastic surgery e.g. room with virtual furniture mobile applications for smartphones e.g. Wikitude, Layar, 17 Being "elsewhere" Telepresence Reference: http://graphics.stanford.edu/~bjohanso/telepresence/ bj-telepresence.html Feeling of being in another place in a sense, also virtual reality and augmented reality are forms of telepresence Typical use exploration of inaccessible places by means of remote-controlled mobile robots endowed with cameras and possible other sensors 18 9
Being "elsewhere" telepresence Possible classification of "kinds of telepresence" as a broader concept Full Interactivity Viewing Interactivity Passive Viewing Single User Multi-user Single User Multi-user Single User Multi-user Virtual Reality 3-D Games 3-D Network Games, 3-D Chat Rooms Virtual Museum Virtual Plays Video tours of virtual locations Broadcast VR, ie. "Toy Story" Augmented Reality Remote Exploration/ Surgery with HUD Tele- Cubicles 3-D City Model with supplemental HUD Data 3-D Television with Embedded Objects/ Information Off-line Distance Learning Live Distance Learning Reality Remote Exploration/ Surgery Robot Sports 3-D City Model 3-D Television, Panoramic Movies Video Tourism Most Modern Television 19 10