Reality & Imagination. Performing Arts and Innovative Technologies

Transcription

1 Reality & Imagination Performing Arts and Innovative Technologies Alexander Eichhorn // Simula Research Laboratory // October 2009

2 About... The Presenter PostDoc at Simula Research Laboratory since 2008 Project Manager Verdione and Perceval Diploma and PhD from Ilmenau Technical University, Germany Background in Media Technology, Networks and Operating Systems The Talk Technological Innovations for Performing Arts (mainly focusing on visual sensations) Part I - A brief history of technology for performing arts Part II - A glance into research Labs (challenges and technologies of tomorrow) 2

3 Main Topic Mixed Reality in Performing Arts Mixed Reality refers to merging of real and virtual worlds to produce new environments and visualisations where physical and digital objects co-exist and interact in real time Natural vs. Artificial Digital Content merging natural images into virtual worlds merging artificial images into physical reality merging natural images into physical reality Actors, Spectators and Space shared space and shared experience pure digital (virtual) space (e.g. Second Life) real space (e.g. an Opera or Theatre Stage) 3

4 History Castellum Umbrarum, 1420 Castle of Shadows the first virtual reality environment (CAVE) designed by the venetian engineer Giovanni Fontana a room with walls composed of folded translucent parchments lighted from behind magic lantern to project life-size images of devils or beasts 4

5 History Pepper s Ghost, 1862 Pepper s Ghost Illusion first seen in 1862 production of Charles Dickens s Haunted Man at the Royal Polytechnic Institution in London created by placing an angled piece of plate glass between audience and actors allowing off-stage objects or people to appear as if they were onstage although they are reflected on the glass 5

6 History Concerts over Telephone, 1864 Elisha Gray's transmission of "familiar melodies" over telegraph wire first public demonstration on December 29, 1874 a London company offered multiple headsets for connecting telephone subscribers to theatres, concerts and church services, but this service was never widely accepted telephone was later optimised for maximum calls per line 6

7 History Pepsi Pavillion at World Expo, 1970 Pepsi Cola Pavillion at Osaka World Expo 70 first interactive multimedia arts installation designed by Experiments in Architecture and Technology (EAT), an intermedia artist group Visual sounds were produced with coloured lasers and electronic music by composer Lowell Cross visitors could pick up audio signals with audio handsets and create threedimensional images of themselves 7

8 History Pepsi Pavillion at World Expo,

9 History Satellite Arts Project, 1977 A performance space with no geographical boundaries first two-way remote and interactive performance by Kit Galloway and Sherrie Rabinowitz demonstrate that several performing artists could appear and perform together although separated by oceans and geography using satellite transmission over long distance networks performed a number of tele-collaborative dance and music scores to determine what genres could be supported and what new genres would emerge 9

10 History Satellite Symphony, 1988 Françoise Legrand: Beethoven s 9 th Symphony and Ode to Joy first live conducted remote choir and orchestra performance choirs in Moscow, Geneva and San Francisco, and the World Philharmonic Orchestra in Montreal performed live before a television audience over 2-way satellite links 10

11 History Grammy Awards,

12 History Grammy Awards, 2006 Gorillaz & Madonna at 2006 Grammy Awards first 1 large-scale mixed reality show both live and TV audiences Gorillaz is a pure virtual band created in 1998 by Damon Albarn (Blur) the first part of Madonna s performance was virtual, De La Soul were in fact real De La Soul (real) in front of Gorillaz (virtual) De La Soul (real) next to of Gorillaz (virtual) Madonna (virtual) behind Murdoc (virtual) 1 for the manufacturer of the system (Eyeliner) 12

13 History Diesel Liquid Space Show,

14 History 3LD Loosing Something, Legged Dog, NY, Mixed Reality Performance Loosing Something, 2006 Loosing Something, Behind the Scenes,

15 History 3LD Loosing Something,

16 Behind the Scenes Holographic Illusions on Stage Modern Technology using Holographic Film, 2006 Old-School Pepper s Ghost using Glass,

17 Behind the Scenes Holographic Illusions in Movies George Lucas Star Wars: Episode IV - A new Hope 1977 Joss Whedon Serenity

18 A Glance into Research Labs Performing Music over the Internet McGill University Interactive Cross-Continental Jazz, 2002 McGill University Distributed Violin Duet,

19 A Glance into Research Labs Dancing with Yourself, 2007 University of Illinois at Urbana Champaign Teeve Project,

20 A Glance into Research Labs 360 Volumetric Display 20

21 A Glance into Research Labs The World Opera, 2009 Distributed Duet between Denmark and New York World Opera Symposium Struer DK, 2009 First Display Technology Experiments World Opera Labs at Bang & Olufsen Struer DK,

22 A Glance into Research Labs The World Opera, 2009 Niels Muus (World Opera Conductor) during a Test Session at McGill University,

23 A Glance into Research Labs Challenges for Mixed Reality on Stages Delay influences Interactivity conductor cues and audio-feedback to the conductor two-way delay between singers and musicians Perceptual Limits dictate Audiovisual Fidelity natural experience demands sufficient resolution and color brilliance difficult light and shadow conditions challenge recording technology size of stages and occlusions challenge camera handling Comfort and Artistic Expressiveness opera singers need eye contact to synchronise size, transparency and viewing angle of displays dictate their placement artists need easy-to-use and flexible tools that support creativity 23

24 A Glance into Research Labs The Perceval Project Facts Verdikt Program, Jul 09 Dec 12, 3 PhD students, 9M NKr 4 Norwegian partners (Simula, NTNU/Q2S, Nofima Mat AS, UiO Psychology), 3 external collaborators (Bang&Olufsen, TU Ilmenau, Tampere University) website: Objectives extend existing audiovisual quality assessment methods with a focus on multi-modal, robust and human-centered methods and statistical scales considering cognitive and affective factors, and bio-signals low attention and long-term assessment (for entire movies and opera performances) 24

25 A Glance into Research Labs The Verdione Project Facts Verdikt Program (StorIKT), Jul 08 Jun 12, 7 PhD students, 2 PostDocs, 24M NKr 5 Norwegian partners (Simula, UiO, UiT, Telenor, Lividi) website: Objectives high-quality 3D volumetric video capturing and embedded video displays for opera stages user-centric interface design for artists and stage engineers resilient networking and dependable services to achieve the desired reliability for artists ultra-low latency operation and synchronous playout control 25

26 Final Words Artistic performances are about imagination, not technological candy Thank your for the attention. I m happy to answer your questions now. 26