La réalité augmentée sans lunettes : projections, incrustations, holographie

Transcription

1 La réalité augmentée sans lunettes : projections, incrustations, holographie Prof. T. Dutoit, UMONS ATELIERS DE CRÉATIVITÉ NUMÉRIQUE

2 Tool-oriented research axes Motion Capture Speech & Audio ARtificial Intelligence (Deep nets) MultiMedia Information Retrieval AR/VR Smart Spaces 2

3 Contents AR for the masses «Lowtech» AR : anamorphosis Spatial AR Parallax «Holographics» displays 3D mapping Spatial AR challenges 3

4 What most people think AR is about Pas que écran (IKEA) 4

5 What SOME people think AR is Pas que écran (IKEA) about 5

6 What IS AR about? Strictly speaking The technologies developed for increasing perception by transferring more information and data about the real world we perceive through our senses. More broadly ( MIXED REALITY ) The technologies developed for increasing perception by transferring virtual information and data into the real world we perceive through our senses. What ABOUT AR for the masses? The technologies developed for increasing perception by transferring virtual information and data into the real world we collectively perceive through our senses. 6

7 IS PAINTiNG AR?

8 BUT Anamorphic PAINTiNG can be Giant Slug (Julian Beever, 2013, street art, NYC) 8

9 Anamorphose en pratique BUT Anamorphic PAINTiNG can be 9

10 Anamorphose en pratique BUT Anamorphic PAINTiNG can be 10

11 Holbein's The Ambassadors, 1533 Leonardo da Vinci, ( ) AND SO DOES PAINTING 11

12 ICAVS Project (Labo LIFL, ULille1) Methodsfor assisteddesign of catoptric anamorphoses ONGOING R&D on anamorphosis Prof. F. Decomite anamorphoses/index.html 12

13 DynaMic anamorphosis 13

14 Contents AR for the masses «Lowtech» AR : anamorphosis Spatial AR Parallax augmented virtuality «Holographics» displays 3D mapping Spatial AR challenges 14

15 IS CINEMA AR? VR? 15

16 But interactive IMAGES can be 16

17 CINEMA AS Augmented Virtuality 3D presence from parallax Multiplane camera, Disney studios (1933) 17

18 CINEMA AS Augmented 3D presencefromparallax Virtuality 3D presence from parallax Parallaxe, Patrick Jean & NUMEDIART (2011) 18

19 CINEMA AS Augmented Virtuality 3D projections and 3D screens 19

20 CINEMA AS Augmented Virtuality Autostereoscopic screens 20

21 CINEMA AS Augmented virtuality DeltaCast SA Augmented replay sequences 21

22 CINEMA AS Augmented virtuality KeyallSA Interactive Greenkey 22

23 Contents AR for the masses «Lowtech» AR : anamorphosis Spatial AR Parallax «Holographics» displays 3D mapping Spatial AR challenges 23

24 AR WITH Holographic projections 24

25 AR WITH Holographic projections Hatsune Miku(2007 ) 25

26 AR WITH Semi-Transparent screens (OLED screens, CES 2016) 26

27 Contents AR for the masses «Lowtech» AR : anamorphosis Spatial AR Parallax «Holographics» displays 3D mapping Spatial AR challenges 27

28 3D MAPPING (3D mapping Dirty Monitor Charleroi, WOM) 28

29 3D MAPPING (3D face mapping D. Marleau, 2011) 29

30 3D MAPPING (BattleKart, Dottignies, 2016) But also B71, Manu Di Martino, Alterface SA, etc 30

31 INSIDE-OUT SPATIAL AR (Map-In, First Spinoff project, UMONS, ) Monumental gaming : (collab. DragOnSlide SPRL) 31

32 SPATIAL AR WITH Semi-Transparent WINDOWS (AGC Research, Gosselies, 2016) Ecrans LEDstranslucides pour AR k2 12 Et montrer AGC transparent projective screens 32

33 Contents AR for the masses «Lowtech» AR : anamorphosis Spatial AR Parallax «Holographics» displays 3D mapping Spatial AR challenges 33

34 SPATIAL AR challenges Dynamicspatial AR 34

35 SPATIAL AR challenges Beyond projection Beyond projection : Mass interaction Mass positionning(indoor) Mass tracking(indoor) Mass gesture understanding Augmented Audio Reality 35

36 Beyond projection : Mass interaction Skemmi SA 36

37 Augmented Audio reality AR Audio vs. Audio AR for mixingreal soundsand virtualcontent in real environments e.g. whislingin a virtualbottle, vs. for interacting virtual objects by voice commands Combinedwithcontextualnoise canceling, or audio beamforming(superhumanaudio), cognitive services (personal interpreter) Combined with holographic audio (via inertial sensors) Combined with gaze detection: hearing additional sounds basedon whatyoulook at (languagelearning, audio description for the blind) 37

38 Augmented Audio reality Smart earphones Hearables(BRAGI GMBH) By combining Bragi ssmart earphones The Dash with IBM s Watson IoTplatform, the companies hope to transform the way people interact, communicate and collaborate in the workplace. 38