Convergence Real-Virtual thanks to Optics Computer Sciences

Transcription

1 Convergence Real-Virtual thanks to Optics Computer Sciences Xavier Granier To cite this version: Xavier Granier. Convergence Real-Virtual thanks to Optics Computer Sciences. 4th Sino-French Symposium on Virtual Reality, Aug 2015, Xi an, China <hal > HAL Id: hal Submitted on 28 Oct 2016 HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d enseignement et de recherche français ou étrangers, des laboratoires publics ou privés. Distributed under a Creative Commons Attribution - NonCommercial 4.0 International License

2 Convergence Real-Virtual thanks to Optics & Computer Sciences Xavier Granier Sino-French Symposium

3 Spatial Augmented Reality [Ridel Reuter Granier] Sino-French Symposium

4 Convergence between real & virtual [Ridel Reuter Granier 2014] Sino-French Symposium

5 Convergence between real & virtual Columbia University 2008 Sino-French Symposium

6 A unique representation in a hybrid systems Cossairt SIGGRAPH 2008 Sino-French Symposium

7 Convergence Real-Virtual A global but specialized view of light interactions Real World: Physics and Optics laws Sensors characteristics (physical & human) Virtual World: models & algorithms Real World Light Interactions Optics Virtual World Digital Acquire / Model Render / Display Sino-French Symposium

8 Convergence Real-Virtual A global but specialized view of light interactions Real World: Physics and Optics laws Sensors characteristics (physical & human) Virtual World: models & algorithms Real World Light Interactions Optics Virtual World Digital Shortened distance Acquire / Model Render / Display Sino-French Symposium

9 MANAO team-project: a bridge Axe IV: Computational Optics & Mixed Reality LP2N LaBRI Team: Image & Sound Group: Acquisition & Visualization Sino-French Symposium

10 玛瑙科研组在哪里? 法 国 9

11 Convergence Optics & Computers 4 Challenges 1. Simulation 2. Tools for design & Co-design 3. Hybrid systems 4. Certifications Systems, tools Simulations Sino-French Symposium

12 Interactive simulation of transfers ) n L( p o )=Le ( p o )+ Ω ρ( ω p o ω L( ω p )d ω L ( u, v, s, t ) = ij I ij ( s, t ) cosd φ ϕ ij ( u, v ) 2 2 [Lu Pacanowski Granier 2015] Sino-French Symposium

13 Conception : BRDF orientation field Theoretical analysis Optimization BRDF orientiation field Orientation field Highlight tangent field To obtain highligths [Raymond Barla Guennebaud Pacanowski Granier 2014] Sino-French Symposium

14 Co-Design High-dimensional Imaging analysis High-D images captur e display Computer Vision esis h t syn Computer Graphics Dolby Inc. Optics Sino-French Symposium

15 Light-Field Acquisition Lytro 14

16 Light-Field Acquisition Microlenses Array SIGGRAPH 2005 & TR : Ng, Levoy, Brédif, Duval, Horowitz & Hanrahan Sino-French Symposium

17 Co-design: Plenoptique Imaging [Manakov Retrepo Ihrke 2013] Sino-French Symposium

18 Generalized plenoptic imaging Many copies of the same view HDR Spectral Imaging. Many view-points Light-Field... L( x, y, z, l, λ, ψ,t ) 17

19 How to make many copies Directly a diffuser 18

20 How to make many copies and after a reflection 19

21 How to make many copies and another one 20

22 How to make many copies Many virtual copies of the diffuser 21

23 Application 1: HDR Imaging Neutral Density Filters 22

24 Application 1: HDR Imaging 23

25 Application 2: Spectral Imaging 24

26 Application 2: Spectral Imaging 25

27 Imagerie plénoptique généralisée Many copies of the same view HDR Spectral Imaging. Many view-points Light-Field... L( x, y, z, l, λ, ψ,t ) 26

28 How to make many viewpoints Remove the diffuser 27

29 How to make many viewpoints Direct view point 28

30 How to make many viewpoints and after a reflection 29

31 How to make many viewpoints and another one 30

32 How to make many viewpoints Virtual view points 31

33 Resulting Image 32

34 Application 3: Light field 33

35 Reconfigurable Plenoptic Camera Camera Filters Kaleidoscope DiffuserLens 34

36 COEL : Computational Optical Experimentation Lab Experimentation plateform Protyping hybrid systems Optical and mecanical components Controlable lighting Computer resources Common effort Optic (LP2N) Computer Science (Inria) Sino-French Symposium

37 Software ecosystem Eigen Linear Algebra & Optimization Award Symposium on Geometry Processing 2013 High-quality Software in geometry processing PFStools HDR Imaging & Manipulation ALTA Patate Analyze, fit, understand BRDFs Our Computer Graphics results HDRsee HDR GPU-visualization For companies & academies Historical : Eigen, PFSTools, HDRsee Recents : ALTA, Patate Sino-French Symposium

38 Certification ALTA library Open-source C++ Library Models comparisons (fitting) Data analysis Plugins Easy to extend Connections (BRDF Explorer) Scripting Alpha version Open Data format (MERL, ASTM) Non-linear approximation Rational functions Analytic BRDFs Moment analysis erg b n ve Le ard u q r Ma t T CUre L MER Lafortune Ward [Pacanowski Guennebaud Barla 2014] 3737 Sino-French Symposium 2015

39 Conclusion Convergence of Virtual Real Worlds From Acquisition to Display Need of hybrid tools: Optics + Computer sciences Challenges 1. Simulation 2. Tools for design & Co-desig 3. Hybrid systems 4. Certifications Sino-French Symposium