IMMERSIVE VIRTUAL REALITY SCENES USING RADIANCE

Transcription

1 IMMERSIVE VIRTUAL REALITY SCENES USING RADIANCE COMPARISON OF REAL AND VIRTUAL ENVIRONMENTS KYNTHIA CHAMILOTHORI RADIANCE INTERNATIONAL WORKSHOP 2016 Prof. Marilyne Andersen thesis director Dr.-Ing. Jan Wienold thesis co-director

2 IMMERSIVE VIRTUAL REALITY SCENES USING RADIANCE 2 INTRODUCTION

3 VARIATION OF DAYLIGHT MOTIVATION: KYNTHIA S DOCTORAL RESEARCH 3 subjective experiments VARIATION OF VIEW Which pattern factors (if any) lead to changes in the perceived spatial ambience?

4 MOTIVATION: KYNTHIA S DOCTORAL RESEARCH 4 challenges in real space experiments change of façade pattern variation of luminous conditions 2D rendering? limited luminance range lacking immersion [Cauwerts, ] problematic for evaluation of pleasantness 1 distribution of light 1

5 MOTIVATION: KYNTHIA S DOCTORAL RESEARCH 5 Oculus Rift Virtual Reality Headset

6 MOTIVATION: KYNTHIA S DOCTORAL RESEARCH 6 feasibility study virtual space experiments statistical model real space experiments

7 MOTIVATION: KYNTHIA S DOCTORAL RESEARCH 7 feasibility study virtual space experiments statistical model real space experiments

8 FEASIBILITY STUDY: GENERATION OF VIRTUAL SCENES 8 Immersive virtual representation of the DEMONA test room meeting space office space DEMONA test room, EPFL 3D model of the test room viewpoint set in the center of the room

9 FEASIBILITY STUDY: GENERATION OF VIRTUAL SCENES 9 Immersive virtual representation of the DEMONA test room meeting space office space

10 FEASIBILITY STUDY: GENERATION OF VIRTUAL SCENES 10 meeting space Rendering pairs: one image for each eye

11 FEASIBILITY STUDY: GENERATION OF VIRTUAL SCENES 11 meeting space office space real virtual

12 IMMERSIVE VIRTUAL REALITY SCENES USING RADIANCE 12 EXPERIMENTAL RESULTS

13 FEASIBILITY STUDY: REALVERSUS VIRTUAL SPACE 13 9:30 10:30 11:30 12:30 13:30 14:30 15:30 10 immersive virtual scenes 7 with clear sky 3 with overcast sky hourly time steps from 9:30-15:30 different view out conditions presented according to similarity with conditions in real space limited similarity due to time constraints

14 FEASIBILITY STUDY: REALVERSUS VIRTUAL SPACE 14 subject exploring the virtual space subject exploring the real space ambience questionnaire for each space physical symptoms before and after the session perceived presence in the virtual environment

15 RESULTS: EVALUATION OF REAL VERSUS VIRTUAL SPACE 15 How pleasant do you find this space? scatter plot mark text = frequency of responses (%) office space N subjects Percentage of pairs with absolute difference (%) and 1 pleasant interesting complex exciting satisfied with amount of view

16 RESULTS: EVALUATION OF REAL VERSUS VIRTUAL SPACE 16 How interesting do you find this space? scatter plot mark text = frequency of responses (%) office space N subjects Percentage of pairs with absolute difference (%) and 1 pleasant interesting complex exciting satisfied with amount of view

17 RESULTS: EVALUATION OF REAL VERSUS VIRTUAL SPACE 17 How complex do you find this space? scatter plot mark text = frequency of responses (%) office space N subjects Percentage of pairs with absolute difference (%) and 1 pleasant interesting complex exciting satisfied with amount of view

18 RESULTS: EVALUATION OF REAL VERSUS VIRTUAL SPACE 18 How exciting do you find this space? scatter plot mark text = frequency of responses (%) office space N subjects Percentage of pairs with absolute difference (%) and 1 pleasant interesting complex exciting satisfied with amount of view

19 RESULTS: EVALUATION OF REAL VERSUS VIRTUAL SPACE 19 How satisfied are you with the amount of view in this space? scatter plot mark text = frequency of responses (%) N subjects Percentage of pairs with absolute difference (%) and 1 pleasant interesting complex exciting satisfied with amount of view

20 RESULTS: EVALUATION OF REAL VERSUS VIRTUAL SPACE 20 marked attributes: adequate perceptual accuracy in the virtual space N subjects Percentage of pairs with absolute difference (%) and 1 pleasant interesting complex exciting satisfied with amount of view

21 RESULTS: PHYSICAL SYMPTOMS BEFORE AND AFTER THE USE OF VR 21 How fatigued do you feel? scatter plot mark text = frequency of responses (%) N subjects Percentage of pairs with absolute difference (%) and 1 fatigue clear vision fresh head sore eyes

22 RESULTS: PHYSICAL SYMPTOMS BEFORE AND AFTER THE USE OF VR 22 How clear is your vision? scatter plot mark text = frequency of responses (%) N subjects Percentage of pairs with absolute difference (%) and 1 fatigue clear vision fresh head sore eyes

23 RESULTS: PHYSICAL SYMPTOMS BEFORE AND AFTER THE USE OF VR 23 How fresh is your head? scatter plot mark text = frequency of responses (%) N subjects Percentage of pairs with absolute difference (%) and 1 fatigue clear vision fresh head sore eyes

24 RESULTS: PHYSICAL SYMPTOMS BEFORE AND AFTER THE USE OF VR 24 How sore are your eyes? scatter plot mark text = frequency of responses (%) N subjects Percentage of pairs with absolute difference (%) and 1 fatigue clear vision fresh head sore eyes

25 RESULTS: EVALUATION OF REAL VERSUS VIRTUAL SPACE 25 marked attributes: negligible physical symptoms after the use of the VR headset Questionnaire based on Shibata et al., N subjects Percentage of pairs with absolute difference (%) and 1 fatigue clear vision fresh head sore eyes

26 RESULTS: PRECEIVED the real space?* PRESENCE IN THE VIRTUAL SPACE [PR1] [PR2] How much did you feel like "being there" in How much did you feel like Very the virtual in much space the virtual space? How much didpr3 virtual space become the reality for you? [PR3] How much did your experience in the VR Somewhat space seemed consistent with your experience in the real space? PR2 Moderately "being there" in the virtual space How much did you feel like "being there" in Very the virtual much space became the reality for you?* How much did virtual space became the reality for you?* How much did your experience in the virtual space seemed consistent with your experience in nce in the virtual space seemed consistent with your experience in Not at all Slightly Somewhat Moderately Very much PR1 PR3 Questionnaire based on Witmer and Singer, How much did you feel like "being there" in the virtual space How much did virtual space became the reality for you?* How much did your experience in the virtual space seemed consistent with your experience in Not at all Slightly Somewhat Moderately How much did you feel like "being there" in the virtual space How much did virtual space became the reality for you?* How much did your experience in the virtual space seemed consistent with your experience in the real space?* Not at all Slightly the real PR1 PR3 space?* Not at all Slightly Somewhat PR2 Percentage Moderately of responses Very much PR2 Percentage of responses 26 INTRODUCTION PR1 WORKFLOW EXPERIMENTAL RESULTS

27 IMMERSIVE VIRTUAL REALITY SCENES USING RADIANCE 27 ONGOING & FUTURE WORK

28 ONGOING AND FUTURE WORK Immersive hemispherical scene from HDR photograph immersive hemisphere 180 fisheye image with a SIGMA 4.5mm F2.8 lens cube mapping using pinterp (monoscopic projection)

29 ONGOING AND FUTURE WORK adequacy of tonemapping algorithms in immersive virtual environments perceptual accuracy of device (Oculus Rift CV1) in photographic immersive scenes 180 fisheye HDR with a SIGMA 4.5mm F2.8 lens

30 ONGOING AND FUTURE WORK 30 improvement of perceptual accuracy of the virtual scene VR immersion in architectural spaces tone-mapping algorithm, new VR headset, scene details & view out upcoming experiment with Siobhan Rockcastle

31 31 Thank you!