1 Virtual Reality NBAY 6120 April 4, 2016 Donald P. Greenberg Lecture 9
2 Virtual Reality A term used to describe a digitally-generated environment which can simulate the perception of PRESENCE. Note that within the context of this course, I refer to VR as containing 3D data as contrasted to just creating a digital copy of information obtained from a film or digital camera.
3 Virtual Reality A person immersed within this virtual world can manipulate objects, interact with the environment, and explore the virtual world in the same perceptual way as one interacts with the physical world.
4 Why is VR different than other modes of watching images and video?
5 Human in the Loop Abstract Interpretation Viewing a Picture on Television Cinema Viewing Presence
10 Current and Recent Business Investments
11 Facebook Buys Oculus Rift
12 Why did Facebook invest $2 billion in Oculus Rift?
13 Microsoft s Minecraft
14 Microsoft s Hololens
15 Microsoft s Hololens 3/30/16
16 Why did Microsoft buy Minecraft? Why is Microsoft building its Hololens?
17 Magic Leap 2015
18 Google Why is Google (and Andressen / Horwitz) investing $500+ million in Magic Leap?
19 Virtual Reality What is necessary to make virtual reality a reality?
20 Virtual Reality Virtual Reality is not new The amount of financing which has been made available Costs have been sufficiently lowered to bring to the masses
21 Ivan Sutherland s HMD 1968
22 Head-mounted Displays 1990s Henry Fuchs, University of North Carolina
23 Oculus Rift 2016 Not Yet Available
24 HTC and Valve s SteamVR Vive 2016 Available Tomorrow
25 HTC and Valve s Tower and Hands
26 Minecraft and Netflix for VR 9/24/15 John Carmack announces deal for bringing both Minecraft (MSFT) and Netflix to both Gear VR and Oculus VR. Minecraft was bought by MSFT for $2.5B, and Netflix is responsible for 37% of internet traffic.
28 Google s Cardboard
29 Samsung s Cell Phones
30 How Do Virtual Reality Goggles Work Today?
31 Distorted Images
32 Jean-Francois Niceron. Thaumaturgus opticus (Rome, 1646), illus. 25. The projection of a screen or grid in anamorphic perspective makes the transfer of a representation possible. Fred Leeman. Hidden Images, 1975, Verlag M. DuMont Schauberg,
33 Erhard Schon. Picture puzzle: Out, You Old Fool c Fred Leeman. Hidden Images, 1975, Harry N. Abrams. Fred Leeman. Hidden Images, 1975, Verlag M. DuMont Schauberg,
34 Hans Holbein The Ambassadors Google Art Project:
35 Opera Lighting Siggraph 1991 Dorsey, Sillion and Greenberg
36 Opera Lighting Siggraph 1991 Dorsey, Sillion and Greenberg
37 Opera Lighting Siggraph 1991 Dorsey, Sillion and Greenberg
38 Opera Lighting Siggraph 1991 Dorsey, Sillion and Greenberg
49 Requirements for PRESENCE Need to be able to see (understand) correct DEPTH information Need to have significant RESOLUTION to merge virtual and real imagery Need to render images that are physically accurate and perceptually indistinguishable from real world scenes and all of this must be done fast enough to imply motion
50 Depth Perception from 2-D Images Monoscopic Stereoscopic
53 Monoscopic Depth Cues Perspective Depth from Motion, Relative Size, Position, Familiarity Occlusion Texture Gradient Parallax from Motion Shadows and Specular Highlights Atmospheric Blur
54 Monoscopic Depth Cues Perspective Depth from Motion, Relative Size, Position, Familiarity Occlusion Texture Gradient Parallax from Motion Shadows and Specular Highlights Atmospheric Blur
55 Monoscopic Depth Cues Perspective Depth from Motion, Relative Size, Position, Familiarity Occlusion Texture Gradient Parallax from Motion Shadows and Specular Highlights Atmospheric Blur
56 Monoscopic Depth Cues Perspective Depth from Motion, Relative Size, Position, Familiarity Occlusion Texture Gradient Parallax from Motion Shadows and Specular Highlights Atmospheric Blur
57 Monoscopic Depth Cues Perspective Depth from Motion, Relative Size, Position, Familiarity Occlusion Texture Gradient Parallax from Motion Shading, Shadows, and Specular Highlights Atmospheric Blur Viewpoint A Viewpoint B Viewpoint C
58 Monoscopic Depth Cues Perspective Depth from Motion, Relative Size, Position, Familiarity Occlusion Texture Gradient Parallax from Motion Shading, Shadows, and Specular Highlights Atmospheric Blur
59 Monoscopic Depth Cues Perspective Depth from Motion, Relative Size, Position, Familiarity Occlusion Texture Gradient Parallax from Motion Shading, Shadows, and Specular Highlights Atmospheric Blur
60 Monoscopic Depth Cues Perspective Depth from Motion, Relative Size, Position, Familiarity Occlusion Texture Gradient Parallax from Motion Shadows and Specular Highlights Atmospheric Blur
61 Monoscopic Depth Cues Perspective Depth from Motion, Relative Size, Position, Familiarity Occlusion Texture Gradient Parallax from Motion Shadows and Specular Highlights Atmospheric Blur Accommodation Note change in lens shape
62 Accommodation This is the process by which the vertebrate eye changes optical power to maintain a clear image or focus on an object as its distance varies.
63 Accommodation The reflex can be controlled but cannot be felt Accommodation amplitude declines with age
65 Stereoscopic Vision: Behind The Screen (Concave) Apparent Image Depth Screen / Image Plane L R L R
66 Stereoscopic Vision: In Front Of The Screen (Convex) Apparent Image Depth Screen / Image Plane L R L R
67 Stereoscopic Vision: At The Screen Apparent Image Depth Screen / Image Plane L R L R
68 Vergence The simultaneous movement of the pupils of the eyes toward or away from one another during focusing. This measure of the convergence or divergence of a pair of light rays is defined as vergence.
69 Diagram of Vergence
70 Vergence Accommodation Conflict Computer and projection displays present images on a single surface but have a focal distance (blur on the retina) which may be in front of or behind the screen The inability to fuse the binocular stimuli causes discomfort and fatigue to the viewer Viewers can be trained, and the discomfort can diminish with practice David M. Hoffman, Ahna R. Girschick, Kurt Akeley, Martin S. Banks. Vergence-accommodation conflicts hinder visual performance and cause visual fatigue, Journal of Vision, vol. 8, no. 3, article 33, March 28, 2008.
Virtual Reality Lecture #11 NBA 6120 Donald P. Greenberg September 30, 2015 Virtual Reality What is Virtual Reality? Virtual Reality A term used to describe a computer generated environment which can simulate
an engineering-focused introduction to! The Human Visual System! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 2! Gordon Wetzstein! Stanford University! nautilus eye,
Depth and Space Perception Regan Mandryk Disclaimer Many of these slides include animated gifs or movies that may not be viewed on your computer system. They should run on the latest downloads of Quick
3D Space Perception (aka Depth Perception) 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information is available to support this process? Interaction
Perception of 3D Structure Depth perception is crucially important for everyday activities Getting out of bed in the morning Reaching for nearby objects (such as the alarm clock) Pouring coffee into your
The Impact of Dynamic Convergence on the Human Visual System in Head Mounted Displays by Ryan Sumner A thesis submitted to the Victoria University of Wellington in partial fulfilment of the requirements
Color Deficiency ( Color Blindness ) Monochromat - person who needs only one wavelength to match any color Dichromat - person who needs only two wavelengths to match any color Anomalous trichromat - needs
CSC Stereography Course 101... 3 I. What is Stereoscopic Photography?... 3 A. Binocular Vision... 3 1. Depth perception due to stereopsis... 3 2. Concept was understood hundreds of years ago... 3 3. Stereo
VR based HCI Techniques & Application November 29, 2002 firstname.lastname@example.org What is Virtual Reality? Coates (1992): Virtual Reality is electronic simulations of environments experienced via head mounted
Market Snapshot: Consumer Strategies and Use Cases for Virtual and Augmented A Parks Associates Snapshot Virtual Snapshot Companies in connected CE and the entertainment IoT space are watching the emergence
Mobile Virtual Reality what is that and how it works? Alexey Rybakov, Senior Engineer, Technical Evangelist at DataArt email@example.com Agenda 1. XR/AR/MR/MR/VR/MVR? 2. Mobile Hardware 3. SDK/Tools/Development
1 PHYS:1200 LECTURE 31 LIGHT AND OPTICS (3) In lecture 30, we applied the law of reflection to understand how images are formed using plane and curved mirrors. In this lecture we will use the law of refraction
CSC 170 Introduction to Computers and Their Applications Lecture #3 Digital Graphics and Video Basics Bitmap Basics As digital devices gained the ability to display images, two types of computer graphics
in aviation training Aaron Snoswell, Boeing Research & Technology Australia Valve, - SteamVR featuring the HTC Vive 2 Paradigm Shift Step Change A step-change in digital content from abstractions to immersion
Geog183: Cartographic Design and Geovisualization Spring Quarter 2018 Lecture 2: The human vision system Bottom line Use GIS or other mapping software to create map form, layout and to handle data Pass
Campus Space Planning for VR/AR 2017 TECH EXCHANGE Chris M. Collins @fleep UC SIM Center for Simulations & Virtual Environments Research UCIT Research & Development Division of Innovation & Partnerships
Sky Italia & Immersive Media Experience Age Geneve - Jan18th, 2017 Sky Italia Sky Italia, established on July 31st, 2003, has a 4.76-million-subscriber base. It is part of Sky plc, Europe s leading entertainment
59 JSL, Volume 2 (2006), 59 69 Simple Figures and Perceptions in Depth (2): Stereo Capture Kazuo OHYA Following previous paper the purpose of this paper is to collect and publish some useful simple stimuli
Use with Text Pages 558 563 The Optics of Mirrors Use the terms in the list below to fill in the blanks in the paragraphs about mirrors. reversed smooth eyes concave focal smaller reflect behind ray convex
Hello Doctor! If you re reading this, the person who gave it to you is one of over 11,000 people who visited our website looking for a provider of Vivid Vision - Vision Therapy in Virtual Reality. They
A Guide to Virtual Reality for Social Good in the Classroom Welcome to the future, or the beginning of a future where many things are possible. Virtual Reality (VR) is a new tool that is being researched
Linear Magnification (m) This is the factor by which the size of the object has been magnified by the lens in a direction which is perpendicular to the axis of the lens. Linear magnification can be calculated
Module 2 Lecture-1 Understanding basic principles of perception including depth and its representation. Initially let us take the reference of Gestalt law in order to have an understanding of the basic
L 32 Light and Optics  Measurements of the speed of light The bending of light refraction Total internal reflection Dispersion Dispersion Rainbows Atmospheric scattering Blue sky and red sunsets Mirrors
REVIT PURE PRESENTS PAMPHLETS ISSUE #6 / FALL 2017 VIRTUAL REALITY revitpure.com Copyright 2017 - BIM Pure productions WHAT IS THIS PAMPHLET? Revit Pure Pamphlets are published 4 times a year by email.
Final Reg Optics Review 1) How far are you from your image when you stand 0.75 m in front of a vertical plane mirror? 1) 2) A object is 12 cm in front of a concave mirror, and the image is 3.0 cm in front
Topic 4: Lenses and Vision Lens a curved transparent material through which light passes (transmit) Ex) glass, plastic Double Concave Lenses Are thinner and flatter in the middle than around the edges.
https://doi.org/10.2352/issn.2470-1173.2017.5.sd&a-376 2017, Society for Imaging Science and Technology Analysis of retinal images for retinal projection type super multiview 3D head-mounted display Takashi
Oculus Rift Best Practices 2 Introduction Copyrights and Trademarks 2015 Oculus VR, LLC. All Rights Reserved. OCULUS VR, OCULUS, and RIFT are trademarks of Oculus VR, LLC. (C) Oculus VR, LLC. All rights
Oculus Best Practices Version 310-30000-02 2 Introduction Best Practices Copyrights and Trademarks 2017 Oculus VR, LLC. All Rights Reserved. OCULUS VR, OCULUS, and RIFT are trademarks of Oculus VR, LLC.
PERCEPTUAL INSIGHTS INTO FOVEATED VIRTUAL REALITY Anjul Patney Senior Research Scientist INTRODUCTION Virtual reality is an exciting challenging workload for computer graphics Most VR pixels are peripheral
1:1 Scale Perception in Virtual and Augmented Reality Emmanuelle Combe Laboratoire Psychologie de la Perception Paris Descartes University & CNRS Paris, France firstname.lastname@example.org email@example.com
Exam Name MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. 1) A plane mirror is placed on the level bottom of a swimming pool that holds water (n =
Chapter 36 Image Formation Real and Virtual Images Real images can be displayed on screens Virtual Images can not be displayed onto screens. Focal Length& Radius of Curvature When the object is very far
VR/AR Concepts in Architecture And Available Tools Peter Kán Interactive Media Systems Group Institute of Software Technology and Interactive Systems TU Wien Outline 1. What can you do with virtual reality
Today Pattern Recognition Intro Psychology Georgia Tech Instructor: Dr. Bruce Walker Turning features into things Patterns Constancy Depth Illusions Introduction We have focused on the detection of features
Assignment 5: Virtual Reality Design Version 1.0 Visual Imaging in the Electronic Age Assigned: Thursday, Nov. 9, 2017 Due: Friday, December 1 November 9, 2017 Abstract Virtual reality has rapidly emerged
Physics Approximate Timeline Students are expected to keep up with class work when absent. CHAPTER 18 REFRACTION & LENSES Day Plans for the day Assignments for the day 1 18.1 Refraction of Light o Snell
2 Outline of Ultra-Realistic Communication Research NICT is conducting research on Ultra-realistic communication since April in 2006. In this research, we are aiming at creating natural and realistic communication
BIM & Emerging Technologies Disrupting Design process & Construction Introduction Introduction - BIM Disrupting the Construction Introduction Design Major disruption already in various parts of the World
University of Wollongong Research Online Faculty of Health and Behavioural Sciences - Papers (Archive) Faculty of Science, Medicine and Health 2009 Psychophysics of night vision device halo Robert S Allison
The Hologram in My Hand: How Effective is Interactive Exploration of 3D Visualizations in Immersive Tangible Augmented Reality? Benjamin Bach, Ronell Sicat, Johanna Beyer, Maxime Cordeil, Hanspeter Pfister
Lenses Sandy Skoglund 2 Converging and Diverging s AIR Converging If the surface is convex, it is a converging surface in the sense that the parallel rays bend toward each other after passing through the
Thinking About Psychology: The Science of Mind and Behavior 2e Charles T. Blair-Broeker Randal M. Ernst Sensation and Perception Chapter Module 9 Perception Perception While sensation is the process by
Refraction is the bending of the path of a light wave as it passes from one material into another material. Refraction occurs at the boundary and is caused by a change in the speed of the light wave upon
E X P E R I M E N T 12 Mirrors and Lenses Produced by the Physics Staff at Collin College Copyright Collin College Physics Department. All Rights Reserved. University Physics II, Exp 12: Mirrors and Lenses
Aims In the activity you will learn more about how we see, how light interacts with materials, and how we see colour. Task 1: Light Use these words to complete the sentences about light: absorb different
arxiv:1710.03889v1 [cs.hc] 11 Oct 2017 Abstract Air Mounted Eyepiece: Design Methods for Aerial Optical Functions of Near-Eye and See-Through Display using Transmissive Mirror Device Yoichi Ochiai 1, 2,
USTGlobal VIRTUAL AND AUGMENTED REALITY Ideas for the Future - Retail Industry UST Global Inc, August 2017 Table of Contents Introduction 3 Focus on Shopping Experience 3 What we can do at UST Global 4
Video formats for VR A new opportunity to increase the content value But what is missing today? MPEG workshop on Immersive media Jan. 18 th 2017 Consumption models have dramatically changed Content offer
Lecture Outline Chapter 27 Physics, 4 th Edition James S. Walker Chapter 27 Optical Instruments Units of Chapter 27 The Human Eye and the Camera Lenses in Combination and Corrective Optics The Magnifying
OCULUS VR, LLC Oculus User Guide Runtime Version 0.4.0 Rev. 1 Date: July 23, 2014 2014 Oculus VR, LLC All rights reserved. Oculus VR, LLC Irvine, CA Except as otherwise permitted by Oculus VR, LLC, this
-1- Towards Quantifying Depth and Size Perception in 3D Virtual Environments Jannick P. Rolland*, Christina A. Burbeck, William Gibson*, and Dan Ariely Departments of *Computer Science, CB 3175, and Psychology,
WAVES: LENSES QUESTIONS LIGHT (2016;1) Tim was looking into a convex mirror ball in his garden. Standing behind a small plant, he noticed that when he looked at the reflection of the plant in the convex
Reverse Perspective Rebecca Achtman & Duje Tadin Basic idea: We see the world in 3-dimensions even though the image projected onto the back of our eye is 2-dimensional. How do we do this? The short answer
Vision Sensation & Perception Part 3 - Vision Visible light is the form of electromagnetic radiation our eyes are designed to detect. However, this is only a narrow band of the range of energy at different
Lecture 19 (Geometric Optics I Plane and Spherical Optics) Physics 262-01 Spring 2018 Douglas Fields Optics -Wikipedia Optics is the branch of physics which involves the behavior and properties of light,
Chapter 34 Geometric Optics Lecture by Dr. Hebin Li Goals of Chapter 34 To see how plane and curved mirrors form images To learn how lenses form images To understand how a simple image system works Reflection
CHAPTER 16 14 SECTION Sound and Light Refraction, Lenses, and Prisms KEY IDEAS As you read this section, keep these questions in mind: What happens to light when it passes from one medium to another? How
Person s Optics Test KEY SSSS 2017-18 Competitors Names: School Name: All questions are worth one point unless otherwise stated. Show ALL WORK or you may not receive credit. Include correct units whenever
Table of Contents Chapter: Sound and Light Section 1: Sound Section 2: Reflection and Refraction of Light Section 3: Mirrors, Lenses, and the Eye Section 4: Light and Color 1 Sound Sound When an object
Sensation and Perception PSY 100: Foundations of Contemporary Psychology Basic Terms Sensation: the activation of receptors in the various sense organs Perception: the method by which the brain takes all
Chapter 23 Mirrors and Lenses Notation for Mirrors and Lenses The object distance is the distance from the object to the mirror or lens Denoted by p The image distance is the distance from the image to
University of Canterbury Augmenting Immersive Cinematic Experience/Scene with User Body Visualization Author: Joshua Yang Chen Supervisor: Dr. Christoph Bartneck Co-supervisor: Dr. Gun Lee Co-supervisor:
1 Refraction of Light Activity: Disappearing coin Place an empty cup on the table and drop a penny in it. Look down into the cup so that you can see the coin. Move back away from the cup slowly until the
Perception: From Biology to Psychology What do you see? Perception is a process of meaning-making because we attach meanings to sensations. That is exactly what happened in perceiving the Dalmatian Patterns
Physics 228 Lecture 3 Today: Spherical Mirrors Lenses www.physics.rutgers.edu/ugrad/228 a) Santa as he sees himself in a mirrored sphere. b) Santa as he sees himself in a flat mirror after too much eggnog.
Lecture PowerPoint Chapter 25 Physics: Principles with Applications, 6 th edition Giancoli 2005 Pearson Prentice Hall This work is protected by United States copyright laws and is provided solely for the
Chapter 29/30 Refraction and Lenses Refraction Refraction the bending of waves as they pass from one medium into another. Caused by a change in the average speed of light. Analogy A car that drives off
Connecting Plant Simulation with mobile 3D & Virtual Reality Systems e.g. using an Oculus Rift Gottfried Roosen, more3d, phone +49.221.677.8797.5, mail: firstname.lastname@example.org Stefan J. Koch, more3d, phone
David J. Starling Penn State Hazleton PHYS 214 The human eye is a visual system that collects light and forms an image on the retina. The human eye is a visual system that collects light and forms an image
Chapter 23 Mirrors and Lenses Mirrors and Lenses The development of mirrors and lenses aided the progress of science. It led to the microscopes and telescopes. Allowed the study of objects from microbes
Oculus Rift Getting Started Guide Version 1.23 2 Introduction Oculus Rift Copyrights and Trademarks 2017 Oculus VR, LLC. All Rights Reserved. OCULUS VR, OCULUS, and RIFT are trademarks of Oculus VR, LLC.
Announcements 1 st exam (next Thursday): Multiple choice (about 22), short answer and short essay don t list everything you know for the essay questions Book vs. lectures know bold terms for things that
Achieving High Quality Mobile VR Games Roberto Lopez Mendez, Senior Software Engineer Carl Callewaert - Americas Director & Global Leader of Evangelism, Unity Patrick O'Luanaigh CEO, ndreams GDC 2016 Agenda