Virtual Reality Lecture #11 NBA 6120 Donald P. Greenberg September 30, 2015
Virtual Reality What is Virtual Reality?
Virtual Reality A term used to describe a computer generated environment which can simulate the perception of PRESENCE.
Virtual Reality A person immersed within this virtual world can manipulate objects, interact with the environment, and explore the virtual world in the same perceptual way as one interacts with the physical world.
Oculus Rift
Why did Facebook invest $2 billion in Oculus Rift?
Microsoft s Hololens
Microsoft buys Minecraft
Why is Microsoft building its Hololens? Why did it buy Minecraft?
Magic Leap
Google Why is Google (and Andressen / Horwitz) investing $500+ million in Magic Leap?
Oculus Rift DK2
HTC and Valve s SteamVR Vive
HTC and Valve s SteamVR Vive Introduced this month at the Game Developers Conference. This device will be at the high end of the game market with better tracking technology and higher resolution.
Minecraft and Netflix for VR 9/24/15 John Carmack announces deal for bringing both Minecraft (MSFT) and Netflix to both Gear VR and Oculus VR. Minecraft was bought by MSFT for $2.5B, and Netflix is responsible for 37% of internet traffic.
Why is VR different than other modes of watching images and video?
Human in the Loop Abstract Interpretation Viewing a Picture on Television Cinema Viewing Presence
Depth Perception from 2-D Images Monoscopic Stereoscopic
Paris Street, Rainy Day 1877 Caillebotte
Human Depth Perception Depth Perception Oculomotor Visual Binocular Monocular Binocular Monocular Convergence Accommodation Stereopsis Static Cues Motion Parallax Perspective Familiarity, Relative Size Motion, Position Occlusion Texture Gradient Shading, Shadows, Highlights Atmospheric Blur
Monoscopic Depth Cues Perspective Depth from Motion, Relative Size, Position, Familiarity Occlusion Texture Gradient Parallax from Motion Shadows and Specular Highlights Atmospheric Blur Accommodation Note change in lens shape
Accommodation This is the process by which the vertebrate eye changes optical power to maintain a clear image or focus on an object as its distance varies.
Accommodation The reflex can be controlled but cannot be felt Accommodation amplitude declines with age
Vergence The simultaneous movement of the pupils of the eyes toward or away from one another during focusing. This measure of the convergence or divergence of a pair of light rays is defined as vergence.
Diagram of Vergence
Stereoscopic Vision: Behind The Screen (Concave) Apparent Image Depth Screen / Image Plane L R L R
Stereoscopic Vision: In Front Of The Screen (Convex) Apparent Image Depth Screen / Image Plane L R L R
Stereoscopic Vision: At The Screen Apparent Image Depth Screen / Image Plane L R L R
Vergence Accommodation Conflict Computer and projection displays present images on a single surface but have a focal distance (blur on the retina) which may be in front of or behind the screen The inability to fuse the binocular stimuli causes discomfort and fatigue to the viewer Viewers can be trained, and the discomfort can diminish with practice David M. Hoffman, Ahna R. Girschick, Kurt Akeley, Martin S. Banks. Vergence-accommodation conflicts hinder visual performance and cause visual fatigue, Journal of Vision, vol. 8, no. 3, article 33, March 28, 2008.
Understanding the Human Visual System
Components of the Human Eye Foundations of Sensation and Perception, George Mather
Image Formation by Lenses Foundations of Sensation and Perception, George Mather
Resolution of the Human Eye Humans can tell visual details at distances larger than 0.3 arc minutes The Field of View (FOV) of the human eye can be generously estimated as 120 by 90 degrees
Resolution of the Human Eye (120 degrees x 60 arcminutes / degree x 1 pixel / 0.3 arcminutes) x (90 degrees x 60 arcminutes / degree x 1 pixel / 0.3 arcminutes) 431,568,000 pixels; 432 MegaPixels. A 1080p display is 2.1 megapixels.
Samsung AMOLED Displays Standard LCD RGB Display PenTile Display
Distorted Images
Jean-Francois Niceron. Thaumaturgus opticus (Rome, 1646), illus. 25. The projection of a screen or grid in anamorphic perspective makes the transfer of a representation possible. Fred Leeman. Hidden Images, 1975, Verlag M. DuMont Schauberg,
Erhard Schon. Picture puzzle: Out, You Old Fool c. 1535. Fred Leeman. Hidden Images, 1975, Harry N. Abrams. Fred Leeman. Hidden Images, 1975, Verlag M. DuMont Schauberg,
Hans Holbein The Ambassadors Google Art Project: http://www.googleartproject.com/museums/nationalgallery/the-ambassadors
Hans Holbein Fred Leeman. Hidden Images, 1976 Harry N. Abrams incorporated, p. 19
DORSEY 1993
DORSEY 1993
Truck Art http://www.wltc.org/documents/truckart.htm
Julian Beever - Chalk Drawings
The goal of VR reproduction operators VR Reproduction Operator visual model scene observer model display observer model display device model scene radiances display inputs scene observer presence display observer display device After Tumblin, IEEE CG&A 13(6) IEEE, 1993.
Stainless Steel Simulation
Eames Chair Pixar s Renderman
Oculus Rift
Oculus Rift
Oculus Rift Components Accelerometers and logic board Lenses Flat 1080P AMOLED Display
Oculus Rift
Oculus Rift Angular Rotation
Oculus Rift Distortion Strategy
Oculus Rift Distorted Image
Oculus Rift Distorted Image
Oculus Rift Distorted Image
Oculus Ready PC Program > $1,000 including computer
Requirements for PRESENCE Understanding the Human Visual System Improving the Device Characteristics System Performance
Virtual Reality What is necessary to make virtual reality a reality?
Crossing the VR Chasm Device Characteristics Display resolution Field of view Color Gamut Dynamic range View Location and Direction Position accuracy Sensor Response Gaze direction
Crossing the VR Chasm Dynamic Motion Refresh/update Latency Rendering computation Bandwidth Pixel switching time Model Complexity Dynamic Data Capture D-tethering Economy
Current vs. Desired Characteristics
Crossing the VR Chasm See your hands Eye-to-eye contact SOCIAL ACCEPTANCE
End