Realtime 3D Computer Graphics Virtual Reality

Similar documents
VR-programming. Fish Tank VR. To drive enhanced virtual reality display setups like. Monitor-based systems Use i.e.

MECHANICAL DESIGN LEARNING ENVIRONMENTS BASED ON VIRTUAL REALITY TECHNOLOGIES

Trends & Milestones. History of Virtual Reality. Sensorama (1956) Visually Coupled Systems. Heilig s HMD (1960)

Sensation and Perception

Introduction to Haptics

History of Virtual Reality. Trends & Milestones

Geographic information systems and virtual reality Ivan Trenchev, Leonid Kirilov

Psychology in Your Life

Sensation and Perception. What We Will Cover in This Section. Sensation

Human Factors. We take a closer look at the human factors that affect how people interact with computers and software:

Why interest in visual perception?

Using Hybrid Reality to Explore Scientific Exploration Scenarios

Sensory and Perception. Team 4: Amanda Tapp, Celeste Jackson, Gabe Oswalt, Galen Hendricks, Harry Polstein, Natalie Honan and Sylvie Novins-Montague

SENSATION AND PERCEPTION

Sensation. Our sensory and perceptual processes work together to help us sort out complext processes

Virtual Reality in Neuro- Rehabilitation and Beyond

Digital image processing vs. computer vision Higher-level anchoring

Multi-Modal User Interaction

Exploring Surround Haptics Displays

Virtual Environments. Ruth Aylett

Introduction to Virtual Reality. Chapter IX. Introduction to Virtual Reality. 9.1 Introduction. Definition of VR (W. Sherman)

Force versus Frequency Figure 1.

AUGMENTED VIRTUAL REALITY APPLICATIONS IN MANUFACTURING

Perception in Immersive Virtual Reality Environments ROB ALLISON DEPT. OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCE YORK UNIVERSITY, TORONTO

6 Ubiquitous User Interfaces

Augmented Perception for Diagnosis and Orientation Support

Realtime 3D Computer Graphics Virtual Reality

PSYCHOLOGY. Chapter 5 SENSATION AND PERCEPTION PowerPoint Image Slideshow

4/23/16. Virtual Reality. Virtual reality. Virtual reality is a hot topic today. Virtual reality

Chapter 2 Introduction to Haptics 2.1 Definition of Haptics

Below is provided a chapter summary of the dissertation that lays out the topics under discussion.

An Introduction into Virtual Reality Environments. Stefan Seipel

D S R G. Alina Mashko, GUI universal and global design. Department of vehicle technology. Faculty of Transportation Sciences

Application of Virtual Reality Technology in College Students Mental Health Education

What is Virtual Reality? What is Virtual Reality? An Introduction into Virtual Reality Environments

Scholarly Article Review. The Potential of Using Virtual Reality Technology in Physical Activity Settings. Aaron Krieger.

Touch Perception and Emotional Appraisal for a Virtual Agent

Beau Lotto: Optical Illusions Show How We See

Geo-Located Content in Virtual and Augmented Reality

Sound rendering in Interactive Multimodal Systems. Federico Avanzini

Issues and Challenges of 3D User Interfaces: Effects of Distraction

Input-output channels

Effective Iconography....convey ideas without words; attract attention...

Sensation & Perception

HeroX - Untethered VR Training in Sync'ed Physical Spaces

Output Devices - Visual

What is Virtual Reality? What is Virtual Reality? An Introduction into Virtual Reality Environments. Stefan Seipel

Sensation and Perception

VIRTUAL REALITY Introduction. Emil M. Petriu SITE, University of Ottawa

Realtime 3D Computer Graphics Virtual Reality

IV: Visual Organization and Interpretation

Sensation notices Various stimuli Of what is out there In reality

Virtual Reality and simulation (1) -Overview / 3D rotation-

Keywords: Innovative games-based learning, Virtual worlds, Perspective taking, Mental rotation.

Virtual Reality Calendar Tour Guide

E90 Project Proposal. 6 December 2006 Paul Azunre Thomas Murray David Wright

VIRTUAL REALITY FOR NONDESTRUCTIVE EVALUATION APPLICATIONS

Multisensory Virtual Environment for Supporting Blind Persons' Acquisition of Spatial Cognitive Mapping a Case Study

By: Celine, Yan Ran, Yuolmae. Image from oss

Designing Pseudo-Haptic Feedback Mechanisms for Communicating Weight in Decision Making Tasks

OUR RELENTLESS PURSUIT: Applying 3D Video / VR /AR ON THE ROAD TO ZERO

Waves Nx VIRTUAL REALITY AUDIO

the human chapter 1 Traffic lights the human User-centred Design Light Vision part 1 (modified extract for AISD 2005) Information i/o

Reviews of Virtual Reality and Computer World

Unit 4: Sensation and Perception

BASIC COMPONENTS OF VIRTUAL REALITY

Abdulmotaleb El Saddik Associate Professor Dr.-Ing., SMIEEE, P.Eng.

Research on Application of Virtual Reality Technology in Architectural Space Design

Omni-Directional Catadioptric Acquisition System

PERCEPTUAL AND SOCIAL FIDELITY OF AVATARS AND AGENTS IN VIRTUAL REALITY. Benjamin R. Kunz, Ph.D. Department Of Psychology University Of Dayton

Research on product design and application based on virtual reality. technology and media interactive art

Unit IV: Sensation & Perception. Module 19 Vision Organization & Interpretation

Chapter 9. Conclusions. 9.1 Summary Perceived distances derived from optic ow

AP PSYCH Unit 4.2 Vision 1. How does the eye transform light energy into neural messages? 2. How does the brain process visual information? 3.

What is Virtual Reality? Burdea,1993. Virtual Reality Triangle Triangle I 3 I 3. Virtual Reality in Product Development. Virtual Reality Technology

702. Investigation of attraction force and vibration of a slipper in a tactile device with electromagnet

Feeding human senses through Immersion

Graphical User Interfaces for Blind Users: An Overview of Haptic Devices

GLOSSARY for National Core Arts: Media Arts STANDARDS

Chapter 4 PSY 100 Dr. Rick Grieve Western Kentucky University

THE DAWN OF A VIRTUAL ERA

Perceptual Interfaces. Matthew Turk s (UCSB) and George G. Robertson s (Microsoft Research) slides on perceptual p interfaces

IDENTIFYING AND COMMUNICATING 2D SHAPES USING AUDITORY FEEDBACK. Javier Sanchez

From Encoding Sound to Encoding Touch

Some Future Possibilities for Education and Learning 2030

Haptic Cueing of a Visual Change-Detection Task: Implications for Multimodal Interfaces

Ubiquitous Computing Summer Episode 16: HCI. Hannes Frey and Peter Sturm University of Trier. Hannes Frey and Peter Sturm, University of Trier 1

IMGD 5100: Immersive HCI. Augmented Reality

GUIBDSS Gestural User Interface Based Digital Sixth Sense The wearable computer

VR based HCI Techniques & Application. November 29, 2002

Perception. The process of organizing and interpreting information, enabling us to recognize meaningful objects and events.

Multisensory experiences in HCI

The Application of Virtual Reality in Art Design: A New Approach CHEN Dalei 1, a

Paper Body Vibration Effects on Perceived Reality with Multi-modal Contents

HW- Finish your vision book!

CSE 165: 3D User Interaction. Lecture #14: 3D UI Design

RV - AULA 05 - PSI3502/2018. User Experience, Human Computer Interaction and UI

Detection of external stimuli Response to the stimuli Transmission of the response to the brain

Virtual Environments. CSCI 420 Computer Graphics Lecture 25. History of Virtual Reality Flight Simulators Immersion, Interaction, Real-time Haptics

Haplug: A Haptic Plug for Dynamic VR Interactions

Transcription:

Realtime 3D Computer Graphics Virtual Reality Marc Erich Latoschik AI & VR Lab Artificial Intelligence Group University of Bielefeld Virtual Reality (or VR for short)

Virtual Reality (or VR for short) can be defined as Virtual Reality (or VR for short) can be defined as an artificial environment which is experienced through sensory stimuli (as sights and sounds) provided by a computer and in which one's actions partially determine what happens in the environment (Merriam Webster)

Virtual Reality (or VR for short) can be defined as an artificial environment which is experienced through sensory stimuli (as sights and sounds) provided by a computer and in which one's actions partially determine what happens in the environment (Merriam Webster) a human-computer interface which -by addressing several senses- lets us perceive a computer generated environment as reality. (based on Alexander Hennig "Die andere Wirklichkeit (the other reality) ) Virtual Reality (or VR for short) can be defined as an artificial environment which is experienced through sensory stimuli (as sights and sounds) provided by a computer and in which one's actions partially determine what happens in the environment (Merriam Webster) a human-computer interface which -by addressing several senses- lets us perceive a computer generated environment as reality. (based on Alexander Hennig "Die andere Wirklichkeit (the other reality) ) the simulation of a real or imagined environment that can be experienced visually in the three dimensions of width, height, and depth and that may additionally provide an interactive experience visually in full real-time motion with sound and possibly with tactile and other forms of feedback.

Virtual Reality (or VR for short) can be defined as an artificial environment which is experienced through sensory stimuli (as sights and sounds) provided by a computer and in which one's actions partially determine what happens in the environment (Merriam Webster) a human-computer interface which -by addressing several senses- lets us perceive a computer generated environment as reality. (based on Alexander Hennig "Die andere Wirklichkeit (the other reality) ) the simulation of a real or imagined environment that can be experienced visually in the three dimensions of width, height, and depth and that may additionally provide an interactive experience visually in full real-time motion with sound and possibly with tactile and other forms of feedback. (and many more) The term(s) of Virtual Reality

The term(s) of Virtual Reality Phantomology or phantomatic is introduced by Stanislav Lem as a concept of artificial realities in his Summa Technologiae (Lem, 964) and in several publications since then. The term(s) of Virtual Reality Phantomology or phantomatic is introduced by Stanislav Lem as a concept of artificial realities in his Summa Technologiae (Lem, 964) and in several publications since then. Virtual Reality This term is attributed to Jaron Lanier of VPL in 986 in a conversation regarding the work of Scott Fisher.

The term(s) of Virtual Reality Phantomology or phantomatic is introduced by Stanislav Lem as a concept of artificial realities in his Summa Technologiae (Lem, 964) and in several publications since then. Virtual Reality This term is attributed to Jaron Lanier of VPL in 986 in a conversation regarding the work of Scott Fisher. Virtual Environments is how Fisher, of NASA Ames, had been referring to the field. The term(s) of Virtual Reality Phantomology or phantomatic is introduced by Stanislav Lem as a concept of artificial realities in his Summa Technologiae (Lem, 964) and in several publications since then. Virtual Reality This term is attributed to Jaron Lanier of VPL in 986 in a conversation regarding the work of Scott Fisher. Virtual Environments is how Fisher, of NASA Ames, had been referring to the field. Artificial Reality is a label for such activities by Myron Krueger in 983.

The term(s) of Virtual Reality Phantomology or phantomatic is introduced by Stanislav Lem as a concept of artificial realities in his Summa Technologiae (Lem, 964) and in several publications since then. Virtual Reality This term is attributed to Jaron Lanier of VPL in 986 in a conversation regarding the work of Scott Fisher. Virtual Environments is how Fisher, of NASA Ames, had been referring to the field. Artificial Reality is a label for such activities by Myron Krueger in 983. Cyberspace This term is coined by William Gibson in his book Neuromancer (Gibson, 984). VR Flavors

VR Flavors Artificial Reality User is observer of an artificial environment, uses an avatar as a placeholder for the user. VR Flavors Artificial Reality User is observer of an artificial environment, uses an avatar as a placeholder for the user. Augmented Reality Merges reality with Virtual Reality. Naturally and artificially generated stimulus is overlapped and complements each other.

VR Flavors Artificial Reality User is observer of an artificial environment, uses an avatar as a placeholder for the user. Augmented Reality Merges reality with Virtual Reality. Naturally and artificially generated stimulus is overlapped and complements each other. Cyberspace Emphasizes the network related parts of and artificial computer generated environment. VR Flavors Artificial Reality User is observer of an artificial environment, uses an avatar as a placeholder for the user. Augmented Reality Merges reality with Virtual Reality. Naturally and artificially generated stimulus is overlapped and complements each other. Cyberspace Emphasizes the network related parts of and artificial computer generated environment. Immersive Virtual Reality Embeds the user psycho-physically into the artificial surrounding. User merges into the generated environment.

VR characteristics VR characteristics. immersion: To submerge into simulated space.

VR characteristics. immersion: To submerge into simulated space. 2. multidimensionality: Used to create space. VR characteristics. immersion: To submerge into simulated space. 2. multidimensionality: Used to create space. 3. real-time: Simulation is processed in real-time.

VR characteristics. immersion: To submerge into simulated space. 2. multidimensionality: Used to create space. 3. real-time: Simulation is processed in real-time. 4. adequacy: Movement results in an appropriate simulation change. VR characteristics. immersion: To submerge into simulated space. 2. multidimensionality: Used to create space. 3. real-time: Simulation is processed in real-time. 4. adequacy: Movement results in an appropriate simulation change. 5. interaction: Users can interact with the environment.

VR characteristics. immersion: To submerge into simulated space. 2. multidimensionality: Used to create space. 3. real-time: Simulation is processed in real-time. 4. adequacy: Movement results in an appropriate simulation change. 5. interaction: Users can interact with the environment. 6. navigation: Movement in the simulated space (as would be possible in reality). VR characteristics. immersion: To submerge into simulated space. 2. multidimensionality: Used to create space. 3. real-time: Simulation is processed in real-time. 4. adequacy: Movement results in an appropriate simulation change. 5. interaction: Users can interact with the environment. 6. navigation: Movement in the simulated space (as would be possible in reality). 7. reality-effect: To perceive the artificial surrounding as real and believable.

VR characteristics. immersion: To submerge into simulated space. 2. multidimensionality: Used to create space. 3. real-time: Simulation is processed in real-time. 4. adequacy: Movement results in an appropriate simulation change. 5. interaction: Users can interact with the environment. 6. navigation: Movement in the simulated space (as would be possible in reality). 7. reality-effect: To perceive the artificial surrounding as real and believable. 8. multi-user: Multiple users can enter the virtual space and communicate and interact. VR characteristics. immersion: To submerge into simulated space. 2. multidimensionality: Used to create space. 3. real-time: Simulation is processed in real-time. 4. adequacy: Movement results in an appropriate simulation change. 5. interaction: Users can interact with the environment. 6. navigation: Movement in the simulated space (as would be possible in reality). 7. reality-effect: To perceive the artificial surrounding as real and believable. 8. multi-user: Multiple users can enter the virtual space and communicate and interact.

VR characteristics. immersion: To submerge into simulated space. 2. multidimensionality: Used to create space. 3. real-time: Simulation is processed in real-time. 4. adequacy: Movement results in an appropriate simulation change. 5. interaction: Users can interact with the environment. 6. navigation: Movement in the simulated space (as would be possible in reality). 7. reality-effect: To perceive the artificial surrounding as real and believable. 8. multi-user: Multiple users can enter the virtual space and communicate and interact. VR - simulating stimuli VR is simulation of stimuli for human senses. No agreement about the number of actual senses (at least 9). The better the simulation the higher is the degree of immersion.

VR - simulating stimuli VR is simulation of stimuli for human senses. No agreement about the number of actual senses (at least 9). The better the simulation the higher is the degree of immersion. peripheral external sensation source Phantomology central direct brain excitation Sense: a system that consists of a sensory cell type (or group of cell types) that respond to a specific kind of physical energy, and that correspond to a defined region (or group of regions) within the brain where the signals are received and interpreted (Wikipedia) W

...residual self image......mental projection of digital self... W...what is real?..feel.....smell......taste......see......electrical signals interpreted by your brain... VR - simulating stimuli sight smell reality virtuality touch hearing taste

VR - simulating stimuli Simulating stimuli: VR simulates stimuli to 5 main senses (following Aristotle) Senses are gradually simulated to bridge reality and virtuality. The different VR-flavors stimulate different senses to different degrees. deg. of immersion central phantomology peripheral phantomology Immersive Virtual Reality Non-immersive Virtual Reality Pre-virtual worlds CMC, mediazation sight smell reality virtuality touch hearing taste VR - simulating stimuli Simulating stimuli: VR simulates stimuli to 5 main senses (following Aristotle) Senses are gradually simulated to bridge reality and virtuality. The different VR-flavors stimulate different senses to different degrees. deg. of immersion central phantomology peripheral phantomology Immersive Virtual Reality Non-immersive Virtual Reality Pre-virtual worlds CMC, mediazation sight smell reality virtuality touch hearing taste

VR and the notion of space VR and the notion of space Simulating sensual stimuli is done by setting certain parameters (to generate stimuli). Every parameter defines a one dimensional range of possible values. Combining several parameters for the same stimulated sense creates a sense space For example: R,G,B (or HIS, HSV etc.) parameters open a color space. Sweet, sour, salty, bitter, umami parameters open a gustatory (taste) space. Pitch, volume and duration open a sound space. X, Y, Z (or length, height and width) open an 3D (possibly Euclidian) space.

VR and the notion of space VR and the notion of space Perceptual (mental) Space Important aspect in philosophy and cognitive science. Things appear extended because they have the attributes of color and solidity (David Hume). has a projective geometry, things within it appear as if they are viewed from a point (Rene Descarte). Projective geometry might describe the layout of things in perception (Peters, 2000).

Simulation of sensory stimuli Simulation of sensory stimuli VR is about the simulation of sensory stimuli which fake stimuli sensed in the real physical world.

Simulation of sensory stimuli VR is about the simulation of sensory stimuli which fake stimuli sensed in the real physical world. The human sensory systems consists of several sub-systems all with their own features and modes of operation, e.g. sensed space(s) processing speed processing resolution processing accuracy Simulation of sensory stimuli VR is about the simulation of sensory stimuli which fake stimuli sensed in the real physical world. The human sensory systems consists of several sub-systems all with their own features and modes of operation, e.g. sensed space(s) processing speed processing resolution processing accuracy Stimulation of a certain sensory system requires to take that system s mode of operation into account.

Simulation of sensory stimuli VR is about the simulation of sensory stimuli which fake stimuli sensed in the real physical world. The human sensory systems consists of several sub-systems all with their own features and modes of operation, e.g. sensed space(s) processing speed processing resolution processing accuracy Stimulation of a certain sensory system requires to take that system s mode of operation into account. For example: The simulation of tactile feedback (haptics) requires a much higher simulation rate as the simulation of visual stimuli. The resolution of the auditory sense is different then the resolution of the visual sense. Simulation of sensory stimuli VR is about the simulation of sensory stimuli which fake stimuli sensed in the real physical world. The human sensory systems consists of several sub-systems all with their own features and modes of operation, e.g. sensed space(s) processing speed processing resolution processing accuracy Stimulation of a certain sensory system requires to take that system s mode of operation into account. For example: The simulation of tactile feedback (haptics) requires a much higher simulation rate as the simulation of visual stimuli. The resolution of the auditory sense is different then the resolution of the visual sense.! Creating visual stimuli is considered critical for immersive VR. This is followed by tactile and auditory and then by olfactory and gustatory simulation.

Space: creating visual stimuli Space: creating visual stimuli Visual stimuli are a major source for the perception of space.

Space: creating visual stimuli Visual stimuli are a major source for the perception of space. Simulating the surrounding virtual space of users is the goal. Space: creating visual stimuli Visual stimuli are a major source for the perception of space. Simulating the surrounding virtual space of users is the goal. VR utilizes real-time 3D computer graphics (CG) to create visual stimuli.

Space: creating visual stimuli Visual stimuli are a major source for the perception of space. Simulating the surrounding virtual space of users is the goal. VR utilizes real-time 3D computer graphics (CG) to create visual stimuli. Conventional 3D CG in contrast to VR: 3D Computer Graphics Purely visual presentation Presentation can be rendered off-line, time is uncritical Static scenes or predefined animations 2D interaction mouse, keyboard Virtual Reality Multimedia presentation visual, acoustic, haptic, Real-time presentation Real-time interaction and simulation 3D interaction with special input devices + speech (and gesture) AI & VR Lab: Virtual Biosphere II

AI & VR Lab: Virtual Biosphere II