Application of eye tracking and galvanic vestibular inputs for enhancing human performance

Size: px
Start display at page:

Download "Application of eye tracking and galvanic vestibular inputs for enhancing human performance"

Transcription

1 Application of eye tracking and galvanic vestibular inputs for enhancing human performance Gaurav Gary N. Pradhan, PhD Aerospace Medicine & Vestibular Research Laboratory (AMVRL)

2 Financial Disclosure Patent: Galvanic Vestibular Stimulation System and Method of Use for Simulation, Directional Cueing, and Alleviating Motion-Related Sickness (Licensed to vmocion, Patent: Computer System and Method for Diagnostic Data Display Software: Software Development for Eye Tracking Data: Analysis, Visualization, and Real-Time Processing

3 Outline Overview of Aerospace Medicine and Vestibular Research Laboratory Projects of interest: Cognitive Performance and Eye Tracking Galvanic Vestibular Stimulation Technology and Technique Acknowledgments

4

5 Focus of AMVRL High altitude protection Spatial orientation / disorientation Acceleration protection

6 Outline Overview of Aerospace Medicine and Vestibular Research Laboratory Projects of interest: Cognitive Performance and Eye Tracking Galvanic Vestibular Stimulation Technology and Technique Acknowledgments

7 Continuous Human Performance Monitoring Using Eye Tracking Deriving Cognitive Performance Based on Oculometric Features Hypoxia Fixational Eye Movements Saccadic Performance Blink Metrics Pupillary Dynamics Baseline Hypoxia FOCUS: Noninvasive and neurophysiological biomarkers to detect early signs of hypoxia Acute hypoxic hypoxia and isocapnic hypoxia effects on oculometric features. Aviat Space Environ Med 2014;85:700 7.

8 Current System A non-invasive eye-tracking device during a validated cognitive challenge task - Mayo King-Devick test. Eye Tracking is based on the infrared light technology. Mayo King Devick test is currently used as a sideline test for concussion.

9 Real Time Eye Tracking as a Biomarker of Cognitive Impairment in Hypoxia and Concussion Extraction of Oculometric Features Baseline Hypoxia Concussion Hypoxia Oculometric Feature Selection (Identifying Biomarkers) Prediction of Cognitive Impairment (Yes / No) Classifier/Predictor Training (Machine Learning Algorithm) Real-Time Classification/Prediction Model (Diagnostic/ Decision Support System)

10 Diagnostic Visualization Tool (DiViTo) PATENT: US 62/074,932 - Computer System and Method for Diagnostic Data Display

11 Challenges and Requirements Integration of the eye tracking system into the current operational platform using flexible technology Heads-up Displays Helmet Displays Night Vision Goggles Interference of day light due to the limitation of infrared sensors Multi-spectral eye-tracking sensors Restricted field-of-view Surround eye-tracking system surrounding human vision

12 Outline Overview of Aerospace Medicine and Vestibular Research Laboratory Projects of interest: Cognitive Performance and Eye Tracking Galvanic Vestibular Stimulation Technology and Technique Acknowledgments

13 Galvanic Vestibular Stimulation (GVS) Electrical stimulation of the human vestibular system (balance organ) through the skin. The electrical inputs to the balance system across multiple electrodes allow us to predictably evoke a perception of pitch, roll and yaw. First use of multiple electrodes to evoke defined, predictable perceptions. PATENT: WO 2010/ Galvanic Vestibular Stimulation System and Method of Use for Simulation, Directional Cueing, and Alleviating Motion-related Sickness

14 Real-time matching of GVS to the motion

15 Reduction of Simulator Sickness and Enhancement of Motion Perception Fidelity Flight Simulation Entertainment Real-Time 3D Movement Data Virtual / Augmented Reality Applications Real time GVS commands

16 Challenges and Requirements Miniaturization of the GVS device using flexible technology GVS as an on-body processing unit. Inter-individual variability in the intensity of perceiving motion sensation Sensors that can assess inter-individual variability due to different skin resistances.

17 Outline Overview of Aerospace Medicine and Vestibular Research Laboratory Projects of interest: Cognitive Performance and Eye Tracking Galvanic Vestibular Stimulation Technology and Technique Acknowledgments

18 Acknowledgments Mayo Clinic AMVRL Team Jan Stepanek, M.D., Co-Director AMVRL Michael Cevette, Ph.D., Co-Director AMVRL Samantha Kleindienst, Ph.D., Post-doctoral Fellow

19 Contacts Jan Stepanek Michael Cevette Gaurav Gary N. Pradhan Samantha Kleindienst

20

Aviation Medicine Seminar Series. Aviation Medicine Seminar Series

Aviation Medicine Seminar Series. Aviation Medicine Seminar Series Aviation Medicine Seminar Series Aviation Medicine Seminar Series Bruce R. Gilbert, M.D., Ph.D. Associate Clinical Professor of Urology Weill Cornell Medical College Stony Brook University Medical College

More information

Appendix E. Gulf Air Flight GF-072 Perceptual Study 23 AUGUST 2000 Gulf Air Airbus A (A40-EK) NIGHT LANDING

Appendix E. Gulf Air Flight GF-072 Perceptual Study 23 AUGUST 2000 Gulf Air Airbus A (A40-EK) NIGHT LANDING Appendix E E1 A320 (A40-EK) Accident Investigation Appendix E Gulf Air Flight GF-072 Perceptual Study 23 AUGUST 2000 Gulf Air Airbus A320-212 (A40-EK) NIGHT LANDING Naval Aerospace Medical Research Laboratory

More information

Understanding Spatial Disorientation and Vertigo. Dan Masys, MD EAA Chapter 162

Understanding Spatial Disorientation and Vertigo. Dan Masys, MD EAA Chapter 162 Understanding Spatial Disorientation and Vertigo Dan Masys, MD EAA Chapter 162 Topics Why this is important A little aviation history How the human body maintains balance and positional awareness Types

More information

CAN GALVANIC VESTIBULAR STIMULATION REDUCE SIMULATOR ADAPTATION SYNDROME? University of Guelph Guelph, Ontario, Canada

CAN GALVANIC VESTIBULAR STIMULATION REDUCE SIMULATOR ADAPTATION SYNDROME? University of Guelph Guelph, Ontario, Canada CAN GALVANIC VESTIBULAR STIMULATION REDUCE SIMULATOR ADAPTATION SYNDROME? Rebecca J. Reed-Jones, 1 James G. Reed-Jones, 2 Lana M. Trick, 2 Lori A. Vallis 1 1 Department of Human Health and Nutritional

More information

COMPUTATIONAL ERGONOMICS A POSSIBLE EXTENSION OF COMPUTATIONAL NEUROSCIENCE? DEFINITIONS, POTENTIAL BENEFITS, AND A CASE STUDY ON CYBERSICKNESS

COMPUTATIONAL ERGONOMICS A POSSIBLE EXTENSION OF COMPUTATIONAL NEUROSCIENCE? DEFINITIONS, POTENTIAL BENEFITS, AND A CASE STUDY ON CYBERSICKNESS COMPUTATIONAL ERGONOMICS A POSSIBLE EXTENSION OF COMPUTATIONAL NEUROSCIENCE? DEFINITIONS, POTENTIAL BENEFITS, AND A CASE STUDY ON CYBERSICKNESS Richard H.Y. So* and Felix W.K. Lor Computational Ergonomics

More information

Mathematical model for accurate measurement of head movements in simulators with frontal field visual display

Mathematical model for accurate measurement of head movements in simulators with frontal field visual display Original Article Mathematical model for accurate measurement of head movements in simulators with frontal field visual display Major P Biswal* ABSTRACT Modern Simulators in the Aeromedical environment

More information

2/3/2016. How We Move... Ecological View. Ecological View. Ecological View. Ecological View. Ecological View. Sensory Processing.

2/3/2016. How We Move... Ecological View. Ecological View. Ecological View. Ecological View. Ecological View. Sensory Processing. How We Move Sensory Processing 2015 MFMER slide-4 2015 MFMER slide-7 Motor Processing 2015 MFMER slide-5 2015 MFMER slide-8 Central Processing Vestibular Somatosensation Visual Macular Peri-macular 2015

More information

COMPARING TECHNIQUES TO REDUCE SIMULATOR ADAPTATION SYNDROME AND IMPROVE NATURALISTIC BEHAVIOUR DURING SIMULATED DRIVING

COMPARING TECHNIQUES TO REDUCE SIMULATOR ADAPTATION SYNDROME AND IMPROVE NATURALISTIC BEHAVIOUR DURING SIMULATED DRIVING COMPARING TECHNIQUES TO REDUCE SIMULATOR ADAPTATION SYNDROME AND IMPROVE NATURALISTIC BEHAVIOUR DURING SIMULATED DRIVING James G. Reed-Jones 1, Rebecca J. Reed-Jones 2, Lana M. Trick 1, Ryan Toxopeus 1,

More information

A Guide to Senses from a Manipulation Perspective

A Guide to Senses from a Manipulation Perspective very incomplete draft A Guide to Senses from a Manipulation Perspective by Wo Meijer very incomplete draft Introduction This document provides a brief overview of the human sense available to designers

More information

Psychophysics of night vision device halo

Psychophysics of night vision device halo University of Wollongong Research Online Faculty of Health and Behavioural Sciences - Papers (Archive) Faculty of Science, Medicine and Health 2009 Psychophysics of night vision device halo Robert S Allison

More information

Multi-Axis Pilot Modeling

Multi-Axis Pilot Modeling Multi-Axis Pilot Modeling Models and Methods for Wake Vortex Encounter Simulations Technical University of Berlin Berlin, Germany June 1-2, 2010 Ronald A. Hess Dept. of Mechanical and Aerospace Engineering

More information

FLIGHT SAFETY THROUGH TECHNOLOGY & TRAINING AIRCREW TRAINING SYSTEMS

FLIGHT SAFETY THROUGH TECHNOLOGY & TRAINING AIRCREW TRAINING SYSTEMS AIRCREW TRAINING SYSTEMS FLIGHT SAFETY THROUGH TECHNOLOGY & TRAINING HIGH-G FLIGHT SIMULATION PILOT SELECTION NIGHT VISION ALTITUDE PHYSIOLOGY TRAINING EMERGENCY EGRESS SPATIAL DISORIENTATION SITUATIONAL

More information

Haptic Interface using Sensory Illusion Tomohiro Amemiya

Haptic Interface using Sensory Illusion Tomohiro Amemiya Haptic Interface using Sensory Illusion Tomohiro Amemiya *NTT Communication Science Labs., Japan amemiya@ieee.org NTT Communication Science Laboratories 2/39 Introduction Outline Haptic Interface using

More information

Job Description. Commitment: Must be available to work full-time hours, M-F for weeks beginning Summer of 2018.

Job Description. Commitment: Must be available to work full-time hours, M-F for weeks beginning Summer of 2018. Research Intern Director of Research We are seeking a summer intern to support the team to develop prototype 3D sensing systems based on state-of-the-art sensing technologies along with computer vision

More information

State of the Science Symposium

State of the Science Symposium State of the Science Symposium Virtual Reality and Physical Rehabilitation: A New Toy or a New Research and Rehabilitation Tool? Emily A. Keshner Department of Physical Therapy College of Health Professions

More information

Feeding human senses through Immersion

Feeding human senses through Immersion Virtual Reality Feeding human senses through Immersion 1. How many human senses? 2. Overview of key human senses 3. Sensory stimulation through Immersion 4. Conclusion Th3.1 1. How many human senses? [TRV

More information

Sensation and Perception. What We Will Cover in This Section. Sensation

Sensation and Perception. What We Will Cover in This Section. Sensation Sensation and Perception Dr. Dennis C. Sweeney 2/18/2009 Sensation.ppt 1 What We Will Cover in This Section Overview Psychophysics Sensations Hearing Vision Touch Taste Smell Kinesthetic Perception 2/18/2009

More information

A Vestibular Sensation: Probabilistic Approaches to Spatial Perception (II) Presented by Shunan Zhang

A Vestibular Sensation: Probabilistic Approaches to Spatial Perception (II) Presented by Shunan Zhang A Vestibular Sensation: Probabilistic Approaches to Spatial Perception (II) Presented by Shunan Zhang Vestibular Responses in Dorsal Visual Stream and Their Role in Heading Perception Recent experiments

More information

Electroluminescent Lighting Applications

Electroluminescent Lighting Applications Electroluminescent Lighting Applications By Chesley S. Pieroway Major, USAF PRAM Program Office Aeronauical Systems Division Wright-Patterson AFB OH 45433 Presented to illuminating Engineering Society

More information

ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS

ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS BY SERAFIN BENTO MASTER OF SCIENCE in INFORMATION SYSTEMS Edmonton, Alberta September, 2015 ABSTRACT The popularity of software agents demands for more comprehensive HAI design processes. The outcome of

More information

interactive laboratory

interactive laboratory interactive laboratory ABOUT US 360 The first in Kazakhstan, who started working with VR technologies Over 3 years of experience in the area of virtual reality Completed 7 large innovative projects 12

More information

Best Practices for VR Applications

Best Practices for VR Applications Best Practices for VR Applications July 25 th, 2017 Wookho Son SW Content Research Laboratory Electronics&Telecommunications Research Institute Compliance with IEEE Standards Policies and Procedures Subclause

More information

AOA and AOCOPM Aerospace Medicine Spatial Disorientation. CAPT Kris Belland, MC, USN COMMANDER NAVAL AIR FORCES Force Surgeon

AOA and AOCOPM Aerospace Medicine Spatial Disorientation. CAPT Kris Belland, MC, USN COMMANDER NAVAL AIR FORCES Force Surgeon AOA and AOCOPM Aerospace Medicine Spatial Disorientation CAPT Kris Belland, MC, USN COMMANDER NAVAL AIR FORCES Force Surgeon Background 1980-90 USNA / PCOM / Gen Surgery NHO 1990-95 Flight Surgery / CVW-5

More information

Rotational Vestibular Chair

Rotational Vestibular Chair TM Rotational Vestibular Chair Rotational Chair testing provides versatility in measuring the Vestibular- ocular Reflex (VOR). The System 2000 Rotational Chair is engineered to deliver precisely controlled

More information

DENSO www. densocorp-na.com

DENSO www. densocorp-na.com DENSO www. densocorp-na.com Machine Learning for Automated Driving Description of Project DENSO is one of the biggest tier one suppliers in the automotive industry, and one of its main goals is to provide

More information

Human Factors Research Unit At the University of Southampton

Human Factors Research Unit At the University of Southampton Human Factors Research Unit At the University of Southampton Human Factors Research Unit (HFRU) 3 Academic staff, 3 Research Fellows 15 PhDs, 3 technicians 0.5 m external funding (EU/UK Govt/Industry)

More information

What has been learnt from space

What has been learnt from space What has been learnt from space Gilles Clément Director of Research, CNRS Laboratoire Cerveau et Cognition, Toulouse, France Oliver Angerer ESA Directorate of Strategy and External Relations, ESTEC, Noordwijk,

More information

This article attempts to explain only a few of the illusions encountered by aviators.

This article attempts to explain only a few of the illusions encountered by aviators. Disorientation SPATIAL DISORIENTATION AND FATIGUE Wondai, QLD, a healthy, instrument rated type experienced pilot flies a perfectly sound Beech King Air into the ground only seconds after taking off into

More information

Automated Thermal Camouflage Generation Program Status

Automated Thermal Camouflage Generation Program Status David J. Thomas (Chairman SCI114) US Army TACOM, Warren, MI, USA thomadav@tacom.army.mil ABSTRACT The art of camouflage pattern generation has been based on heuristic techniques, combining both art and

More information

Virtual Reality in aviation training

Virtual Reality in aviation training in aviation training Aaron Snoswell, Boeing Research & Technology Australia Valve, - SteamVR featuring the HTC Vive 2 Paradigm Shift Step Change A step-change in digital content from abstractions to immersion

More information

Fast and accurate vestibular testing

Fast and accurate vestibular testing Fast and accurate vestibular testing Next-generation vestibular testing The ICS Chartr 200 system is the latest generation of our well-known vestibular test systems. ICS Chartr 200 provides you with a

More information

Unpredictable movement performance of Virtual Reality headsets

Unpredictable movement performance of Virtual Reality headsets Unpredictable movement performance of Virtual Reality headsets 2 1. Introduction Virtual Reality headsets use a combination of sensors to track the orientation of the headset, in order to move the displayed

More information

NAVAL AEROSPACE MEDICAL RESEARCH LAB: RESEARCHING

NAVAL AEROSPACE MEDICAL RESEARCH LAB: RESEARCHING NAVAL AEROSPACE MEDICAL RESEARCH LAB: RESEARCHING THE HUMAN ELEMENT By I n the technology-based world of Naval Aviation, both aviator and aircraft are expected to perform at peak levels. But the interface

More information

Teaching Psychology in a $15 million Virtual Reality Environment

Teaching Psychology in a $15 million Virtual Reality Environment Teaching Psychology in a $15 million Virtual Reality Environment Dr. Farhad Dastur Dept. of Psychology, Kwantlen University August 23, 2007 farhad.dastur@kwantlen.ca 1 What Kinds of Psychology Can We Teach

More information

Cybersickness, Console Video Games, & Head Mounted Displays

Cybersickness, Console Video Games, & Head Mounted Displays Cybersickness, Console Video Games, & Head Mounted Displays Lesley Scibora, Moira Flanagan, Omar Merhi, Elise Faugloire, & Thomas A. Stoffregen Affordance Perception-Action Laboratory, University of Minnesota,

More information

Motion sickness issues in VR content

Motion sickness issues in VR content Motion sickness issues in VR content Beom-Ryeol LEE, Wookho SON CG/Vision Technology Research Group Electronics Telecommunications Research Institutes Compliance with IEEE Standards Policies and Procedures

More information

Effects of Visual-Vestibular Interactions on Navigation Tasks in Virtual Environments

Effects of Visual-Vestibular Interactions on Navigation Tasks in Virtual Environments Effects of Visual-Vestibular Interactions on Navigation Tasks in Virtual Environments Date of Report: September 1 st, 2016 Fellow: Heather Panic Advisors: James R. Lackner and Paul DiZio Institution: Brandeis

More information

Geo-Located Content in Virtual and Augmented Reality

Geo-Located Content in Virtual and Augmented Reality Technical Disclosure Commons Defensive Publications Series October 02, 2017 Geo-Located Content in Virtual and Augmented Reality Thomas Anglaret Follow this and additional works at: http://www.tdcommons.org/dpubs_series

More information

SUPRA Simulation of UPset Recovery in Aviation. Project Overview. Dr. Eric Groen, Scientific Coordinator

SUPRA Simulation of UPset Recovery in Aviation. Project Overview. Dr. Eric Groen, Scientific Coordinator SUPRA Simulation of UPset Recovery in Aviation Project Overview Dr. Eric Groen, Scientific Coordinator SUPRA project Funding scheme: EU Call: THEME: AREA: Collaborative Research AAT-2008-RTD-1 AERONAUTICS

More information

Human Factors. Chapter 3. Introduction

Human Factors. Chapter 3. Introduction Chapter 3 Human Factors Introduction Human factors is a broad field that examines the interaction between people, machines, and the environment for the purpose of improving performance and reducing errors.

More information

Crew Health Monitoring Systems

Crew Health Monitoring Systems Project Dissemination Athens 24-11-2015 Advanced Cockpit for Reduction Of Stress and Workload Presented by Aristeidis Nikologiannis Prepared by Aristeidis Nikologiannis Security & Safety Systems Department

More information

David Jones President, Quantified Design

David Jones President, Quantified Design Cabin Crew Virtual Reality Training Guidelines Based on Cross- Industry Lessons Learned: Guidance and Use Case Results David Jones President, Quantified Design Solutions @DJonesCreates 2 David Jones Human

More information

Exploring Surround Haptics Displays

Exploring Surround Haptics Displays Exploring Surround Haptics Displays Ali Israr Disney Research 4615 Forbes Ave. Suite 420, Pittsburgh, PA 15213 USA israr@disneyresearch.com Ivan Poupyrev Disney Research 4615 Forbes Ave. Suite 420, Pittsburgh,

More information

MECHANICAL DESIGN LEARNING ENVIRONMENTS BASED ON VIRTUAL REALITY TECHNOLOGIES

MECHANICAL DESIGN LEARNING ENVIRONMENTS BASED ON VIRTUAL REALITY TECHNOLOGIES INTERNATIONAL CONFERENCE ON ENGINEERING AND PRODUCT DESIGN EDUCATION 4 & 5 SEPTEMBER 2008, UNIVERSITAT POLITECNICA DE CATALUNYA, BARCELONA, SPAIN MECHANICAL DESIGN LEARNING ENVIRONMENTS BASED ON VIRTUAL

More information

Push Path Improvement with Policy based Reinforcement Learning

Push Path Improvement with Policy based Reinforcement Learning 1 Push Path Improvement with Policy based Reinforcement Learning Junhu He TAMS Department of Informatics University of Hamburg Cross-modal Interaction In Natural and Artificial Cognitive Systems (CINACS)

More information

Advanced Simulation Displays. High-Performance Displays for the Most Demanding Training Applications

Advanced Simulation Displays. High-Performance Displays for the Most Demanding Training Applications Advanced Simulation Displays High-Performance Displays for the Most Demanding Training Applications Highest Fidelity, Greatest Versatility, Best Value Providing Display Solutions for Nearly 30 Years A

More information

Insights into High-level Visual Perception

Insights into High-level Visual Perception Insights into High-level Visual Perception or Where You Look is What You Get Jeff B. Pelz Visual Perception Laboratory Carlson Center for Imaging Science Rochester Institute of Technology Students Roxanne

More information

True F-16 SPECIFICATION. Dynamic Motion Seats SHEET

True F-16 SPECIFICATION. Dynamic Motion Seats SHEET F-16 SPECIFICATION SHEET COMPLETE DYNAMIC MOTION SEAT SYSTEM INCLUDES Ultra-high fidelity replica ejection seat with multi-channel motion system built inside. Suite of Internal sensors manage seat status.

More information

Neurovestibular/Ocular Physiology

Neurovestibular/Ocular Physiology Neurovestibular/Ocular Physiology Anatomy of the vestibular organs Proprioception and Exteroception Vestibular illusions Space Motion Sickness Artificial gravity issues Eye issues in space flight 1 2017

More information

Perception. What We Will Cover in This Section. Perception. How we interpret the information our senses receive. Overview Perception

Perception. What We Will Cover in This Section. Perception. How we interpret the information our senses receive. Overview Perception Perception 10/3/2002 Perception.ppt 1 What We Will Cover in This Section Overview Perception Visual perception. Organizing principles. 10/3/2002 Perception.ppt 2 Perception How we interpret the information

More information

Capacitive Face Cushion for Smartphone-Based Virtual Reality Headsets

Capacitive Face Cushion for Smartphone-Based Virtual Reality Headsets Technical Disclosure Commons Defensive Publications Series November 22, 2017 Face Cushion for Smartphone-Based Virtual Reality Headsets Samantha Raja Alejandra Molina Samuel Matson Follow this and additional

More information

Touch Perception and Emotional Appraisal for a Virtual Agent

Touch Perception and Emotional Appraisal for a Virtual Agent Touch Perception and Emotional Appraisal for a Virtual Agent Nhung Nguyen, Ipke Wachsmuth, Stefan Kopp Faculty of Technology University of Bielefeld 33594 Bielefeld Germany {nnguyen, ipke, skopp}@techfak.uni-bielefeld.de

More information

Human Factors. Principal Investigators: Nadine Sarter Christopher Wickens. Beth Schroeder Scott McCray. Smart Icing Systems Review, May 28,

Human Factors. Principal Investigators: Nadine Sarter Christopher Wickens. Beth Schroeder Scott McCray. Smart Icing Systems Review, May 28, Human Factors Principal Investigators: Nadine Sarter Christopher Wickens Graduate Students: John McGuirl Beth Schroeder Scott McCray 5-1 SMART ICING SYSTEMS Research Organization Core Technologies Aerodynamics

More information

Tracking. Alireza Bahmanpour, Emma Byrne, Jozef Doboš, Victor Mendoza and Pan Ye

Tracking. Alireza Bahmanpour, Emma Byrne, Jozef Doboš, Victor Mendoza and Pan Ye Tracking Alireza Bahmanpour, Emma Byrne, Jozef Doboš, Victor Mendoza and Pan Ye Outline of this talk Introduction: what makes a good tracking system? Example hardware and their tradeoffs Taxonomy of tasks:

More information

VIEW: Visual Interactive Effective Worlds Lorentz Center International Center for workshops in the Sciences June Dr.

VIEW: Visual Interactive Effective Worlds Lorentz Center International Center for workshops in the Sciences June Dr. Virtual Reality & Presence VIEW: Visual Interactive Effective Worlds Lorentz Center International Center for workshops in the Sciences 25-27 June 2007 Dr. Frederic Vexo Virtual Reality & Presence Outline:

More information

Innovations in Simulation: Virtual Reality

Innovations in Simulation: Virtual Reality Innovations in Simulation: Virtual Reality Sherry Farra, RN, PhD, CNE, CHSE Sherrill Smith RN, PhD, CNL, CNE Wright State University College of Nursing and Health Disclosure The authors acknowledge they

More information

MEASURING AND ANALYZING FINE MOTOR SKILLS

MEASURING AND ANALYZING FINE MOTOR SKILLS MEASURING AND ANALYZING FINE MOTOR SKILLS PART 1: MOTION TRACKING AND EMG OF FINE MOVEMENTS PART 2: HIGH-FIDELITY CAPTURE OF HAND AND FINGER BIOMECHANICS Abstract This white paper discusses an example

More information

Identifying Human Control Behavior

Identifying Human Control Behavior Identifying Human Control Behavior In the SIMONA Research Simulator Dr. ir. Herman Damveld 2-6-2010 Challenge the future Outline Aerospace Engineering Human Control Research at Aerospace Engineering Identifying

More information

Workshop Session #3: Human Interaction with Embedded Virtual Simulations Summary of Discussion

Workshop Session #3: Human Interaction with Embedded Virtual Simulations Summary of Discussion : Summary of Discussion This workshop session was facilitated by Dr. Thomas Alexander (GER) and Dr. Sylvain Hourlier (FRA) and focused on interface technology and human effectiveness including sensors

More information

Audio Output Devices for Head Mounted Display Devices

Audio Output Devices for Head Mounted Display Devices Technical Disclosure Commons Defensive Publications Series February 16, 2018 Audio Output Devices for Head Mounted Display Devices Leonardo Kusumo Andrew Nartker Stephen Schooley Follow this and additional

More information

UNCLASSIFIED FY 2016 OCO. FY 2016 Base

UNCLASSIFIED FY 2016 OCO. FY 2016 Base Exhibit R-2, RDT&E Budget Item Justification: PB 2016 Air Force Date: February 2015 3600: Research, Development, Test & Evaluation, Air Force / BA 2: Applied Research COST ($ in Millions) Prior Years FY

More information

CORE RESEARCH AREA 1: SENSORY PHYSIOLOGY AND MOTION PERCEPTION

CORE RESEARCH AREA 1: SENSORY PHYSIOLOGY AND MOTION PERCEPTION CORE RESEARCH AREA 1: SENSORY PHYSIOLOGY AND MOTION PERCEPTION Keywords: Vestibular, visual and proprioceptive systems, motion sickness, thresholds, adaptation, sensory interaction, spatial orientation,

More information

Multi variable strategy reduces symptoms of simulator sickness

Multi variable strategy reduces symptoms of simulator sickness Multi variable strategy reduces symptoms of simulator sickness Jorrit Kuipers Green Dino BV, Wageningen / Delft University of Technology 3ME, Delft, The Netherlands, jorrit@greendino.nl Introduction Interactive

More information

Technologies. Philippe Fuchs Ecole des Mines, ParisTech, Paris, France. Virtual Reality: Concepts and. Guillaume Moreau.

Technologies. Philippe Fuchs Ecole des Mines, ParisTech, Paris, France. Virtual Reality: Concepts and. Guillaume Moreau. Virtual Reality: Concepts and Technologies Editors Philippe Fuchs Ecole des Mines, ParisTech, Paris, France Guillaume Moreau Ecole Centrale de Nantes, CERMA, Nantes, France Pascal Guitton INRIA, University

More information

Optical Marionette: Graphical Manipulation of Human s Walking Direction

Optical Marionette: Graphical Manipulation of Human s Walking Direction Optical Marionette: Graphical Manipulation of Human s Walking Direction Akira Ishii, Ippei Suzuki, Shinji Sakamoto, Keita Kanai Kazuki Takazawa, Hiraku Doi, Yoichi Ochiai (Digital Nature Group, University

More information

SE4D03 Computer User Interfaces

SE4D03 Computer User Interfaces SE4D03 Computer User Interfaces The Science of Visualization continued Visual Attention Attention comes in two types of considerations: 1. Low-level as considered below, and 2. High-level as considered

More information

Module 2: Lecture 4 Flight Control System

Module 2: Lecture 4 Flight Control System 26 Guidance of Missiles/NPTEL/2012/D.Ghose Module 2: Lecture 4 Flight Control System eywords. Roll, Pitch, Yaw, Lateral Autopilot, Roll Autopilot, Gain Scheduling 3.2 Flight Control System The flight control

More information

Virtual Reality in Neuro- Rehabilitation and Beyond

Virtual Reality in Neuro- Rehabilitation and Beyond Virtual Reality in Neuro- Rehabilitation and Beyond Amanda Carr, OTRL, CBIS Origami Brain Injury Rehabilitation Center Director of Rehabilitation Amanda.Carr@origamirehab.org Objectives Define virtual

More information

Quality of Experience for Virtual Reality: Methodologies, Research Testbeds and Evaluation Studies

Quality of Experience for Virtual Reality: Methodologies, Research Testbeds and Evaluation Studies Quality of Experience for Virtual Reality: Methodologies, Research Testbeds and Evaluation Studies Mirko Sužnjević, Maja Matijašević This work has been supported in part by Croatian Science Foundation

More information

Development of a Novel Low-Cost Flight Simulator for Pilot Training

Development of a Novel Low-Cost Flight Simulator for Pilot Training Development of a Novel Low-Cost Flight Simulator for Pilot Training Hongbin Gu, Dongsu Wu, and Hui Liu Abstract A novel low-cost flight simulator with the development goals cost effectiveness and high

More information

New Challenges of immersive Gaming Services

New Challenges of immersive Gaming Services New Challenges of immersive Gaming Services Agenda State-of-the-Art of Gaming QoE The Delay Sensitivity of Games Added value of Virtual Reality Quality and Usability Lab Telekom Innovation Laboratories,

More information

Sensation notices Various stimuli Of what is out there In reality

Sensation notices Various stimuli Of what is out there In reality 1 Sensation and Perception Are skills we need For hearing, feeling And helping us to see I will begin with A few definitions This way confusion Has some prevention Sensation notices Various stimuli Of

More information

Platform-Based Design of Augmented Cognition Systems. Latosha Marshall & Colby Raley ENSE623 Fall 2004

Platform-Based Design of Augmented Cognition Systems. Latosha Marshall & Colby Raley ENSE623 Fall 2004 Platform-Based Design of Augmented Cognition Systems Latosha Marshall & Colby Raley ENSE623 Fall 2004 Design & implementation of Augmented Cognition systems: Modular design can make it possible Platform-based

More information

Visual Interpretation of Hand Gestures as a Practical Interface Modality

Visual Interpretation of Hand Gestures as a Practical Interface Modality Visual Interpretation of Hand Gestures as a Practical Interface Modality Frederik C. M. Kjeldsen Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Graduate

More information

FRAUNHOFER INSTITUTE FOR INTEGRATED CIRCUITS IIS. MANUAL PANORAMIC MICROSCOPY WITH istix

FRAUNHOFER INSTITUTE FOR INTEGRATED CIRCUITS IIS. MANUAL PANORAMIC MICROSCOPY WITH istix FRAUNHOFER INSTITUTE FOR INTEGRATED CIRCUITS IIS MANUAL PANORAMIC MICROSCOPY WITH istix CLINICAL DIAGNOSTICS AND MATERIAL SCIENCES IMPROVED BY DIGITAL MICROSCOPY B A C K G R O U N D Due to a high grade

More information

Interactive Simulation: UCF EIN5255. VR Software. Audio Output. Page 4-1

Interactive Simulation: UCF EIN5255. VR Software. Audio Output. Page 4-1 VR Software Class 4 Dr. Nabil Rami http://www.simulationfirst.com/ein5255/ Audio Output Can be divided into two elements: Audio Generation Audio Presentation Page 4-1 Audio Generation A variety of audio

More information

Motion Perception II Chapter 8

Motion Perception II Chapter 8 Motion Perception II Chapter 8 Lecture 14 Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Spring 2019 Eye movements: also give rise to retinal motion. important to distinguish motion due to

More information

Towards a Next Generation Platform for Neuro-Therapeutics

Towards a Next Generation Platform for Neuro-Therapeutics Update November 2017 Towards a Next Generation Platform for Neuro-Therapeutics Dr Christopher Brown Pain and cognitive neuroscience Dr Alex Casson EPS researcher Prof Anthony Jones Neuro-rheumatologist

More information

Reinventing movies How do we tell stories in VR? Diego Gutierrez Graphics & Imaging Lab Universidad de Zaragoza

Reinventing movies How do we tell stories in VR? Diego Gutierrez Graphics & Imaging Lab Universidad de Zaragoza Reinventing movies How do we tell stories in VR? Diego Gutierrez Graphics & Imaging Lab Universidad de Zaragoza Computer Graphics Computational Imaging Virtual Reality Joint work with: A. Serrano, J. Ruiz-Borau

More information

Autonomous Mobile Robot Design. Dr. Kostas Alexis (CSE)

Autonomous Mobile Robot Design. Dr. Kostas Alexis (CSE) Autonomous Mobile Robot Design Dr. Kostas Alexis (CSE) Course Goals To introduce students into the holistic design of autonomous robots - from the mechatronic design to sensors and intelligence. Develop

More information

SENLUTION Miniature Angular & Heading Reference System The World s Smallest Mini-AHRS

SENLUTION Miniature Angular & Heading Reference System The World s Smallest Mini-AHRS SENLUTION Miniature Angular & Heading Reference System The World s Smallest Mini-AHRS MotionCore, the smallest size AHRS in the world, is an ultra-small form factor, highly accurate inertia system based

More information

Simulator Sickness Questionnaire: Twenty Years Later

Simulator Sickness Questionnaire: Twenty Years Later University of Iowa Iowa Research Online Driving Assessment Conference 2013 Driving Assessment Conference Jun 19th, 12:00 AM Simulator Sickness Questionnaire: Twenty Years Later Stacy A. Balk Science Applications

More information

Wireless In Vivo Communications and Networking

Wireless In Vivo Communications and Networking Wireless In Vivo Communications and Networking Richard D. Gitlin Minimally Invasive Surgery Wirelessly networked modules Modeling the in vivo communications channel Motivation: Wireless communications

More information

Partner sought to develop a Free Viewpoint Video capture system for virtual and mixed reality applications

Partner sought to develop a Free Viewpoint Video capture system for virtual and mixed reality applications Technology Request Partner sought to develop a Free Viewpoint Video capture system for virtual and mixed reality applications Summary An Austrian company active in the area of artistic entertainment and

More information

U.S. ARMY AVIATION CENTER. Aviation Medicine

U.S. ARMY AVIATION CENTER. Aviation Medicine SUBCOURSE EDITION AV0593 6 U.S. ARMY AVIATION CENTER Aviation Medicine THIS SUBCOURSE HAS BEEN REVIEWED FOR OPERATIONS SECURITY CONSIDERATIONS. UNITED STATES ARMY CORRESPONDENCE COURSE AVIATION SUBCOURSE

More information

Virtual Reality Calendar Tour Guide

Virtual Reality Calendar Tour Guide Technical Disclosure Commons Defensive Publications Series October 02, 2017 Virtual Reality Calendar Tour Guide Walter Ianneo Follow this and additional works at: http://www.tdcommons.org/dpubs_series

More information

Graphics and Perception. Carol O Sullivan

Graphics and Perception. Carol O Sullivan Graphics and Perception Carol O Sullivan Carol.OSullivan@cs.tcd.ie Trinity College Dublin Outline Some basics Why perception is important For Modelling For Rendering For Animation Future research - multisensory

More information

New Software Tool Visualizes Spatial Disorientation in Airplane Safety Events

New Software Tool Visualizes Spatial Disorientation in Airplane Safety Events New Software Tool Visualizes Spatial Disorientation in Airplane Safety Events Dr. Eric Groen Senior scientist, TNO Co-authors: Dr. Mark Houben, TNO Prof. Jelte Bos, TNO Mr. Jan Bos, TNO 1 Research area

More information

Jane Li. Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute

Jane Li. Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute Jane Li Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute Use an example to explain what is admittance control? You may refer to exoskeleton

More information

Short Course on Computational Illumination

Short Course on Computational Illumination Short Course on Computational Illumination University of Tampere August 9/10, 2012 Matthew Turk Computer Science Department and Media Arts and Technology Program University of California, Santa Barbara

More information

INERTIAL LABS SUBMINIATURE 3D ORIENTATION SENSOR OS3DM

INERTIAL LABS SUBMINIATURE 3D ORIENTATION SENSOR OS3DM Datasheet Rev..5 INERTIAL LABS SUBMINIATURE D ORIENTATION SENSOR TM Inertial Labs, Inc Address: 9959 Catoctin Ridge Street, Paeonian Springs, VA 2029 U.S.A. Tel: + (70) 880-4222, Fax: + (70) 95-877 Website:

More information

ClearVision Complete HUD and EFVS Solution

ClearVision Complete HUD and EFVS Solution ClearVision Complete HUD and EFVS Solution SVS, EVS & CVS Options Overhead-Mounted or Wearable HUD Forward-Fit & Retrofit Solution for Fixed Wing Aircraft EFVS for Touchdown and Roll-out Enhanced Vision

More information

Why interest in visual perception?

Why interest in visual perception? Raffaella Folgieri Digital Information & Communication Departiment Constancy factors in visual perception 26/11/2010, Gjovik, Norway Why interest in visual perception? to investigate main factors in VR

More information

SKYBOX. 5-channel Digital EMG, NCS and EP System

SKYBOX. 5-channel Digital EMG, NCS and EP System SKYBOX - COMPACT - INSTANT EMG ACQUISITION - ALL EP MODALITIES IN BASE DELIVERY SET - EMG ACCORDING TO INTERNATIONAL STANDARDS - PORTABLE, CAN BE POWERED BY NOTEBOOK 5-channel Digital EMG, NCS and EP System

More information

Title: A Comparison of Different Tactile Output Devices In An Aviation Application

Title: A Comparison of Different Tactile Output Devices In An Aviation Application Page 1 of 6; 12/2/08 Thesis Proposal Title: A Comparison of Different Tactile Output Devices In An Aviation Application Student: Sharath Kanakamedala Advisor: Christopher G. Prince Proposal: (1) Provide

More information

The CyberSeat. A computer-driven consumer product for simulation A multi-media and internet-related project. Copyright Transforce Developments Ltd 1

The CyberSeat. A computer-driven consumer product for simulation A multi-media and internet-related project. Copyright Transforce Developments Ltd 1 The CyberSeat A computer-driven consumer product for simulation A multi-media and internet-related project Copyright Transforce Developments Ltd 1 What is The CyberSeat? An exciting, durable, silent, extremely

More information

Blind navigation with a wearable range camera and vibrotactile helmet

Blind navigation with a wearable range camera and vibrotactile helmet Blind navigation with a wearable range camera and vibrotactile helmet (author s name removed for double-blind review) X university 1@2.com (author s name removed for double-blind review) X university 1@2.com

More information

Admin. Today: Designing for Virtual Reality VR and 3D interfaces Interaction design for VR Prototyping for VR

Admin. Today: Designing for Virtual Reality VR and 3D interfaces Interaction design for VR Prototyping for VR HCI and Design Admin Reminder: Assignment 4 Due Thursday before class Questions? Today: Designing for Virtual Reality VR and 3D interfaces Interaction design for VR Prototyping for VR 3D Interfaces We

More information

Perception in Immersive Virtual Reality Environments ROB ALLISON DEPT. OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCE YORK UNIVERSITY, TORONTO

Perception in Immersive Virtual Reality Environments ROB ALLISON DEPT. OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCE YORK UNIVERSITY, TORONTO Perception in Immersive Virtual Reality Environments ROB ALLISON DEPT. OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCE YORK UNIVERSITY, TORONTO Overview Basic concepts and ideas of virtual environments

More information

Defense Technical Information Center Compilation Part Notice

Defense Technical Information Center Compilation Part Notice UNCLASSIFIED Defense Technical Information Center Compilation Part Notice ADP013886 TITLE: Motion Sickness When Driving With a Head-Slaved Camera System DISTRIBUTION: Approved for public release, distribution

More information