David Jones President, Quantified Design

Similar documents
Virtual and Augmented Reality for Cabin Crew Training: Practical Applications

Admin. Today: Designing for Virtual Reality VR and 3D interfaces Interaction design for VR Prototyping for VR

MANPADS VIRTUAL REALITY SIMULATOR

10/18/2010. Focus. Information technology landscape

PRESS RELEASE EUROSATORY 2018

Roadmap for virtual reality (VR)

Potential Uses of Virtual and Augmented Reality Devices in Commercial Training Applications

Health & Safety

CAN GALVANIC VESTIBULAR STIMULATION REDUCE SIMULATOR ADAPTATION SYNDROME? University of Guelph Guelph, Ontario, Canada

State Of The Union.. Past, Present, And Future Of Wearable Glasses. Salvatore Vilardi V.P. of Product Development Immy Inc.

Introduction.

Virtual Reality in aviation training

One Size Doesn't Fit All Aligning VR Environments to Workflows

Mid-term report - Virtual reality and spatial mobility

Simulation and Virtual reality

Virtual Reality Based Scalable Framework for Travel Planning and Training

Realtime 3D Computer Graphics Virtual Reality

Software Requirements Specification

Immersive Training. David Lafferty President of Scientific Technical Services And ARC Associate

AUGMENTED VIRTUAL REALITY APPLICATIONS IN MANUFACTURING

Teaching Psychology in a $15 million Virtual Reality Environment

* These health & safety warnings are periodically updated for accuracy and completeness. Check oculus.com/warnings for the latest version.

Imagine your future lab. Designed using Virtual Reality and Computer Simulation

SIMULATION MODELING WITH ARTIFICIAL REALITY TECHNOLOGY (SMART): AN INTEGRATION OF VIRTUAL REALITY AND SIMULATION MODELING

Using VR and simulation to enable agile processes for safety-critical environments

Sikorsky S-70i BLACK HAWK Training

Development of a Novel Low-Cost Flight Simulator for Pilot Training

VIRTUAL REALITY. for events & conferences

CSC 2524, Fall 2018 Graphics, Interaction and Perception in Augmented and Virtual Reality AR/VR

INTUITION Integrated Research Roadmap

Haptics-Augmented Physics Simulation: Coriolis Effect

Arcaid: Addressing Situation Awareness and Simulator Sickness in a Virtual Reality Pac-Man Game

The Impact of Dynamic Convergence on the Human Visual System in Head Mounted Displays

Virtual Reality in Neuro- Rehabilitation and Beyond

SKILLS Conference 2011 Montpellier 15 th December Emanuele Ruffaldi & ROW Team

Established via Executive Order in Help craft the future vision of learning science and tech

The Army s Future Tactical UAS Technology Demonstrator Program

preface Motivation Figure 1. Reality-virtuality continuum (Milgram & Kishino, 1994) Mixed.Reality Augmented. Virtuality Real...

LANEY COLLEGE COURSE OUTLINE

Immersive Mobile Technologies: Virtual/Augmented Reality Technologies in the Classroom

FINAL PROJECT BEST WAYS OF PRODUCING CYBERSICKNESS IN VR

immersive visualization workflow

Developing a VR System. Mei Yii Lim

HeroX - Untethered VR Training in Sync'ed Physical Spaces

Welcome, Introduction, and Roadmap Joseph J. LaViola Jr.

ARMY RDT&E BUDGET ITEM JUSTIFICATION (R2 Exhibit)

Perception in Immersive Virtual Reality Environments ROB ALLISON DEPT. OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCE YORK UNIVERSITY, TORONTO

Engineering excellence through life SIMULATION AND TRAINING. Immersive, high-fidelity, 3D software solutions

Edward Waller Joseph Chaput Presented at the IAEA International Conference on Physical Protection of Nuclear Material and Facilities

Revolution of the Information Viewport

Video Games and Interfaces: Past, Present and Future Class #2: Intro to Video Game User Interfaces

Chapter 1 Virtual World Fundamentals

Mitigating Visually Induced Motion Sickness: A Virtual Hand-Eye Coordination Task

EVALUATION OF. SECURITY FORCES APPLICATIONS IN THE CONTEXT OF VIRTUAL REALITY AND MOBILE LEARNING Prof. Gonca Telli Yamamoto

arxiv: v1 [cs.hc] 6 Oct 2017

Virtual Reality. A Unique Selling Strategy for International Markets

EMPOWERING THE CONNECTED FIELD FORCE WORKER WITH ADVANCED ANALYTICS MATTHEW SHORT ACCENTURE LABS

Pilot Training with the Full Capability of an Integrated LVC Training System

VIRTUAL REALITY. Mete CINAR - Merve KAYA - Gonul KANBAY - Umit VATANSEVER. Course Professor Rushan ZIATDINOV FATIH UNIVERSITY

[Akmal, 4(9): September, 2015] ISSN: (I2OR), Publication Impact Factor: 3.785

Immersive Visualization On the Cheap. Amy Trost Data Services Librarian Universities at Shady Grove/UMD Libraries December 6, 2019

Attorney Docket No Date: 25 April 2008

Easy Robot Software. And the MoveIt! Setup Assistant 2.0. Dave Coleman, PhD davetcoleman

Adilas.biz Career Opportunities:

FIRESIDE. a 1-day immersive tech workshop

Multi variable strategy reduces symptoms of simulator sickness

How Virtual Reality Works

Study on Parallax Affect on Simulator Sickness in One-screen and Three-screen Immersive Virtual Environment

Leaping from Role Play to Game Play

Navigation in Immersive Virtual Reality The Effects of Steering and Jumping Techniques on Spatial Updating

Unity & VR Best Practices

APSC 150 Project: Remotely Controlled Satellite Launcher Design [Feb.2015]

Embalse Simulator for Training and Plant Life Extension

Virtual Reality Mobile 360 Nanodegree Syllabus (nd106)

INFORMATION DECK 2018

Using Hybrid Reality to Explore Scientific Exploration Scenarios

VR-programming. Fish Tank VR. To drive enhanced virtual reality display setups like. Monitor-based systems Use i.e.

Quality of Experience assessment methodologies in next generation video compression standards. Jing LI University of Nantes, France

The development of a virtual laboratory based on Unreal Engine 4

History of Virtual Reality. Trends & Milestones

Bring Imagination to Life with Virtual Reality: Everything You Need to Know About VR for Events

Virtual Reality on a Budget. Tuesday, February 6 8:00 a.m. 11:00 a.m. Room 9C Capacity: 90

Motion sickness issues in VR content

Virtual Reality in E-Learning Redefining the Learning Experience

A Step Forward in Virtual Reality. Department of Electrical and Computer Engineering

VR based HCI Techniques & Application. November 29, 2002

ThumbsUp: Integrated Command and Pointer Interactions for Mobile Outdoor Augmented Reality Systems

FAA Research and Development Efforts in SHM

Is This Real Life? Augmented & Virtual Reality in Your Library

> Training & Simulation The only way to be ready for anything is to be prepared for everything Helicopters

Application of eye tracking and galvanic vestibular inputs for enhancing human performance

VIRTUAL REALITY FOR METAL ARC WELDING: A REVIEW AND DESIGN CONCEPT

Human Integration in the Life-cycle of Aviation Systems HILAS

SUNY Immersive Augmented Reality Classroom. IITG Grant Dr. Ibrahim Yucel Dr. Michael J. Reale

Dialogue goggles by Lygia Clark (1968). A conceptual art performance.

More than Meets the Eye

MRT: Mixed-Reality Tabletop

MULTI-INDUSTRY TRAINING SIMULATOR

The Design of Teaching System Based on Virtual Reality Technology Li Dongxu

Design of All Digital Flight Program Training Desktop Application System

Transcription:

Cabin Crew Virtual Reality Training Guidelines Based on Cross- Industry Lessons Learned: Guidance and Use Case Results David Jones President, Quantified Design Solutions @DJonesCreates

2 David Jones Human Factors Industrial Engineering 14 Years Training Experience Focus on Advanced R&D Military, Medical, Aviation

Why Virtual Reality And no the answer is not because it s cool Well, that s not the only reason

4 Computer Based Training Perfect for basic knowledge acquisition Affordable Low barrier to entry Easily Updated After all, content does change Available to Masses Computers are everywhere now

5 Mobile Training Training on the Go Perfect for Just in Time Training Trackable All performance can generally be sent to a Learning Management System

https://www.gartner.com/newsroom/id/3784363 Virtual Training Engagement, skill acquisition, muscle memory 6 Physical Practice Muscle Memory Smaller Space Full sized simulators not required Engaging/Safe Medium allows for exciting training and safe for high risk tasks

A Little Background on Virtual Reality How Did We Get Here

8 A High Level History 1950s-1960s Morton Heilig s Sensorama Full Immersion Experience- Audio, 3D Visual, Scent, Vibration, Fans 1987- Virtual Reality Term Used Visual Programming Lab (Jaron Lanier) was the first company to sell VR Goggles and gloves

Mid-90 s- Gaming Companies Want a Piece of VR 9 Nintendo and SEGA both fail- Too expensive and clunky 2010- Present- Commercial Gaming is Back and Better Hardware platforms are getting better and applying lessons learned from research 90 s through 2010- LOTS of research Military, NASA, Education, Aviation, and Medical research in VR. 2017- Virtual Cabin Crew Training Virtual training is ready for Cabin Crew and maintenance applications

INDUSTRY GUIDANCE Standing on the shoulders of giants- Applying lessons learned To make training good

VR Sickness #1 barrier to VR integration 11 Problem Space Motion Sickness- Disagreement between visual perception and vestibular system. - Simulator Sickness- Subset of motion sickness caused by the use of simulators (interesting to note that experience effects sim sickness) - VR Sickness- Subset of simulator sickness caused by VR use Symptoms- Headache, nausea, sweating, drowsiness, disorientation Reduce multimodal mismatches Improve the match between head movement and visual updates, including improving visual framerates (Badcock, Palmisano, & May, 2014) Reduced FOV when moving (reduce vection) Leverage approaches to reduce vection, including reducing fast movements in the scene and dynamically reducing the FOV when leveraging controller movement (Fernandes & Feiner, 2016) Reduce Unnatural Movements Leverage room scale design to allow physical movements to drive visual updates (instead of controller inputs). When controller movement is a must, avoid unnatural movements. Always allow the user to control the movement. Babcock, D.R., Palmisano, S., & May, J.G. (2014). Vision and Virtual Environments. In Handbook of Virtual Environments: Design, implementation, and applications (2 nd ed., pp.39-86). Boca Raton, FL: Taylor & Francis Group, Inc. Fernandes, A. S. and Feiner, S.K. (2016). Combating VR sickness through subtle dynamic field-of-view modification. 2016 IEEE Symposium on 3D User Interfaces (3DUI), Greenville, SC, pp 201-210.

Additional Guidance 12 Training Intervals VR training has the potential to create aftereffects and discomfort after long use. To reduce these effects limit time to 30 minutes of continuous use. To make training as efficient as possible, plan training for short training sessions (1 hour or less) on consecutive days (Kang, et al., 2015) User Interfaces Need to Change Leverage natural user interfaces when possible and avoid heads up displays to present information. Instead present them naturally in the environment Reduce Intrinsic and Extraneous Cognitive Load Cognitive Load = Intrinsic Cognitive Load + Extraneous + Germane Intrinsic Load can be reduced by creating smaller, easier to accomplish steps. Within VR s, Extraneous load comes from distracting information and hard to learn controls/interfaces. Simplify controls and reduce distractions.

USE CASE Cabin Crew Virtual Readiness Trainer

14 Cabin Crew Virtual Readiness Lab Problem Opportunity Space Student Throughput American Airlines would not have enough physical training platforms to keep up with training demands Breadth of scenarios Within a physical training platform, creating and resetting a variety of scenarios takes a lot of time to do Expanding Class Structure American Airlines was changing their program to increase training demand and reduce training cycles New Focus to Student Driven Training American Airlines wanted a way to allow their students to drive their own training on their own schedule with less instructor involvement Student Engagement Students are not engaged during classroom training due to lack of interactivity. This has the potential to lead to poor performance

15 VR Training Turn-key 12-room VR training lab Quantified Design and Newton Design developed a VR training application to introduce air crew to new aircraft and complete pretraining prior to FAA approved check-outs on physical trainers Designed to practice door operations and knowledge of emergency equipment locations and preflight check requirements.

Cabin Crew Virtual Readiness- 16 Two Training Goals, Two Modes Optimizing training efficiency and effectiveness for door training and equipment knowledge Training Mode Students are guided through door open and closing procedures as well as the location of emergency equipment Evaluation Mode Students are evaluated on door open and closing procedures and the location of emergency equipment

17 Design and Development Process Iteration in every step 01 02 03 04 Defining Goals Design Research/ Rapid Prototyping Final Design Delivery/ Support Testing Refining Execution 08 07 06 05

Results/Training Self-Efficacy 18 Improved Self-Efficacy From February Class High Self-efficacy scores increased from 20% of students to 68% Scope/ Process 50 Students completed self-efficacy Measures given before and after training Limitations of Research Small Scale (50 Learners)

Results/Transfer of Training 19 Improved Performance From Jan March Unsatisfactory rate dropped from 25% to 2% Error Free Increased from 34% to 82% Scope/ Process 750 Students completed training VR training changes added in February to focus on monitor and challenge skill Limitations of Research Currently completing comprehensive review associating time in VR and performance in VR to initial procedural evaluations

LESSONS LEARNED/ GUIDANCE AND NEXT STEPS Cabin Crew Virtual Readiness Trainer

Controls Can t Be Simplified Enough 21 Lesson When you think you ve simplified enough, simplify again Initial Design- 4 buttons on control Simplified Controller- 2 buttons on control Final Design- Hand tracking

Provide all Long Distance Movement Through Teleportation 22 Lesson When required to move a larger distance than the room space will allow, leverage teleportation to reduce potential for sim sickness Tested Designs- Walking with controls Free teleportation Restricted teleportation

Integrate Learning Management and Progression System 23 Lesson Leverage a data driven progression system to unlock training as students complete Initial Training- Fully unlocked to allow for exploration. This led to reduced training efficiency as students did not train to proficiency prior to moving on Final Design- Supports train to proficiency progression guiding them through an optimal training path Complete A321 Training to Unlock

Future Research 24 Detailed analysis to evaluate effects of time in VR to trials saved and initial transfer performance in live evaluation

Visit our Booth for a Demo and compete to win an ipad Mini Compete all week to add chances for the drawing 25 WATS- Booth 209 David Jones- President 3259 Progress Drive, Suite A Orlando, FL 32826 David.jones@quantifieddesign.com 321-430-8374 www.quantifieddesign.com