AutoHabLab Addressing Design Challenges in Automotive UX. Prof. Joseph Giacomin September 4 th 2018

Similar documents
Gavriel Salvendy (1985)

Figure 1) Early driving simulators (

Humans and Automated Driving Systems

ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS

The Art and Fun of User Integration. Consortium Building Workshop Brussels, April 16, 2015

Designing A Human Vehicle Interface For An Intelligent Community Vehicle

Usability vs. user experience

Iowa Research Online. University of Iowa. Robert E. Llaneras Virginia Tech Transportation Institute, Blacksburg. Jul 11th, 12:00 AM

Trust in Automated Vehicles

MIN-Fakultät Fachbereich Informatik. Universität Hamburg. Socially interactive robots. Christine Upadek. 29 November Christine Upadek 1

HUMAN-MACHINE COLLABORATION THROUGH VEHICLE HEAD UP DISPLAY INTERFACE

Early Take-Over Preparation in Stereoscopic 3D

Associated Emotion and its Expression in an Entertainment Robot QRIO

R.I.T. Design Thinking. Synthesize and combine new ideas to create the design. Selected material from The UX Book, Hartson & Pyla

This document is downloaded from DR-NTU, Nanyang Technological University Library, Singapore.

Introduction to HCI. CS4HC3 / SE4HC3/ SE6DO3 Fall Instructor: Kevin Browne

Digital Swarming. Public Sector Practice Cisco Internet Business Solutions Group

HAPTICS AND AUTOMOTIVE HMI

Non Verbal Communication of Emotions in Social Robots

Interaction in Urban Traffic Insights into an Observation of Pedestrian-Vehicle Encounters

Partners. Mobility Schemes Ensuring ACCESSibility of Public Transport for ALL Users. all.eu

Journal of Physics: Conference Series PAPER OPEN ACCESS. To cite this article: Lijun Jiang et al 2018 J. Phys.: Conf. Ser.

Technology trends in the digitalization era. ANSYS Innovation Conference Bologna, Italy June 13, 2018 Michele Frascaroli Technical Director, CRIT Srl

Communication and interaction strategies in automotive adaptive interfaces *

Safe Speech by Knowledge

The word ergonomics implies the study of man at work while the word human factors implies the study of man in relation to equipment and environment.

Connected Car Networking

Multi-sensory Tracking of Elders in Outdoor Environments on Ambient Assisted Living

Virtual Road Signs: Augmented Reality Driving Aid for Novice Drivers

STUDY ON REFERENCE MODELS FOR HMI IN VOICE TELEMATICS TO MEET DRIVER S MIND DISTRACTION

A Matter of Trust: white paper. How Smart Design Can Accelerate Automated Vehicle Adoption. Authors Jack Weast Matt Yurdana Adam Jordan

Adapting SatNav to Meet the Demands of Future Automated Vehicles

Designing the consumer experience

Interaction Design. Beyond Human - Computer Interaction. 3rd Edition

THE FUTURE OF DATA AND INTELLIGENCE IN TRANSPORT

Safe, Efficient and Effective Testing of Connected and Autonomous Vehicles Paul Jennings. Franco-British Symposium on ITS 5 th October 2016

Christine T. Wood, Ph.D.

Integrated Driving Aware System in the Real-World: Sensing, Computing and Feedback

1:15-2:15 p.m. Registration & Refreshments

Volkswagen Group: Leveraging VIRES VTD to Design a Cooperative Driver Assistance System

Touch Perception and Emotional Appraisal for a Virtual Agent

INTERIOR DESIGN PROGRAM. General Objective And Profiles. 1. Overall objective of the bachelor s degree

School of Computer Science. Course Title: Introduction to Human-Computer Interaction Date: 8/16/11

Essay on A Survey of Socially Interactive Robots Authors: Terrence Fong, Illah Nourbakhsh, Kerstin Dautenhahn Summarized by: Mehwish Alam

Assessments of Grade Crossing Warning and Signalization Devices Driving Simulator Study

Immersive Simulation in Instructional Design Studios

The GATEway Project London s Autonomous Push

Home-Care Technology for Independent Living

Decision to make the Wireless Telegraphy (Vehicle Based Intelligent Transport Systems)(Exemption) Regulations 2009

Evaluating 3D Embodied Conversational Agents In Contrasting VRML Retail Applications

Assistant Professor Computer Science. Introduction to Human-Computer Interaction

Map of Human Computer Interaction. Overview: Map of Human Computer Interaction

Open Research Online The Open University s repository of research publications and other research outputs

OASIS concept. Evangelos Bekiaris CERTH/HIT OASIS ISWC2011, 24 October, Bonn

Game Design 2. Table of Contents

Analysis of Computer IoT technology in Multiple Fields

CPE/CSC 580: Intelligent Agents

Digital Radio in the car in 10 years

VSI Labs The Build Up of Automated Driving

Performance Evaluation of a Hybrid Sensor and Vehicular Network to Improve Road Safety

Centre for the Study of Human Rights Master programme in Human Rights Practice, 80 credits (120 ECTS) (Erasmus Mundus)

Choosing the Optimum Mix of Sensors for Driver Assistance and Autonomous Vehicles

Qosmotec. Software Solutions GmbH. Technical Overview. QPER C2X - Car-to-X Signal Strength Emulator and HiL Test Bench. Page 1

The 3xD Simulator for Intelligent Vehicles Professor Paul Jennings. 20 th October 2016

Towards affordance based human-system interaction based on cyber-physical systems

Towards Intuitive Industrial Human-Robot Collaboration

Development of Gaze Detection Technology toward Driver's State Estimation

Distributed Vision System: A Perceptual Information Infrastructure for Robot Navigation

Human-Computer Interaction

EVALUATION OF DIFFERENT MODALITIES FOR THE INTELLIGENT COOPERATIVE INTERSECTION SAFETY SYSTEM (IRIS) AND SPEED LIMIT SYSTEM

Work Domain Analysis (WDA) for Ecological Interface Design (EID) of Vehicle Control Display

Human-Centered Design. Ashley Karr, UX Principal

Enhancing industrial processes in the industry sector by the means of service design

Situational Awareness A Missing DP Sensor output

Autonomic gaze control of avatars using voice information in virtual space voice chat system

Scania s truck Simulator and its contribution to simulator-based design: Simulator architecture, uses, and processes.

CRUCIALLY IMPORTANT FOR DESIGN

Racenet - Sports Gambling. Multi Maxa - MVP app built from scratch

Autonomy Mode Suggestions for Improving Human- Robot Interaction *

Human-Computer Interaction

A SURVEY OF SOCIALLY INTERACTIVE ROBOTS

White paper on CAR28T millimeter wave radar

Abstract. Keywords: virtual worlds; robots; robotics; standards; communication and interaction.

Design Technology. IB DP course syllabus

Intelligent driving TH« TNO I Innovation for live

Virtual Shadow: Making Cross Traffic Dynamics Visible through Augmented Reality Head Up Display

FAQ New Generation Infotainment Insignia/Landing page usage

Real Time Traffic Light Control System Using Image Processing

1. EXECUTIVE SUMMARY

Further than the Eye Can See Jennifer Wahnschaff Head of Instrumentation & Driver HMI, North America

Can the Success of Mobile Games Be Attributed to Following Mobile Game Heuristics?

Directional Driver Hazard Advisory System. Benjamin Moore and Vasil Pendavinji ECE 445 Project Proposal Spring 2017 Team: 24 TA: Yuchen He

PROGRAM OVERVIEW. 10th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications

The Application of Human-Computer Interaction Idea in Computer Aided Industrial Design

lecture notes for method Observation & Invention

Current Technologies in Vehicular Communications

Human-Computer Interaction IS 4300

Embracing Complexity. Gavin Walker Development Manager

With a New Helper Comes New Tasks

A Brief Survey of HCI Technology. Lecture #3

Transcription:

AutoHabLab Addressing Design Challenges in Automotive UX Prof. Joseph Giacomin September 4 th 2018

Human Centred Design

Human Centred Design Involves techniques which empathise with, interact with, and stimulate people, achieving an understanding of their needs, desires and perspectives which often transcends that which they themselves knew and realised. Leads to products, systems and services which are physically, perceptually, cognitively and emotionally intuitive.

Some Human Centred Design Tools Facts Regarding Humans and Society Capture of Meanings and Needs Simulation of Possible Futures - Anthropometric data sets and models - Biomechanical data sets and models - Psychophysical data sets and models - Cognitive data sets and models - Emotional data sets and models - Psychological data sets and models - Sociological data sets and models - Philosophical data sets and models Verbally based - Ethnographic interviews - Questionnaires - Day-in-the-life analysis - Cognitive task analysis - The five whys - Conceptual landscape - Think aloud analysis - Metaphor elicitation - Be your customer - Customer journey - Personas - Scenarios - Extreme Users Non Verbally based - Game playing - Cultural Probes - Visual journals - Error analysis - Fly-on-the-wall observation - Customer Shadowing - Body language analysis - Facial coding analysis - Physiological measures - Electroencephalograms - Role playing - Focus groups - Co-design - Experience prototypes - Para-functional prototypes - Real fictions

Human Centred Design Process prototyping customer testing construct co-design technical specification meaning/metaphor elicitation time

1990 1994 1985

1995

2001

The current trend is a reduced emphasis on matters of physics, which are now minimum requirements, and a greater emphasis on matters of metaphysics.

Automotive Design Challenge

Challenges Arising From The Context Response (n=20 participants) to the question what would you like now? 4618 words 5333 words 5704 words Giuliano, L, Germak, C. and Giacomin, J. 2017, Effect of Driving Context On Design Dialogue, 8th Int. Conf. on Applied Human factors and Ergonomics (AHFE),17 to 21 July, Los Angeles, California, USA.

Challenges Arising From Human Nature - role of emotion - attention narrowing under intense emotion (Easterbrook effect) - fading affect bias - errors caused by encoding to, and recalling from, long term memory - gaps caused by the event horizon

Challenges Arising From Previous Experience When you were in a car Describe a time you were in a car and something happened that made you respond emotionally. Where specifically did the story happen? (i.e. motorway? country road? car park? etc.) Events What did you do? (Tell us what were your actions) Activities What or who were involved in the story? (i.e. intelligent technology, animals or human?) Agents At the time of the story, you felt... (Choose as many as you like) Emotions Other Anger Fear Disgust Happiness Sadness Surprise

Challenges Arising From Previous Experience Themes from the emotion survey (n=245 respondents): Theme 1. Road violations (i.e. Overtaking, Insulting, Forcing to give way) Theme 2. Car accident (i.e. Bumping into another car or obstacle, Memory of the accident) Theme 3. External environment conditions (i.e. Heavy traffic, Road infrastructure, Other road users) Theme 4. Infotainment (i.e. Music on the radio, News from the radio / calls) Theme 5. Car hardware system malfunction (i.e. Warning alerts, Broken down, Partial system malfunction) Theme 6. Abrupt manoeuvring of driver (i.e. Sudden stop, Sudden road entry, Sudden lane changing) Theme 7. Lack of awareness in driving (i.e. Mistakes/confusion, First time driving in conditions) Theme 8. Driving with a loved one (i.e. Driving with family, Driving with friends) Theme 9. Generous driving behaviour on the road (i.e. Getting help, Giving way) Theme 10. Driver s in-car experience (i.e. Experience with car features, Feeling relaxation) Theme 11. Car software system malfunction (i.e. Navigation/GPS error, Flat phone battery) Theme 12. Driving landscape (i.e. Seeing incredible scenery, Night driving with stars) Theme 13. Usability (i.e. Adjusting angels of mirrors)

Virtual Workshops: a new tool for automotive HCD

Addressing Emotion

Basic Emotions Joy Distress Fear Anger Surprise Disgust Ekman (1971) concluded that at least some emotions are basic, universal or innate. It is now generally accepted that there are at least six basic emotions which are of rapid onset and which last only a few seconds at a time.

Real-Time Emotion Measurement

Emotion Road Circuit Drive time of 40 minutes Distance of 15.2 miles City of 4.5 miles (23%) Country of 4 miles (26%) Highway of 6.7 miles (44%)

Driving Emotion Study Naturalistic Setting Partially-controlled Setting Familiar Environment In people s own cars Familiar Route Route familiar to Participant Unfamiliar Environment In JLR car Predefined Route Emotion road circuit Min. 20 participants covering different driver types Real-time FEA of 6 basic emotions and facial action units

Driving Emotion Statistics: setting Naturalistic Setting Average Of One Emotion Event Every 2 Minutes Partially Controlled Setting Average Of One Emotion Event Every 1.5 Minutes

Driving Emotion Statistics: roads Average emotion rate for all roads was 2.16 facial expressions per minute. Total Time (Sec) Total FE FE/Sec Relative Highway 16340 465 0.028 0.80 City 19163 687 0.036 1.00 Country 10273 434 0.042 1.19

Driving Emotion Statistics: causes City 14% NAVIGATION ALERT 11% ENJOYING CAR 10% NO CAUSE ASSIGNED 7% HIGH TRAFFIC DENSITY 7% CHECKING NAVIGATION 5% INTERACTION WITH PERSON Highway 23% CHECKING NAVIGATION 17% HIGH TRAFFIC DENSITY 6% NO CAUSE ASSIGNED 5% BAD ROAD CONDITIONS 5% ROUNDABOUT 4% NAVIGATION ALERT Country 27% BAD ROAD CONDITIONS 13% LIMITED VISUAL FIELD 9% CHECKING NAVIGATION 4% CAR PASSING CLOSE 3% NO CAUSE ASSIGNED 3% SUN BLINDING DRIVER

Addressing Co-Design

Communication Requirements For people in automobiles the real-time communication is effected by the screen size, screen resolution and sound volume of the in-car interface. Tests of achievable combinations of these three parameters were thus performed in a driving simulator Screen Options Size (inches) Pixels* Speaker Options Volume** 1 7.8 x 5.8 854 x 480 1 55 db 2 5.6 x 4.2 3 4 x 3 320 x 180 2 67 db 3 77 db *images at 25 frames per second **sound at driver s left ear.

Communication Requirements For each of the nine combinations (3 screens x 3 volumes) each participant (n=24) was asked to drive in a driving simulator while performing secondary tasks: - follow a route involving five road junctions which was presented on screen; - detect and count the ball passes which occurred in a thirty second sports video presented on screen; - detect and count a specific word from within a two minute speech emitted from the speaker; Measurements were made of the cognitive workload (WL*), perceived media quality (PMQ**) and error rate (ER***) at the end of each secondary task. The secondary tasks were repeated three times for a total driving time of approximately 45 minutes. * Sauro, J. and Dumas, J.S. 2009, Comparison of three one-question, post-task usability questionnaires, Proceedings Of The SIGCHI Conference On Human Factors In Computing Systems, ACM, April 4th to 9th, Boston, Massachusetts, USA, pp. 1599-1608. ** International Telecommunication Union, 1999, ITU-T Recommendation P.910, Subjective video quality assessment methods for multimedia applications, Series P Telephone Transmission Quality, Telephone Installations, Local Line Networks. ***Rümelin, S. and Butz, A. 2013, How to make large touch screens usable while driving, Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI13), ACM, October 28 th to 30 th, Eindhoven, The Netherlands, pp. 48-55. The optimal combination was: - screen size: 7.8 x 5.8 inches - frame resolution: 854 x 480 pixels - speaker volume: 77 db

Telepresence Requirements Participants (n=24) were grouped into couples with one person assigned the role of driver and the other the role of collaborator. The driver was located in the driving simulator while the collaborator was located in a control room. Each couple was connected through either a voice+video channel or by a voice channel alone, and was asked to perform tasks as a team while driving a city route: - co-navigation task where both driver and collaborator had a map (10 minutes); - co-navigation task where only the collaborator had a map (10 minutes); - riddle resolution task where the couple talked their way through a problem of logic (10 minutes) Self-reported copresence, reported others copresence and social presence* were measured at the end of each task. * Nowak, K.L. and Biocca, F. 2003, The effect of the agency and anthropomorphism on users' sense of telepresence, copresence, and social presence in virtual environments, Presence: Teleoperators & Virtual Environments, Vol. 12, No. 5, pp.481-494.

Telepresence Requirements Driver - Voice + Video Assistant - Voice + Video Driver - Voice alone Assistant - Voice alone Means of reported presence 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 3.87 3.61 3.29 3.38 3.05 3.17 3.12 3.00 2.85 2.71 2.24 2.36 Self-reported co-presence Perceived other's co-presence Social Presence Greater telepresence was reported in the case of the voice channel alone.

Co-Design Requirements: general Open Questions -> to stimulate creative responses Narrow Questions -> to ground responses via a predetermined experience or concept Experience Questions -> to ground responses via past experiences of the individual Descriptive Questions -> to solicit longer and more detailed articulations Co-Creation Questions -> to facilitate brainstorming

Co-Design Requirements: specific automotive Discussion Context Discussion Target Discussion Rhetoric Discussion Objective Road And Traffic Conditions Interaction With The Vehicle Or With Other Agents Unexpected Events, Errors Or Emergencies Component System Complete Vehicle Where When How Why Incremental Innovation Disruptive Innovation Q1 Q2 Q3... Qn

Automotive Habitat Laboratory

Virtual Workshops: a new tool for automotive HCD

Modem Streams data live back to the control room. Cameras Driver camera imotions camera Interior camera Dashboard camera Three Raspberry Pis CAN bus outputs via USB to the Raspberry Pis, which transfer the data to the communications laptop via an IP network. Microsoft Surface behind driver s seat controls all software, including imotions.

Looking To The Future

Human Centred Design Of Autonomous Vehicles Vehicle Concept Metaphors and Architectures Communication with Occupants and Road Users Vehicle Emotion Management Systems Trust Strategies and Brand Strategies Ethical Design Framework Customer Acceptance Tests Inclusivity and Disabled Mobility Traffic Management Systems Infrastructure and Urban Planning for Autonomy Co-design Frameworks