Der Fahrer im Dialog mit Auto und Umwelt - das Auto als Plattform für Interaktive Anwendungen Prof. Dr. Albrecht Schmidt Pervasive Computing University Duisburg-Essen http://www.pervasive.wiwi.uni-due.de/ Overview Pervasive Computing & User Interface Engineering i What is changing and how does this impact the user interface in the car? Selected Areas Communication Text input Interruptions Multimodality Future applications speculations Implicit it user /car generated content t Open logbook for a car Conclusions / Discussion Forschungs-Kolloquium ConnectedDrive, BMW Forschung und Technik, 24.4.2009 2 3 4
Pervasive Computing Enabling Intelligent Devices & Environments Processing cheap, fast, small, energy efficient Displays projection, flexible materials, Storage power consumption big and fast Sensors global, local, ad-hoc, low-power Actuators Networking types, speed, accuracy, price The most profound many, computer controlled technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it. (Mark Weiser) Novel User Interfaces user interface paradigms Tangible and physical user interface Context-aware user interfaces and Implicit interaction Speech and gesture Physiological and emotional interaction Eye gaze interaction Interfaces ecologies (D. Bishop, 92) Albrecht Schmidt, 2009 23.04.2009 5 Albrecht Schmidt, 2009 1.4.2009 6 Design Space for Interactive ti Systems Implicit and explicit multimodal interaction modality command line GUI & direct manipulation gestures and speech tangible and physical UIs physiological and emotional eye gaze mode of interaction explicit implicit What has become of cars? W Image from: BMW VW up! like an ipod touch that you can drive, too. og.ch Image from: http://apfelblo 7 8
The Car a means for transport. an space for media consumption? is a personal communication center? alters our perception of the environment? creates user generated content? used as a inter-connected workplace? mobile (phone) terminal Essentially a interactive computing platform and a node in a distributed (computer/social) network? Some reasons why Increase mobility Assistive functionalities ease the driving task People live connected lives information access always and everywhere availability of communication as normal Media consumption is digital and ubiquitous Context acquisition becomes possible Sensing technologies have improved Processing / sense making of sensor information Cars become networked Car to internet, car to infrastructure, car to car 9 10 What has not changes? Primary function as transport vehicle is central and a prerequisite Primary task (basically driving) has priority fun of use and ease of use are essential Human users wants to be in control Driving is often a social situation Need for safety (gets even more emphasized) Results in challenges for the UI More information available car data, e.g. sensors, night vision, from the environment, e.g. signs, parking distance, other cars, e.g. weather warnings, collision warnings, from the backend, e.g. internet, t online source, From human to human communication channels, e.g. phone, instant messaging, New interaction demands from assistive systems (joint tasks human and car) Increased complexity of interaction while driving due to secondary tasks 11 12
Selected areas to be addressed Safe communication while driving Contextualizing as an essential step Text input and output Essential for many application Making it easy that interactions can be interrupted Minimizing the cognitive cost for the user for interrupting Interacting with all sense Creating truly multimodal user interfaces 13 From: Auto-Bild Making decisions in the car going on holiday (63%) buying a car (50%) moving (40%) getting a pet (26%) getting married (23%) Why long journey being an effective environment for communication people are close together for a long time and no-one can walk away (41%). you have reason not to look the other person into the eyes 14 Bridging the Communication Gap in the Car Face to face communication between a driver an a passenger is very different between a parking situation and a driving situation While driving eye-contact is nearly entirely lost Bridging i the Communication Gap Video link improves communication When eye contact is made the risk for the di driver is increased 15 16
Bridging the Communication Gap in the Car Without compromising di driving i performance Text input while driving People do it but it may be dangerous Many applications Navigation system Entertainment / News Internet access Communication (SMS, messaging, email) Speech has not taken off yet (not in cars nor on the desktop) 17 18 Handwritten Text Input While Driving Handwritten Text Input While Driving Study Driving simulator CARS 16 participants (5 female) inputting address and names 5 minutes drivers under each condition steering wheel/steering wheel (sw/sw steering wheel/dashboard (sw/db) central console / central console (cc/cc) central console/dashboard (cc/db) one reference drive Text input while driving will inevitably impact driving performance steering wheel is well accepted by users and lead to 25% fewer corrections and remaining errors 19 20
Minimizing the cost for interruptions Interruptions are well investigated in User interfaces for PC but on a long term scale (on several minutes to an hour) Interruptions ti in the car on very short time scales second level Typically not completing a navigation task with looking once while driving Shifting attention between environment and display constantly How to make this shifts easier? Eye-Tracking Interaction ti Rembering the last gaze point Gaze point as additional modality Motivation: finger on the map when switching visual attention 21 22 Multimodality Enabling the human to use more senses and more actions to interact with a system Perceiving information Visual /Audio Vibration / tactile Air flow / temperature t / smell / Explicitly vs. implicitly providing information Inputting information to the system Tactile, using hands and feet Speech Gestures, hands, feet, whole body Physiological signals Combing different modalities 23 Tactile Output Embedded into the Steering Wheel Directional tactile output as an additional modality Motivation: turn off audio when in conversation and then missing the exit 24
Tactile Output t Embedded d into the Steering Wheel study Results show that adding tactile information to existing audio, or particularly visual representations, can improve both driving i performance and user experience. 25 Exploring foot computer interaction ti as additional modality in cars Both feet traditonally use in primary control With automatic transmission only one is required Does it make sense to use the other one for other interaction tasks? 26 Evaluation of Car User Interfaces Trail and error may be fatal hence moving the beta-culture from the web to the car may be a bad idea What to evaluate? Impact on driving performance in general? Impact on reaction time? Impact on lane keeping ability? Impact on user experience? Control vs. Assistance 27 CARS Configurable Automotive Research Simulator Map Editor Driving Simulation Tool Analysis Tool https://www.pcuie.uni-due.de/projectwiki/index.php/cars 28
Speculating about some future applications But first some trends tracking and logging of location, activity, and interaction of people and objects will be common Quelle: http://www.cartype.com/ and most of us will share this information with their friends and colleagues, just for pure convenience Quelle: [2] 29 Albrecht Schmidt, 2009 23.04.2009 30 our understanding of privacy, and what we consider private will radically change Implicit user/car generate content Open logbook for a car Imagine you store all the information that goes over the bus systems in the car permanently. Imagine 10% of the people share it? our personal information will likely become a commodity that we trade What new information could we create? What could the user do with it? What could a community do with it? What could a manufacturer do with it? Albrecht Schmidt, 2009 23.04.2009 31 32
Conclusions Car user interface provide an interesting room for innovation Experimental evaluation is key trail and error is not an option User experience plays an essential role performance is not everything http://auto-ui.org 33 34 More Information Our Website http://www.pervasive.wiwi.uni-due.de/ My Blog http://albrecht-schmidt.blogspot.com/ 2008-11-08 - Albrecht Schmidt 35