CS415 Human Computer Interaction

Transcription

1 CS415 Human Computer Interaction Lecture 11 Advanced HCI Intro to Cognitive Models November 3, 2016 Sam Siewert

2 Assignments Assignment #5 Propose Group Project (Groups of 3) Assignment #6 Project Final Oral Exam Presentation of Project Myself, Jim Weber, Dr. Davis, Dr. Bruder Controls Lab Student Monitors 9-5 on Sat, 12 noon 9pm Sun Sam Siewert 2

3 This Week Chapter 12 Cognitive Models GOMS Goal, Operators, Methods and Selection Goal - describing what the user wants to achieve Operators - basic actions that the user must perform in order to use the system Methods - several ways in which a goal can be split into subgoals Selection choice of method and prediction of which will be used Sam Siewert 3

4 Poor Software-Engineering Practices HCI is an Aspect of Software Engineering HMI is and Aspect of Systems Engineering Software and Hardware Must be Co-Designed Software CMVC and SQA Should be Rigorous No Software Guru Should be the Only One Who Knows How the Code Works Sam Siewert 4

5 Assignment #5 - Objectives Explore Root-causes of Therac-25 Accidents Propose a Final Team Exercise 1. provide a design and prototype that suggests how to improve a well-known past HCI 2. provide a design and prototype to address a current (contemporary) HCI for an application such as intelligenttransportation, UAV/UAS operations, wearable computing (e.g. smart-watch), etc. 3. design and experiment to evaluate whether a contemporary or proposed HCI design and implementation does in fact provide advantage over previous alternatives (ERAU IRB guidelines) Sam Siewert 5

6 Cognitive Models - Introduction Hierarchical Models Task and Goal Structure Linguistic Models System Grammar Physical and Device Models Human Motor Skills Cognitive Models Combine All 3 of the Above Sam Siewert 6

7 1) GOMS = Goals, Operators, Methods, Selection Sam Siewert 7

8 GOMS - Selection Sam Siewert 8

9 GOMS - Evaluation New HCI Design Efficiency Sam Siewert 9

10 2) Linguistic Models BNF (Backus Naur Form) Syntax E.g E Sam Siewert 10

11 Linguistic Models - HCI Interactive Specification of a US Postal Address Form Text Entry, Pull-downs, etc. Sam Siewert 11

12 Change of Address Example Sam Siewert 12

13 Linguistic Systems Syntax Rules for Writing Expressions Semantics Expression Meaning Chomsky s Hierarchy Sam Siewert 13

14 In Practice, Limited to Regular Expressions and CFG Natural Languages Use both CFG and CSG Noam Chomsky [Linguistics, Strong Influence on Computer Science and Programming Languages, Activist] Alonzo Church Lambda Calculus Kurt Gödel Mathematics Related to Languages and Formal Systems - Completeness Alan Turing Turing Machine and Computability Formal Grammars Sam Siewert 14

15 3) Physical and Device Models Keystroke Level Model 1. Finding and Striking Keys (Combinations Ctrl+Alt+Del) 2. Mouse Button 3. Moving Cursor to a Target (Fitts Law) 4. Mouse to Keyboard Hand Transition 5. Tracing with Mouse 6. Thought Prior to Action 7. System Response Latency Sam Siewert 15

16 Physical Efficiency GOMS Task Time to Complete Sam Siewert 16

17 Example Analysis Keystroke Short-cut vs. Point and Click Sam Siewert 17

18 Interactive Cognitive Systems Philip Barnard ICS provides a model of perception, cognition and action not intended to describe the user in terms of action sequences ICS provides a more holistic view of the user as an informationprocessing machine emphasis on how easy particular procedures of action sequences become as they are made more automatic within the user Interdisciplinary Study and Research Computer Science Automation, Programming Languages, AI, HCI, Systems, Machine Learning Cognitive Psychology Human Perception, Thought, Reason Brain Physiology fmri, functional Magnetic Resonance Imaging Interesting Recent Projects EPFL Blue Brain, IBM Watson Sam Siewert 18

19 Reality Hybrid of 3 Models and HCI GOMS + Linguistic + Physical + Intelligence Newell and Simon [CMU, AI] Power of Recursion, 1958 NSS Chess E.g. Minimax Search Herbert Alexander Simon, (June 15, 1916 February 9, 2001) was an American scientist and artificial intelligence pioneer, economist and psychologist. Professor, most notably, at the Carnegie Mellon University, Pittsburgh, Pennsylvania, which became an important center of AI and computer chess,...herbert Simon received many top-level honors, most notably the Turing Award (with Allen Newell) (1975) for his AIcontributions [1] and the Nobel Memorial Prize in Economics for his pioneering research into the decision-making process within economic organizations (1978) [2 Allen Newell, (March 19, July 19, 1992) was a American researcher in computer science and pioneer in the field of artificial intelligence and chess software [1] at the Carnegie Mellon University, Pittsburgh, Pennsylvania. In 1958, Allen Newell, Cliff Shaw, and Herbert Simon developed the chess program NSS [2]. It was written in a high-level language. Allen Newell and Herbert Simon were co-inventors of the alphabeta algorithm, which was independently approximated or invented by John McCarthy, Arthur Samuel and Alexander Brudno [3]. Sam Siewert 19

20 About 40 Years Later From Algorithm to Computer Oponnent YouTube Documentary Randy Moulic s Team IBM / CMU Kasparov Requested a Re-match, No Response from IBM IBM s Page - Controversy Game 2, Wired on bug, Conditions Chess today (GNU Chess ) Sam Siewert 20

21 Summary Models for How Humans Perceive, Think and Act Models for Computing (State Machines, PLs, Computability) Models for Interaction (CLI, WIMP, PL, NLP, 3D, Neural) Goals for HCI and Thoughts? To Extend Human Capabilities with Computers [Efficiently] To Emulate How Humans Perceive and Think [for Interaction] To Create an Artificial Intelligence [to Share Cognitive Load] Is Human Helping Computer with Task Completion or Computer Helping Human? Is HCI Inherently Linked to AI and Cognitive Psychology? Sam Siewert 21