Ecological Interface Design The Application of Cognitive Interface Design Methodology for a Digitalized Human Machine System

Transcription

1 Guest Lecture of IE546 Human Machine Systems Engineering Ecological Interface Design The Application of Cognitive Interface Design Methodology for a Digitalized Human Machine System Prof. Woo Chang Cha Kumoh National Institute of Technology, Korea Courtesy faculty in Oregon State University

2 WOO CHANG CHA Academic Background BS(1984), Industrial Engineering, Hanyang University, Korea MS(1990), Industrial Systems Engineering, Ohio University PhD(1996), Industrial & MFG Engineering, Oregon State University Communicating Pilot Goals To An Intelligent Cockpit Aiding System Advisor: Ken Funk Work Experiences : Professor in Dept. of Engineering School of Industrial Engineering. Kumoh National Institute of Technology. 2001~2006: Director of National Research Lab for HFE Guidelines in NPP, Ministry of Education, Science and Technology, Korea: : Research scholar, in department of Industrial Engineering of San Jose State University, Cowork with NASA Ames Research Center (Dr. Corker) 2007~2009: Project director of environment design of main control room of KNGR an d UAE nuclear power plant for KEPCO(Korea Electric Power Company) 2005~2014: Editor of Journal of the Ergonomic Society of Korea 2014~2015: Courtesy faculty in Oregon State University 2/48

3 WOO CHANG CHA Teaching/Research Interests Cognitive systems engineering Human factors engineering in system safety Human performance and process modeling & simulation Applied artificial intelligence Performed and on-going main researches Pilot goal tracking system in avionic system (1994 ~ 2002) NASA-AMES, Korea Air Force Academy,.. NPP MCR Design & Evaluation (2001 ~ 2013) KINS, KAERI, KOPEC, KEPRI, ENEC.. Railroad Human Error Research (2012 ~ 2014) Korea Railroad, KTX Size Korea Anthropometry (2013 ~ 2014) Product design researches and so on Cognitive Systems Lab since 2002, 3/48

4 Background: Human Machine System A system with one or more human components Three components: Human, Machine and Interface Human-Computer Interface (Interface) Controls, displays, and other features that transmit information and energy between humans and machines A boundary across which two independent systems meet and act on or communicate with each other Similar terms: Human Computer Interaction(HCI) Intelligent Machine (Computers) Display Human(s) User Control Interface 4/48

5 Background: Human-Computer Interaction Design Evaluation - Implementation Iterative process Usability engineering of Interactive computing systems Goal communication between human and computer for Human use Human centered design concerns Safety, usability, privacy Adapted from Figure 1 of the ACM SIGCHI Curricula for Human-Computer Interaction 5/48

6 Interactive Computing System Design Trends Independent being => Relational being Computer Centered => Human Centered Design Oriented => User Oriented User Interface(UI) => User Experience(UX) Work in Socio-Technical System Norman, D.A. (1986). Cognitive Engineering, User Centered System Design-New Perspective on Human-Computer Interaction. 6/48

7 A Definition of Good Design A design to reduce a cognitive distance between user s mental model and designer s conceptual model about a product or a system (HMS) Cognitive distance The distance people perceive to exist in a given situation How subjectively two pieces of information are related for the user. Ontological drift Gulf of execution: Mismatch between the users' intentions and the allowable actions Gulf of evaluation : Mismatch between the system's representation and the users' expectations Display compatibility Display representation compatible with physical system and mental model Compatible design with user s expectation of stimulus and response to information display. Rapid learning time and response time Reduce human errors Reduce mental workload Increase user satisfaction The best way to reduce a cognitive distance is to develop an interface in term of UI design principles such as usefulness, usability and affectiveness. How can we develop useful, usable, and even aesthetic computer systems? 7/48

8 Background: Digitalized Interface Design 8/48

9 Totally Digitalized System Environment: Korea Next Generation Reactor Main Control Room Conventional MCR Shingori 3&4 MCR 3D Mockup 9/48

10 KNGR MMIS: Large Display Panel(LDP) PPS/CFM/SPM/BISI Section Plant Overview Message Section 10'-9" 67" 67" 67" 67" Mimic Section (RO) 120" 120" Mimic Section (TO) 67" 67" Variable Display Section (RO) Variable Display Section (TO) 24'-5" 10/48

11 KNGR MMIS: Soft Control Heartbeat Timer System Name SAFETY INJECTION SYSTEM A 14:30:01 Channel Indicator SI VALVE SI-HS-698 SYS-1 SYS-2 Navigation Button to System Directory Page 2 OPEN ESF-2 SI Navigation Button to System Directory Page 1 TROUBLE DISABLED Navigation Button to System Mimic Display CLOSE SC Display(Non-Safety) ESCM Control Switch (Safety Level) 11/48

12 KNGR MMIS: Computerized Procedure System PBP: Paper Based Procedure CBP: Computer Based Procedure 12/48

13 NPP MCR Development Process Human Factor Engineering Program Review Model (NUREG-0711 Rev.2, 2004) A. Planning & Analysis 1. HFE Program Management 2. Operating Experience Review 3. Function Analysis 4. Task Analysis 5. Staffing & Qualification 6. Human Reliability Analysis B. Design 7. Human-System Interface Design 8. Procedure Development 9. Training Program Development C. Verification & Validation 10. Human Factor V & V D. Implementation & Operation 11. Design Implementation 12. Human Performance Monitoring 13/48

14 Adapted from IE Funk HMSE Process 14/48

15 What should be analyzed? CSE is concerned with what and how should be analyzed to provide design/evaluation requirements Possibilities of information technology Organizational/ social/ cultural environment Work domain (Functional) constraints Designer Interface User s constraints Interaction (Task) 15/48

16 HMS Complexity Complexity of human-machine interaction can be affected by several factors Typical dimension of complexity Structural complexity Number of components in the technical system Number of connections between components Number of common nodes Type of components and the connections Functional complexity Order of systems and subsystems Number of functions at a components Loop time constraints Interface complexity Level of interaction Type of interaction 16/48

17 Information Displays in Digitalized MCR Various type of information displays: PMAS Graph(Plot),List-Table, Graphics, Logic Diagram, Box Fill-in Digitalized information displays of MCR Present information exceeding human cognitive processing limitation. Decision making by integrating the information Increases cognitive demand Occurs new types of human error: TM error, Mode error,.. Needs to provide cognitively oriented interface Not simple P&ID, but displays reflecting system dynamics characteristics and the relationship between system variables Cognitive tasks based interface design => EID 17/48

18 Cognitive Oriented Information Display Cognitive System Engineering(CSE) Is about developing concepts, methods, and tools for analyzing, designing, and evaluating usable and safe systems to help humans as they carry out their daily cognitive endeavors Is systems engineering activity to enhance the performance of humanmachine systems to be considered as a total cognitive system 18/48

19 CSE approach to development of HMS Analysis Design Evaluation Operation Why To provide design/ evaluation requirements To achieve artificial cognitive systems that enhance user s performance To verify and validate the design elements and to assess the performance of total cognitive system To enhance the performance of total cognitive system What Work domain (Functionality) User s task User s mental strategies Organization structure User s knowledge and competencies Error and reliability Information display Alarm Computerized and written procedure Training system Automation Information aiding Staffing and organization Each design element Human-work interaction Functionality Usability Safety and reliability Affordability Maintenability Safety Reliability Usability Functionality Maintenability Affordability Analysis framework Design framework Evaluation framework Analytic method How Conceptual tools Method Creativity Principles and guidelines Analytic method Experimentation Experimentation 19/48

20 Cognitive task analysis (CTA) Characteristics of tasks What to be analyzed requiring CTA Knowledge Involve a high degree of problem solving and decision making Place high mental workload on operators Skill Require large amounts of Automated skill information to be assimilated Procedural skill Are difficult to verbalize or are not observable Have substantial time pressures Heuristics Declarative knowledge Structural knowledge Operational knowledge Representational skill Decision making skill Cognitive bias Strategies 20

21 Cognitive task analysis (CTA) Typical CTA methods Decision ladder and Information flow map Critical decision method Consistent component method Diagramming method Simplified PARI (precursor, action, result, interpretation) Verbal reports Conceptual graph analysis GOMS Cognitive walkthrough 21/48

22 CTA tool: Decision Ladder Information processing activities States of knowledge Option Goals Evaluate options Predict consequences Goal chosen State Target Identification Choice of task Observation Infor matio n Heuristics, shortcuts Task Planning Alert Proce dure Activation Execution 22/48

23 CTA tool: Information flow map Fault found Yes Hypothesis and test search strategy for fault diagnosis task Failed system Pattern matching MATCH? Reference symptom pattern Deduce response pattern Present operation al input No Model of function in hypothetica l failed state Search strategy Next hypothesis Hypothesis of fault in system Modify the model of function according to hypothesis Model of normal function Hypothesis from other sources 23/48

24 Abstraction hierarchy (AH) AH is a multilevel knowledge representation framework for describing the functional structure of work domain AH is defined by goal-means relations between levels Five abstraction levels are known to be useful for describing complex system such as NPP Functional purpose (FP): the purpose for which the system was designed Abstract function (AF): the causal structure of the process in terms of mass, energy, information and value flows General function (GF): the basic functions that the system was designed to achieve Physical function (PF): the characteristics of the components and their interconnections Physical form (P): the appearance and spatial location of those components 24/48

25 Abstraction hierarchy (AH) Example of goal-means abstraction hierarchy Washing machine Functional purpose Abstract function General function Physical function Physical form Property Washing specifications Energy waste requirements Energy, water, and detergent flow topology Washing, draining, drying, Heating, temperature control Mechanical drum drive Pump and valve function Electrical/ gas heating circuit Configuration and weight, size Style and color 25/48

26 Abstraction-Decomposition matrix Whole-part Goal-means Total system Subsystem Functional unit Subassembly Component Functional purpose Why Abstract function, priority, measure Why What General function What How Physical function How Physical form 26/48

27 Strategy analysis using the AH Whole-part Goal-means Total system Subsystem Functional unit Subassembly Component Functional purpose 1 Abstract function, priority, measure 3 4 General function 2 Physical function Physical form /48

28 (Vicente, 1999) A road from analysis to design Identify Realize Develop Models of Form Build Conceptual Modeling intrinsic Systems design distinctions tools work interventions constraints Work domain Control tasks Strategies Abstraction hierarchy Decision ladder Information flow map Sensors, models, DB Procedures, automation, context-sensitive interface Dialogue modes, process flow Socialorganizationa l Worker competencies All of the above SRK taxonomy Role allocation, organizational structure Selection, training, interface form 28/48

29 What should be designed? Information display Design of total cognitive system Alarm Procedure Automation Information aiding Training system Staffing and organization CSE aims to provide framework, principles, guidelines, rules, and standards to help HMS designers develop artificial cognitive system that are safe and pleasant to use, thereby realizing proper human-machine (computer) interaction 29/48

30 User interface design methods Data analysis methods List of users List of environments Users profiles Workflow diagrams Task sequences Task hierarchies User/task matrices Detailed task descriptions from procedural analysis Task flowcharts Interface design methods Qualitative usability goals Objects/actions Metaphors Use scenarios Use sequences Use flow diagrams Use workflows Use hierarchies Storyboards Rough interface sketches Video dramatizations Etc. (Hackos, 1998) 30

31 Cognitive Information Displays Design Cognitive Interface An optimally designed interface based on CSE principles Cognitively oriented displays and controls considering work domain (functional) constraints, users and environmental constraints through Work Domain Analysis(WDA) Design methodologies for cognitive information displays IRD(Information Rich Design) EID(Ecological Interface Design) 31/48

32 Information Rich Display Design Information Rich Display Braseth et al. 2003, 2004 Present information as much as it can be displayed within users cognitive limitation IRD design principles Dull Screen Principle Normalization/Integrated Trends Macro Representation Used a complimentary design tool for EID Loviisa NPP conventional display IRD applied display 32/48

33 Ecological Interface Display Design EID Vicente & Rasmussen, Visualize the abstracted information Describe the functional structure of work domain Design a cognitive interface using two strategies: representation of system constraints use the concept of abstraction hierarchy. Improve performance of situation awareness 33/48

34 EID Display 34/48

35 Generic EID Design Process EID Process (Burns 2004) Cognitive Task Analysis Reflect DM process to move abstraction level Cognitive continuum theory: intuition analysis 35/48

36 A NPP Research Background Difficult to apply cognitive interface for designing MMIS of NPP NO design guidelines for cognitive interface Crews spend much time to learn, adapt, and reluctant to use redesigned interface Too much additional cost for a small change of design Research Objectives Provide a framework and feasible methodology for displaying cognitive information Develop design guideline for cognitively oriented displays and controls suitable for the digitalized MCR of NPP Proposed feasible example of the cognitive interface 36/48

37 Define the System Main Feed Water System 37/48

38 Applied EID Design Process 12th IFAC/IFIP/IFORS/IEA Symposium on Analysis, Design, and Evaluation of Human-Machine Systems 38/48

39 Performed Analysis - WDA Part-Whole Decomposition of SG Abstraction Hierarchy of SG 39/48

40 Performed Design: Variables Single variable displays Multiple variable displays 40/48

41 75% 75% EID Design Example (SG Feed Water Control Display) FWP SG1 Master FD DC Valve EC Valve Feed Water Flow Steam Flow SG 1 Level RCS 1 Temp ( C) 75% 75% 75% 75% 80.0 T/h 85% (NR) T h 305 FWP Speed (RPM) 50% PV 60%SP 50% PV 60%SP 50.0 T/h 40% 47% 54% 44% 34% T avg 300 T ref 297 T c K 20% AUTO MANUAL 4.0K PV 4.2K SP FWP1 AUTO MANUAL AUTO MANUAL 10% -2 (min) AUTO 4.0K PV 4.5K DC Valve EC Valve Feed Water Flow Steam Flow SG 2 Level RCS 2 Temp ( C) MANUAL 4.2K SP FWP2 4.5K 75% 75% 75% 80.0 T/h 85% (NR) T h 305 AUTO MANUAL 4.0K PV 4.2K SP FWP3 50% PV 60%SP 50% PV 60%SP 50.0 T/h 40% 47% 54% 44% 34% T avg 300 T ref 297 T c % 0K 10% AUTO 0K PV AUTO AUTO -2 (min) MANUAL 60% SP SP MANUAL MANUAL SG2 41/48

42 75% 75% EID Design Example (Information Flow) Main FW Pump SG1 FWP FW REQ Flow Master FD DC & EC valve control DC Valve EC Valve Compare FW & Steam flow Feed Water Flow Steam Flow SG 1 Level SG1 SG1 flow level RCS 1 Temp ( C) RCS temp 75% 75% 75% 75% 80.0 T/h 85% (NR) T h 305 FWP Speed (RPM) 50% PV 60%SP 50% PV 60%SP 50.0 T/h 40% 47% 54% 44% 34% T avg 300 T ref 297 T c 295 AUTO Pump Velocity 4.0K PV MANUAL Control 4.2K SP 4.5K FWP1 AUTO MANUAL AUTO MANUAL 20% 10% To Higher Abstraction -2 (min) -1 0 Level +1 AUTO 4.0K PV 4.5K DC Valve EC Valve Feed Water Flow Steam Flow SG 2 Level RCS 2 Temp ( C) MANUAL AUTO MANUAL 4.0K PV 4.2K SP 4.5K 4.2K SP FWP2 FWP3 75% 50% PV 60%SP 75% 50% PV 60%SP 75% 50.0 T/h 40% 80.0 T/h SG Feed Water Flow 85% (NR) 47% 54% SG2 flow level 44% 34% T h 305 T avg 300 T ref 297 T c 295 RCS temp 20% 0K 10% AUTO 0K PV AUTO AUTO -2 (min) MANUAL 60% SP SP MANUAL MANUAL DC & EC valve Control Compare FW & Steam Flow SG2 SG 2 42/48

43 75% 75% EID Design Example (Represent AH) FWP PFn / PF GF SG1 FP Master FD DC Valve EC Valve Feed Water Flow Steam Flow SG 1 Level RCS 1 Temp ( C) 75% FWP Speed (RPM) 75% 75% Economizer 60%SP Valve open 50% PV rate 50% PV 60%SP 75% 50.0 T/h 40% 80.0 T/h Steam Flow 47% 85% (NR) 54% 44% 34% T h 305 T avg 300 T ref 297 T c K 20% AUTO MANUAL 4.0K PV 4.2K SP FWP1 AUTO MANUAL AUTO MANUAL 10% To Higher Abstraction -2 (min) -1 0 Level +1 AUTO 4.0K PV 4.5K DC Valve EC Valve Feed Water Flow Steam Flow SG 2 Level RCS 2 Temp ( C) MANUAL 4.2K SP FWP2 4.5K 75% 75% 75% 80.0 T/h 85% (NR) T h 305 AUTO MANUAL Main FW pump 0K 4.0K PV 4.2K SP FWP3 50% PV 60%SP 50% PV 60%SP 50.0 T/h 40% 10% FW Flow 47% 54% 44% 34% SG Flow 20% level T avg 300 T ref 297 T c 295 RCS temp AUTO 0K PV AUTO AUTO -2 (min) MANUAL 60% SP SP MANUAL Downcoma valve open rate MANUAL SG2 43/48

44 A Conventional Display of SG 44/48

45 Proposed Example of EID for SG process 45/48

46 Evaluations Perform the empirical test for the suitability Only feasibility test at this moment due to much cost. Full V&V will be performed with the persuasive outcome of the proposed cognitive interface design Efforts to persuade the cognitive interface design Design the alternatives of cognitive interface according to EID principle and guideline FGI with operators and Delphi feedback for suitable design Explain why the abstract information should be visualized Compare with existing interface for its usability Refer to other EID researches with better performance NOVA chemical plant, HAMBO project.. Reduce # and times of tasks, lower human errors.. 46/48

47 Discussion Current outcomes from the NPP application of EID method Collective documents of various researches with effectiveness of EID design methodology Information Requirement and CTA SG & pressurizer control process of digitalized MCR of NPP Empirical design guidelines for cognitive interface Style guideline for design element based on EID principle Feasibility analysis of the proposed cognitive interface Look for the usefulness of the proposed interface Not in the main displays but may work for the supportive aiding display for the tasks demanding cognitive workload 47/48

48 Future Research with EID Nuclear Power KNGR Develop design standard and guideline for cognitively oriented information displays Develop design template for the cognitive interface Increase design fidelity of cognitive interface by which can be used on the real environment of digitalized MCR Medical OSU Design study (EID, Burns & Hajdukiewicz, CRC, 2004) Oxygenation Monitoring in the national ICU Patient monitoring in the operating room Diabetes management system Working on HTK design 48/48