INDE/TC 455: User Interface Design

Transcription

1 INDE/TC 455: User Interface Design Module 13.0 Interface Technology 1

2 Three more interface considerations What is the best allocation of responsibility between the human and the tool? What is the best representational/interaction construct? Which technology choose to implement? 2

3 Technology for the Interface 3

4 Which technology to choose? To match the task Mobility Automation To match the user (persona?) Child vs. adult disabled To work in the environment Outside inside Other Aesthetics (form) Efficiency (function) Effectiveness (form + function) 4

5 Tools versus Technology Decide what your tool should do first Design a representational construct Then decide how to implement that functionality with technology Refine form for aesthetics May require iteration Use thinking hats 5

6 Important Considerations Responsiveness Actions have direct results User acts intuitively and spontaneously Permissiveness User can do anything reasonable Do and undo Different paths to task completion Consistency Same interface style for all applications from Human Interface Guidelines: The Apple Desktop Interface 6

7 Technology subsystems #1 Technology to get signals to the user. = displays #2 Technology get signals from the user. = controls 7

8 Human-Machine Systems Operator Sensing Machine Information Processing Psychomotor Performance Display Control 8

9 Human Interface Model -- Level 3 EXPERIENCE A PRIORI KNOWLEDGE EXPERIENCE TRAINING DESIGNER USER META COMMUNICATION MODEL OF MODEL OF USER MACHINE INDIRECT PATH MACHINE HUMAN PROCESSES MACHINE PROCESSES DIRECT PATH COGNITIVE PERCEPTUAL SENSORY PSYCHOMOTOR DISPLAY CONTROL INPUT PROCESSING PROGRAMMING SIGNAL TRANSFER TASK 9

10 Interface technologies displays COGNITIVE PERCEPTUAL SENSORY PSYCHOMOTOR controls DISPLAY CONTROL INPUT PROCESSING PROGRAMMING Signal Level Transfer of physical signals across machine and human boundaries 10

11 Human Signal Input Parameters Sensation-transducer Signal intensity Resolution Contrast/modulation Color Dynamic range Update rate Throughput delays Interference 11

12 Human Signal Output Parameters Psychomotor transducer Movement (head, eyes, hand, body) Event (eye blink) Utterance (vibration of vocal chords) Physiological transducer Electro-myography Electro-encephalography Electro-cardiography Electro-oculography Galvanic skin response 12

13 Technology transducers Displays Visual Acoustic Tactile (haptic) Smell Taste Controls Handheld Fingers Feet Body Head Eyes Speech 13

14 Technology Matrix Modality Visual Acoustic Display Real image Virtual image Control Tactile Olfactory Taste 14

15 Visual displays 15

16 Visual Display transduction Photon source Phosphor (cathode ray tube) Solid state emitter (light emitting diodes) Light modulators (liquid crystal) Lasers Plasma Photon manipulation modulation scanning Photon representation Real image Virtual image 16

17 Real image displays 17

18 Real Image Display Packaging Panel display (monitor) Tablet display Handheld display (e.g. PDA, cellphone) Projection Display Electronic paper 18

19 Palm Pilot - Stylus Input 19

20 Tablet computer 20

21 Plasma display 21

22 Bendable video displays 22

23 Electronic paper 23

24 Xerox electronic paper 24

25 Virtual Image Displays 25

26 Real & Virtual Images

27 Real Image 27

28 Virtual image 28

29 Virtual image x 2 29

30 Virtual image x 3 30

31 Virtual display? 31

32 TYPES OF VIRTUAL VISUAL DISPLAYS occluded see-thru multiplexed 32

33 eye multiplexed virtual displays 33

34 Early Furness Patent

35 Virtual Vision Personal Eyewear Display

36 Wearing Virtual Vision Display

37 Virtual image inset into real world

38 Entertaining the patient!

39 Entertaining little patients!

40 Parkinson s disease

41

42 first helmet-mounted display (1967) 42

43 Occluded virtual displays 43

44 Flat Panel vs. VRD Matrix Element Display Matrix of 1,000,000 pixels Virtual Retinal Display One pixel

45 Color Virtual Retinal Display

46 VRD Demo* *courtesy BBC Tomorrow s s World

47 Microvision Simulation and Medical Display Scanning Engine Relay Optics Combiner

48 VRD in action!

49 See-through virtual displays 49

50 See-through virtual displays 50

51 Low vision findings - 1 Mean Percent Difference- Matched Luminance VRD and Red CRT Percent (%) All Subjects Optical Causes Retinal Causes Character Size (Visual Angle Subtended)

52 Low Vision Findings - 2 Which Display Was Perceptually Clearer? Same (2) CRT (2) VRD (10)

53 MEMs Scanning Technology

54 VRD as a personal eyewear display

55 Other visual display variants 55

56 Interactive big screens 56

57 #4 HI SPACE Collaborative interaction Tangible interface Gestural recognition Joint project with Battelle PNL Companion to Magicbook Seattle Art Museum 57

58 HALO Display 58

59 59

60 60

61 Simulated Immersive Display (SID) 61

62 CAVE Automatic Virtual Environment 62

63 CAVE 63

64 Holographic display 64

65 65

66 TV on a T-shirt 66

67 Cloaking cloak 67

68 Acoustic displays 68

69 Acoustic displays Monaural sound Stereophonic sound Binaural sound (true 3D sound) Sacred space Active Noise reduction Audio icons (earcons) 69

70 sound effect earcons 70

71 Some more earcons

72 Whoopee cushion 72

73 Tactile displays 73

74 NIST Tactile Display

75 NIST Tactile Display - US Map 75

76 NIST Tactile Display - Face 76

77 NIST Tactile Display - graphics 77

78 Tactile back display 78

79 Tactile ear display 79

80 Controllers Or human input devices 80

81 Input devices 81

82 Hand & feet controllers 82

83 83

84 Flight simulation controllers 84

85 Direct Manipulation = touch screen 85

86 Direct manipulation with Dataglove 86

87 Initial Exploration. 87

88 Gesture-based Interaction With 3D Displays. Intuitive interaction, easy to learn. 88

89 SVM Recognizer. 89

90 Palm Pilot - Stylus Input 90

91 early helmet sight (1968) 91

92 visor projected sight/display 92

93 Super Cockpit revisited 93

94 Eye control systems 94