INDE/TC 455: User Interface Design

Similar documents
INDE/TC 455: User Interface Design

6 Ubiquitous User Interfaces

INDE/TC 455: User Interface Design

Ubiquitous Computing Summer Episode 16: HCI. Hannes Frey and Peter Sturm University of Trier. Hannes Frey and Peter Sturm, University of Trier 1

Comparison of Haptic and Non-Speech Audio Feedback

Introduction to Haptics

Interactive Simulation: UCF EIN5255. VR Software. Audio Output. Page 4-1

Interface Design V: Beyond the Desktop

ISO INTERNATIONAL STANDARD. Ergonomics of human-system interaction Part 910: Framework for tactile and haptic interaction

Perceptual Interfaces. Matthew Turk s (UCSB) and George G. Robertson s (Microsoft Research) slides on perceptual p interfaces

CS415 Human Computer Interaction

Haptics CS327A

Touch & Gesture. HCID 520 User Interface Software & Technology

3D Interaction Techniques

Image Representations, Colors, & Morphing. Stephen J. Guy Comp 575

R (2) Controlling System Application with hands by identifying movements through Camera

VIRTUAL REALITY Introduction. Emil M. Petriu SITE, University of Ottawa

Perception. Read: AIMA Chapter 24 & Chapter HW#8 due today. Vision

Auto und Umwelt - das Auto als Plattform für Interaktive

CS415 Human Computer Interaction

Virtual Tactile Maps

Title: A Comparison of Different Tactile Output Devices In An Aviation Application

Computer Haptics and Applications

An Example Cognitive Architecture: EPIC

Beyond Visual: Shape, Haptics and Actuation in 3D UI

Computer Graphics. Spring April Ghada Ahmed, PhD Dept. of Computer Science Helwan University

Augmented and Virtual Reality

Human Factors. We take a closer look at the human factors that affect how people interact with computers and software:

CS148: Introduction to Computer Graphics and Imaging. Displays. Topics. Spatial resolution Temporal resolution Tone mapping. Display technologies

Heads up interaction: glasgow university multimodal research. Eve Hoggan

Nontraditional Interfaces

Multi-Modal User Interaction

Trends & Milestones. History of Virtual Reality. Sensorama (1956) Visually Coupled Systems. Heilig s HMD (1960)

Projection Based HCI (Human Computer Interface) System using Image Processing

Virtual and Augmented Reality Applications

Communication Technology

PERFORMANCE IN A HAPTIC ENVIRONMENT ABSTRACT

E90 Project Proposal. 6 December 2006 Paul Azunre Thomas Murray David Wright

CSE 165: 3D User Interaction. Lecture #14: 3D UI Design

Aural and Haptic Displays

MECHANICAL DESIGN LEARNING ENVIRONMENTS BASED ON VIRTUAL REALITY TECHNOLOGIES

History of Virtual Reality. Trends & Milestones

Universidade de Aveiro Departamento de Electrónica, Telecomunicações e Informática. Interaction in Virtual and Augmented Reality 3DUIs

Issues and Challenges of 3D User Interfaces: Effects of Distraction

Topic 3: Output Devices

What was the first gestural interface?

Illusion of Surface Changes induced by Tactile and Visual Touch Feedback

Proposal for the Object Oriented Display : The Design and Implementation of the MEDIA 3

Nontraditional Interfaces. An Introduction into Nontraditional Interfaces R.I.T. S. Ludi/R. Kuehl p. 1 R I T. Software Engineering

Eye Tracking and EMA in Computer Science

Reviews of Virtual Reality and Computer World

Haptic Technology- Comprehensive Review Study with its Applications

Touch & Gesture. HCID 520 User Interface Software & Technology

Stereo-based Hand Gesture Tracking and Recognition in Immersive Stereoscopic Displays. Habib Abi-Rached Thursday 17 February 2005.

Tangible Interaction AVANCERAD INTERAKTIONSDESIGN. Héctor Caltenco Certec, Inst. för Designvetenskaper, LTH

Advancements in Gesture Recognition Technology

Introduction to HCI. CS4HC3 / SE4HC3/ SE6DO3 Fall Instructor: Kevin Browne

Quantitative Assessment of the Effectiveness of Using Display Techniques with a Haptic Device for Manipulating 3D Objects in Virtual Environments

Einführung in die Erweiterte Realität. 5. Head-Mounted Displays

Effective Iconography....convey ideas without words; attract attention...

Virtual Grasping Using a Data Glove

Digital Olfaction Society Fourth World Congress December 3-4, 2018 Tokyo Institute of Technology 0

devices 1 Interaction Devices

Sonic Interaction Design: New applications and challenges for Interactive Sonification

The worlds we live in. The worlds we live in

CSE Tue 10/09. Nadir Weibel

Contents. Mental Commit Robot (Mental Calming Robot) Industrial Robots. In What Way are These Robots Intelligent. Video: Mental Commit Robots

Table of Contents. Display + Touch + People = Interactive Experience. Displays. Touch Interfaces. Touch Technology. People. Examples.

Abdulmotaleb El Saddik Associate Professor Dr.-Ing., SMIEEE, P.Eng.

2 Outline of Ultra-Realistic Communication Research

IMGD 4000 Technical Game Development II Interaction and Immersion

Glasgow eprints Service

CSE 165: 3D User Interaction. Lecture #7: Input Devices Part 2

Haptic Holography/Touching the Ethereal

ARMY RDT&E BUDGET ITEM JUSTIFICATION (R2 Exhibit)

EMPOWERING THE CONNECTED FIELD FORCE WORKER WITH ADVANCED ANALYTICS MATTHEW SHORT ACCENTURE LABS

Multisensory Virtual Environment for Supporting Blind Persons' Acquisition of Spatial Cognitive Mapping a Case Study

Sensory and Perception. Team 4: Amanda Tapp, Celeste Jackson, Gabe Oswalt, Galen Hendricks, Harry Polstein, Natalie Honan and Sylvie Novins-Montague

User Interface Agents

us Al (19) United States (12) Patent Application Publication Li et al. (10) Pub. No.: US 2004/ Al (43) Pub. Date: Aug.

Digitizing Color. Place Value in a Decimal Number. Place Value in a Binary Number. Chapter 11: Light, Sound, Magic: Representing Multimedia Digitally

Laser Scanning for Surface Analysis of Transparent Samples - An Experimental Feasibility Study

Images and Displays. Lecture Steve Marschner 1

16.400/453J Human Factors Engineering /453. Displays. Prof. D. C. Chandra Lecture 7

Input-output channels

CSC 2524, Fall 2018 Graphics, Interaction and Perception in Augmented and Virtual Reality AR/VR

Human Computer Interaction

Shared Imagination: Creative Collaboration in Mixed Reality. Charles Hughes Christopher Stapleton July 26, 2005

from the Photonics Dictionary at Photonics.com

Session 9.1 SID2010 May 25 th, Sep Lyu Jae Jin. Samsung Electronics

Classifying 3D Input Devices

5/17/2009. Digitizing Color. Place Value in a Binary Number. Place Value in a Decimal Number. Place Value in a Binary Number

Future Directions for Augmented Reality. Mark Billinghurst

Devices and Op-Amps p. 1 Introduction to Diodes p. 3 Introduction to Diodes p. 4 Inside the Diode p. 6 Three Diode Models p. 10 Computer Circuit

Lecture 1: image display and representation

Interacting within Virtual Worlds (based on talks by Greg Welch and Mark Mine)

Booklet of teaching units

HUMAN COMPUTER INTERFACE

Acquisition, Processing and Display

Learning to Detect Doorbell Buttons and Broken Ones on Portable Device by Haptic Exploration In An Unsupervised Way and Real-time.

Transcription:

INDE/TC 455: User Interface Design Autumn 2008 Class #21 URL:courses.washington.edu/ie455 1

TA Moment 2

Class #20 Review Review of flipbooks 3

Assignments for Class #22 Individual Review modules: 5.7, 12.1, 12.2, 13.0 Group Phase 6A: Field Trials 1 (to be completed by Class #24 - Monday 17 Nov) with emailed report card to Prof. Furness 4

Class #21 Agenda Questions about 5A: Flipbooks Finishing up transactional constructs Technologies for the interface - part 2 5

INDE/TC 455: User Interface Design Module 13.0 Interface Technology 6

Three more interface considerations What is the best allocation of responsibility between the human and the tool? What is the best representational/interaction construct? Which technology choose to implement? 7

Technology for the Interface 8

Which technology to choose? To match the task Mobility Automation To match the user (persona?) Child vs. adult disabled To work in the environment Outside inside Other Aesthetics (form) Efficiency (function) Effectiveness (form + function) 9

Tools versus Technology Decide what your tool should do first Design a representational construct Then decide how to implement that functionality with technology Refine form for aesthetics May require iteration Use thinking hats 10

Important Considerations Responsiveness Actions have direct results User acts intuitively and spontaneously Permissiveness User can do anything reasonable Do and undo Different paths to task completion Consistency Same interface style for all applications from Human Interface Guidelines: The Apple Desktop Interface 11

Technology subsystems #1 Technology to get signals to the user. = displays #2 Technology get signals from the user. = controls 12

Human-Machine Systems Operator Sensing Machine Information Processing Psychomotor Performance Display Control 13

Human Interface Model -- Level 3 EXPERIENCE A PRIORI KNOWLEDGE EXPERIENCE TRAINING DESIGNER USER META COMMUNICATION MODEL OF MODEL OF USER MACHINE INDIRECT PATH MACHINE HUMAN PROCESSES MACHINE PROCESSES DIRECT PATH COGNITIVE PERCEPTUAL SENSORY PSYCHOMOTOR DISPLAY CONTROL INPUT PROCESSING PROGRAMMING SIGNAL TRANSFER TASK 14

Interface technologies displays COGNITIVE PERCEPTUAL SENSORY PSYCHOMOTOR controls DISPLAY CONTROL INPUT PROCESSING PROGRAMMING Signal Level Transfer of physical signals across machine and human boundaries 15

Human Signal Input Parameters Sensation-transducer Signal intensity Resolution Contrast/modulation Color Dynamic range Update rate Throughput delays Interference 16

Human Signal Output Parameters Psychomotor transducer Movement (head, eyes, hand, body) Event (eye blink) Utterance (vibration of vocal chords) Physiological transducer Electro-myography Electro-encephalography Electro-cardiography Electro-oculography Galvanic skin response 17

Technology transducers Displays Visual Acoustic Tactile (haptic) Smell Taste Controls Handheld Fingers Feet Body Head Eyes Speech 18

Technology Matrix Modality Visual Acoustic Display Real image Virtual image Control Tactile Olfactory Taste 19

Visual Display Technology 20

Types of visual displays Real image Direct view Projected view Virtual image See-thru Occluded Eye multiplexed 21

Visual displays 22

Visual Display transduction Photon source Phosphor (cathode ray tube) Solid state emitter (light emitting diodes) Light modulators (liquid crystal) Lasers Plasma Photon manipulation modulation scanning Photon representation Real image Virtual image 23

Real image displays 24

Real Image Display Packaging Panel display (monitor) Tablet display Handheld display (e.g. PDA, cellphone) Projection Display Electronic paper 25

Palm Pilot - Stylus Input 26

Tablet computer 27

Plasma display 28

Bendable video displays 29

Electronic paper 30

Xerox electronic paper 31

Virtual Image Displays 32

Real & Virtual Images

Real Image 34

Virtual image 35

Virtual image x 2 36

Virtual image x 3 37

Virtual display? 38

Visual Display Packaging Head or helmet mounted display Eyeglass display Cellphone virtual display 39

TYPES OF VIRTUAL VISUAL DISPLAYS occluded see-thru multiplexed 40

first helmet-mounted display (1967) 41

eye multiplexed virtual displays 42

Early Furness Patent

Virtual Vision Personal Eyewear Display

Wearing Virtual Vision Display

Virtual image inset into real world

Entertaining the patient!

Entertaining little patients!

Parkinson s disease

emagin Inc.

My Vu

Occluded virtual displays 53

Flat Panel vs. VRD Matrix Element Display Matrix of 1,000,000 pixels Virtual Retinal Display One pixel

Color Virtual Retinal Display

VRD Demo* *courtesy BBC Tomorrow s s World

Microvision Simulation and Medical Display Scanning Engine Relay Optics Combiner

VRD in action!

See-through virtual displays 59

See-through virtual displays 60

Low vision findings - 1 Mean Percent Difference- Matched Luminance VRD and Red CRT Percent (%) 50.00 40.00 30.00 20.00 10.00 0.00-10.00-20.00 3.15 1.88 1.22 0.74 All Subjects Optical Causes Retinal Causes Character Size (Visual Angle Subtended)

Low Vision Findings - 2 Which Display Was Perceptually Clearer? Same (2) CRT (2) VRD (10)

MEMs Scanning Technology

VRD as a personal eyewear display

Other visual display variants 65

Interactive big screens 66

HI SPACE Collaborative interaction Tangible interface Gestural recognition Joint project with Battelle PNL Companion to Magicbook Seattle Art Museum 67

Multi-touch displays 68

HALO Display 69

Simulated Immersive Display (SID) 70

71

72

CAVE Automatic Virtual Environment 73

CAVE 74

Holographic display 75

76

TV on a T-shirt 77

Cloaking cloak 78

Acoustic displays 79

Acoustic displays Monaural sound Stereophonic sound Binaural sound (true 3D sound) Sacred space Active Noise reduction Audio icons (earcons) 80

Whoopee cushion 81

Assignments for Class #22 Individual Review modules: 5.7, 12.1, 12.2, 13.0 Group Phase 6A: Field Trials 1 (to be completed by Class #24 - Monday 17 Nov) with emailed report card to Prof. Furness 82