slides are online password will be announced during the sessions in UniWorx question for a potential future exercises:

Transcription

1 Exercise s slides are online password will be announced during the sessions in UniWorx question for a potential future exercises: could those who have programmable phones please prepare to have access to eduroam if not already done? 1

2 Mensch-Maschine Interaktion 2 Interactive Environments Mobile Technologies Desktop Desktop Environments Mobile Interactive Environments in in in 2

3 Mensch-Maschine-Interaktion 2 Desktop Environments Prof. Dr. Andreas Butz, Dr. Julie Wagner 3

4 Environments in 4

5 in 1973 Xerox PARC s Alto hardware: bit-mapped display mouse chord-keyboard (like 5 piano keys) single person setup, seated 5

6 in Xerox star 1981, commercial product of Alto 6

7 in 1973 Xerox PARC s Alto hardware: bit-mapped display mouse chord-keyboard (like 5 piano keys) single person setup, seated GUI features: WYSIWYG sliders, scrollbar windows icons menus pointer = WIMP 7

8 Design Rationale Who was it ed for? in 8

9 in 9

10 in Design Rationale Who was it ed for? What do they do? collect information arrange/rearrange information process information What is their context? working under pressure, deadlines typing skills no time for learning complex piece of office equipment Might that be the reason for getting rid of chord keyboard? cope with a lot of content Goal: optimizing/elim. time-consuming s. 10

11 in Design Rationale Who was it ed for? What do they do? collect information arrange/rearrange information process information What is their context? working under pressure, deadlines typing skills similar questions no time for learning complex piece of office equipment cope with a lot of content new s we want to use computers for new context we use technology in Might that be the reason for getting rid of chord keyboard? Goal: optimizing/eliminating time-consuming s. 11

12 Desktop Multiple work places example: biologists problem: redundancy in working process The elabbench in the Wild Supporting Exploration in a Molecular Biology Lab RACT Aure lien Tabard, Juan David Hincapie -Ramos, Jakob E. Bardram The Pervasive Interaction Technology Laboratory IT University of Copenhagen {auta,jdhr,bardram}@itu.dk paper we present a field trial of the elabbench, a digbletop-based laboratory bench ed to support the atory practices of molecular biologists in the laborathe elabbench supports the organization of personal ation, capture of experimental work for later access, e use of a variety of computational resources directly at bench. We deployed the elabbench in a biology labofor 16 weeks, and invited seven molecular biologists to periments on it. We report on how they used the bench w it fitted within their larger experimental process. The mpact of the elabbench lies in the changes it sparked preparing, running, and documenting lab experiments. pporting computation at the bench and management of al objects in the office, the elabbench blurred the sepabetween office and laboratory work. Based on our obons, we discuss how interactive systems for laboratoch as the elabbench can support a more exploratory or -oriented way of doing science. in r Keywords op, elabbench, digital bench, biology, laboratory, de- eld study, experiment, experimental cycle, life science. al Terms n Factors ODUCTION ature of synthetic biology work is changing in at least gnificant ways. First, biology research increasingly redigital tools not only for everyday information mannt, but also for simulation and analysis of experimental ions. Digital laboratory notebooks and laboratory inion management systems are examples of the former, as bioinformatics and 3D visualization tools are examthe latter. This digitalization creates opportunities for ists, for instance by letting them virtually explore exental parameters before running time-consuming laboexperiments, or by offering much more powerful alms and datasets against which they can analyze coldata. Second, due to a better understanding of bionisms down to the nano-scale, a number of researchers ning to ing synthetical biological matter. This camera wiki notebook Figure 1. A biologist doing a lab experiment using the elabbench. publications/elabbenchshift from an analytical natural science to a or engineering science changes the way many biologists work and deployment.pdf surfaces research practices in which experimentation, explo- activity browser augmented rack folded resource ration or trial and error play an important role. Within HCI, we mainly addressed the first change by helping biologists handle digital resources in the lab or in the wild, for instance by augmenting laboratory notebooks with digital capabilities [12, 14, 20, 22] or supporting the experimental workflow with ubiquitous computing technology [1]. Such systems aimed at facilitating the transition to a more digital workflow. However, the changes in the way synthetic biologists do science the notion of a well defined workflow. Windows bar scribbles on the activity's canvas pen mouse photo capture button In this paper, we present a field study of the elabbench and keyboard its supporting infrastructure, a set of that aim at supporting exploration and computation in molecular biology laboratories. Figure 1 shows the elabbench, an interactive tabletop system which supports browsing and annotation Figure 3. A top view of the elabbench showing the interactive display, the activity browser, a resumed activity displaying a set of resources included of digital resources, access to native applications and object two different types of augmented test-tube racks, and the top-mounted camera and its button. tracking of test tube racks and other objects on its surface. The underlying infrastructure allows users to store, manage, move, share, and annotate digital resources both at the ELABBENCH elaband INFRASTRUCTURE or in the office, support capture of laboratory data in digibench and on their office computers. We presented thetosystal format, and provide seamless coverage throughout the exsupport the exploratory type of work we observed, we detem and its technical implementation elsewhere [19].signed The the elabbench and its supporting infrastructure [19]. perimental cycle (i.e. integration with activities happening purpose of this paper is to report from a 16 week trial deployout-of-the-lab). Moreover, the bench must accommodate the The elabbench is a tabletop-based laboratory bench supportment of the system in a biology laboratory. The purpose sion to make digital or hard copies of all or part of this work for actual work conditions in a laboratory, such as safety reguing of the phases of, construction, and analysis of exthe deployment was to gauge the usefulness of the system in l or classroom use is granted without fee provided that copies are lations or the presence of many items laying on the bench. ploratory biology research. A distributed infrastructure ende or distributed for profit or commercial advantage and that copies the wild, investigating how this type of technology canables sup-users to move smoothly between their elabbench and Finally, the bench should not be distractive and take into cons notice and the full citation on the first page. To copy otherwise, or 12 port analytical as well as synthetic experiments. Our their studyoffice computers. Data and II LMU München Medieninformatik Andreas Butz! M ensch-maschine-interaktion WS2013/14 products sideration that users focus lay on the experimental document management in sh, to post on servers or to redistribute to lists, requires prior specific publications/elabbenchdeployment.pdf

13 Imposed External Decisions example: biologists at Institut Pasteur (in Paris) problem: multiple media in 13

14 Creative Tasks example composers problem: express your ideas, support creativity in 14

15 Exploration of Large Datasets example: researchers problem: navigate in large datasets in 15

16 Exploration of Large Datasets example: collaborative data exploration problem: social aspects of in Guest Lecturer: Michel Beaudouin-Lafon 16

17 Interactive Cognitive Aids in Medicine in 17

18 in Take-away message understand complex way of history to understand how we got where we are! technical and economic constraints changes by living with technology there is no single setup that can model all human s. Let s push the boundaries in shape, functionality and usage. Desktop Environments Mobile Technologies Interactive Environments 18

19 in Take-away message understand complex way of history to understand how we got where we are! technical and economic constraints changes by living with 5 technology MINUTE MICRO-TASK there is no single setup that can model all Come up with professions and their that are not well modeled with a desktop Let s push the setup boundaries and might in take shape, advantage functionality of other and usage. forms or shapes of technology. human s Desktop Environments Mobile Technologies Interactive Environments 19

20 in Challenges in HCI models discussed in MMI1: Hick s law, Guiard s kinematic chain theory, GOMS, KLM etc. two particular in HCI: predictive model value and decide between two alternatives. systematic exploration of alternatives are there more than two alternatives? what are the other alternative? why did I choose these two s? what are their differences? Power Generative Power Descriptive Power 20

21 models in Model Fitts law is a robust model of human psychomotor behavior Predicts movement time for rapid, aimed pointing s Clicking on buttons, touching icons, etc. Developed by Paul Fitts in 1954 Fitts discovery "was a major factor leading to the mouse's commercial introduction by Xerox [Stuart Card] Literature: Fitts, P. M. (1954). The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 47,

22 Model models start D W target in MT: movement time a and b: constants dependent on the pointing system (user/ device) D: distance to the target area W: width of the target Literature: Fitts, P. M. (1954). The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 47,

23 Model models in ID = index of difficulty ID difficulty of independent of device / method units constant a measured in seconds constant b measured in seconds / bit index of difficulty, ID measured in bits 23

24 models in Building a Fitts Law Model interactive computing systems: manipulating a cursor with the mouse, selecting icons in virtual space using a glove, grabbing tangible objects. determine slope and intercept coefficients controlled experiment one or more devices condition cover range of difficulties conduct multiple trials in each condition and measure the required time. perform tests of correlation and linear regression

25 Importance for HCI models in inspire techniques for optimizing MT: increase W decrease D do both improve hardware, reduce b reduce a? create standards give a value to a solution and justify why A is better than B. attention: findings can be different between lab studies and field studies. model does not capture complete complexity of a situation. 25

26 models Assumptions one-dimensional movement straight line movement constant velocity undivided attention of movement in 26

27 models in no one-dimensional two models: W model: substitutes for W the extend of the target along an approach vector through the center + : theoretically attractive, retains one-dimensional model - : requires angle of movement SMALLER-OF model: substitutes for W either the width or height of the target, whichever is smaller. + : easy to apply - : but limited to rectangular targets. Literature: MacKenzie et al. (1992): Extending Fitts law to two-dimensional s. CHI 92 27

28 models no straight line movement length-distance ratio Motion is not always straight: spiral or zig-zag to measure this deviation from ideal trajectory use legnth-distance ration (LD) LD = length of movement/actual distance in Literature: re 2. Chapuis, O. et al. (2007). Fitts Law in the Wild: A Field Study of Aimed Movements. Technical Report LRI Data recorded by the OS X probe: configuration o 28

29 models in no constant velocity no single smooth motion motion composed of sequence of one or more sub-movements ballistic phase: first movement is large and fast, cover most of distance corrective control phase: small and slower movements deterministic iterative-corrections model sub-movements have equal duration, each travel a constant fraction of the remaining distance toward the target and are all executed Target Width Velocity (a) (c) Literature: Meyer et al. Optimality in human motor performacne: ideal control of rapid aimed movements, 1988 (b) Distance 29

30 models bimanual pointing perform a bimanual aiming one hand reaches for target in 10cm distance other hand reached for target in 30cm distance What happened? What is MT in this case? in Literature: Marteniuk, R.G. et al. (1984). Bimanual movement control: Information processing and effects. Quarterly Journal of Experimental Psychology, 36A,

31 models in bimanual pointing perform a bimanual aiming one hand reaches for target in 10cm distance other hand reached for target in 30cm distance What happened? What is MT in this case? MICRO-EXPERIMENT try a bimanual pointing yourself! Literature: Marteniuk, R.G. et al. (1984). Bimanual movement control: Information processing and effects. Quarterly Journal of Experimental Psychology, 36A,

32 models in bimanual pointing perform a bimanual aiming one hand reaches for target in 10cm distance other hand reached for target in 30cm distance What happened? What is MT in this case? Bimanual s are not just two simultaneously performed uni-manual s. inter-limb coordination has tendency towards symmetry limited degree of independence von Holst (1939), Beharrungstendenz vs. Magnetoeffekt more about bimanual in section mobile. Literature: Marteniuk, R.G. et al. (1984). Bimanual movement control: Information processing and effects. Quarterly Journal of Experimental Psychology, 36A,

33 Importance for HCI models in inspire techniques for optimizing MT: increase W decrease D do both improve hardware, reduce b reduce a? create standards adapt and refine models to new situations contributes to understanding helps communicating observed phenomena give a value to a solution and justify why A is better than B. attention: findings can be different between lab studies and field studies. model does not capture complete complexity of a situation. 33

34 Models Systematic Exploration in Systematic Exploration variety of devices: keyboards, mice, headmice, pen+tablet, dialboxes, polhemus sensors, gloves, body suits. descriptive power: my is... A and B differ in... predictive power A is faster than B because... generative power the combination of X and Y had not been explored before... Literature: Card et al., A Morphological Analysis of the Design Space of Input Devices. ACM Transactions on Information Systems, Vol.9, No. 2,

35 Models Systematic Exploration in Systematic Exploration morphological space analysis. device = point in a parametrically described space. primitive movement vocabulary set of composition operators formal and visual description of devices. testing points in space expressiveness effectiveness limitations: idealized devices (no lag, noise etc.), speech excluded. Literature: Card et al., A Morphological Analysis of the Design Space of Input Devices. ACM Transactions on Information Systems, Vol.9, No. 2,

36 Models Systematic Exploration in Systematic Exploration morphological space analysis. device = point in a parametrically described space. primitive movement vocabulary set of composition operators formal and visual description of devices. testing points in space expressiveness effectiveness limitations: idealized devices (no lag, noise etc.), speech excluded. Literature: Card et al., A Morphological Analysis of the Design Space of Input Devices. ACM Transactions on Information Systems, Vol.9, No. 2,

37 Models Primitive Movement Vocabulary an device is a transducer from the physical properties of the world into logical parameters of an application (Baeker and Buxton) Systematic Exploration in Literature: Baecker et al., Reading in Human-Computer Interaction: A Multidisciplinary Approach. Kaufmann, Los Altos, Calif.,

38 Manipulation operators M Models Systematic Exploration in user-centered coordinates What are the limitations of this approach? what about speech? what else is not modeled? y z facing x screen Literature: Card et al., A Morphological Analysis of the Design Space of Input Devices. ACM Transactions on Information Systems, Vol.9, No. 2,

39 Models Systematic Exploration in VolumeKnob = <Rz, [0,270 ],0, I, [0,270 ], {}> 39

40 Models Try it yourself! Literature: Card et al., A Morphological Analysis of the Design Space of Input Devices. ACM Transactions on Information Systems, Vol.9, No. 2, 1991 Systematic Exploration in 40

41 Models Systematic Exploration in Composition Operators merge composition two devices can be composed so that their common sets are merged layout composition several devices laid out together in a control panel connect composition two devices connected that the of one is cascaded to the of the other Literature: Card et al., A Morphological Analysis of the Design Space of Input Devices. ACM Transactions on Information Systems, Vol.9, No. 2,

42 Visual Description Models Systematic Exploration in 42

43 Models Systematic Exploration in Importance for? Morphological Approach cope with complexity, cope with large number of alternatives. Descriptive power (how?) Generative power (how?) 43

44 in Take-away Message models are important research: communicate interdisciplinary field establish understanding of a phenomena work on systematic ways of exploring s industry: can reduce costs of testing different s generate ideas for the next product require models that enable description prediction generation of new ideas. reality vs. model 44