HAPTIC USER INTERFACES Final lecture

Transcription

1 HAPTIC USER INTERFACES Final lecture Roope Raisamo School of Information Sciences University of Tampere, Finland

2 Content A little more about crossmodal interaction The next steps in the course 1

3 2 CROSSMODAL INTERACTION

4 Crossmodal interaction Impairments which affect one sense or communication channel can be alleviated by substitution of a different channel. This implies mapping information from one form to another (crossmodal interaction). Channels have different inherent characteristics. Thus, such mappings are not straightforward. Channels are not simple, uni-dimensional entities. 3

5 Crossmodal interaction In principle, the same information can be communicated through different modalities. In practice, such mappings are not pure and easy. The meaning is usually subtly altered in translation to another modality. For instance, speech and writing are based on words, but speech includes elements of intonation and prosody which are mostly lost in text. 4

6 Crossmodal interaction Technological constraints imply that in technologymediated communication it is practical to use the senses of vision, hearing and touch. Physical, sensory and cognitive impairments may mean that one or more of these senses is/are unavailable or inefficient. It is the role of technology to supplement or replace the missing function. Taking one form of information and making it accessible through a different channel implies a modality mapping. Map information between different modalities in order to accommodate the needs of users with disabilities. Anyone can be situationally impaired. 5

7 Expressive and perceived modalities 6

8 MICOLE (an EU/IST einclusion project) An EU-funded IST project MICOLE: Multimodal collaboration environment for inclusion of visually impaired children in Coordinator University of Tampere, TAUCHI 13 partners from all over the Europe 7

9 The MICOLE environment Main objectives Multimodal and crossmodal presentation of information Learning information and skills through the inclusive environment Collaboration of visually impaired and sighted children 8

10 Multimodal applications for visually impaired children Real models Virtual models Applications 9 [Patomäki et al., 2004]

11 An example on exploration of the Earth and the concept of gravity [Kangassalo et al., 2004] 10

12 An example on exploration of the Earth and the concept of gravity Haptic feedback: The spherical form of the Earth can be felt with the stick three-dimensionally. When exploring the Earth, the child can feel the gravity with the stick (the stick in the child s hand is pulled towards the Earth). 11

13 An example on exploration of the Earth and the concept of gravity Auditory feedback: The child can hear the names of the continents and people s voices when exploring the surface of the Earth. The sounds of the sea can be heard above the oceans. Visual feedback: A view of the spherical Earth. 12

14 An example on exploration of the Earth and the concept of gravity The proactive agents, e.g.: direct the child s attention to gravity: Did you notice that... challenge the child s thinking with arguments: What happens to different objects when you throw them in the air or drop them? 13

15 Solar System Earth s Orbit Earth Study Room Earth s Internal Layers Atmosphere 14

16 The next steps in the course 15

17 Passing the Course Short form (5 cp) 60% of the assignments (9/15 tasks) (up to 3 bonus points with additional assignments): 11 tasks = 1 point 13 tasks = 2 points 15 tasks = 3 points Demonstration visit (third week) Exam (30 points) 16

18 Passing the Course Long form (10 cp) Course in the short form and Paper (20 points) About 15 pages in M.Sc. thesis format Peer review of another student s paper Instructions sent in late November, the review process carried out in December. 17

19 Course Papers (10 cp course) Each student writes a scientific paper on a topic related to haptic user interfaces The topic must be approved by the teachers: send your suggestion to hui@cs.uta.fi. Deadline for topics: You need to decide the topic by the end of the lecture period to take the course in 10 credit point form: by October 21 st, The common template for papers will be the Master s thesis template found at Papers will be peer-reviewed in December. Deadline for final papers: January 9th,

20 Some examples of paper topics A review of a certain class of haptic applications Haptics in multimodal systems A scientifically justified design of a haptic interface A survey of haptic technologies applied in a certain use (user group, application domain) Force feedback in simulations of some phenomena Tactile feedback as a communication medium When you have an idea for your paper topic, for example, based on a lecture, please let us know. 19

21 A follow-up course in the Spring of 2012 Uusien vuorovaikutustekniikoiden toteutus (Implementation of New Interaction Techniques), 10 cp Implementation of novel user interfaces that make use of at least one new modality, like gaze, speech, haptics, computer vision, mobile phone sensors In haptics projects, the present course Haptic User Interfaces is a prerequisite. more information at 20

22 Examination Examination on November 3rd and 24th Remember to register online at The examination will be based on the lecture slides, assignments, and papers you have been given to read during the course. In addition to definitions and basic knowledge, the tasks require understanding of the course material (knowledge applied in a design task). 21

23 Before we finish.. do you happen to have any questions regarding the examination and/or starting to write the paper? 22

24 Thank you for participating in the course! 23