Designing Tactile Vocabularies for Human-Computer Interaction

Size: px

Start display at page:

Download "Designing Tactile Vocabularies for Human-Computer Interaction"

Brandon Ryan
5 years ago
Views:

1 VICTOR ADRIEL DE JESUS OLIVEIRA Designing Tactile Vocabularies for Human-Computer Interaction Thesis presented in partial fulfillment of the requirements for the degree of Master of Computer Science Advisor: Prof. Dr. Anderson Maciel Universidade Federal do Rio Grande do Sul Instituto de Informática PO. Box 15064, CEP Porto Alegre - RS - Brazil

2 Vibrotactile Communication The greatest challenge in this area is the discovery of a set of tactile patterns that, as speech sounds or letters, are clearly discriminated, rapidly processed and easily learned. (Sherrick, 1991) 2

3 Vibrotactile Communication 3

4 Vibrotactile Communication 4

5 Vibrotactile Communication 5

6 Vibrotactile Communication 6

7 Vibrotactile Communication 7

8 Vibrotactile Communication Complex Signals 8

9 Vibrotactile Communication Obstacle detection Complex Signals (Yoon, Jeong e Yu, 2009) 9

10 Vibrotactile Communication Complex Signals Simple Signals 10

11 Vibrotactile Communication Tap-on-shoulders approach (Hao e Song, 2010) Complex Signals Simple Signals 11

12 Problem Expressive capacity: To increase the expressiveness of a tactile language, keeping it as easy as possible to learn and to understand. 12

13 Problem Expressive capacity: To increase the expressiveness of a tactile language, keeping it as easy as possible to learn and to understand. Vibrotactile Navigation Approach for tactile prefixation Design and assessment of vocabularies 13

14 Summary Introduction The Modifier Tactile Pattern Initial Vocabulary for Tactile Navigation Assessment of Tactile Vocabularies Redesign and Application Trial Conclusion 14

15 Summary Introduction The Modifier Tactile Pattern Initial Vocabulary for Tactile Navigation Assessment of Tactile Vocabularies Redesign and Application Trial Conclusion 15

16 Summary Introduction The Modifier Tactile Pattern Initial Vocabulary for Tactile Navigation Assessment of Tactile Vocabularies Redesign and Application Trial Conclusion 16

17 Tactile Prefixation Prefixation in Braille a b c Sinal de Número

18 Tactile Prefixation Prefixation in Braille The Touch *the touch 18

19 Tactile Prefixation Prefixation in Braille Uppercase Prefix The Touch *the touch 19

20 Tactile Prefixation Prefixation in Braille Uppercase Prefix XXXThe Touch *The touch 20

21 Tactile Prefixation Prefixation in Braille Uppercase Modifier XXXThe Touch *THE touch 21

22 Tactile Prefixation Prefixation in Braille Uppercase Modifier XXXThe Touch *THE TOUCH 22

23 The Modifier Tactile Pattern A Modifier Tactile Pattern is a tactile signal that modifies the interpretation of the remaining signals in a Tacton or tactile sequence. 23

24 The Modifier Tactile Pattern A Modifier Tactile Pattern is a tactile signal that modifies the interpretation of the remaining signals in a Tacton or tactile sequence. 24

25 The Modifier Tactile Pattern A Modifier Tactile Pattern is a tactile signal that modifies the interpretation of the remaining signals in a Tacton or tactile sequence. M 25

26 The Modifier Tactile Pattern A Modifier Tactile Pattern is a tactile signal that modifies the interpretation of the remaining signals in a Tacton or tactile sequence. M M 26

27 The Modifier Tactile Pattern A Modifier Tactile Pattern is a tactile signal that modifies the interpretation of the remaining signals in a Tacton or tactile sequence. M M 27

28 The Modifier Tactile Pattern A Modifier Tactile Pattern is a tactile signal that modifies the interpretation of the remaining signals in a Tacton or tactile sequence. M M M 28

29 Summary Introduction The Modifier Tactile Pattern Initial Vocabulary for Tactile Navigation Assessment of Tactile Vocabularies Redesign and Application Trial Conclusion 29

30 Summary Introduction The Modifier Tactile Pattern Initial Vocabulary for Tactile Navigation Assessment of Tactile Vocabularies Redesign and Application Trial Conclusion 30

31 Initial Vocabulary for Navigation Tactile Language Design Hand-based Display User Study Results 31

32 Initial Vocabulary for Navigation 32

33 Initial Vocabulary for Navigation 33

34 Initial Vocabulary for Navigation 34

35 Initial Vocabulary for Navigation 35

36 Initial Vocabulary for Navigation 36

37 Initial Vocabulary for Navigation 37

38 Initial Vocabulary for Navigation 38

39 Hand-based Tactile Display 39

40 User Study 15 individuals (14 males); Mean age 25 years old (23-37); 3 users have some degree of myopia or astigmatism; One user mentioned he suffers from hyperhidrosis, Two participants are left handed.

41 User Study 41

42 Navigation task Scene 1: Scene 2: 42

43 Results Perception 43

44 Results Perception 44

45 Results Perception 45

46 Results Interpretation 46

47 Summary Introduction The Modifier Tactile Pattern Initial Vocabulary for Tactile Navigation Assessment of Tactile Vocabularies Redesign and Application Trial Conclusion 47

48 Summary Introduction The Modifier Tactile Pattern Initial Vocabulary for Tactile Navigation Assessment of Tactile Vocabularies Redesign and Application Trial Conclusion 48

49 Assessment of Vocabularies Vibrotactile belt Designing the Vocabularies User Study Results 49

50 Vibrotactile Belt 50

51 Design of Tactile Languages We assessed three tactile vocabularies: A Conventional one, based only on metaphors; A Modifier-based vocabulary with patterns made by juxtaposition of tactons in sequence; and Another Modifier-based vocabulary with patterns made by superposition. Five messages: Obstacle, Destination, Warning, Course and Itinerary.

52 Design of Tactile Languages First Vocabulary

53 Design of Tactile Languages First Vocabulary Tactor position: Obstacles

54 Design of Tactile Languages First Vocabulary Tactor position: Obstacles Tactor position: Course

55 Design of Tactile Languages First Vocabulary Tactor position: Obstacles Tactor position: Course Tactor position: Warning

56 Design of Tactile Languages First Vocabulary Tactor position: Obstacles Tactor position: Course Tactor position: Warning Frequency: Destination Wave form: Itinerary

57 Design of Tactile Languages First Vocabulary

58 Design of Tactile Languages Second Vocabulary Tactor position: Obstacles

59 Design of Tactile Languages Second Vocabulary Tactor position: Obstacles Tactor position: Modifiers

60 Design of Tactile Languages Second Vocabulary Tactor position: Obstacles Tactor position: Modifiers 2x Course/Warning Destination Itinerary

61 Design of Tactile Languages Second Vocabulary 2x

62 Design of Tactile Languages Third Vocabulary Tactor position: Obstacles

63 Design of Tactile Languages Third Vocabulary Tactor position: Obstacles Tactor position: Modifiers

64 Design of Tactile Languages Third Vocabulary

65 User Study 58 individuals (47 males and 11 females); Age range of years; 23 users have some degree of myopia, astigmatism or hypermetropia; Three groups: 20 participants used the first vocabulary; 19 participants used the second vocabulary; 19 participants used the third vocabulary.

66 User Study Practice

67 User Study Perception

68 User Study Interpretation

69 User Study Navigation

70 User Study Navigation

71 User Study Navigation - Scenes played randomly; - Different lighting levels; - Tactile messages displayed in different order for each phase.

72 Results Performance Time in navigation Collisions

73 Results Performance Time in navigation

74 Results Interpretation of the patterns In interpretation task In navigation

75 Summary Introduction The Modifier Tactile Pattern Initial Vocabulary for Tactile Navigation Assessment of Tactile Vocabularies Redesign and Application Trial Conclusion 75

76 Summary Introduction The Modifier Tactile Pattern Initial Vocabulary for Tactile Navigation Assessment of Tactile Vocabularies Redesign and Application Trial Conclusion 76

77 Redesign and Application Trial Redesign methodology Navigation in underground mine User study Results 77

78 Redesign 78

79 Redesign 79

80 Redesign 80

81 Application Trial Navigation in underground mine 81

82 Application Trial Navigation in underground mine 82

83 Application Trial Navigation in underground mine 83

84 User Study 15 individuals (14 males). 4 Mining Engineering students and 10 Computer Science students; Mean age 25 years old (23-37); 7 users have some degree of myopia or keratoconus;

85 User Study Vocabulary practice 85

86 User Study Underground navigation 86

87 User Study Underground navigation 87

88 Results Performance Time in navigation Collisions 88

89 Results 89

90 Results 90

91 Summary Introduction The Modifier Tactile Pattern Initial Vocabulary for Tactile Navigation Assessment of Tactile Vocabularies Redesign and Application Trial Conclusion 91

92 Summary Introduction The Modifier Tactile Pattern Initial Vocabulary for Tactile Navigation Assessment of Tactile Vocabularies Redesign and Application Trial Conclusion 92

93 Summary Introduction The Modifier Tactile Pattern Initial Vocabulary for Tactile Navigation Assessment of Tactile Vocabularies Redesign and Application Trial Conclusion 93

94 Summary Introduction The Modifier Tactile Pattern Initial Vocabulary for Tactile Navigation Assessment of Tactile Vocabularies Redesign and Application Trial Conclusion a b c Sinal de Número

95 Summary Introduction The Modifier Tactile Pattern Initial Vocabulary for Tactile Navigation Assessment of Tactile Vocabularies Redesign and Application Trial Conclusion a b c Sinal de Número

96 Summary Introduction The Modifier Tactile Pattern Initial Vocabulary for Tactile Navigation Assessment of Tactile Vocabularies Redesign and Application Trial Conclusion a b c Sinal de Número

97 Summary Introduction The Modifier Tactile Pattern Initial Vocabulary for Tactile Navigation Assessment of Tactile Vocabularies Redesign and Application Trial Conclusion a b c Sinal de Número

98 Conclusion Work evolution Different levels of immersion; Prototypes of displays for different body sites; Improvement of the experimental setup; Improvement of the tactile interface usability. 98

99 Conclusion Contributions The concept of Modifier Tactile Pattern; The assessment of dozen families of tactile icons; A usable vocabulary for navigation; Data from more than eighty people; A large review of the research on vibrotactile communication. 99

100 Conclusion Future Works To improve the tactile belt ergonomy; To test navigation in physical environments; To assess different ambient conditions and contexts; To assess different user profiles; To build frameworks for haptic interaction design. 100

101 Submissions SIBGRAPI 2012 Using Vibrotactile Communication to Assist in Orientation and Locomotion HAPTICS 2014 Design and Assessment of a Modifier-based Tactile Language CHI 2014 Introducing the Modifier Tactile Pattern for Vibrotactile Communication SVR 2014 Tactile Interface for Navigation in Underground Mines UIST 2013 Introducing the Modifier Tactile Pattern for Haptic Communication 3DUI 2014 Assessment of Tactile Languages as Navigation Aid in 3D Environments Poster: Applying Tactile Languages for 3D Navigation EUROHAPTICS 2014 Introducing the Modifier Tactile Pattern for Vibrotactile Communication Assessment of Tactile Languages as Navigation Aid in 3D Environments 101

102 Submissions SIBGRAPI 2012 Using Vibrotactile Communication to Assist in Orientation and Locomotion HAPTICS 2014 Design and Assessment of a Modifier-based Tactile Language CHI 2014 Introducing the Modifier Tactile Pattern for Vibrotactile Communication SVR 2014 Tactile Interface for Navigation in Underground Mines UIST 2013 Introducing the Modifier Tactile Pattern for Haptic Communication 3DUI 2014 Assessment of Tactile Languages as Navigation Aid in 3D Environments Poster: Applying Tactile Languages for 3D Navigation EUROHAPTICS 2014 Introducing the Modifier Tactile Pattern for Vibrotactile Communication Assessment of Tactile Languages as Navigation Aid in 3D Environments 102

103 Designing Tactile Vocabularies for Human-Computer Interaction Thank you Victor Adriel de Jesus Oliveira Prof. Dr. Anderson Maciel Universidade Federal do Rio Grande do Sul Instituto de Informática PO. Box 15064, CEP Porto Alegre - RS - Brazil

Tactile Interface for Navigation in Underground Mines

XVI Symposium on Virtual and Augmented Reality SVR 2014 Tactile Interface for Navigation in Underground Mines Victor Adriel de J. Oliveira, Eduardo Marques, Rodrigo Peroni and Anderson Maciel Universidade