Haptic Navigation in Mobile Context. Hanna Venesvirta

Size: px
Start display at page:

Download "Haptic Navigation in Mobile Context. Hanna Venesvirta"

Transcription

1 Haptic Navigation in Mobile Context Hanna Venesvirta University of Tampere Department of Computer Sciences Interactive Technology Seminar Haptic Communication in Mobile Contexts October 2008

2 i University of Tampere Department of Computer Sciences Interactive Technology Hanna Venesvirta: Haptic Navigation in Mobile Context Seminar paper, 16 pages, 5 indexes December 2008 Haptic communication is intuitive and easy to learn, and it provides a new and unique interaction method for all users and especially for blind and visually impaired users. There are several haptic navigation devices. When designing and implementing these products and prototypes, the projects have been especially interested in visually impaired users and users in special situations, such as pilots, firemen and military persons are. Furthermore, these devices provide some extra for all users. Key words and terms: Haptic Communication, Haptic Navigation, Haptic I/O, Mobile or Wearable Devices

3 ii Table of Contents 1. Introduction Haptic navigation: what, where, why and why not? What is haptic navigation and where it can be used Advantages of haptic navigation Challenges of haptic navigation Technologies used in haptic navigation Haptic navigation: examples MOMO: A haptic navigation device Lead-Me Interface for a Pulling Sensation from hand-held Devices CabBoots Shoes with integrated Guidance System Vibro-Vest A Wireless Haptic Navigation Device ActiveBelt Technojewerly Conclusion References... 15

4 1 1. Introduction Haptic interaction between the user and the interface or the device has many advantages. Researchers have found many opportunities on haptic navigation, even as a main modality of the communication between the user and the device. That is because haptics have been found to be intuitive and natural way of communication. Haptics support users cognitive attentiveness and perception without disturbing other modalities. Especially it has thought to be really powerful communication method for visually impaired people, but as well for situations, where other modalities are taken. Haptic navigation is a navigation method, which uses sense of touch as an input or output channel. The device can interact with the user by vibrating, leaning to the desired direction, pulling or pushing the user, among others. Here, I will introduce haptic navigation in mobile context. Section 2 will lead the reader in to the subject: what is haptic navigation. On section 3, I will discuss what interaction methods and technologies have been used with haptic navigation, and furthermore, I will introduce few examples of haptic navigation on section 4. Finally, I will conclude on section Haptic navigation: what, where, why and why not? In this section, I will discuss several things: What is haptic navigation; Where it can be used; What are the advantages of haptic navigation compared other navigational methods, and; What are the challenges of haptic navigation What is haptic navigation and where it can be used Word navigation can be understood in several ways: when referring to navigation, it can mean that some (motor) vehicle, like a car, an aeroplane, or a ship is driven. Then again, navigation means browsing in the World Wide Web or some (graphical) interface. In some cases, the word navigation is used to describe a situation, when someone is guides or controls someone else, or a machine. [OED] In haptic navigation, user has a device, which leads them to the desired location by using feedback based on the sense of touch. Feedback can be given via vibrating (several haptic mice use vibration; see also [IDEO; Erp et al., 2001; Hamm; Wang and O Friel]), pulses, by pushing and pulling [Amemiya et al., 2008], or by leaning to the needed direction [Frey, 2007; Wang and O Friel]. Sometimes the device can use several haptic feedbacks at the same time [Wang and O Friel], or a combination of different modalities [IDEO]. In general, the haptic communication is one-sided: the device gives output, but the user does not communicate with the device, not at least with haptic interaction. Then again, it can be argued whether or not users responses (e.g. changing

5 2 movement) to the information given are communication with the device. At least, it is not that active. One can use haptic navigation in a virtual environment, browsing graphical interface, or moving in the real world. One can find some techniques produced for haptic navigation in graphical interface: for instance, it is possible to make large amounts of data more understandable by using haptics and haptic navigation, like information visualization does. This is useful for example for visually impaired users, as they are able to access information usually described in visual or graphical means. Also, this might mean that browsing is faster and easier, as navigation is not based on reading or using screen readers. (More about haptic navigation in graphical interfaces see e.g. [Wall and Brewster, 2006].) Moving in a virtual environment (VE) by means of haptic navigation is very much the same thing as moving in real world; the user is searching a route and explores the VE. This means, they might require help to find their way or to control their route. (More about using haptic navigation in VEs see e.g. [Erp, 2001] or [Nemec et al., 2004].) Several haptic navigational devices for navigating in real world have been developed. Some of the devices have been made for visually impaired (e.g. [Amemiya et al., 2008; Amemiya and Sugiyama, 2008]), for special situations, where visual and auditory channels are taken, like when driving a car, navigating a ship, or flying [e.g. Erp et al., 2005], as well as various common use, in various situation for various people [e.g. MOMO; IDEO; Frey, 2007]. From the viewpoint of mobile haptic navigation, it is reasoned to concentrate on the latter. Clearly it seems that haptic navigation is needed and has potential in real world environments. This is why I have decided, that I will curtail my later discussion on this particular subject Advantages of haptic navigation Haptic communication between the device and the user has been noted to be effective, since haptic modality can provide very intuitive interaction [Amemiya et al., 2008] after all, communication based on touch is the very first way of communication. When communicating with the navigational devices it is important that communication between the device and the user continues to be intuitive and comfortable. For example, the designers of CabBoots [Frey, 2007] and Lead-Me interface [Amemiya et al., 2008] regard that their products are intuitive and easy to learn, as interaction in both products is based metaphors from real life. Haptic information is non-verbal and cognitively less distracting than information from other channels [Amemiya et al., 2008]. When cognitive activity has been oppressed heavily, like when travelling in unfamiliar surroundings, it is very important

6 3 to get information without disturbing or limiting important modalities, like seeing or hearing. As haptic communication is non-verbal and non-visual, attentiveness is not disturbed, but more information channels can be used. In addition, the visually impaired users are often mentioned to benefit haptic communication, since they prefer devices which do not narrow down their last communication channel, hearing. This is really important benefit, as people who s seeing is lacking it is very important that they have their possibility to communicate with other people, and also, be aware their environment, because of their own safety. Also, it has been discovered that haptic channel supports long-term location memory [Amemiya et al., 2008; Chapman et al., 2001]. Haptic navigation devices can be learnt to use fast, even after short practise. Likewise it has discovered that haptic device can be used for navigation both in ordinary situations, and in operational environments, like flying a helicopter. [Erp et al., 2005] Employing mobile devices for navigation makes the usage of navigational device easier, as these devices have been produce for situations, when navigation is often needed: on the road. However, both mobile and haptic elements give challenges for navigation. In next section some of the challenges will be discussed Challenges of haptic navigation In general, the way people use cognitive mappings is a great challenge for navigation devices [Bradley and Dunlop, 2005]. People tend to use cognitive mappings based what they are looking and what interests them. It has speculated that (1) time of day (night, day), (2) season, and (3) direction all have an influence how people build cognitive mappings [Jonsson, 2002]. Because people have different cognitive mappings, it is challenging to take these into account when designing navigation devices. Also, there has been very little research about how visually impaired people use cognitive mapping [Bradley and Dunlop, 2005]. Since potential users for haptic navigation, it would be important to study this. Using only haptics in navigation devices brings two communication problems: it is very difficult to code direction and above all, distance when using haptic feedback [Erp et al., 2005]. Coding direction is notably easier though there were only two directions coded, it has been noted that navigation can be successful [e.g. Bosman et al., 2003]. Of course, if there are more sensors, understanding directional changes is easier [Erp et al., 2005]. Coding distance is challenging regardless of how the device is connected to the user. Then again, when walking, it is not always important to know how big the distance is users concern themselves more the direction. Yet, according Erp et al. [2005], users were pleased if distance and above all, reaching the destination is coded.

7 4 The problem when coding distance on a haptic navigation device is that people have no baseline to tell them where exactly the destination is all they can say, that they are approaching. Only after long period of using some device people may learn to calculate distance. It is also possible, that the problem will not ever be solved, and in most cases, designers have not even tried to implement any coding for it. Mobility as such brings some challenges for haptic navigation: putting together mobile device and kinaesthetic interaction. According Amemiya et al. [2008], most of the interfaces used in mobile devices these days are not suitable for mobile devices. Mobile devices are often compact, so any massive technologies cannot be used. Also, as being small-sized devices held usually in one hand, it is challenging to implement technologies which indicate direction for instance, vibrating is not that informative when used with for example mobile phone. Amemiya et al. have their own suggestion to solve this problem; more of it will be discussed below, on section 4.2. Finally, there might be existing problem, which was ignored in literature: nearly all products I found require that user have to either wear them or carry them in their hand. All wearable devices, like belts and vests, appear to be uncomfortable and not for everyday use. Then again, hand-held devices require that user carry them, so they limit users activities. GPS Toes (introduced on section 4.6) designed by IDEO [IDEO] were closest of device, which is cosy and unnoticeable. 3. Technologies used in haptic navigation In haptic navigation, both tactile and force feedback can be used. It seems that mostly the tactile feedback, such as vibration, is used nowadays, but according Amemiya et al. [2008], especially in hand-held devices, such as in mobile phones, force feedback could be more understandable, effective and intuitive. As mentioned above, several haptic navigation devices use tactile feedback, usually vibration. In this paper, I will later introduce following examples that use vibration (and possible, other interaction methods) to communicate with the user): GPS Toes by IDEO [IDEO], Vibro-Vest [Hamm], ActiveBelt [Tsukada and Yasumura, 2004] and MOMO [Wang and O Friel]. As an examples about force feedback, I will introduce Lead-Me interface by Amemiya et al. [2008] and CabBoots by Frey [2007]. It can be speculated if MOMO [Wang and O Friel] is also using force feedback, too, as it interacts with the user by vibrating and leaning to the needed direction. Vibration feedback seems to have great potential to be more intuitive interaction method to illustrate distance than force feedback. For instance, Erp (et al.) have studied with users, how distance could be coded in haptic navigation device, which the user wears [Erp, 2005; Erp et al., 2005].

8 5 Still, for more everyday situations, like navigating in an unfamiliar city, the force feedback could be more useful, at least when implemented on a hand-held device. Firstly, on an everyday situation like this, the user rarely needs any coding for distance, but rather for direction. Furthermore, people usually would not wear any big, uncomfortable and heavy wearable devices, but rather they could prefer that some proper interface could be implemented their own mobile phone. 4. Haptic navigation: examples In this section, I will introduce six different kinds of haptic navigation devices. None of these devices are commercial produces, but more like scientific or artistic trials. Yet, it is never said whether or not some of these examples would end up at the markets. I have tried to choose different examples as it would be un-wise to discuss similar devices here MOMO: A haptic navigation device MOMO is totally haptic and mobile navigation device designed by Wang and O Friel [MOMO; Wang and O Friel]. It navigates the user by vibrating and leaning to the direction, where one is about to go. There is no haptic input interaction available, only interaction is output. Unfortunately there is no explicit information available that could comprehensive describe how user could interact with MOMO. The designers state that they have pre-programmed the routes they have used to test the device, so it seems that there is no possibility to give direct orders to the device, at least not nowadays. MOMO is twelve inches (about 30 centimetres) tall, the diameter is eight inches (about 20 cm) and the weight one pound (less than half of a kilogramme). MOMO is comprised of a GPS module, digital compass, an arduino board, two servo motors and a vibration motor (see Figure 1, on left). MOMO has an open hardware. Its sweater was crocheted out of wool, cotton, and, as the designers mention, love, creating a soft, huggable surface (see Figure 1, on right).

9 6 Figure 1: On left, the mechanics of MOMO, on right, MOMO in its clothing. According Wang and O Friel, MOMO provides positive emotional experiences, enabling people to feel empowered in unfamiliar places. The designers have preprogrammed GPS coordinates of twelve New York City parks, and they have used MOMO as a tour guide (see Figure 2). Currently, it is evident that using MOMO for navigation anywhere is not possible. Yet, I personally think that if the interface of MOMO will be expanded so, that it is possible to interact with him like giving him direct orders of the destination or the changes of the route, and then it could be potential navigational device for versatile use. MOMO has won an award in Art Hacks on Arduino Contest 2008.

10 7 Figure 2. MOMO working Lead-Me Interface for a Pulling Sensation from hand-held Devices Lead-Me interface uses metaphor of pulling and pushing when guiding the user. Amemiya et al. [2008] compares metaphor to a situation, where parent leads a child. The child can watch around while they know that direction is about to be changed when parent pushes or pulls them on hand. Figure 3. Lead-Me: Overview of the prototype of the haptic device. Amemiya et al. [2008] have developed a design that uses different acceleration patterns for the two directions to create a perceived force imbalance and thereby produce the sensation of directional pushing or pulling. The prototype of the device is based on a crack-slider mechanism. The mechanism imparts a feeling of back-and-forth movement, which can be recognized as a sensation of pushing and pulling. Schematic drawings and a figure of the prototype are shown in Figure 3.

11 8 Amemiya et al. have some ideas of how the interface could be used. On Figure 4 Assisted navigation application can be seen (on left). According the designers, Lead-Me could be implemented to hand-held device, like mobile phone. The device could use GPS and Lead-Me when guiding user to the destination. Also, they have thought that Lead-Me could be used in a game controller (see Figure 4, on right). Figure 4. Proposed interfaces for Lead-Me: Assisted navigation application (on left and in the middle) and an effective game controller (on right). Metaphor of the interface seems to fit for situations, where only one navigational device, (e.g. mobile phone) is used. On situations like this, metaphor of pushing and pulling could make easier to indicate direction. At the moment, Amemiya et al. have been testing whether or not the metaphor could be used as effectively as thought. There is no accurate information whether or not Lead-Me could be implemented into even smaller devices if it is not possible, then the device has to be a hand-held, and that will limit users activity in some cases CabBoots Shoes with integrated Guidance System With CabBoots (see Figure 5), the user gets to take a walk into a virtual path, which the shoes will not let them wander off [Frey, 2007; see also Frey]. The idea of the interface is to plan the most suitable route for the user, based on the known starting point and desired destination. When the user draws, they can rely that CabBoots know the way.

12 9 Figure 5. CabBoots. The designer uses metaphor of walking on a path: user walks along a virtual path. If the user treads the edge of the path, in other words, is about to stray off the course, CabBoots model the feeling of the edge, and the user is able to fix their direction. (See Figure 6) Figure 6. CabBoots-tour. The first prototype of CabBoots consist a pair of shoes equipped with sensors and mechanics, which are wirelessly connected to the laptop computer the user needs to carry around, which runs a control-software. Servo motors connected to wooden flaps in the shoes are able to set the angle of the sole when needed. There are several sensors, which deliver information about the actual state of the shoe, and thereby the foot. Software is needed for setting the paths in direction and also to provide a visual controlpanel for monitoring the shoes spatial state. All this makes possible to navigate in a virtual path. The designer argues that the communication metaphor is familiar and it is based real life experiences. [Frey, 2007]

13 10 The designer has made a second prototype, in which the shoes host all necessary parts themselves: e.g. mechanics, electronics, power supply, rf link. Also, the shoes can be strapped on any shoes (as long as the shoe is a certain size) and are connected wirelessly via Bluetooth. The control-software can be run not only in a computer, but also in PDA or mobile phone, so huge progress has been made between 2007 and [Frey] 4.4. Vibro-Vest A Wireless Haptic Navigation Device In the fall 2002 Damon Hamm with 3 other designers built a wireless haptic navigation and guidance system called Vibro-Vest [Hamm]. Also, the designers produced a game, which they named Human Pac-Man. A player guides person who wears the vest through a human-sized maze. The person, who is in the maze, gets the feedback sent from the player by haptic feedback. (See Figures 7 and 8) Figure 7. The Vest hardware Vibro-Vest is not technically mobile navigation device; instead a videogame console is used to guide the piece. However, Vibro-Vest is one example of many interesting possibilities when exploiting haptic navigation, e.g. in the context of social interfaces. Then again, the designer mentions [Hamm], that this product has many possible applications. Also other vest and belt applications have been produced [e.g. Erp et al., 2005; see also Erp, 2005]. In most cases feedback is given by vibrating, and the count of sensors depends of the product. According to Erp et al. [2005], vibrotactile navigation is a powerful method, especially in illustrating direction. Yet, there is a question whether or not these kinds of products are mobile: the navigational device itself can be wireless, but when some other device is needed to specify the route, the concept of mobility is arguable.

14 11 Figure 8. Video game console (on left) and the human-sized maze (on right) ActiveBelt ActiveBelt is a novel belt-type wearable tactile display that can transmit directional information for the user. According Tsukada and Yasumura [2004], there is at least three advantages in this kind of a haptic navigation device: (1) as there is several sensors on the belt (on their prototype, they use eight sensors), the user can easily match the information given from the device to the directions in the real world. (2) As the users usually wear a belt, there is no need to wear anything extra, as on this device, the actuator can be attached on the users own belt. (3) Furthermore, there are several applications the device can use. The applications Tsukada and Yasumura have developed will be discussed below. Figure 9 shows the prototype of the device. There are four components: the hardware (version 1) (1), a GPS (2), a directional sensor (3) and a microcomputer (4). Tsukada and Yasumura state also that they have designed the version 2 of the device so that the size of the belt is universal; the sensors can be moved so the device can be worn by several users.

15 12 Figure 9. ActiveBelt: Prototype (version 1) Tsukada and Yasumura have developed four applications for ActiveBelt: (1) FeelNavi for human navigation systems, (2) FeelSense for location aware information services, (3) FeelSeek for search of lost properties, and (4) FeelWave for entertainment. Here, I will introduce the first three of these. (See also Figure 10.) Figure 10. The basic concepts of proposed applications: on left, FeelNavi; in the middle, FeelSense; and on right, FeelSeek. FeelNavi is an application for navigation. The direction is illustrated by vibration. The prototype uses the latitude and longitude when registering the destination the user

16 13 needs to reach; the device uses this information among the information about users current position and orientation, and activates the sensor that illustrates the direction. FeelSense is a location-aware information system. The user can pre-register some information, like which shops they are interested in, and the application can then communicate to the user, when something matching their concern is nearby. FeelSeek is an application to remind users of valuables left behind. Furthermore, the application can lead the user back to the spot the item was left. The combination of ActiveBelt, FeelSeek application and RFID tags is used Technojewerly In 2001, IDEO [IDEO] executed a project, which purpose was to bring two new and at the same time, very ordinary technologies closer to everyday usage. Penta Phone and Ring Phone are concepts for mobile phones, and GPS Toes is a navigational device (see Figure 11). The idea of producing these kinds of concepts was to prove, that new technology does not need to look unfamiliar or uncanny, but it can and should be integrated our word and users person. GPS Toes (see Figure 11, on right) uses low-power, nano-derived technology. GPS Toes communicates with a GPS receiver nearby, like the one which is in the user s purse. The device indicates the direction by vibrating and lighting up to signal upcoming direction changes; a ring in a left toe to the left, in a right toe to the right. According the designers, GPS Toes can be used whether driving a car, walking on the streets, or hiking on the countryside. Unfortunately, these products were concepts only, and those cannot be invested reselling. Figure 11. Technojewerly. GPS Toes on right.

17 14 5. Conclusion What I was most longing during my survey, was some product, which would slightly be like IDEOs Technojewelry concept; that is because in my opinion, GPS Toes is (of the all products I was able to find) alone imperceptible, mobile, handy and ordinary enough, that it could be useful when navigating; specially if it could use some promising interface, like Lead-Me. Most of the devices illustrated on this paper appear to limit the user s motion. Vest and belt devices are large and seemingly unwieldy, at least many of them. All different kinds of hand-held devices, like mobile phones, require that the user has to keep them in hand while using. Both MOMO and CabBoots might be too extraordinary for everyday use; likewise, MOMO is needed to be held with both hands, so it encumbers the user s activities a lot. Hopefully, in future there will be some hand-held or wearable devices, which can be used for haptic navigation, with appearance ordinary enough. For this purpose, ActiveBelt could be promising option, with the many interesting ideas of applications the developers have. Haptics open up a possibility for navigation to be novel and cognitively lighter. Haptic navigation has lots of potential, both in virtual environments and in real world. The benefits it offers for special needs and for all others are large. Yet, more research and development is needed, so haptic navigation could be more commonly used. Currently, haptics can be one element used in navigational devices, together with other modalities. Perhaps also in the future there is need to use several modalities in communication between the user and navigation device after all, as the users are multimodal, should the device be also.

18 15 References [AMEMIYA et al., 2008] AMEMIYA, T., ANDO, H. and MAEDA, T., Lead-me interface for a pulling sensation from hand-held devices. ACM Trans.Appl.Percept., 5(3), pp [AMEMIYA and SUGIYAMA, 2008] AMEMIYA, T. and SUGIYAMA, H., Design of a Haptic Direction Indicator for Visually Impaired People in Emergency Situations. Computers Helping People with Special Needs. Springer, pp [BOSMAN et al., 2003] BOSMAN, S., GROENENDAAL, B., FINDLATER, J.W., VISSER, T., GRAAF, M. and MARKOPOULOS, P., GentleGuide: An Exploration of Haptic Output for Indoors Pedestrian Guidance. Proceedings of the Mobile HCI, , Springer Publications, pp [BRADLEY and DUNLOP, 2005] BRADLEY, A. and DUNLOP, D., An Experimental Investigation into Wayfinding Directions for Visually Impaired People. Personal Ubiquitous Comput., 9(6), pp [CHAPMAN et al., 2001] CHAPMAN, C.D., HEATH, M.D., WESTWOOD, D.A. and ROY, E.A., Memory for kinesthetically defined target location: Evidence for manual asymmetries. Brain and cognition, 46(1-2), pp [ERP, 2005] ERP, JAN B.F. VAN, Presenting directions with a vibrotactile torso display. Ergonomics, 48(3), pp [ERP, 2001] ERP, J.B.F. VAN., Tactile Navigation Display. Proceedings of the First International Workshop on Haptic Human-Computer Interaction, 2001, Springer-Verlag pp [ERP et al., 2005] ERP, J.B.F. Van., VEEN, H.A.H.C.V., JANSEN, C. and DOBBINS, T., Waypoint navigation with a vibrotactile waist belt. ACM Trans.Appl.Percept., 2(2), pp [FREY, 2007] FREY, M., CabBoots: shoes with integrated guidance system. Proceedings of the 1st international conference on Tangible and embedded interaction, 2007, ACM pp [FREY] FREY, M., CabBoots - Shoes with Integrated Guidance System. Available: [9/22, 2008]. [HAMM] HAMM, D., Damon Hamm - Haptic Navigation Device: Vibro-Vest A Wireless Haptic Navigation Device. Available: [9/22, 2008]. [IDEO] Technojewelry - Case Studies - IDEO. Available: [9/30, 2008]. [JONSSON, 2002] JONSSON, E., Inner navigation: why we get lost and how we find our way. Scribner, New York, pp

19 16 [MOMO] MOMO: A haptic navigation device Libelium. [NEMEC et al., 2004] NEMEC, V., SPORKA, A.J. and SLAVIK, P., Haptic and Spatial Audio Based Navigation of Visually Impaired Users in Virtual Environment Using Low Cost Devices. User-Centered Interaction Paradigms for Universal Access in the Information Society, Springer, pp [OED] OED, Oxford English Dictionary last update [Homepage of Oxford University Press], [Online]. Available: [9/25, 2008]. [TSUKADA and YASUMURA, 2004] TSUKADA, K. and YASUMURA, M., ActiveBelt: Belt-Type Wearable Tactile Display for Directional Navigation. Proc. of Ubicomp 04 (2004), Springer, pp [WALL and BREWSTER, 2006] WALL, S. and BREWSTER, S., Feeling what you hear: tactile feedback for navigation of audio graphs. CHI '06: Proceedings of the SIGCHI conference on Human Factors in computing systems, 2006, ACM pp [WANG and O FRIEL] WANG, C. and O FRIEL, K., MOMO: a haptic navigation device. Available: [9/22, 2008].

ActiveBelt: Belt-type Wearable Tactile Display for Directional Navigation

ActiveBelt: Belt-type Wearable Tactile Display for Directional Navigation ActiveBelt: Belt-type Wearable Tactile Display for Directional Navigation Koji Tsukada 1 and Michiaki Yasumura 2 1 Graduate School of Media and Governance, Keio University, 5322 Endo Fujisawa, Kanagawa

More information

A Comparison of Two Wearable Tactile Interfaces with a Complementary Display in Two Orientations

A Comparison of Two Wearable Tactile Interfaces with a Complementary Display in Two Orientations A Comparison of Two Wearable Tactile Interfaces with a Complementary Display in Two Orientations Mayuree Srikulwong and Eamonn O Neill University of Bath, Bath, BA2 7AY, UK {ms244, eamonn}@cs.bath.ac.uk

More information

Tactile Wayfinder: Comparison of Tactile Waypoint Navigation with Commercial Pedestrian Navigation Systems

Tactile Wayfinder: Comparison of Tactile Waypoint Navigation with Commercial Pedestrian Navigation Systems Tactile Wayfinder: Comparison of Tactile Waypoint Navigation with Commercial Pedestrian Navigation Systems Martin Pielot 1, Susanne Boll 2 OFFIS Institute for Information Technology, Germany martin.pielot@offis.de,

More information

Haptic messaging. Katariina Tiitinen

Haptic messaging. Katariina Tiitinen Haptic messaging Katariina Tiitinen 13.12.2012 Contents Introduction User expectations for haptic mobile communication Hapticons Example: CheekTouch Introduction Multiple senses are used in face-to-face

More information

6 Ubiquitous User Interfaces

6 Ubiquitous User Interfaces 6 Ubiquitous User Interfaces Viktoria Pammer-Schindler May 3, 2016 Ubiquitous User Interfaces 1 Days and Topics March 1 March 8 March 15 April 12 April 26 (10-13) April 28 (9-14) May 3 May 10 Administrative

More information

HAPTIGO TACTILE NAVIGATION SYSTEM

HAPTIGO TACTILE NAVIGATION SYSTEM HAPTIGO TACTILE NAVIGATION SYSTEM A Senior Scholars Thesis by SARIN REGMI Submitted to Honors and Undergraduate Research Texas A&M University in partial fulfillment of the requirements for the designation

More information

Rich Tactile Output on Mobile Devices

Rich Tactile Output on Mobile Devices Rich Tactile Output on Mobile Devices Alireza Sahami 1, Paul Holleis 1, Albrecht Schmidt 1, and Jonna Häkkilä 2 1 Pervasive Computing Group, University of Duisburg Essen, Schuetzehnbahn 70, 45117, Essen,

More information

MOBILE AND UBIQUITOUS HAPTICS

MOBILE AND UBIQUITOUS HAPTICS MOBILE AND UBIQUITOUS HAPTICS Jussi Rantala and Jukka Raisamo Tampere Unit for Computer-Human Interaction School of Information Sciences University of Tampere, Finland Contents Haptic communication Affective

More information

Drumtastic: Haptic Guidance for Polyrhythmic Drumming Practice

Drumtastic: Haptic Guidance for Polyrhythmic Drumming Practice Drumtastic: Haptic Guidance for Polyrhythmic Drumming Practice ABSTRACT W e present Drumtastic, an application where the user interacts with two Novint Falcon haptic devices to play virtual drums. The

More information

MELODIOUS WALKABOUT: IMPLICIT NAVIGATION WITH CONTEXTUALIZED PERSONAL AUDIO CONTENTS

MELODIOUS WALKABOUT: IMPLICIT NAVIGATION WITH CONTEXTUALIZED PERSONAL AUDIO CONTENTS MELODIOUS WALKABOUT: IMPLICIT NAVIGATION WITH CONTEXTUALIZED PERSONAL AUDIO CONTENTS Richard Etter 1 ) and Marcus Specht 2 ) Abstract In this paper the design, development and evaluation of a GPS-based

More information

Glasgow eprints Service

Glasgow eprints Service Hoggan, E.E and Brewster, S.A. (2006) Crossmodal icons for information display. In, Conference on Human Factors in Computing Systems, 22-27 April 2006, pages pp. 857-862, Montréal, Québec, Canada. http://eprints.gla.ac.uk/3269/

More information

An Investigation on Vibrotactile Emotional Patterns for the Blindfolded People

An Investigation on Vibrotactile Emotional Patterns for the Blindfolded People An Investigation on Vibrotactile Emotional Patterns for the Blindfolded People Hsin-Fu Huang, National Yunlin University of Science and Technology, Taiwan Hao-Cheng Chiang, National Yunlin University of

More information

t t t rt t s s tr t Manuel Martinez 1, Angela Constantinescu 2, Boris Schauerte 1, Daniel Koester 1, and Rainer Stiefelhagen 1,2

t t t rt t s s tr t Manuel Martinez 1, Angela Constantinescu 2, Boris Schauerte 1, Daniel Koester 1, and Rainer Stiefelhagen 1,2 t t t rt t s s Manuel Martinez 1, Angela Constantinescu 2, Boris Schauerte 1, Daniel Koester 1, and Rainer Stiefelhagen 1,2 1 r sr st t t 2 st t t r t r t s t s 3 Pr ÿ t3 tr 2 t 2 t r r t s 2 r t ts ss

More information

Welcome to this course on «Natural Interactive Walking on Virtual Grounds»!

Welcome to this course on «Natural Interactive Walking on Virtual Grounds»! Welcome to this course on «Natural Interactive Walking on Virtual Grounds»! The speaker is Anatole Lécuyer, senior researcher at Inria, Rennes, France; More information about him at : http://people.rennes.inria.fr/anatole.lecuyer/

More information

A Design Study for the Haptic Vest as a Navigation System

A Design Study for the Haptic Vest as a Navigation System Received January 7, 2013; Accepted March 19, 2013 A Design Study for the Haptic Vest as a Navigation System LI Yan 1, OBATA Yuki 2, KUMAGAI Miyuki 3, ISHIKAWA Marina 4, OWAKI Moeki 5, FUKAMI Natsuki 6,

More information

Comparison between audio and tactile systems for delivering simple navigational information to visually impaired pedestrians

Comparison between audio and tactile systems for delivering simple navigational information to visually impaired pedestrians British Journal of Visual Impairment September, 2007 Comparison between audio and tactile systems for delivering simple navigational information to visually impaired pedestrians Dr. Olinkha Gustafson-Pearce,

More information

Kissenger: A Kiss Messenger

Kissenger: A Kiss Messenger Kissenger: A Kiss Messenger Adrian David Cheok adriancheok@gmail.com Jordan Tewell jordan.tewell.1@city.ac.uk Swetha S. Bobba swetha.bobba.1@city.ac.uk ABSTRACT In this paper, we present an interactive

More information

Touch Your Way: Haptic Sight for Visually Impaired People to Walk with Independence

Touch Your Way: Haptic Sight for Visually Impaired People to Walk with Independence Touch Your Way: Haptic Sight for Visually Impaired People to Walk with Independence Ji-Won Song Dept. of Industrial Design. Korea Advanced Institute of Science and Technology. 335 Gwahangno, Yusong-gu,

More information

Supporting Interaction Through Haptic Feedback in Automotive User Interfaces

Supporting Interaction Through Haptic Feedback in Automotive User Interfaces The boundaries between the digital and our everyday physical world are dissolving as we develop more physical ways of interacting with computing. This forum presents some of the topics discussed in the

More information

Comparison of Haptic and Non-Speech Audio Feedback

Comparison of Haptic and Non-Speech Audio Feedback Comparison of Haptic and Non-Speech Audio Feedback Cagatay Goncu 1 and Kim Marriott 1 Monash University, Mebourne, Australia, cagatay.goncu@monash.edu, kim.marriott@monash.edu Abstract. We report a usability

More information

Simultaneous presentation of tactile and auditory motion on the abdomen to realize the experience of being cut by a sword

Simultaneous presentation of tactile and auditory motion on the abdomen to realize the experience of being cut by a sword Simultaneous presentation of tactile and auditory motion on the abdomen to realize the experience of being cut by a sword Sayaka Ooshima 1), Yuki Hashimoto 1), Hideyuki Ando 2), Junji Watanabe 3), and

More information

Haptic presentation of 3D objects in virtual reality for the visually disabled

Haptic presentation of 3D objects in virtual reality for the visually disabled Haptic presentation of 3D objects in virtual reality for the visually disabled M Moranski, A Materka Institute of Electronics, Technical University of Lodz, Wolczanska 211/215, Lodz, POLAND marcin.moranski@p.lodz.pl,

More information

Seminar: Haptic Interaction in Mobile Environments TIEVS63 (4 ECTS)

Seminar: Haptic Interaction in Mobile Environments TIEVS63 (4 ECTS) Seminar: Haptic Interaction in Mobile Environments TIEVS63 (4 ECTS) Jussi Rantala Tampere Unit for Computer-Human Interaction (TAUCHI) School of Information Sciences University of Tampere, Finland Contents

More information

Evaluating Haptic and Auditory Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras

Evaluating Haptic and Auditory Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras Evaluating Haptic and Auditory Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras TACCESS ASSETS 2016 Lee Stearns 1, Ruofei Du 1, Uran Oh 1, Catherine Jou 1, Leah Findlater

More information

Buddy Bearings: A Person-To-Person Navigation System

Buddy Bearings: A Person-To-Person Navigation System Buddy Bearings: A Person-To-Person Navigation System George T Hayes School of Information University of California, Berkeley 102 South Hall Berkeley, CA 94720-4600 ghayes@ischool.berkeley.edu Dhawal Mujumdar

More information

Open Research Online The Open University s repository of research publications and other research outputs

Open Research Online The Open University s repository of research publications and other research outputs Open Research Online The Open University s repository of research publications and other research outputs MusicJacket: the efficacy of real-time vibrotactile feedback for learning to play the violin Conference

More information

Blind navigation with a wearable range camera and vibrotactile helmet

Blind navigation with a wearable range camera and vibrotactile helmet Blind navigation with a wearable range camera and vibrotactile helmet (author s name removed for double-blind review) X university 1@2.com (author s name removed for double-blind review) X university 1@2.com

More information

Heads up interaction: glasgow university multimodal research. Eve Hoggan

Heads up interaction: glasgow university multimodal research. Eve Hoggan Heads up interaction: glasgow university multimodal research Eve Hoggan www.tactons.org multimodal interaction Multimodal Interaction Group Key area of work is Multimodality A more human way to work Not

More information

6th Senses for Everyone! The Value of Multimodal Feedback in Handheld Navigation Aids

6th Senses for Everyone! The Value of Multimodal Feedback in Handheld Navigation Aids 6th Senses for Everyone! The Value of Multimodal Feedback in Handheld Navigation Aids ABSTRACT Martin Pielot, Benjamin Poppinga, Wilko Heuten OFFIS Institute for Information Technology Oldenburg, Germany

More information

Smart Navigation System for Visually Impaired Person

Smart Navigation System for Visually Impaired Person Smart Navigation System for Visually Impaired Person Rupa N. Digole 1, Prof. S. M. Kulkarni 2 ME Student, Department of VLSI & Embedded, MITCOE, Pune, India 1 Assistant Professor, Department of E&TC, MITCOE,

More information

Reach Out and Touch Someone

Reach Out and Touch Someone Reach Out and Touch Someone Understanding how haptic feedback can improve interactions with the world. The word haptic means of or relating to touch. Haptic feedback involves the use of touch to relay

More information

Design and evaluation of Hapticons for enriched Instant Messaging

Design and evaluation of Hapticons for enriched Instant Messaging Design and evaluation of Hapticons for enriched Instant Messaging Loy Rovers and Harm van Essen Designed Intelligence Group, Department of Industrial Design Eindhoven University of Technology, The Netherlands

More information

Guiding Tourists through Haptic Interaction: Vibration Feedback in the Lund Time Machine

Guiding Tourists through Haptic Interaction: Vibration Feedback in the Lund Time Machine Guiding Tourists through Haptic Interaction: Vibration Feedback in the Lund Time Machine Szymczak, Delphine; Magnusson, Charlotte; Rassmus-Gröhn, Kirsten Published in: Lecture Notes in Computer Science

More information

Rethinking Prototyping for Audio Games: On Different Modalities in the Prototyping Process

Rethinking Prototyping for Audio Games: On Different Modalities in the Prototyping Process http://dx.doi.org/10.14236/ewic/hci2017.18 Rethinking Prototyping for Audio Games: On Different Modalities in the Prototyping Process Michael Urbanek and Florian Güldenpfennig Vienna University of Technology

More information

Wearable Haptics. Deepa Mathew

Wearable Haptics. Deepa Mathew Wearable Haptics Deepa Mathew University of Tampere Department of Computer Sciences Interactive Technology Seminar: Wearable Haptics December 2008 i University of Tampere Department of Computer Sciences

More information

Multisensory Virtual Environment for Supporting Blind Persons' Acquisition of Spatial Cognitive Mapping a Case Study

Multisensory Virtual Environment for Supporting Blind Persons' Acquisition of Spatial Cognitive Mapping a Case Study Multisensory Virtual Environment for Supporting Blind Persons' Acquisition of Spatial Cognitive Mapping a Case Study Orly Lahav & David Mioduser Tel Aviv University, School of Education Ramat-Aviv, Tel-Aviv,

More information

Network Institute Tech Labs

Network Institute Tech Labs Network Institute Tech Labs Newsletter Spring 2016 It s that time of the year again. A new Newsletter giving you some juicy details on exciting research going on in the Tech Labs. This year it s been really

More information

Haptic Interface using Sensory Illusion Tomohiro Amemiya

Haptic Interface using Sensory Illusion Tomohiro Amemiya Haptic Interface using Sensory Illusion Tomohiro Amemiya *NTT Communication Science Labs., Japan amemiya@ieee.org NTT Communication Science Laboratories 2/39 Introduction Outline Haptic Interface using

More information

Auto und Umwelt - das Auto als Plattform für Interaktive

Auto und Umwelt - das Auto als Plattform für Interaktive Der Fahrer im Dialog mit Auto und Umwelt - das Auto als Plattform für Interaktive Anwendungen Prof. Dr. Albrecht Schmidt Pervasive Computing University Duisburg-Essen http://www.pervasive.wiwi.uni-due.de/

More information

Multi-Modal User Interaction

Multi-Modal User Interaction Multi-Modal User Interaction Lecture 4: Multiple Modalities Zheng-Hua Tan Department of Electronic Systems Aalborg University, Denmark zt@es.aau.dk MMUI, IV, Zheng-Hua Tan 1 Outline Multimodal interface

More information

An Audio-Haptic Mobile Guide for Non-Visual Navigation and Orientation

An Audio-Haptic Mobile Guide for Non-Visual Navigation and Orientation An Audio-Haptic Mobile Guide for Non-Visual Navigation and Orientation Rassmus-Gröhn, Kirsten; Molina, Miguel; Magnusson, Charlotte; Szymczak, Delphine Published in: Poster Proceedings from 5th International

More information

Vibrotactile Apparent Movement by DC Motors and Voice-coil Tactors

Vibrotactile Apparent Movement by DC Motors and Voice-coil Tactors Vibrotactile Apparent Movement by DC Motors and Voice-coil Tactors Masataka Niwa 1,2, Yasuyuki Yanagida 1, Haruo Noma 1, Kenichi Hosaka 1, and Yuichiro Kume 3,1 1 ATR Media Information Science Laboratories

More information

Exploring Surround Haptics Displays

Exploring Surround Haptics Displays Exploring Surround Haptics Displays Ali Israr Disney Research 4615 Forbes Ave. Suite 420, Pittsburgh, PA 15213 USA israr@disneyresearch.com Ivan Poupyrev Disney Research 4615 Forbes Ave. Suite 420, Pittsburgh,

More information

The Chatty Environment Providing Everyday Independence to the Visually Impaired

The Chatty Environment Providing Everyday Independence to the Visually Impaired The Chatty Environment Providing Everyday Independence to the Visually Impaired Vlad Coroamă and Felix Röthenbacher Distributed Systems Group Institute for Pervasive Computing Swiss Federal Institute of

More information

IAC-15,B2,1,3,x30573 TACTILE SATELLITE NAVIGATION SYSTEM: USING HAPTIC TECHNOLOGY TO ENHANCE THE SENSE OF ORIENTATION AND DIRECTION

IAC-15,B2,1,3,x30573 TACTILE SATELLITE NAVIGATION SYSTEM: USING HAPTIC TECHNOLOGY TO ENHANCE THE SENSE OF ORIENTATION AND DIRECTION IAC-15,B2,1,3,x30573 TACTILE SATELLITE NAVIGATION SYSTEM: USING HAPTIC TECHNOLOGY TO ENHANCE THE SENSE OF ORIENTATION AND DIRECTION Jan Walter Schroeder Sensovo, Germany, walter@sensovo.com Manuel Martin-Salvador

More information

Mobile & ubiquitous haptics

Mobile & ubiquitous haptics Mobile & ubiquitous haptics Roope Raisamo Tampere Unit for Computer-Human Interaction (TAUCHI) School of Information Sciences University of Tampere, Finland Based on material by Jussi Rantala, Jukka Raisamo

More information

Physical Affordances of Check-in Stations for Museum Exhibits

Physical Affordances of Check-in Stations for Museum Exhibits Physical Affordances of Check-in Stations for Museum Exhibits Tilman Dingler tilman.dingler@vis.unistuttgart.de Benjamin Steeb benjamin@jsteeb.de Stefan Schneegass stefan.schneegass@vis.unistuttgart.de

More information

Interactive Exploration of City Maps with Auditory Torches

Interactive Exploration of City Maps with Auditory Torches Interactive Exploration of City Maps with Auditory Torches Wilko Heuten OFFIS Escherweg 2 Oldenburg, Germany Wilko.Heuten@offis.de Niels Henze OFFIS Escherweg 2 Oldenburg, Germany Niels.Henze@offis.de

More information

E90 Project Proposal. 6 December 2006 Paul Azunre Thomas Murray David Wright

E90 Project Proposal. 6 December 2006 Paul Azunre Thomas Murray David Wright E90 Project Proposal 6 December 2006 Paul Azunre Thomas Murray David Wright Table of Contents Abstract 3 Introduction..4 Technical Discussion...4 Tracking Input..4 Haptic Feedack.6 Project Implementation....7

More information

Design and Evaluation of Tactile Number Reading Methods on Smartphones

Design and Evaluation of Tactile Number Reading Methods on Smartphones Design and Evaluation of Tactile Number Reading Methods on Smartphones Fan Zhang fanzhang@zjicm.edu.cn Shaowei Chu chu@zjicm.edu.cn Naye Ji jinaye@zjicm.edu.cn Ruifang Pan ruifangp@zjicm.edu.cn Abstract

More information

Towards a 2D Tactile Vocabulary for Navigation of Blind and Visually Impaired

Towards a 2D Tactile Vocabulary for Navigation of Blind and Visually Impaired Proceedings of the 2009 IEEE International Conference on Systems, Man, and Cybernetics San Antonio, TX, USA - October 2009 Towards a 2D Tactile Vocabulary for Navigation of Blind and Visually Impaired

More information

Collaboration in Multimodal Virtual Environments

Collaboration in Multimodal Virtual Environments Collaboration in Multimodal Virtual Environments Eva-Lotta Sallnäs NADA, Royal Institute of Technology evalotta@nada.kth.se http://www.nada.kth.se/~evalotta/ Research question How is collaboration in a

More information

Human Factors. We take a closer look at the human factors that affect how people interact with computers and software:

Human Factors. We take a closer look at the human factors that affect how people interact with computers and software: Human Factors We take a closer look at the human factors that affect how people interact with computers and software: Physiology physical make-up, capabilities Cognition thinking, reasoning, problem-solving,

More information

Enhanced Collision Perception Using Tactile Feedback

Enhanced Collision Perception Using Tactile Feedback Department of Computer & Information Science Technical Reports (CIS) University of Pennsylvania Year 2003 Enhanced Collision Perception Using Tactile Feedback Aaron Bloomfield Norman I. Badler University

More information

Graphical User Interfaces for Blind Users: An Overview of Haptic Devices

Graphical User Interfaces for Blind Users: An Overview of Haptic Devices Graphical User Interfaces for Blind Users: An Overview of Haptic Devices Hasti Seifi, CPSC554m: Assignment 1 Abstract Graphical user interfaces greatly enhanced usability of computer systems over older

More information

The Mixed Reality Book: A New Multimedia Reading Experience

The Mixed Reality Book: A New Multimedia Reading Experience The Mixed Reality Book: A New Multimedia Reading Experience Raphaël Grasset raphael.grasset@hitlabnz.org Andreas Dünser andreas.duenser@hitlabnz.org Mark Billinghurst mark.billinghurst@hitlabnz.org Hartmut

More information

Waves Nx VIRTUAL REALITY AUDIO

Waves Nx VIRTUAL REALITY AUDIO Waves Nx VIRTUAL REALITY AUDIO WAVES VIRTUAL REALITY AUDIO THE FUTURE OF AUDIO REPRODUCTION AND CREATION Today s entertainment is on a mission to recreate the real world. Just as VR makes us feel like

More information

Human Guidance: Suggesting Walking Pace Under Workload

Human Guidance: Suggesting Walking Pace Under Workload Human Guidance: Suggesting Walking Pace Under Workload Tommaso Lisini Baldi 1,2, Gianluca Paolocci 1,2, and Domenico Prattichizzo 1,2 1 University of Siena, Department of Information Engineering and Mathematics,

More information

Designing Pseudo-Haptic Feedback Mechanisms for Communicating Weight in Decision Making Tasks

Designing Pseudo-Haptic Feedback Mechanisms for Communicating Weight in Decision Making Tasks Appeared in the Proceedings of Shikakeology: Designing Triggers for Behavior Change, AAAI Spring Symposium Series 2013 Technical Report SS-12-06, pp.107-112, Palo Alto, CA., March 2013. Designing Pseudo-Haptic

More information

An Emotional Tactile Interface Completing with Extremely High Temporal Bandwidth

An Emotional Tactile Interface Completing with Extremely High Temporal Bandwidth SICE Annual Conference 2008 August 20-22, 2008, The University Electro-Communications, Japan An Emotional Tactile Interface Completing with Extremely High Temporal Bandwidth Yuki Hashimoto 1 and Hiroyuki

More information

What will the robot do during the final demonstration?

What will the robot do during the final demonstration? SPENCER Questions & Answers What is project SPENCER about? SPENCER is a European Union-funded research project that advances technologies for intelligent robots that operate in human environments. Such

More information

Indoor Positioning 101 TECHNICAL)WHITEPAPER) SenionLab)AB) Teknikringen)7) 583)30)Linköping)Sweden)

Indoor Positioning 101 TECHNICAL)WHITEPAPER) SenionLab)AB) Teknikringen)7) 583)30)Linköping)Sweden) Indoor Positioning 101 TECHNICAL)WHITEPAPER) SenionLab)AB) Teknikringen)7) 583)30)Linköping)Sweden) TechnicalWhitepaper)) Satellite-based GPS positioning systems provide users with the position of their

More information

Investigating Phicon Feedback in Non- Visual Tangible User Interfaces

Investigating Phicon Feedback in Non- Visual Tangible User Interfaces Investigating Phicon Feedback in Non- Visual Tangible User Interfaces David McGookin and Stephen Brewster Glasgow Interactive Systems Group School of Computing Science University of Glasgow Glasgow, G12

More information

Haptic Camera Manipulation: Extending the Camera In Hand Metaphor

Haptic Camera Manipulation: Extending the Camera In Hand Metaphor Haptic Camera Manipulation: Extending the Camera In Hand Metaphor Joan De Boeck, Karin Coninx Expertise Center for Digital Media Limburgs Universitair Centrum Wetenschapspark 2, B-3590 Diepenbeek, Belgium

More information

2011 TUI FINAL Back/Posture Device

2011 TUI FINAL Back/Posture Device 2011 TUI FINAL Back/Posture Device Walter Koning Berkeley, CA 94708 USA wk@ischool.berkeley.edu Alex Kantchelian Berkeley, CA 94708 USA akantchelian@ischool.berkeley.edu Erich Hacker Berkeley, CA 94708

More information

Magnusson, Charlotte; Rassmus-Gröhn, Kirsten; Szymczak, Delphine

Magnusson, Charlotte; Rassmus-Gröhn, Kirsten; Szymczak, Delphine Show me the direction how accurate does it have to be? Magnusson, Charlotte; Rassmus-Gröhn, Kirsten; Szymczak, Delphine Published: 2010-01-01 Link to publication Citation for published version (APA): Magnusson,

More information

Arbitrating Multimodal Outputs: Using Ambient Displays as Interruptions

Arbitrating Multimodal Outputs: Using Ambient Displays as Interruptions Arbitrating Multimodal Outputs: Using Ambient Displays as Interruptions Ernesto Arroyo MIT Media Laboratory 20 Ames Street E15-313 Cambridge, MA 02139 USA earroyo@media.mit.edu Ted Selker MIT Media Laboratory

More information

Integrated Driving Aware System in the Real-World: Sensing, Computing and Feedback

Integrated Driving Aware System in the Real-World: Sensing, Computing and Feedback Integrated Driving Aware System in the Real-World: Sensing, Computing and Feedback Jung Wook Park HCI Institute Carnegie Mellon University 5000 Forbes Avenue Pittsburgh, PA, USA, 15213 jungwoop@andrew.cmu.edu

More information

ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS

ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS BY SERAFIN BENTO MASTER OF SCIENCE in INFORMATION SYSTEMS Edmonton, Alberta September, 2015 ABSTRACT The popularity of software agents demands for more comprehensive HAI design processes. The outcome of

More information

The UCD community has made this article openly available. Please share how this access benefits you. Your story matters!

The UCD community has made this article openly available. Please share how this access benefits you. Your story matters! Provided by the author(s) and University College Dublin Library in accordance with publisher policies., Please cite the published version when available. Title Visualization in sporting contexts : the

More information

Multisensory virtual environment for supporting blind persons acquisition of spatial cognitive mapping, orientation, and mobility skills

Multisensory virtual environment for supporting blind persons acquisition of spatial cognitive mapping, orientation, and mobility skills Multisensory virtual environment for supporting blind persons acquisition of spatial cognitive mapping, orientation, and mobility skills O Lahav and D Mioduser School of Education, Tel Aviv University,

More information

Interactions and Applications for See- Through interfaces: Industrial application examples

Interactions and Applications for See- Through interfaces: Industrial application examples Interactions and Applications for See- Through interfaces: Industrial application examples Markus Wallmyr Maximatecc Fyrisborgsgatan 4 754 50 Uppsala, SWEDEN Markus.wallmyr@maximatecc.com Abstract Could

More information

Augmented Home. Integrating a Virtual World Game in a Physical Environment. Serge Offermans and Jun Hu

Augmented Home. Integrating a Virtual World Game in a Physical Environment. Serge Offermans and Jun Hu Augmented Home Integrating a Virtual World Game in a Physical Environment Serge Offermans and Jun Hu Eindhoven University of Technology Department of Industrial Design The Netherlands {s.a.m.offermans,j.hu}@tue.nl

More information

preface Motivation Figure 1. Reality-virtuality continuum (Milgram & Kishino, 1994) Mixed.Reality Augmented. Virtuality Real...

preface Motivation Figure 1. Reality-virtuality continuum (Milgram & Kishino, 1994) Mixed.Reality Augmented. Virtuality Real... v preface Motivation Augmented reality (AR) research aims to develop technologies that allow the real-time fusion of computer-generated digital content with the real world. Unlike virtual reality (VR)

More information

PERFORMANCE IN A HAPTIC ENVIRONMENT ABSTRACT

PERFORMANCE IN A HAPTIC ENVIRONMENT ABSTRACT PERFORMANCE IN A HAPTIC ENVIRONMENT Michael V. Doran,William Owen, and Brian Holbert University of South Alabama School of Computer and Information Sciences Mobile, Alabama 36688 (334) 460-6390 doran@cis.usouthal.edu,

More information

RV - AULA 05 - PSI3502/2018. User Experience, Human Computer Interaction and UI

RV - AULA 05 - PSI3502/2018. User Experience, Human Computer Interaction and UI RV - AULA 05 - PSI3502/2018 User Experience, Human Computer Interaction and UI Outline Discuss some general principles of UI (user interface) design followed by an overview of typical interaction tasks

More information

Subject Name:Human Machine Interaction Unit No:1 Unit Name: Introduction. Mrs. Aditi Chhabria Mrs. Snehal Gaikwad Dr. Vaibhav Narawade Mr.

Subject Name:Human Machine Interaction Unit No:1 Unit Name: Introduction. Mrs. Aditi Chhabria Mrs. Snehal Gaikwad Dr. Vaibhav Narawade Mr. Subject Name:Human Machine Interaction Unit No:1 Unit Name: Introduction Mrs. Aditi Chhabria Mrs. Snehal Gaikwad Dr. Vaibhav Narawade Mr. B J Gorad Unit No: 1 Unit Name: Introduction Lecture No: 1 Introduction

More information

HELPING THE DESIGN OF MIXED SYSTEMS

HELPING THE DESIGN OF MIXED SYSTEMS HELPING THE DESIGN OF MIXED SYSTEMS Céline Coutrix Grenoble Informatics Laboratory (LIG) University of Grenoble 1, France Abstract Several interaction paradigms are considered in pervasive computing environments.

More information

Co-experience, exercise and entertainment in the backseat

Co-experience, exercise and entertainment in the backseat Co-experience, exercise and entertainment in the backseat ABSTRACT This paper describes our design process when designing our game concept for a car in Interactive Prototyping course at the University

More information

Interface Design V: Beyond the Desktop

Interface Design V: Beyond the Desktop Interface Design V: Beyond the Desktop Rob Procter Further Reading Dix et al., chapter 4, p. 153-161 and chapter 15. Norman, The Invisible Computer, MIT Press, 1998, chapters 4 and 15. 11/25/01 CS4: HCI

More information

Multi-Modality Fidelity in a Fixed-Base- Fully Interactive Driving Simulator

Multi-Modality Fidelity in a Fixed-Base- Fully Interactive Driving Simulator Multi-Modality Fidelity in a Fixed-Base- Fully Interactive Driving Simulator Daniel M. Dulaski 1 and David A. Noyce 2 1. University of Massachusetts Amherst 219 Marston Hall Amherst, Massachusetts 01003

More information

Beyond Visual: Shape, Haptics and Actuation in 3D UI

Beyond Visual: Shape, Haptics and Actuation in 3D UI Beyond Visual: Shape, Haptics and Actuation in 3D UI Ivan Poupyrev Welcome, Introduction, & Roadmap 3D UIs 101 3D UIs 201 User Studies and 3D UIs Guidelines for Developing 3D UIs Video Games: 3D UIs for

More information

Context-Aware Interaction in a Mobile Environment

Context-Aware Interaction in a Mobile Environment Context-Aware Interaction in a Mobile Environment Daniela Fogli 1, Fabio Pittarello 2, Augusto Celentano 2, and Piero Mussio 1 1 Università degli Studi di Brescia, Dipartimento di Elettronica per l'automazione

More information

ASSISTIVE TECHNOLOGY BASED NAVIGATION AID FOR THE VISUALLY IMPAIRED

ASSISTIVE TECHNOLOGY BASED NAVIGATION AID FOR THE VISUALLY IMPAIRED Proceedings of the 7th WSEAS International Conference on Robotics, Control & Manufacturing Technology, Hangzhou, China, April 15-17, 2007 239 ASSISTIVE TECHNOLOGY BASED NAVIGATION AID FOR THE VISUALLY

More information

Apple s 3D Touch Technology and its Impact on User Experience

Apple s 3D Touch Technology and its Impact on User Experience Apple s 3D Touch Technology and its Impact on User Experience Nicolas Suarez-Canton Trueba March 18, 2017 Contents 1 Introduction 3 2 Project Objectives 4 3 Experiment Design 4 3.1 Assessment of 3D-Touch

More information

Interactive Multimedia Contents in the IllusionHole

Interactive Multimedia Contents in the IllusionHole Interactive Multimedia Contents in the IllusionHole Tokuo Yamaguchi, Kazuhiro Asai, Yoshifumi Kitamura, and Fumio Kishino Graduate School of Information Science and Technology, Osaka University, 2-1 Yamada-oka,

More information

Haplug: A Haptic Plug for Dynamic VR Interactions

Haplug: A Haptic Plug for Dynamic VR Interactions Haplug: A Haptic Plug for Dynamic VR Interactions Nobuhisa Hanamitsu *, Ali Israr Disney Research, USA nobuhisa.hanamitsu@disneyresearch.com Abstract. We demonstrate applications of a new actuator, the

More information

1 of 5 01/04/

1 of 5 01/04/ 1 of 5 01/04/2004 2.02 &KXFN\SXWWLQJLWDOOWRJHWKHU :KRV&KXFN\WKHQ" is our test robot. He grown and evolved over the years as we ve hacked him around to test new modules. is ever changing, and this is a

More information

Touching and Walking: Issues in Haptic Interface

Touching and Walking: Issues in Haptic Interface Touching and Walking: Issues in Haptic Interface Hiroo Iwata 1 1 Institute of Engineering Mechanics and Systems, University of Tsukuba, 80, Tsukuba, 305-8573 Japan iwata@kz.tsukuba.ac.jp Abstract. This

More information

Non-Visual Navigation Using Combined Audio Music and Haptic Cues

Non-Visual Navigation Using Combined Audio Music and Haptic Cues Non-Visual Navigation Using Combined Audio Music and Haptic Cues Emily Fujimoto University of California, Santa Barbara efujimoto@cs.ucsb.edu Matthew Turk University of California, Santa Barbara mturk@cs.ucsb.edu

More information

AN AUTONOMOUS SIMULATION BASED SYSTEM FOR ROBOTIC SERVICES IN PARTIALLY KNOWN ENVIRONMENTS

AN AUTONOMOUS SIMULATION BASED SYSTEM FOR ROBOTIC SERVICES IN PARTIALLY KNOWN ENVIRONMENTS AN AUTONOMOUS SIMULATION BASED SYSTEM FOR ROBOTIC SERVICES IN PARTIALLY KNOWN ENVIRONMENTS Eva Cipi, PhD in Computer Engineering University of Vlora, Albania Abstract This paper is focused on presenting

More information

Tactile Feedback to Aid Blind Users of Mobile Guides

Tactile Feedback to Aid Blind Users of Mobile Guides Tactile Feedback to Aid Blind Users of Mobile Guides Giuseppe Ghiani, Barbara leporini, Fabio Paternò CNR-ISTI Via Moruzzi 1 56124, Pisa, Italy {giuseppe.ghiani, barbara.leporini, fabio.paterno}@isti.cnr.it

More information

Haptics for Guide Dog Handlers

Haptics for Guide Dog Handlers Haptics for Guide Dog Handlers Bum Jun Park, Jay Zuerndorfer, Melody M. Jackson Animal Computer Interaction Lab, Georgia Institute of Technology bpark31@gatech.edu, jzpluspuls@gmail.com, melody@cc.gatech.edu

More information

Dynamic Knobs: Shape Change as a Means of Interaction on a Mobile Phone

Dynamic Knobs: Shape Change as a Means of Interaction on a Mobile Phone Dynamic Knobs: Shape Change as a Means of Interaction on a Mobile Phone Fabian Hemmert Deutsche Telekom Laboratories Ernst-Reuter-Platz 7 10587 Berlin, Germany mail@fabianhemmert.de Gesche Joost Deutsche

More information

Sweep-Shake: Finding Digital Resources in Physical Environments

Sweep-Shake: Finding Digital Resources in Physical Environments Sweep-Shake: Finding Digital Resources in Physical Environments Simon Robinson, Parisa Eslambolchilar, Matt Jones Future Interaction Technology Lab Computer Science Department Swansea University Swansea,

More information

Welcome, Introduction, and Roadmap Joseph J. LaViola Jr.

Welcome, Introduction, and Roadmap Joseph J. LaViola Jr. Welcome, Introduction, and Roadmap Joseph J. LaViola Jr. Welcome, Introduction, & Roadmap 3D UIs 101 3D UIs 201 User Studies and 3D UIs Guidelines for Developing 3D UIs Video Games: 3D UIs for the Masses

More information

Interactive Simulation: UCF EIN5255. VR Software. Audio Output. Page 4-1

Interactive Simulation: UCF EIN5255. VR Software. Audio Output. Page 4-1 VR Software Class 4 Dr. Nabil Rami http://www.simulationfirst.com/ein5255/ Audio Output Can be divided into two elements: Audio Generation Audio Presentation Page 4-1 Audio Generation A variety of audio

More information

Physical Presence in Virtual Worlds using PhysX

Physical Presence in Virtual Worlds using PhysX Physical Presence in Virtual Worlds using PhysX One of the biggest problems with interactive applications is how to suck the user into the experience, suspending their sense of disbelief so that they are

More information

Tele-Nursing System with Realistic Sensations using Virtual Locomotion Interface

Tele-Nursing System with Realistic Sensations using Virtual Locomotion Interface 6th ERCIM Workshop "User Interfaces for All" Tele-Nursing System with Realistic Sensations using Virtual Locomotion Interface Tsutomu MIYASATO ATR Media Integration & Communications 2-2-2 Hikaridai, Seika-cho,

More information

HAPTIC USER INTERFACES Final lecture

HAPTIC USER INTERFACES Final lecture HAPTIC USER INTERFACES Final lecture Roope Raisamo School of Information Sciences University of Tampere, Finland Content A little more about crossmodal interaction The next steps in the course 1 2 CROSSMODAL

More information