Do You Feel What I Hear?
|
|
- Marion Wilkerson
- 5 years ago
- Views:
Transcription
1 1 Do You Feel What I Hear? Patrick Roth 1, Hesham Kamel 2, Lori Petrucci 1, Thierry Pun 1 1 Computer Science Department CUI, University of Geneva CH Geneva 4, Switzerland Patrick.Roth@cui.unige.ch 2 The Group for User Interface Research EECS, UC Berkeley Berkeley, Ca , USA
2 2 Abstract In this research we implemented three different methods for presenting scientific graphs to blind and visually impaired people. Each rendering method employed either audition, kinesthetic or a combination of those two modalities. In order to allow for distance learning, we have used low cost portable devices for the output graph rendering. The three modes of representation were then compared by three separate groups of blind and visually impaired computer users. Each group consisted of four participants. Results reveal that the combination of both audio and kinesthetic modalities can be a promising representation medium of common scientific graphs for visually challenged people. KEYWORDS Blind, non-visual and non-tactile graph representation, audio and kinesthetic rendering.
3 3 Introduction The representation of scientific graphs is among the teaching concepts that are difficult to electronically transform onto computers for blind and visually impaired people. Most often tactile channel (e.g., hard copies produced via Braille printers) seems to be privileged by specialists to convey such type of graphical information. However, this method in its nature does not provide an adequate solution when presenting graphical information via distance learning. Hard copies are static in nature (i.e., they cannot be modified) and tactile devices are expensive as well as hard to carry (Kamel & Landay, 2000). Over the past several years, triggered by the advent of virtual reality devices, various investigations have been made by researchers regarding the presentation of non-visual scientific data using either audio or kinesthetic modality (Flowers & Hauer, 1995; Fritz & Barner, 1999; Mansur, Blattner, and Joy, 1985; Ramloll, Yu, Brewster, Riedel, Burton, and Dimigen, 2000; Sahyun & Gardner, 1997). However, very little work has been undertaken in comparing these two non-visual rendering techniques. In addition, most often researchers conduct experiments using high cost devices (e.g., the PHANToM Haptic interface). These devices present a problem to most ordinary blind users since they cannot afford them. Addressing the problems mentioned above, we have designed three methods of non-visual graph representation, making use of two different modalities. In the first rendering method, we used auditory feedback (non-speech sounds). In the second method, we utilized a kinesthetic interaction through the use of a Haptic mouse. As for the third rendering method, we combined the first and the second modalities. In order to fit with the distance-learning concept and to address the mobility issues, we rendered the graphical output by using low cost mobile devices (i.e., a force feedback mouse).
4 4 Audio and Kinesthetic Representation The three methods that we developed to represent scientific graphs provide two different categories of graphical information. The first category conveys information regarding the overall shape of the graph, whereas the second category provides extra information regarding several aspects of the graph: its maximum and minimum values; all the point(s) where the graph crosses either the horizontal or the vertical axis; using the kinesthetic rendering, the user recognizes a starting or an ending position when the Force Feedback (FF) device is pointing at either one of them. Audio Encoding For the audio rendering of the entire graph, we have implemented a traditional approach. We presented the graph by a single tone where its pitch represented the Y coordinate and the duration represented the X coordinate (Flowers & Hauer, 1995; Mansur, Blattner, and Joy, 1985; Sahyun, 1999). In addition, to improve the rendering, we immerged the tone into a 2D sound plane in which the stereo effect allowed to represent the X coordinate and the elevation effect the Y coordinate (Roth, Petrucci, Assimacopoulos, and Pun, 2000). This plane is vertically oriented and virtually located in front of the blind listener. For instance, if the rendered graph is a linear curve (i.e., y=a*x+b, where a and b are constants and a is superior to zero), the user hears a tone ascending obliquely from the bottom left to the top right (see Figure 1). When the shape to be rendered is ascending, the tone increases in frequency.
5 5 Figure 1. 2D sound plane rendering. For the rendering of the extra information of the graph, each output is characterized by a different non-speech sound. These tones differ so they can be easily recognized if they are played at the same time (Brewster, 1995). Also, the tones are short so that the blind users can quickly interpret them. Kinesthetic Encoding The haptic rendering of the graph is based on a virtual fixture (Rosenberg, 1993). In this method, the blind user by holding the mouse trails the edge of the graph following its path. Concretely, we determine a point on the graph (P min ), and the distance between this point and the cursor position (c) forms the minimum distance (d) (see Figure 1.a). If the distance is below a given threshold, we activate the force (F) that attracts the mouse towards the graph (see Figure 1.b). Therefore, when the mouse moves away from the graph, it is automatically attracted back to it.
6 6 Distance threshold curve x max x max x max x min P min c d x min P min F p c a x min P min c fixture region Figure 2.a. Distance setting. Figure 2.b. Attraction force. Figure 2.c. Audio rendering. All the extra information of the graph is produced by vibrations. These vibrations are generated by a periodical effect that repetitively moves back and forth in a very short distance and with a relatively high frequency. We can thus differentiate between different vibrations by either varying their frequency, their direction, or both. Audio-Kinesthetic Encoding This encoding method combines the audio and the kinesthetic modalities. In this method, the information of the entire graph is rendered by the virtual fixture (explained section Kinesthetic Encoding ). As for the extra information, we have replaced the vibration effects by non-speech sounds. In addition, we encoded the slope of the graph by two different tones (i.e., one tone for each ascending or descending slopes). This tone also varies in frequency proportionally to the slope itself (see Figure 3). Figure 3. Auditory coding of the slope.
7 7 During the development of the virtual fixture, we have noted several problems that concerned the push back force limitation. This limitation, due to the nature the haptic device, does not allow blind users to follow the path of the graph without deviating. To solve this problem, we developed a feature that we called auditory fixture. In this feature, we use sound as an alarm to inform the user that he or she leaves the graph. In this case, when the blind user moves the mouse (cursor) away from the curve fixture region an auditory signal is automatically played (see Figure 2.c). Hardware Configuration The evaluation of the system was made on a Pentium PII computer. The audio rendering was obtained by using the DirectSound3D 1 library on a SoundBlaster Live 2 sound card, and a Sennheiser HD580 3 headphone. We choose to work with a SoundBlaster Live and a Sennheiser II because they provide together an effective 2D sound rendering. As for the kinesthetic interaction, we worked with the Logitech WingMan Force Feedback 4 mouse. This mouse is much more affordable than the PHANToM 5 device. To obtain a more detailed comparison between the two force feedback systems, please refer to the report written by Sjöström (1999) and (Roth, Giess, Petrucci and Pun, in press). System Evaluation We have conducted a series of experiments in order to study the efficiency of each of the three methods mentioned above. The three methods of representation were experiment by three groups (G1, G2 and G3) each consisted of four participants aged between years old. We assigned one method to each of the three groups; in each group, two of the participants were congenitally 1 library included on windows 98 or recent systems. 2 available on regular computer stores or at for about $ available on music stores or at for about $ available on regular computer stores or at for about $50. 5 available at for about $13500.
8 8 blind and the two others were visually impaired. G1 participated in recognizing scientific graphs via the auditory encoding method (see section Audio Encoding ). G2 examined the graphs using the kinesthetic encoding (see section Kinesthetic Encoding ). Finally, G3 obtained the scientific graphs using the audio-kinesthetic encoding (see section Audio-Kinesthetic Encoding ). During the experiment, the visually impaired participants were not blindfolded, however they did not have access to the computer screen. All of the participants had received some type of mathematical education background (viz., knowledge of scientific graphs.). We gave each of the participants the same amount of time (20 minutes) to get familiarized with the method they were testing. During this time, we briefly explained the method of representation they were going to experiment and we let them use the program on a simple graph (i.e., y = abs(x), 0 x 4). Tasks and Scenarios Each of the participants was given three different scientific graphs one at a time for evaluation: a linear function: y = 1-x, -2 x 2 (see Figure 4.a); a parabolic curve: y = x 2, -2 x 2 (see Figure 4.b); a periodical sine wave: y = sin(x), -4 x 4 (see Figure 4.c); Figure 4.a. y=1-x Figure 4.b. y=x 2 Figure 4.c. y=sin(x) For each graph, after interacting with it for a period that did not exceeds five minutes, each of the participants was asked to reproduce it. The blind participants reproduced it using a tactile medium, where the visually impaired used a pencil and a sheet of paper. The success of reproduction was based on two complementary criteria (C1, C2). The first criterion C1 is
9 9 subjective and relative to the level of general similarity between the real graph and the one that as been reproduced by the participant. As for the second criterion C2, we evaluated more specific similarities of the two graphs such as curvatures or symmetries. In addition, we asked all participants while drawing to place the horizontal and vertical axis. Our goal was to check the efficiency of the extra information rendered by the encoding method that was being tested. In this task, the criterion of success was based on the precision in which the participant placed the horizontal axis (criterion C3) respectively the vertical axis (criterion C4) on the graph. After completing each task, we asked all participants several questions regarding the characteristic of the graph rendered (e.g., the periodicity, minimum and maximum values, location, and continuity). Finally, after conducting the experiment, we then asked each of the three groups to evaluate the system they had tested. Results and Discussion For the graph that represented the linear function, the results shown in Figure 5 reveal that the group G1 using the audio encoding had the most difficulties in reproducing the linear function (25% of success for C1 and C2). As it is shown in Figure 6.a, the majority of G1 participants represented the linear function as a parabola. y=1-x Percentage of Success 120% 100% 80% 60% 40% 20% 0% C1 C2 C3 C4 Criteria G1 G2 G3 Figure 5. For the linear function, percentage of participants of groups G1-G3 that correctly performed the criteria C1-C4.
10 10 All the participants of G1 agreed that the auditory rendering did not have sufficient information concerning the linearity. However, this problem did not occur to the groups G2 (75% of success for C1 and C2) and G3 (100% of success for C1-C4) which used the kinesthetic sense as principal modality. Figure 6.a. Linear function reproduced by participant from G3. Figure 6.b. Linear function reproduced by participant from G1. As Figure 7 shows, no participant in any of the three groups had any difficulty to recognize then reproduce the parabolic graph (100% of success for C1). However, we noted some imprecision y=x 2 120% Percentage of Success 100% 80% 60% 40% 20% 0% C1 C2 C3 C4 G1 G2 G3 Criteria Figure 7. For the parabolic function, percentage of participants of groups G1-G3 that correctly performed the criteria C1-C4.
11 11 for the three groups and more for the group G3 (50% of success) in reproducing the exact symmetry of the parabolic (see Figure 8.a). The participants of G2 were not able to recreate their mental perception of the horizontal axis (0% of success for C3) (see Figure 8.b). We believe the reason is that at the origin there were two different vibrations (the first was for the x axis and the second was for the y axis). This group expressed that they could not distinguish between them. One possible solution to this problem would be to replace these vibrations occurring at the same time by their consecutive output. However, such approach may require the participants to spend more time to recognize the graphs. Figure 8.a. Parabolic function reproduced by participant from G3. Figure 8.b. Parabolic function reproduced by participant from G2. As shown in Figure 9, G1, G2 and G3 were capable to reproduce a recognizable overview of the y=sin(x) Percentage of Success 120% 100% 80% 60% 40% 20% 0% C1 C2 C3 C4 G1 G2 G3 Criteria Figure 9. For the periodical function, percentage of participants of groups G1-G3 that correctly performed the criteria C1-C4.
12 12 periodical graph (75% of success for C1). They however had difficulties in precisely reproducing the two curvatures at -π/2 and π/2 (see Figure 10.a,b,c). The audio rendering was not sufficient enough to precisely encode such kind of information for G1 (25% of success for C2). Concerning G2 and G3 participants (0% of success for C2), the principal drawback is due to the fact that the workspace of the force feedback device was small. Another problem is that the nature of this device required hand grasping, as opposed to finger grasping, which did not allow for high precision feedback (Cutkosky, 1990; Sjöström, 1999). Figure 10.a. Periodical graph reproduced by participant from G1. Figure 10.b. Periodical graph reproduced by participant from G2. Figure 10.c. Periodical graph reproduced by participant from G3. Therefore, we concluded that by replacing hand grasping (see Figure 11.a) with finger grasping and by increasing the size of the workspace as well as the force of feedback, the recognition would be facilitated. To this effect, we designed a modified device allowing finger grasping (see Figure 11.b). We are currently investigating the use of this modified device.
13 13 Figure 11.a. Force feedback device used for the experiment. Figure 11.b. Modified device. Most of the participants felt that the three systems would be of a great assistance for providing access to scientific graphs via computer systems. The participants who are used to Braille preferred interacting with the tactile medium over the kinesthetic rendering, but it should be noted that not all blind people are Braille readers. Conclusion In this paper we have presented the design of three methods of non-visual graph representation as well as their user s evaluations. Our results show that in general the participants were capable to reproduce an overview of three scientific graphs they were testing. In some case however they had difficulties in reproducing curvatures and symmetries. In our point of view, by taking into account all the possible modifications (i.e., finger grasping, workspace and size increased), the combination of the kinesthetic and audio renderings seems to be the most promising method. As an extension to this work, we plan the development of a framework on the Web where blind users will be able to access scientific graphs on-line. This work will be done in order to promote the possibility of using such technique of representation in the domain of distance education.
14 14 Acknowledgments This project is partly financed by the Association pour le Bien des Aveugles, Geneva, Switzerland. The authors are grateful to the Eingliederungsstelle für Sehbehinderte institution, Basel, Switzerland, and particularly to Denis Rossel, Denis Page and, Alain Barrillier for their help in the design and evaluation of the prototype. References Brewster, S.A., Wright, P.C. & Edwards, A.D.N. (1995). Parallel earcons: Reducing the length of audio messages. International Journal of Human-Computer Studies, 43(2), Cutkosky, M.R., Howe, R.D. (1990). Human Grasp Choice and Robotic Grasp Analysis. In Dextrous Robot Hands, S.T. Venkataraman and T. Iberall, (Ed.), Springer-Verlag, New York, Flowers, J. H., and Hauer, T. A. (1995). Musical versus visual graphs: Cross-modal equivalence in perception of time series data. Human Factors, 37, Fritz, J. P., Barner, K. E. (1999). Design of a Haptic Visualization System for People with Visual Impairments. IEEE Transactions on rehabilitation engineering, vol 7, No 3, Kamel, H., Landay, J. (2000). A Study of Blind Drawing Practice: Creating Graphical Information Without the Visual Channel. The Fourth International Conference on Assistive Technologies, 2000, ACM Press, Arlington, VA Mansur, D.L., Blattner, M.M., and Joy, K.I. (1985). Sound graphs: a numerical data analysis method for the blind. Journal of Medical Systems, 9(3), Ramloll, R., Yu, W., Brewster, S.A., Riedel, B., Burton, A.M. and Dimigen, G. (2000). Constructing Sonified Haptic Line Graphs for the Blind Student: First Steps. The Fourth International Conference on Assistive Technologies, 2000, ACM Press, Arlington, VA Rosenberg, L. B. (1993). Virtual fixtures: perceptual tools for telerobotic manipulation. IEEE Virtual Reality Annual International Symposium, 1993, Seattle, WA
15 15 Roth, P., Petrucci, L., Assimacopoulos, A., Pun, T. (2000). From Dots to Shapes : an auditory haptic game platform for teaching geometry to blind pupils. Computer Helping People with Special Needs, 2000, Austrian Computer Society, Karlsruhe, Germany Roth, P., Giess, C., Petrucci, L., Pun, T. (in press). Adapting Haptic Game Devices for non-visual Graph Rendering. First International Conference on Universal Access in Human-Computer Interaction, 2001, New Orleans, LA. S. C. Sahyun, Gardner, J. A. (1997). Testing the Equivalence of Visual and Auditory Graphs. International Conference on Auditory Display, 1997, Palo Alto, CA. Available WWW: Sjöström, C. (1999). The IT Potential of Haptics touch access for people with disabilities. licentiate thesis. Center for Rehabilitation Engineering Research. Available WWW:
Article. Reference. A comparison of three nonvisual methods for presenting scientific graphs. ROTH, Patrick, et al.
Article A comparison of three nonvisual methods for presenting scientific graphs ROTH, Patrick, et al. Abstract This study implemented three different methods for presenting scientific graphs to visually
More information"From Dots To Shapes": an auditory haptic game platform for teaching geometry to blind pupils. Patrick Roth, Lori Petrucci, Thierry Pun
"From Dots To Shapes": an auditory haptic game platform for teaching geometry to blind pupils Patrick Roth, Lori Petrucci, Thierry Pun Computer Science Department CUI, University of Geneva CH - 1211 Geneva
More informationComparing Two Haptic Interfaces for Multimodal Graph Rendering
Comparing Two Haptic Interfaces for Multimodal Graph Rendering Wai Yu, Stephen Brewster Glasgow Interactive Systems Group, Department of Computing Science, University of Glasgow, U. K. {rayu, stephen}@dcs.gla.ac.uk,
More informationHaptic presentation of 3D objects in virtual reality for the visually disabled
Haptic presentation of 3D objects in virtual reality for the visually disabled M Moranski, A Materka Institute of Electronics, Technical University of Lodz, Wolczanska 211/215, Lodz, POLAND marcin.moranski@p.lodz.pl,
More informationAutomatic Online Haptic Graph Construction
Automatic Online Haptic Graph Construction Wai Yu, Kenneth Cheung, Stephen Brewster Glasgow Interactive Systems Group, Department of Computing Science University of Glasgow, Glasgow, UK {rayu, stephen}@dcs.gla.ac.uk
More informationComparison of Haptic and Non-Speech Audio Feedback
Comparison of Haptic and Non-Speech Audio Feedback Cagatay Goncu 1 and Kim Marriott 1 Monash University, Mebourne, Australia, cagatay.goncu@monash.edu, kim.marriott@monash.edu Abstract. We report a usability
More informationInteractive Exploration of City Maps with Auditory Torches
Interactive Exploration of City Maps with Auditory Torches Wilko Heuten OFFIS Escherweg 2 Oldenburg, Germany Wilko.Heuten@offis.de Niels Henze OFFIS Escherweg 2 Oldenburg, Germany Niels.Henze@offis.de
More informationAbstract. 2. Related Work. 1. Introduction Icon Design
The Hapticon Editor: A Tool in Support of Haptic Communication Research Mario J. Enriquez and Karon E. MacLean Department of Computer Science University of British Columbia enriquez@cs.ubc.ca, maclean@cs.ubc.ca
More informationYu, W. and Brewster, S.A. (2003) Evaluation of multimodal graphs for blind people. Universal Access in the Information Society 2(2):pp
Yu, W. and Brewster, S.A. (2003) Evaluation of multimodal graphs for blind people. Universal Access in the Information Society 2(2):pp. 105-124. http://eprints.gla.ac.uk/3273/ Glasgow eprints Service http://eprints.gla.ac.uk
More informationGlasgow eprints Service
Yu, W. and Kangas, K. (2003) Web-based haptic applications for blind people to create virtual graphs. In, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 22-23 March
More informationGraphical User Interfaces for Blind Users: An Overview of Haptic Devices
Graphical User Interfaces for Blind Users: An Overview of Haptic Devices Hasti Seifi, CPSC554m: Assignment 1 Abstract Graphical user interfaces greatly enhanced usability of computer systems over older
More informationSONIFICATIONS FOR DIGITAL AUDIO WORKSTATIONS: REFLECTIONS ON A PARTICIPATORY DESIGN APPROACH
SONIFICATIONS FOR DIGITAL AUDIO WORKSTATIONS: REFLECTIONS ON A PARTICIPATORY DESIGN APPROACH Oussama Metatla, Nick Bryan-Kinns, Tony Stockman, Fiore Martin School of Electronic Engineering & Computer Science
More informationMultisensory Virtual Environment for Supporting Blind Persons' Acquisition of Spatial Cognitive Mapping a Case Study
Multisensory Virtual Environment for Supporting Blind Persons' Acquisition of Spatial Cognitive Mapping a Case Study Orly Lahav & David Mioduser Tel Aviv University, School of Education Ramat-Aviv, Tel-Aviv,
More informationIDENTIFYING AND COMMUNICATING 2D SHAPES USING AUDITORY FEEDBACK. Javier Sanchez
IDENTIFYING AND COMMUNICATING 2D SHAPES USING AUDITORY FEEDBACK Javier Sanchez Center for Computer Research in Music and Acoustics (CCRMA) Stanford University The Knoll, 660 Lomita Dr. Stanford, CA 94305,
More informationConstructing Sonified Haptic Line Graphs for the Blind Student: First Steps
Constructing Sonified Haptic Line Graphs for the Blind Student: First Steps Rameshsharma Ramloll, Wai Yu, Stephen Brewster Department of Computing Science University of Glasgow G12 8QQ Tel: 0141-3398855
More informationMultisensory virtual environment for supporting blind persons acquisition of spatial cognitive mapping, orientation, and mobility skills
Multisensory virtual environment for supporting blind persons acquisition of spatial cognitive mapping, orientation, and mobility skills O Lahav and D Mioduser School of Education, Tel Aviv University,
More informationEvaluation of Visuo-haptic Feedback in a 3D Touch Panel Interface
Evaluation of Visuo-haptic Feedback in a 3D Touch Panel Interface Xu Zhao Saitama University 255 Shimo-Okubo, Sakura-ku, Saitama City, Japan sheldonzhaox@is.ics.saitamau.ac.jp Takehiro Niikura The University
More informationDesign and evaluation of Hapticons for enriched Instant Messaging
Design and evaluation of Hapticons for enriched Instant Messaging Loy Rovers and Harm van Essen Designed Intelligence Group, Department of Industrial Design Eindhoven University of Technology, The Netherlands
More informationChapter 2 Introduction to Haptics 2.1 Definition of Haptics
Chapter 2 Introduction to Haptics 2.1 Definition of Haptics The word haptic originates from the Greek verb hapto to touch and therefore refers to the ability to touch and manipulate objects. The haptic
More informationGlasgow eprints Service
Hoggan, E.E and Brewster, S.A. (2006) Crossmodal icons for information display. In, Conference on Human Factors in Computing Systems, 22-27 April 2006, pages pp. 857-862, Montréal, Québec, Canada. http://eprints.gla.ac.uk/3269/
More informationEvaluating the Effectiveness of Auditory and Tactile Surface Graphs for the Visually Impaired
Evaluating the Effectiveness of Auditory and Tactile Surface Graphs for the Visually Impaired James A. Ferwerda; Rochester Institute of Technology; Rochester, NY USA Vladimir Bulatov, John Gardner; ViewPlus
More informationExploring Geometric Shapes with Touch
Exploring Geometric Shapes with Touch Thomas Pietrzak, Andrew Crossan, Stephen Brewster, Benoît Martin, Isabelle Pecci To cite this version: Thomas Pietrzak, Andrew Crossan, Stephen Brewster, Benoît Martin,
More informationLCC 3710 Principles of Interaction Design. Readings. Sound in Interfaces. Speech Interfaces. Speech Applications. Motivation for Speech Interfaces
LCC 3710 Principles of Interaction Design Class agenda: - Readings - Speech, Sonification, Music Readings Hermann, T., Hunt, A. (2005). "An Introduction to Interactive Sonification" in IEEE Multimedia,
More informationBlindstation : a Game Platform Adapted to Visually Impaired Children
Blindstation : a Game Platform Adapted to Visually Impaired Children Sébastien Sablé and Dominique Archambault INSERM U483 / INOVA - Université Pierre et Marie Curie 9, quai Saint Bernard, 75,252 Paris
More informationDrumtastic: Haptic Guidance for Polyrhythmic Drumming Practice
Drumtastic: Haptic Guidance for Polyrhythmic Drumming Practice ABSTRACT W e present Drumtastic, an application where the user interacts with two Novint Falcon haptic devices to play virtual drums. The
More informationMaking Microsoft Excel Accessible: Multimodal Presentation of Charts
Making Microsoft Excel Accessible: Multimodal Presentation of Charts Iyad Abu Doush*, Enrico Pontelli*, Dominic Simon**, Son Tran Cao*, Ou Ma*** *Department of Computer Science, **Department of Psychology,
More informationt t t rt t s s tr t Manuel Martinez 1, Angela Constantinescu 2, Boris Schauerte 1, Daniel Koester 1, and Rainer Stiefelhagen 1,2
t t t rt t s s Manuel Martinez 1, Angela Constantinescu 2, Boris Schauerte 1, Daniel Koester 1, and Rainer Stiefelhagen 1,2 1 r sr st t t 2 st t t r t r t s t s 3 Pr ÿ t3 tr 2 t 2 t r r t s 2 r t ts ss
More informationSOPA version 2. Revised July SOPA project. September 21, Introduction 2. 2 Basic concept 3. 3 Capturing spatial audio 4
SOPA version 2 Revised July 7 2014 SOPA project September 21, 2014 Contents 1 Introduction 2 2 Basic concept 3 3 Capturing spatial audio 4 4 Sphere around your head 5 5 Reproduction 7 5.1 Binaural reproduction......................
More informationSalient features make a search easy
Chapter General discussion This thesis examined various aspects of haptic search. It consisted of three parts. In the first part, the saliency of movability and compliance were investigated. In the second
More informationHaptic Camera Manipulation: Extending the Camera In Hand Metaphor
Haptic Camera Manipulation: Extending the Camera In Hand Metaphor Joan De Boeck, Karin Coninx Expertise Center for Digital Media Limburgs Universitair Centrum Wetenschapspark 2, B-3590 Diepenbeek, Belgium
More informationSeminar: Haptic Interaction in Mobile Environments TIEVS63 (4 ECTS)
Seminar: Haptic Interaction in Mobile Environments TIEVS63 (4 ECTS) Jussi Rantala Tampere Unit for Computer-Human Interaction (TAUCHI) School of Information Sciences University of Tampere, Finland Contents
More informationDesign and Evaluation of Tactile Number Reading Methods on Smartphones
Design and Evaluation of Tactile Number Reading Methods on Smartphones Fan Zhang fanzhang@zjicm.edu.cn Shaowei Chu chu@zjicm.edu.cn Naye Ji jinaye@zjicm.edu.cn Ruifang Pan ruifangp@zjicm.edu.cn Abstract
More informationEnhancing 3D Audio Using Blind Bandwidth Extension
Enhancing 3D Audio Using Blind Bandwidth Extension (PREPRINT) Tim Habigt, Marko Ðurković, Martin Rothbucher, and Klaus Diepold Institute for Data Processing, Technische Universität München, 829 München,
More informationShanthi D L, Harini V Reddy
National Conference on Communication and Image Processing (NCCIP- 2017) 3 rd National Conference by TJIT, Bangalore A Survey: Impact of Haptic Technology Shanthi D L, Harini V Reddy International Journal
More informationTokorozawa, Saitama, Japan
Universal Design Tactile Graphics Production System BPLOT4 for Blind Teachers and Blind Staffs to Produce Tactile Graphics and Ink Print Graphics of High Quality Mamoru Fujiyoshi 1, Akio Fujiyoshi 2(B),
More informationE90 Project Proposal. 6 December 2006 Paul Azunre Thomas Murray David Wright
E90 Project Proposal 6 December 2006 Paul Azunre Thomas Murray David Wright Table of Contents Abstract 3 Introduction..4 Technical Discussion...4 Tracking Input..4 Haptic Feedack.6 Project Implementation....7
More informationBenefits of using haptic devices in textile architecture
28 September 2 October 2009, Universidad Politecnica de Valencia, Spain Alberto DOMINGO and Carlos LAZARO (eds.) Benefits of using haptic devices in textile architecture Javier SANCHEZ *, Joan SAVALL a
More informationHaplug: A Haptic Plug for Dynamic VR Interactions
Haplug: A Haptic Plug for Dynamic VR Interactions Nobuhisa Hanamitsu *, Ali Israr Disney Research, USA nobuhisa.hanamitsu@disneyresearch.com Abstract. We demonstrate applications of a new actuator, the
More informationDescriptive Geometry Courses for Students of Architecture On the Selection of Topics
Journal for Geometry and Graphics Volume 4 (2000), No. 2, 209 222. Descriptive Geometry Courses for Students of Architecture On the Selection of Topics Claus Pütz Institute for Geometry and Applied Mathematics
More informationR (2) Controlling System Application with hands by identifying movements through Camera
R (2) N (5) Oral (3) Total (10) Dated Sign Assignment Group: C Problem Definition: Controlling System Application with hands by identifying movements through Camera Prerequisite: 1. Web Cam Connectivity
More informationGEOMETRIC SHAPE DETECTION WITH SOUNDVIEW. Department of Computer Science 1 Department of Psychology 2 University of British Columbia Vancouver, Canada
GEOMETRIC SHAPE DETECTION WITH SOUNDVIEW K. van den Doel 1, D. Smilek 2, A. Bodnar 1, C. Chita 1, R. Corbett 1, D. Nekrasovski 1, J. McGrenere 1 Department of Computer Science 1 Department of Psychology
More informationDevelopment of a Finger Mounted Type Haptic Device Using a Plane Approximated to Tangent Plane
Journal of Communication and Computer 13 (2016) 329-337 doi:10.17265/1548-7709/2016.07.002 D DAVID PUBLISHING Development of a Finger Mounted Type Haptic Device Using a Plane Approximated to Tangent Plane
More informationthese systems has increased, regardless of the environmental conditions of the systems.
Some Student November 30, 2010 CS 5317 USING A TACTILE GLOVE FOR MAINTENANCE TASKS IN HAZARDOUS OR REMOTE SITUATIONS 1. INTRODUCTION As our dependence on automated systems has increased, demand for maintenance
More informationUsing Haptic Cues to Aid Nonvisual Structure Recognition
Using Haptic Cues to Aid Nonvisual Structure Recognition CAROLINE JAY, ROBERT STEVENS, ROGER HUBBOLD, and MASHHUDA GLENCROSS University of Manchester Retrieving information presented visually is difficult
More informationFrom Encoding Sound to Encoding Touch
From Encoding Sound to Encoding Touch Toktam Mahmoodi King s College London, UK http://www.ctr.kcl.ac.uk/toktam/index.htm ETSI STQ Workshop, May 2017 Immersing a person into the real environment with Very
More informationVirtual Tactile Maps
In: H.-J. Bullinger, J. Ziegler, (Eds.). Human-Computer Interaction: Ergonomics and User Interfaces. Proc. HCI International 99 (the 8 th International Conference on Human-Computer Interaction), Munich,
More informationThe Impact of Haptic Touching Technology on Cultural Applications
The Impact of Haptic Touching Technology on Cultural Applications Stephen Brewster Glasgow Interactive Systems Group Department of Computing Science University of Glasgow, Glasgow, G12 8QQ, UK Tel: +44
More informationLearning to Detect Doorbell Buttons and Broken Ones on Portable Device by Haptic Exploration In An Unsupervised Way and Real-time.
Learning to Detect Doorbell Buttons and Broken Ones on Portable Device by Haptic Exploration In An Unsupervised Way and Real-time Liping Wu April 21, 2011 Abstract The paper proposes a framework so that
More informationPERFORMANCE IN A HAPTIC ENVIRONMENT ABSTRACT
PERFORMANCE IN A HAPTIC ENVIRONMENT Michael V. Doran,William Owen, and Brian Holbert University of South Alabama School of Computer and Information Sciences Mobile, Alabama 36688 (334) 460-6390 doran@cis.usouthal.edu,
More informationConceptual Metaphors for Explaining Search Engines
Conceptual Metaphors for Explaining Search Engines David G. Hendry and Efthimis N. Efthimiadis Information School University of Washington, Seattle, WA 98195 {dhendry, efthimis}@u.washington.edu ABSTRACT
More informationWeb-Based Touch Display for Accessible Science Education
Web-Based Touch Display for Accessible Science Education Evan F. Wies*, John A. Gardner**, M. Sile O Modhrain*, Christopher J. Hasser*, Vladimir L. Bulatov** *Immersion Corporation 801 Fox Lane San Jose,
More informationDiscrimination of Virtual Haptic Textures Rendered with Different Update Rates
Discrimination of Virtual Haptic Textures Rendered with Different Update Rates Seungmoon Choi and Hong Z. Tan Haptic Interface Research Laboratory Purdue University 465 Northwestern Avenue West Lafayette,
More informationPractical Data Visualization and Virtual Reality. Virtual Reality VR Display Systems. Karljohan Lundin Palmerius
Practical Data Visualization and Virtual Reality Virtual Reality VR Display Systems Karljohan Lundin Palmerius Synopsis Virtual Reality basics Common display systems Visual modality Sound modality Interaction
More informationInvestigating Phicon Feedback in Non- Visual Tangible User Interfaces
Investigating Phicon Feedback in Non- Visual Tangible User Interfaces David McGookin and Stephen Brewster Glasgow Interactive Systems Group School of Computing Science University of Glasgow Glasgow, G12
More informationFundamentals of Digital Audio *
Digital Media The material in this handout is excerpted from Digital Media Curriculum Primer a work written by Dr. Yue-Ling Wong (ylwong@wfu.edu), Department of Computer Science and Department of Art,
More informationHuman Factors. We take a closer look at the human factors that affect how people interact with computers and software:
Human Factors We take a closer look at the human factors that affect how people interact with computers and software: Physiology physical make-up, capabilities Cognition thinking, reasoning, problem-solving,
More information¾ B-TECH (IT) ¾ B-TECH (IT)
HAPTIC TECHNOLOGY V.R.Siddhartha Engineering College Vijayawada. Presented by Sudheer Kumar.S CH.Sreekanth ¾ B-TECH (IT) ¾ B-TECH (IT) Email:samudralasudheer@yahoo.com Email:shri_136@yahoo.co.in Introduction
More informationVirtual prototyping based development and marketing of future consumer electronics products
31 Virtual prototyping based development and marketing of future consumer electronics products P. J. Pulli, M. L. Salmela, J. K. Similii* VIT Electronics, P.O. Box 1100, 90571 Oulu, Finland, tel. +358
More informationCreating Usable Pin Array Tactons for Non- Visual Information
IEEE TRANSACTIONS ON HAPTICS, MANUSCRIPT ID 1 Creating Usable Pin Array Tactons for Non- Visual Information Thomas Pietrzak, Andrew Crossan, Stephen A. Brewster, Benoît Martin and Isabelle Pecci Abstract
More informationMicrosoft Scrolling Strip Prototype: Technical Description
Microsoft Scrolling Strip Prototype: Technical Description Primary features implemented in prototype Ken Hinckley 7/24/00 We have done at least some preliminary usability testing on all of the features
More informationHUMAN COMPUTER INTERFACE
HUMAN COMPUTER INTERFACE TARUNIM SHARMA Department of Computer Science Maharaja Surajmal Institute C-4, Janakpuri, New Delhi, India ABSTRACT-- The intention of this paper is to provide an overview on the
More informationSound rendering in Interactive Multimodal Systems. Federico Avanzini
Sound rendering in Interactive Multimodal Systems Federico Avanzini Background Outline Ecological Acoustics Multimodal perception Auditory visual rendering of egocentric distance Binaural sound Auditory
More informationDevelopment of Synchronized CUI and GUI for Universal Design Tactile Graphics Production System BPLOT3
Development of Synchronized CUI and GUI for Universal Design Tactile Graphics Production System BPLOT3 Mamoru Fujiyoshi 1, Akio Fujiyoshi 2,AkikoOsawa 1, Yusuke Kuroda 3, and Yuta Sasaki 3 1 National Center
More informationMethods for Haptic Feedback in Teleoperated Robotic Surgery
Young Group 5 1 Methods for Haptic Feedback in Teleoperated Robotic Surgery Paper Review Jessie Young Group 5: Haptic Interface for Surgical Manipulator System March 12, 2012 Paper Selection: A. M. Okamura.
More information2 Oscilloscope Familiarization
Lab 2 Oscilloscope Familiarization What You Need To Know: Voltages and currents in an electronic circuit as in a CD player, mobile phone or TV set vary in time. Throughout the course you will investigate
More informationUsing haptic cues to aid nonvisual structure recognition
Loughborough University Institutional Repository Using haptic cues to aid nonvisual structure recognition This item was submitted to Loughborough University's Institutional Repository by the/an author.
More informationVisual Interpretation of Hand Gestures as a Practical Interface Modality
Visual Interpretation of Hand Gestures as a Practical Interface Modality Frederik C. M. Kjeldsen Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Graduate
More informationAudio makes a difference in haptic collaborative virtual environments
Audio makes a difference in haptic collaborative virtual environments JONAS MOLL, YING YING HUANG, EVA-LOTTA SALLNÄS HCI Dept., School of Computer Science and Communication, Royal Institute of Technology,
More informationPublished in: HAVE IEEE International Workshop on Haptic Audio Visual Environments and their Applications
AHEAD - Audio-haptic drawing editor and explorer for education Rassmus-Gröhn, Kirsten; Magnusson, Charlotte; Eftring, Håkan Published in: HAVE 2007 - IEEE International Workshop on Haptic Audio Visual
More informationHere I present more details about the methods of the experiments which are. described in the main text, and describe two additional examinations which
Supplementary Note Here I present more details about the methods of the experiments which are described in the main text, and describe two additional examinations which assessed DF s proprioceptive performance
More informationRoll Scanning - MIDI files from piano rolls
Roll Scanning - MIDI files from piano rolls Main Website Rollscanning Home Piano_roll MIDI files Rollscanning Background Keyword Data Converting Piano Rolls to MIDI files My Software S H Introduction My
More informationModaDJ. Development and evaluation of a multimodal user interface. Institute of Computer Science University of Bern
ModaDJ Development and evaluation of a multimodal user interface Course Master of Computer Science Professor: Denis Lalanne Renato Corti1 Alina Petrescu2 1 Institute of Computer Science University of Bern
More informationUsing low cost devices to support non-visual interaction with diagrams & cross-modal collaboration
22 ISSN 2043-0167 Using low cost devices to support non-visual interaction with diagrams & cross-modal collaboration Oussama Metatla, Fiore Martin, Nick Bryan-Kinns and Tony Stockman EECSRR-12-03 June
More informationSpringerBriefs in Computer Science
SpringerBriefs in Computer Science Series Editors Stan Zdonik Shashi Shekhar Jonathan Katz Xindong Wu Lakhmi C. Jain David Padua Xuemin (Sherman) Shen Borko Furht V.S. Subrahmanian Martial Hebert Katsushi
More informationAdvancements in Gesture Recognition Technology
IOSR Journal of VLSI and Signal Processing (IOSR-JVSP) Volume 4, Issue 4, Ver. I (Jul-Aug. 2014), PP 01-07 e-issn: 2319 4200, p-issn No. : 2319 4197 Advancements in Gesture Recognition Technology 1 Poluka
More informationEvaluating Haptic and Auditory Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras
Evaluating Haptic and Auditory Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras TACCESS ASSETS 2016 Lee Stearns 1, Ruofei Du 1, Uran Oh 1, Catherine Jou 1, Leah Findlater
More informationThe Effect of Frequency Shifting on Audio-Tactile Conversion for Enriching Musical Experience
The Effect of Frequency Shifting on Audio-Tactile Conversion for Enriching Musical Experience Ryuta Okazaki 1,2, Hidenori Kuribayashi 3, Hiroyuki Kajimioto 1,4 1 The University of Electro-Communications,
More informationBefore How does the painting compare to the original figure? What do you expect will be true of the painted figure if it is painted to scale?
Dilations LAUNCH (7 MIN) Before How does the painting compare to the original figure? What do you expect will be true of the painted figure if it is painted to scale? During What is the relationship between
More informationSpatialization and Timbre for Effective Auditory Graphing
18 Proceedings o1't11e 8th WSEAS Int. Conf. on Acoustics & Music: Theory & Applications, Vancouver, Canada. June 19-21, 2007 Spatialization and Timbre for Effective Auditory Graphing HONG JUN SONG and
More informationFeeding human senses through Immersion
Virtual Reality Feeding human senses through Immersion 1. How many human senses? 2. Overview of key human senses 3. Sensory stimulation through Immersion 4. Conclusion Th3.1 1. How many human senses? [TRV
More informationDevelopment of A Finger Mounted Type Haptic Device Using A Plane Approximated to Tangent Plane
Development of A Finger Mounted Type Haptic Device Using A Plane Approximated to Tangent Plane Makoto Yoda Department of Information System Science Graduate School of Engineering Soka University, Soka
More informationThe ENABLED Editor and Viewer simple tools for more accessible on line 3D models. Magnusson, Charlotte; Gutierrez, Teresa; Rassmus-Gröhn, Kirsten
The ENABLED Editor and Viewer simple tools for more accessible on line 3D models Magnusson, Charlotte; Gutierrez, Teresa; Rassmus-Gröhn, Kirsten Published in: 5th international conference on Enactive Interfaces
More informationIED Detailed Outline. Unit 1 Design Process Time Days: 16 days. An engineering design process involves a characteristic set of practices and steps.
IED Detailed Outline Unit 1 Design Process Time Days: 16 days Understandings An engineering design process involves a characteristic set of practices and steps. Research derived from a variety of sources
More informationTECHNICAL DRAWING & DESIGN
MINISTRY OF EDUCATION FIJI SCHOOL LEAVING CERTIFICATE EXAMINATION 2011 TECHNICAL DRAWING & DESIGN COPYRIGHT: MINISTRY OF EDUCATION, REPUBLIC OF THE FIJI ISLANDS 2. MINISTRY OF EDUCATION FIJI SCHOOL LEAVING
More informationPerception of room size and the ability of self localization in a virtual environment. Loudspeaker experiment
Perception of room size and the ability of self localization in a virtual environment. Loudspeaker experiment Marko Horvat University of Zagreb Faculty of Electrical Engineering and Computing, Zagreb,
More informationTest of pan and zoom tools in visual and non-visual audio haptic environments. Magnusson, Charlotte; Gutierrez, Teresa; Rassmus-Gröhn, Kirsten
Test of pan and zoom tools in visual and non-visual audio haptic environments Magnusson, Charlotte; Gutierrez, Teresa; Rassmus-Gröhn, Kirsten Published in: ENACTIVE 07 2007 Link to publication Citation
More informationSONIFICATION OF SPATIAL DATA
SONIFICATION OF SPATIAL DATA Tooba Nasir Computing Laboratory University of Kent Canterbury, UK. tn37@kent.ac.uk Jonathan C. Roberts Computing Laboratory University of Kent Canterbury, UK. j.c.roberts@kent.ac.uk
More informationClutching at Straws: Using Tangible Interaction to Provide Non-Visual Access to Graphs
Clutching at Straws: Using Tangible Interaction to Provide Non-Visual Access to Graphs David McGookin, Euan Robertson, Stephen Brewster Department of Computing Science University of Glasgow Glasgow G12
More informationC A R I B B E A N E X A M I N A T I O N S C O U N C I L REPORT ON CANDIDATES WORK IN THE SECONDARY EDUCATION CERTIFICATE EXAMINATION MAY/JUNE 2010
C A R I B B E A N E X A M I N A T I O N S C O U N C I L REPORT ON CANDIDATES WORK IN THE SECONDARY EDUCATION CERTIFICATE EXAMINATION MAY/JUNE 2010 TECHNICAL DRAWING GENERAL PROFICIENCY Copyright 2010 Caribbean
More informationMECHANICAL DESIGN LEARNING ENVIRONMENTS BASED ON VIRTUAL REALITY TECHNOLOGIES
INTERNATIONAL CONFERENCE ON ENGINEERING AND PRODUCT DESIGN EDUCATION 4 & 5 SEPTEMBER 2008, UNIVERSITAT POLITECNICA DE CATALUNYA, BARCELONA, SPAIN MECHANICAL DESIGN LEARNING ENVIRONMENTS BASED ON VIRTUAL
More informationThe Mixed Reality Book: A New Multimedia Reading Experience
The Mixed Reality Book: A New Multimedia Reading Experience Raphaël Grasset raphael.grasset@hitlabnz.org Andreas Dünser andreas.duenser@hitlabnz.org Mark Billinghurst mark.billinghurst@hitlabnz.org Hartmut
More informationHaptic Rendering CPSC / Sonny Chan University of Calgary
Haptic Rendering CPSC 599.86 / 601.86 Sonny Chan University of Calgary Today s Outline Announcements Human haptic perception Anatomy of a visual-haptic simulation Virtual wall and potential field rendering
More informationForce feedback interfaces & applications
Force feedback interfaces & applications Roope Raisamo Tampere Unit for Computer-Human Interaction (TAUCHI) School of Information Sciences University of Tampere, Finland Based on material by Jukka Raisamo,
More informationBlur Estimation for Barcode Recognition in Out-of-Focus Images
Blur Estimation for Barcode Recognition in Out-of-Focus Images Duy Khuong Nguyen, The Duy Bui, and Thanh Ha Le Human Machine Interaction Laboratory University Engineering and Technology Vietnam National
More informationMELODIOUS WALKABOUT: IMPLICIT NAVIGATION WITH CONTEXTUALIZED PERSONAL AUDIO CONTENTS
MELODIOUS WALKABOUT: IMPLICIT NAVIGATION WITH CONTEXTUALIZED PERSONAL AUDIO CONTENTS Richard Etter 1 ) and Marcus Specht 2 ) Abstract In this paper the design, development and evaluation of a GPS-based
More informationThe 21 st Century Wireless Classroom Network for AP Calculus
The 21 st Century Wireless Classroom Network for AP Calculus In this exploratory hands-on workshop, we will be solving Calculus problems with the HP Prime Graphing Calculator and the HP Wireless Classroom
More informationThe Development of a Universal Design Tactile Graphics Production System BPLOT2
The Development of a Universal Design Tactile Graphics Production System BPLOT2 Mamoru Fujiyoshi 1, Akio Fujiyoshi 2, Nobuyuki Ohtake 3, Katsuhito Yamaguchi 4 and Yoshinori Teshima 5 1 Research Division,
More informationISO INTERNATIONAL STANDARD. Ergonomics of human-system interaction Part 910: Framework for tactile and haptic interaction
INTERNATIONAL STANDARD ISO 9241-910 First edition 2011-07-15 Ergonomics of human-system interaction Part 910: Framework for tactile and haptic interaction Ergonomie de l'interaction homme-système Partie
More informationWaves Nx VIRTUAL REALITY AUDIO
Waves Nx VIRTUAL REALITY AUDIO WAVES VIRTUAL REALITY AUDIO THE FUTURE OF AUDIO REPRODUCTION AND CREATION Today s entertainment is on a mission to recreate the real world. Just as VR makes us feel like
More informationGlasgow eprints Service
Brown, L.M. and Brewster, S.A. and Purchase, H.C. (2005) A first investigation into the effectiveness of Tactons. In, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment
More information