Pre-Journey Learning System for Visually-Impaired Pedestrians using Mobile AR Tactile Maps and Crowdsourced POR Aggregation

Transcription

1 Pre-Journey Learning System for Visually-Impaired Pedestrians using Mobile AR Tactile Maps and Crowdsourced POR Aggregation Takeshi Kurata and Ryosuke Ichikari Service Sensing, Assimilation, and Modeling (SEAM) Research Group Human Informatics Research Institute, AIST

2 Paper Tactile Maps Paper tactile maps are regarded as a very useful tool for visually-impaired people in learning walking routes in advance. Road [solid line] Buildings [polygons] Established route [dotted line] Starting point [Solid triangle] Finish point [Solid circle]

3 Paper Tactile Maps However, the amount of contents that can be printed in a tactile map is limited due to the tactile spatial resolution. In addition, such contents are basically static. Tactile Map Tactile Map Tactile Trajectory (for Feedback) Tactile Trajectory (for Feedback)

4 Mobile AR Tactile Maps and Crowdsourced POR Aggregation To alleviate the issue, we have been developing a pre-journey learning system using mobile AR tactile maps and crowdsourced POR (Point of Reference) sharing.

5 POR POR is defined as a specific point location the existence of which is easily recognized for confirming routes for visually-impaired pedestrians. POI vs. POR? POI: Point Of Interest Facilities (i.e. restraint) and geographical point (i.e. park) POR: Point Of Reference (EO Guidage CSUN2014 [3]) Points easy to sense the existence, for confirming routes (Steps, Stairs, Sloop, Door, Sound/Noise, Scent/Odor )

6 6 EO Guidage [3] GUIDINO by Medeo Group [4] BLE on roof Hybrid BLE and Wi-Fi positioning For visually impaired persons Navigation with POR

7 System Overview POR Sharing with cloud servers POR aggregation by families, local volunteers, guide assistances, and visually-impaired Pedestrians

8 Tactile Maps by UV Offset Printing Pro: Universal map with color and tactile presentation Con: Higher cost and Longer making process compared with PIAF (heat sensitive capsule paper) PIAF UV offset printing Heat sensitive capsule paper

9 Tactile Maps by UV Offset Printing Tsukuba (AIST) Shizuoka (Univ. of Shizuoka) Kobe (Kobe Univ.) Niigata (Niigata Univ.) Color Maps

10 Tactile Maps by UV Offset Printing Tsukuba (AIST) Shizuoka (Univ. of Shizuoka) Kobe (Kobe Univ.) Niigata (Niigata Univ.) Tactile maps generated by the Tactile Map Automated Creation System (Tmacs) [7]

11 Smartphone-based mobile AR app The app is implemented with Metaio SDK Pro, and it can identify with which tactile map the user is checking the route, estimate which position in the map the back facing camera of the smartphone is shooting, and provide audio [2] and visual augmentation of the tactile map with POR contents for low vision and blind users.

12 Future Works Fingertip detection for more intuitive UI with tactile maps Crowdsourced POR (Point of Reference) sharing for both of pre-journey learning and talking navigation [1][5][6] POR Sharing Pre-Journey Learning Talking Navigation POR Aggregation

13 References [1] K. Okuno, T. Kurata, Y. Seki, M. Kourogi, J. Ishikawa, Smartphone-based Talking Navigation System for Walking Training, 30th Annual International Technology and Persons with Disabilities Conference (CSUN), IND-026, [2] O'Sullivan, L., Picinali, L., Feakes, C. and Cawthorne, D., Audio Tactile Maps (ATM) System for the Exploration of Digital Heritage Buildings by Visually-impaired Individuals - First Prototype and Preliminary Evaluation, Forum Acousticum, [3] S. Denoncin, AX'S: A New Indoor GPS Solution Designed for All, 29th Annual International Technology and Persons with Disabilities Conference (CSUN), BLV-034, [4] T. Theberge, GUIDINO : Powerful Indoor and Outdoor GPS Solution for Low Vision and Blind, 30th Annual International Technology and Persons with Disabilities Conference (CSUN), TRN-003, [5] T. Kurata, M. Kourogi, T. Ishikawa, Y. Kameda, K. Aoki, and J. Ishikawa: ""Indoor-Outdoor Navigation System for Visually-Impaired Pedestrians: Preliminary Evaluation of Position Measurement and Obstacle Display", ISWC2011, pp , [6] T. Kurata, Y. Seki, M. Kourogi and J. Ishikawa, Roles of Navigation System in Walking with Long Cane and Guide Dog, The 29th Annual International Technology and Persons with Disabilities Conference (CSUN), BLV-040, [7] T. Watanabe, T. Yamaguchi, S. Koda, K. Minatani, Tactile Map Automated Creation System Using OpenStreetMap. ICCHP, Lecture Notes in Computer Science Volume 8548, pp 42-49, 2014.