Orientation and Mobility, O&M ! - 應用智慧型手機輔助視障導航之研究(2/2)

2.1.2 Orientation and Mobility, O&M

Jacobson 1993

-2004

Griffin-Shirley Trusty Richard 2000

2001

turns and compass directions

90 180 linear concepts

Hill Jacobson 1. landmarks and clues

2. shoreline : 3.

9. numbering system 10.

11. self-familiarzation process

a. b. c.

Hanlu, 2014 APP

Navi'Rando 2015

9 Navi'Rando

2.2

2.2.1

2016

“

” :

(1)

(2)

(3)

2.2.1

-2015 1.4

2012

2000

2012

2.3

2.3.1

braille Shiri 2011 GoBraille 12 GPS

Shinohara, 2011

12 GoBraille

Dot InCorporation

2015 Dot Dot Braille Smartwatch

13 2016

13 Dot

Wilko 2008 14 PDA GPS

2.3.2

HumanWare Trekker Breeze+

GPS 15

15 Trekker Breeze+

Microsoft

Cities Unlocked

GPS Microsoft Bing Maps

MiBeacons beacons 3D

clip-clops indicator

Gaunet 2005

5-10 Nicolau 2009

1 2

3 Side

4 / reference point

“ ”

2.3.3

GPS Blasch, 1995 GPS

Ahmetovic 2015 17

RFID NFC GPS

Michitaka 2003 RFID

RFID 18 RFID NFC

18 RFID

2.3.4 iBeacon

Apple iBeacon BLE

UUID iOS iBeacon

RSSI(Received Signal Strength Indication) 0

BlindSquare GPS FourSquare Open Street

Maps

BlindSquare 2015 iBeacon

U-R Able 18

Beacons iOS7

19 BlindSquare

IBM NavCog ibeacon

Beacons APP

20 NavCog 21 iBeacon iBeacon

BlindNavi APP 22

22 BlindNavi APP

2.5

iBeacon

!! Usability

3

!! GuidePin

!! APP GuidePin Beacon

!! Beacon Wizard of OZ

3.1

iPhone

iOS VoiceOver

“ iPhone ”

iOS 8.0 Swift APP

Punch Through

Arduino -LightBlue Bean Honeywell

HMC5883L LightBlue Bean 8 I/O

Bosch Sensortec BMA250 LightBlue Bean BLE Bluetooth Low

Energy, Arduino

Bean Loader Bean Loader LightBlue Bean Processing

25 Beacon

Apple iBeacon API APP

3.2 GuidePin

3.2.1

heading MCU

MCU

wiki Hall

Effect [ ] iOS

“ ” APP X

8 26

GuidePin HMC5883L I2C

gauss HMC118X

Honeywell

1°~2° 12

8 Honeywell

Processing

1 XYZ

2 - + / 2

3 x x_gain 1

4 Y y_gain = x_gain * Y_MAX-y_min / x_max-x_min 5 z z_gain = x_gain * z_max-z_min / x_max-x_min

x_gain XYZ 1

27 HMC5883L

1 2 3

3.2.2

G sensor

GuidePin

-BMA250 30 (3) X Y

arcTan(Y/X)

(1) (2) Pitch Roll Pitch(Φ)

x Roll(θ) y 29

28 MCU

28 29

GuidePin

Kalman Filter

optimal recursive data processing algorithm

!! Linear Stochastic Difference equation

!! White Gaussian Noise

!! Gaussian Distribution

1. k A

B U(k) k

X(k|k-1)=A X(k-1|k-1)+B U(k) ……….. (1)

2. X(k|k-1) covariance

P(k|k-1) X(k|k-1) P(k-1|k-1) X(k-1|k-1) A’ A

P(k|k-1)=A P(k-1|k-1) A’+Q ……… (2)

3. Kg(Kalman Gain) H R

Kg(k)= P(k|k-1) H’ / (H P(k|k-1) H’ + R) ……… (3)

4. (k) X(k|k) Z(k) k

5. k X(k|k)

P(k|k)= I-Kg(k) H P(k|k-1) ……… (5) covariance

R=1e-5

Q = 1e-7

Arduino

32 GuidePin iOS

sandbox iPhone

33 GuidePin

iPhone GuidePin iPhone

iPhone 1.5 GuidePin

GuidePin sample rate

32 iPhone 33 iPhine GuidePin

3.2.3

GuidePin

LightBlue Bean 34

34 GuidePin

3.3 APP

3.3.1 APP

iPhone GuidePin Beacon

APP 35 APP

GuidePin Beacon

GuidePin

35 APP

3.3.2

6 Beacon “id”

”degree”

navi_info

”passing”

“degree” Beacon

”passing” ”degree”

6 Beacon _

id 01 Beacon

degree 60 0~359

navi_info

“

”

Beacon

passing

“

” “

”

3.3

3.3.1

iPhone Wizard of Oz

36 7

No.

B1 19-24

B2 25-30

B3 19-24

B4 19-24

B5 19-24

3.3.2

Wizard of Oz

!! “ ”

think aloud

Beacon Beacon

Beacon 37 Beacon

“ ” 8

37 Beacon

38 Beacon

39-1 39-3

39-1 “ ”

39-2

39-3

/ /

Bee

40-1 “ ”

40-2

3.3.3

B4 “ / “ ” / “

B1 B2 B3 B4 B5

“ ”

3.4

GuidePin-2 APP 3

GuidePin APP

Beacon Contextual Inquiry Wizard of OZ

10 _ /

“

”

41-1

41-2 “

”

4

GuidePin “ ” GuidePin

4.1

4.1.1

“

” / “ /

” “ ”

!! GuidePin

“ ” “ ”

“ ”

4.1.2

42 24.8

9 APP

FM 11

15 20 20

GuidPin GuidPin

Beacon 3

Beacon

4.1.3

12 C5

12 No.

C1 19-24

C2 19-24

C3 25-30

C4 19-24

C5 31-36

4.1.4 a.

”Bee”

“ ” “ ”

TTS(Text-to-Speech)

“Bee”

“Bee” TTS

b.

4 “ ”

-1. 2. 3. 4.

“

”

“

”

( ) “

”

“

”

-4. 5.

“

”

“ / ”

“ ”

c.

GuidePin 43

43 GuidePin

GuidePin

iOS MediaPlayer.framework MPRemoteCommandEvent remotePlay remotePause

Sony 15

Beacon 16

16 GuidePin

44 Beacon

d.

1 45

3D 46 46-1

46-2 46-3 46-3 GuidePin

46-2

GuidePin APP

45 GuidePin 46 46-2

4.2

4.2.1

Beacon Beacon

47 48

!! GuidePin

Kalman 0.5 /

4.2.2

17 1) 2)

50 3 *2 4)

24.8

51 8.6 52 APP

iPhone

15 10 15 20

GuidePin Beacon

FM 49

FM FM

SAMSUNG Galaxy Note 2 FM

APP iPhone 6 3.5mm

15 “ / ”

“ ”

4.2.3

iPhone D2 D3 D4

18 No.

D1 23

D2 23

D3 22

D4 22

D5 28

D6 21

D7 22

4.2.4 a.

Beacon “

”

b.

iPhone

c.

“ ”

d.

T-shirt

4.3

GuidePin GuidPin

D6 “

” D7 “

”

D4 “

” 54

5

5.1

GuidePin

iBeacon APP

GuidePin Beacon APP

1.!

“

...” Beacon

“ / ” “ / ” “ ”

“ ” “

”

2.!

“ / ”

5.2

5.2.1

Hard

Iron Soft Iron

iBeacon

“ ”

55 Apple

5.2.2

Beacon 56

Crowd annotation

5.3

5.3.1

“ ”

hand free

APP “

” “ ” “

5.3.2

Beacon Beacon

APP

5.3.3

iBeacon GuidePin

Beacon

1.! BlindNavi iBeacon GuidePIn App

2.!

3.! Grand Prix & Best of Best

ACM CHISDC award

4.! CVGIP 2016 x

5.!

UI/UX

!! 2016 https://goo.gl/OZCXsx

!! J. Zegarra Flores and R. Farcy, “GPS and IMU (inertial measurement unit) as a

navigation system for the visually impaired in cities,” J. Assist. Technol., vol. 7, no. 1, pp. 47–56, 2013.

!! M. Pielot, B. Poppinga, and S. Boll, “PocketNavigator: Vibro-tactile waypoint navigation for everyday mobile devices.,” in MobileHCI 2010, 2010, pp. 423–426.

!! Azenkot, S. Prasain, A. Borning, E. Fortuna, R. E. Ladner, and J. O. Wobbrock,

“Enhancing Independence and Safety for Blind and Deaf-Blind Public Transit Riders,”

in Proceedings of the 2011 annual conference on Human factors in computing systems - CHI ’11, 2011, pp. 3247–3256.

!! Gaunet and X. Briffault, “Exploring the Functional Specifications of a Localized Wayfinding Verbal Aid for Blind Pedestrians: Simple and Structured Urban Areas,”

Human-Computer Interaction, vol. 20. pp. 267–314, 2005.

!! BlindSquare Inc. (2015) Press. Retrieved August 21, 2015 from http://blindsquare.com/press/.

!! M. Hirose and T. Amemiya, "Wearable Finger-Braille Interface for Navigation of Deaf-Blind in Ubiquitous Barrier-Free Space", Proceedings of 10th International Conference on Human-Computer Interaction, Vol. 4, pp. 1417-1421, Crete, Greece, June 2003.

!! H. Nicolau, J. Jorge, and T. Guerreiro, “Blobby: how to guide a blind person,” in

Proceedings of the 27th international conference extended abstracts on Human factors in computing systems, 2009, pp. 3601–3606.

!! Wearable Finger-Braille Interface for Navigation of Deaf-Blind in Ubiquitous Barrier-Free Space http://yehnan.blogspot.tw/2012/02/arduinoled.html

!! Apple Inc. (2013) iBeacons Bible 1.0. Retrieved August 21, 2015 from

https://meetingofideas.files.wordpress.com/2013/12/ibeacons-bible-1-0.pdf.

!! Jacobson, W. H. (1993). The art and science of teaching orientation and mobility to persons with visual impairments. New York, NY: American Foundation for the Blind.

Cities Unlocked

http://innovation.mubaloo.com/news/microsoft-use-beacons-unlock-cities-blind/

!! Ye, M. Malu, U. Oh, and L. Findlater, “Current and future mobile and wearable device use by people with visual impairments,” Proc. 32nd Annu. ACM Conf. Hum. factors Comput. Syst. - CHI ’14, pp. 3123–3132, 2014.

GLIMNAVI: AN OUTDOOR NAVIGATION SERVICE FOR THE VISUALLY IMPAIRED SMARTPHONE USERS

I-Fang Wang,

Hsuan-Eng Chen,

Yi-Ying Lin,

Chien-Hsing Chen,

Neng-Hao Yu,

Hsien-Hui Tang

National ChengChi University,Taiwan

E-mail: 103753017@nccu.edu.tw, jonesyu@nccu.edu.tw

National Taiwan University of Science and Technology,Taiwan E-mail: drhhtang@mail.ntust.edu.tw

Fig. 1. GlimNavi is composed of two parts: 1) Beacons pro-vide micro-location information alerting the user to corners and stores. 2) A smartphone app functions as a hub to trans-late micro-location information into route information.

ABSTRACT

Today, we can freely travel to unfamiliar places and enjoy the convenience of navigation features on mobile devices.

However most of the current apps are presented via visually-oriented interfaces, depriving visually impaired smartphone users of the benefit of this technology. Statistics shows that the visually impaired need to go out as frequently as those having sight, yet this tremendous demand for independence and mobility remains unsolved. Therefore, we present a new system called GlimNavi that integrates knowledge obtained from O&M training and the micro-location information of iBeacon to provide a point-to-point outdoor navigation sys-tem for the visually impaired. We describe our iterative de-sign process including lessons learned through qualitative re-search methods including contextual inquiry, shadowing, in-terviews with experts, and a discussion of our findings from the deployment of the app on test routes. Finally, the visually impaired are able to move about in the public domain inde-pendently with greater ease and confidence.

phone; Mobile app; Accessibility; Orientation and Mobility;

User Experience; Micro-location

1. INTRODUCTION

According to the WHO (2014) there are approximately 285 million visually impaired people worldwide. Most of them necessarily or by choice make outing in public independently.

According to the survey of Department of Statistics in Tai-wan, the percentage of the visually impaired population that makes an outing daily is even up to 58.09%, so the aid of-fered by such a navigation app for the visually impaired cer-tainly exists. Traditionally, when the visually impaired go on an outing independently they must carry a white cane to maintain balance and to aid in their perception of their sur-rounds, for example helping them to avoid obstacles on the street. Some of them rely on guide tiles to make sure they are on a safe lane. Some of them have a guide dog to lead the way to familiar places. However, these existing aids only solve a small part of their outing needs. To our knowledge, there is no total solution that takes into account the entire process of their venturing out.

In the course of this study, the general process by which the visually impaired prepare for and engage in an outing has been categorized into three stages. The first is the prepara-tion stage which involves a search for informaprepara-tion about their destination is carried out with addresses and contact informa-tion obtained either via the Internet or directly from others.

As they acquire information on their route, they tend to go through it mentally to familiarize themselves with the path they must take.

The second stage is actually going out on the streets. In order to move within the public domain independently, the visually impaired must first acquire the fundamental skills of Orientation and Mobility (O&M). The success of this stage is based upon their O&M training, the visually impaired are

course a totally different process from that which the majority uses that is dependent upon visual cues.

The third stage is post-journey. If some destination ven-tured to is a place to be frequented, the visually impaired may need ask for additional O&M training, a service which pro-vides an instructor to lead them through the entire route to ensure that they can memorize all the details necessary for tracking cues. If it’s a one-time place, they can only ask for relatives or friend’s help. We examine the process of the entire journey in qualitative studies and excerpt an unsolved prob-lem for the later design.

Nowadays, smart phone has become a necessity for peo-ple in daily life. Not only for ordinary peopeo-ple, there is a growing number for the visually impaired using smart phones.

By the service of screen reader from iOS and Android like Voiceover and talkback, the visually impaired can know the content and use smart phone without sight. However, the vi-sually impaired get frustrated on the existing navigation app because of two reasons: 1) the visually-oriented interface which is designed for sighted people have terrible flow for the visually impaired. 2) the lack of finer location info, like a cer-tain side on crossroad, sidewalks, driveway entrances and so on. These information cannot be precisely navigate by merely using GPS positioning technology.

For the first point, we did the qualitative research to learn what they encounter when they use app and how they use smart phone smoothly. And for second point, we see that the technology of iBeacon has been gradually adopted in shops, malls and so on. Unlike GPS which is used for car navi-gation, iBeacon provides micro-location info which can pre-cisely separate the different corners on the crosswalk. Based on our research, by well-planed setting of iBeacons can turn 2D map into a linear point-to-point route, which can definitely lower the load of cognitive for the visually impaired.

To conclude our research questions: 1) how to provide a simple and friendly user interface to the visually impaired in whole process of going out, 2) how to use iBeacons for visually impaireds outdoor navigation properly, 3) whats the rules of setting iBeacons and how to provide useful and clear navigation messages while they go on road.

In this paper, we present an iterative design process with three in-depth studies and tests. Overall, the contributions of this paper are: 1) we presented the needs, challenges and strategies when the visually impaired go out by three qual-itative researches. 2) we design a service called GlimNavi, which is composed of a navigation app and iBeacons, to pro-vide usable route info on-road by using micro-location

infor-2. RELATED WORK

2.1. Wayfinding information for the Visually Impaired According to relevant studies, with proper training the visu-ally impaired can build a mental map in almost the same way as people gifted with sight. However, abstract concepts like numbers, measures of distance, or colors may not be so easy for them to understand [1]. Research also shows that the vi-sual impaired are best served by itinerary descriptions as a directional guide due these descriptions being a part of their O&M training. Gaunet [2] explains that the visually impaired need different kinds of information compared to those having sight in given corresponding scenarios: e.g., 1) Straight road section. 2) Intersection area. 3) Crossing the roads. 4) Walk in progress: landmarks, special environment clues. This study by Gaunet also recommends that the guiding information pro-vided by a navigation system should be in 5-10 meters. Pro-viding notification at the best timing and giving continuous reminders are both necessary. Unlike those with sight, the visually impaired rely on advance planning when going on an outing [3]. Their hands, ears, and attention are occupied and they are concentrating intently while they are walking on the street. As a result, both the user interface and functional design should be simple so it will not distract users.

2.2. Existing Technologies for Navigation

Navigation notifications on route can be divided into two parts: voice or tactile. With regard to voice notification, ISAS [3] uses open-ear headphones to provide spatial POIs along the route using intersection-based rendering method instead of distance. In this way, visually impaired people can focus within a block, reducing confusion and fatigue. Trekker is a GPS-based handheld device that verbally broadcasts names of the streets, intersections and landmarks while walking. Vi-sually impaired users can easily get detailed descriptions and step-by-step instructions from start to end with large, distinc-tive buttons of the device. As for tactile notification, GoB-raille [4] combines BGoB-raille devices and smartphones to pro-vide information on public transportation to the visually im-paired. PocketNavigator [5] uses a combination of different vibration lengths to tell the user which way to go even when the phone is in the pocket. NavRadar [6] divides the journey into only two directions, present direction and desired direc-tion with one and two vibradirec-tions respectively. When inside a building, Listen2dRoom [7] uses image recognition, and IN-SIGHT [8] serves as a navigation system through utilization of Bluetooth and RFID technology. Recently, iBeacon has been widely used for indoor positioning and micro-location service. Comparing to aforementioned technologies, iBea-con can provide more precise location info with least effort

2.3. Location-based Wayfinder Service

BlindSquare (http://blindsquare.com/indoor/) is a dedicated GPS app for the visually impaired. By using FourSquare and Open Street Maps map data, it describes the environment, an-nounces points of interest and street intersections to the user en route. In May 2015, BlindSquare released the BPS (Bea-con Positioning System) version to provide an indoor naviga-tion system with iBeacons installed inside buildings. When GPS fails, BPS continues ensuring that visually impaired re-main aware of the surrounding landmarks. ILSI project [9]

chose a shopping mall in Helsinki as a test bed to evaluate the feasibility of BlindSquare app with ibeacons. They used multi-sensory landmarks as an important feature on road and proposed four levels of information mediated with iBeacons for way-finding. We extend this idea to outdoor navigation which is a general need of visually impaired. We also pay attention to the entire outing experience from preparation to post-journey stages.

3. PILOT STUDY

In order to gain insight in regard to the challenges faced by, and issues involving, the visually impaired, we conducted 3 qualitative research procedures, utilizing the methods of con-textual inquiry, shadowing, and the expert interview, to reveal the needs of the visually impaired regarding mobile naviga-tion and to comprehensively understand their smartphone us-age patterns. The following are some interesting facts and problems encountered in regard to each method:

3.1. Contextual Inquiry

We conducted 30-minute interviews with 10 visually im-paired informants, including 6 smartphone users. Intervie-wees were categorized according to 5 factors: 1) Visual abil-ity, 2) Inherent or acquired cause, 3) Age, 4) Types of mo-bile phone, and 5) Acceptance of technology. Each intervie-wee shared their experience of using smartphones, naviga-tion relevant apps, and their outing habits. In general, the inherent blind, often with better O&M skills, are more inde-pendent than those who later acquired blindness. Their will-ingness to go to unfamiliar places on their own is also much higher. Acquired blindness, usually caused by disease or ac-cidents, forces these individuals to rebuild their lives without the convenience of sight. These individuals tend to feel in-secure while traveling to unfamiliar areas without accompa-niment. So the mobility of those with acquired blindness is more likely to be highly constrained. To sum up factors 3 to 5, older individuals among the visually impaired are less active in their use of smartphones. Average users use their smartphone only for basic functions like making phone calls, web browsing, chatting with friends...etc. Active users are the

ing smartphones, eager to try or share new technological ser-vices. Interestingly, these informants share numerous habits and problems.

3.1.1. VoiceOver Usage Pattern

The 6 informants that use smartphones all use VoiceOver, an iOS gesture-based screen reader. With VoiceOver enabled, a cursor will appear on the screen. Users can then swipe or drag to move the cursor from one object to another. The handset verbally informs the user of the properties of the object upon which the cursor rests (e.g., button, title, text field, etc.) and what options are available to the user (tap times, swipe direc-tions, number of fingers involved, etc.). Each gesture has its own advantages. A swipe is a more effective gesture when a user needs to quickly browse between options or go through the entire screen. Dragging the cursor, while the finger re-mains in contact with the screen, is more suitable for an ex-ploration scenario. VoiceOver allows for a unique smartphone usage pattern for the visually impaired.

3.1.2. Outing Habits

The visually impaired always go out with a very specific pur-pose, for example: go to work or classes, get food, do grocery shopping...etc. Because they need to prepare a lot before they go out, any abrupt change to the well planned daily schedule is not welcome. They prefer not go to unfamiliar places with-out accompany. If its inevitable, they must carry the address and phone number of destination in case they need to ask for help from sighted people.

3.1.3. Search Process

The informants need to prepare in detail prior to an outing to an unfamiliar location. Since text input on mobile devices is not as convenient as a physical keyboard, most of them pre-fer to search for information on a PC. Though voice input is not difficult there is an accuracy problem with identification of words that sometimes necessitates users to carry out mod-ification by texting. In addition, voice input is inappropriate in certain contexts and occasions. So we keep keyboard input in our later version. In the search process, all websites and apps are designed for the visually unimpaired. So the infor-mation displays in a manner usually only accessible to those with the power of sight, a circumstance that greatly inhibits visually impaired users. For those that can see a large amount of information is immediately available at a mere glance and the sought for information is found quickly. Using such an in-terface the visually impaired can only locate the information they seek slowly and painstakingly as often they spend a great deal of time only filtering out irrelevant messages before

hon-switch between different hierarchies, applications or even de-vices. Such a desultory information search process results to a bad navigation experience for the visual impaired.

3.1.4. Single Visit to Unfamiliar Place

If this trip to somewhere unfamiliar is a one-time visit, our informants will not exert the effort to memorize route de-tails. What is necessary for them to know before setting off is the means of transportation that they must take and generally what roads or streets that they will be traveling on. If there is any problem, they just ask people along the way or call someone for help. Since the visually impaired can easily get assistant inside the metro station or on the bus, the unsolved problem falls on the route navigation between each route by walk.

3.1.5. Multiple Visits to Unfamiliar Place

If our informants need to begin visiting a new place regu-larly, for example, when moving to a new apartment, getting a new job, attending a new class, they spend a great deal of time and effort on memorizing route details. To ascertain by what cues they recognize streets and neighborhoods, we ask

在文檔中應用智慧型手機輔助視障導航之研究(2/2) (頁 18-0)