Autonomous Ultrasonic Indoor Tracking System

8 International Symposium on Parallel and Distributed Processing with Applications Autonomous Ultrasonic Indoor Tracking System Junhui Zhao, Yongcai Wang NEC Labs, Beijing, China {zhaojunhui,wangyongcai}@research.nec.com.cn Abstract This paper proposes the Autonomous Ultrasonic Indoor Tracking System (AUITS), an ultrasound based system for locating and tracking mobile objects inside a building. Ultrasound shows promise to be exploited for a practical indoor location system due to its high accuracy ranging, low cost, safety, and imperceptibility. However, conventional ultrasonic location systems pose such challenges as high installation cost and manual calibration. The key idea of AUITS is to use only one autonomous device, Positioning on One Device (POD), to not only process signal acquisition but also conduct position computation. Structural topology is designed to make POD easily deployed and easily calibrated. In addition, a structural localization algorithm is proposed to provide an effective and affordable algorithm for POD to calculate the object s position. We describe the hardware prototype implementation of AUITS and evaluate its performance both experimentally and with simulation. The results show that the coverage area of a POD can reach 65 m and the positioning error is less than 5 cm with over 9% probability. Introduction Location information can be utilized to extract the geographical relationship between users and the environments to further understand user behavior []. The importance and promise of location-aware applications has led to the design and implementation of systems for providing location information, particularly in indoor and urban environments [, ]. In general, there are various kinds of signals commonly used for indoor location systems, including Infrared [], radio frequency (RF) [5-8], Ultrasound (US) [9-], audible sound [], etc. Compared with other signals, we favor that ultrasound is a promising means to be exploited for a practical indoor location system due to its high accuracy ranging, low cost, safety and imperceptibility by user. So far, there are already some ultrasonic indoor location systems to provide location based services. The typical examples are Bat [9] and Cricket []. However, these systems remain in the laboratory or university and are hard to put into real use. The main challenge is the considerable installation and calibration effort, which is special requirement for a location system before being put into use. To bootstrap a conventional ultrasonic location system, firstly networked reference points are required to be deployed and distributed into practical environment, which poses considerable cost for system installation. Then, the positions of the reference points have to be measured or calibrated to form a reference space, which also needs a lot of manual efforts. Thereafter, the position of the object can be calculated with respect to the reference points. To address these limitations in current approaches, we propose AUITS, an autonomous, ultrasound based system for locating mobile objects inside a building. The key idea of AUITS is Positioning on One Device (POD), which uses one positioning device to conduct both signal acquisition and position computation. AUITS is composed by POD and Tags. A Tag containing both a RF transceiver and an US transmitter is carried by the mobile object to be located that works in active transmission mode. A POD integrates single RF transceiver and multiple US receivers into one device so that it can be easily deployed into application environment and autonomously localizes positions of the mobile Tags. Structural topology is designed for POD to reduce the installation and calibration efforts, especially, enabling automatic self-calibration. Based on structural topology, structural localization algorithm is presented to improve the efficiency of position estimation process on POD. The design of AUITS offers several advantages; easy installation, easy calibration and highly accurate location. We implement the hardware prototype of AUITS from off-the-shelf components, including POD and Tag. The performance of AUITS is evaluated with simulation and experiment. The rest of this paper is organized as: we present the system overview in Section. The design philosophy is introduced in Section. The prototype implementation and performance evaluation are presented in Section and 5, respectively. Finally, Section 6 concludes the paper. 978--7695-7-8/8 $5. 8 IEEE DOI.9/ISPA.8.7 5

RF US POD Tag () Emission () Synchronization Context Information Server () Acquisition () Calculation Figure. Work Flow of AUITS System Overview Our aim is to develop an accessible indoor ultrasonic location system, which is easily deployed, auto-calibrated, highly accurate, so that the real-time position and movement trajectories of the mobile object can be tracked. In AUITS, a tag is carried on a mobile object to be located, which works in active transmission mode. An autonomous positioning device, POD, is mounted on the ceiling of the monitoring area to carry out airborne US signal collection and position computation. The tag may contain a RF transceiver and a narrowband US transmitter that is low cost. POD contains single RF transceiver and multiple US receivers. The work flow of AUITS is shown in Fig... Emission Mobile tag sends an RF signal and ultrasonic pulses simultaneously.. Synchronization Hearing the RF signal, POD synchronizes all its connected US receivers to wait for the succeeding US.. Acquisition US receiver detects the airborne US signal emitted from mobile tag and reports the detecting time to POD. Then POD calculates distances from US receiver to the tag based on the Time of Arrivals (TOA).. Calculation A structural localization algorithm is utilized for position estimation. Position results are sent from POD via wire or wireless network to a context information server. POD Design. Structural Topology Installation and calibration efforts are important factors to make a location system feasible for practical applications. One remarkable benefit of the proposed AUITS is the structural property of POD, which greatly reduces the installation and calibration efforts, especially, enabling the structural-based self-calibration. Multiple US receivers are integrated into the single device, POD, and these receivers are uniformly distributed in POD so that structural topology is constructed. Fig. illustrates some typical structure of our proposed POD. (x,y ) l X axis (a) Square Style 5 (x,y ) l X axis 6 (b) Hexagon Style Figure. Typical Structure of POD 5

Basically, the proposed POD appearances in above figure are central symmetric, where one US receiver is located at POD center and others are uniformly distributed along the POD edges. In particular, the surrounding receivers can form a regular shape, such as a square or a hexagon... Easy Installation Fig. shows the POD installation process. An initial form of POD is just like a compact Frisbee that contains single RF transceiver and multiple US receivers. While in use, the surrounding receivers can be extended to the outside so that POD has an umbrella-like appearance. Instead of deploying one by one networked sensors in the building as presented in prior art [9,], POD can be easily installed only once. Therefore the installation efforts will be reduced tremendously. After installation, the coordinates of the US receivers are automatically obtained according to structural topology design. Surrounding Central POD (Spread) Ceiling Installation central US receiver as the origin (x = ; y = ; z = ). This does not involve any manual calibration. After position computation of POD, a relative position of the object will be sent to a context server for location based services. If an absolute position coordinate of the object is required, only the POD center s position needs to be determined. The measurement of the POD center absolute coordinate requires less manual effort compared with conventional ultrasonic location systems. The absolute coordinate of the object can be easily mapped from the POD reference space to the absolute coordinate space. Based on the above analysis, it is evident that structural topology can eliminate the efforts of measuring the distances and angles among US receivers, making POD more convenient and accessible for practical application scenarios.. Structural Localization The block diagram of our proposed structural localization algorithm is shown in Fig.. The inputs are the simultaneous TOA measurements from different US receivers of POD. A TOA reliability filter is used for pre-processing in order to reject the outliers from the TOA measurements. After that, a unique estimated position can be obtained based on structural trilateration. TOA Detections TOA Reliability Filter Structural Trilateration Unique Position Estimation POD (Compact) Figure. POD Installation Process Figure. Block Diagram of Structural Localization.. Easy Calibration In calibration phase, rather than manually measure the coordinates of each US receiver individually, POD can easily infer the coordinates of all receivers based on the structural topology. To be specific, as the direction of the first US receiver is set as the X axis, coordinates of all the other receivers can be obtained as follows. In counterclockwise direction, the coordinates of the ith surrounding receiver is given by: ( ) x i = l cos π (i ) ( n ) y i = l sin π (i ) i =,..., n () n where n is the number of all US receivers and l is the distance between the surrounding receiver and POD center. It should be noted that in the position computation phase, POD always calculates the object s position relative to itself. That is, POD automatically sets the coordinate of the.. The TOA Reliability Filter Ultrasound signal may be reflected by obstacles and such reflected signal will lead to unexpected localization error that should be taken as outlier to be removed from our localization algorithm. We propose a Fast Outlier Rejection (FOR) algorithm to identify and eliminate these outliers from the simultaneous distance estimations. The basic idea is that the difference of two transmitter-receiver distances can not be larger than the distance between the receivers. In the algorithm, we assume the minimum survived TOA measurement is the most reliable. Based on the assumption, the distances are sorted in ascending order. The maximum and the minimum distances are checked according to triangle inequalities. { di d j < E i,j d i + d j > E i,j () where d i and d j are the maximum and minimum distance measurements, respectively, and E i,j is the distance be- 5

tween receiver i and receiver j. If both inequalities are satisfied, the largest distance is regarded as a direct-path signal and a reliable TOA measurement. The filtering process will end and all TOA distance measurements will be accepted as reliable values. Otherwise, the largest distance is classified as an outlier since there is high probability of it being a reflected signal. The second maximum distance measurement is then checked. Such checking process repeats until this condition is satisfied. 5 6 (a) large equilateral triangle 5 6 (b) right angle triangle.. Structural Trilateration POD employs trilateration algorithm to infer the object s position from three TOA measurements. When more than three reliable TOA measurements are obtained after reliability filtering, the conventional localization procedure is multilateration that uses all reliable TOA for position calculation. However, due to multilateration s high computational cost, this is not feasible to POD. In our design, a structural trilateration method is proposed to utilize only three of all TOA samples to get an unique position estimation. Structural trilateration is based on TOA refinement. According to [], the geometric relation of reference points can significantly affect the localization result. The farther separated the reference points are, the better the localization result will be. Conversely, if the three reference points almost lie in a line, there will be a high probability of flip ambiguity in the localization result. Thus, we select the three TOA samples based on a Max Separation criteria, that is, the distribution between these reference points should be as dispersed as possible. Since POD has the structural topology, we can easily define the separation degree according to the possible Three-Point distributions on POD. For example, in a hexagonal POD, there are four potential Three-Point distributions for trilateration. These are shown in Fig.5. In this figure, US receivers on POD are indexed and the central receiver is set as. In (a) large equilateral triangles can be formed by joining US receivers (,,5) or (,,6). In (b), there are possible right angled triangles because each edge has two other points to construct a right angled triangle. For example, (,,) and (,,). In (c), since each edge can determine one small equilateral triangle, there are 6 possible small equilateral triangles. In (d), the center receiver corresponds to 6 possible obtuse angle triangles. For example, (,,6) and (,,). Also, each surrounding receiver can form an obtuse angle triangle, such as (,,6). Therefore, there are possible obtuse angle triangles. It should be pointed out here that the separation degree can be ordered by (a)>(b)>(c)>(d). That is, the Three- Point distributions in (a) have maximum separation degree so that three TOA samples with large equilateral triangles 5 6 (c) small equilateral triangle 5 6 (d) obtuse angle triangle Figure 5. Separation Degree based on Three- Point Distribution for Hexagon-style POD should have the highest trilateration selection priority. On the other hand, (d) represents the minimum separation degree but can still be used for position calculation. Any Three-Point distributions except the above, such as (,,), will be abandoned because no position result can be obtained by them. Prototype Implementation. POD POD is implemented using inexpensive, off-the-shelf, simple hardware parts. Basic parameters for POD prototype design can be found in Table. It includes a microcontroller (such as ATMEL 8 processor), a RF Transceiver for time synchronization and object ID recognition and a set of US Receivers. A CPLD (Complex Programmable Logic Devices) is used to setup a single clock for all US receivers. As soon as the synchronization time is detected by microcontroller, CPLD is signaled for timing all US receivers so that these receivers can be synchronized with minimal error. Since the proposed structural localization needs low computation cost, it can be performed well on the microcontroller. The arrangement of US receivers has one placed in the POD center and others at surrounding edges. For example, a POD board can be implemented as a square for 5 US receivers and a hexagon for 7 US receivers. Around the POD board, each US receiver is connected via a telescopic rod. The US receiver can be pulled outside to form an umbrella-like topology. Fig.6 gives the implementation of the Hexagon-shape POD, the typical size parameters for 55

such a POD is that the distance between center and surrounding US receiver is cm in Compact Mode and the distance is 6 cm in Spread Mode. Figure 6. Prototype for Hexagon-style POD Table. Parameters of POD hardware prototype Name Value RF Chip CC RF frequency MHz RF data rate 9.Kbps RF transmission distance m-6m US Transducer 55-SR/ST US frequency KHz US propagation distance meters 5. Coverage In AUITS, coverage area becomes an important parameter of POD, indicating its suitable application scope. Basically, coverage area of POD is mainly affected by three parameters: Number of surrounding US receivers (SU) Spread distance (SD) Tilt angle of surrounding US receivers (TA) Here, The spread distance means the distance from surrounding receiver to POD center. The tilt angle means the offset degree when surrounding receiver is rotated towards outside. The evaluation for coverage property is carried out in a designed simulation platform based on OMNeT++ [5]. The simulation platform is illustrated in Fig.7. We set up a simulation environment where one POD is mounted on the ceiling and a mobile Tag moves around in a room, which is 6m wide and 8m long. The POD height is.5m to ground and the Tag height is.9m to ground. In simulation, the mobile Tag moves on grids of a horizontal plane and we set the grid size to cm cm. In each grid, it broadcast RF+US signals for localization. According to structural localization, at least three reliable TOA measurements are necessary for accurate positioning. Therefore, if in one grid at least three TOA are detected by POD, such a grid can be counted into the covered area of POD. By counting the number of grids covered by POD, we can achieve the coverage area of POD.. Tag Similar with POD prototype, tag is also implemented using low cost, off-the-shelf and simple hardware components. It contains a microcontroller, a RF transceiver and an US transmitter. Basically, the tag is implemented for goals of small size, low power consumption and user friendly. Two kinds of tag are manufactured. One is pen-style for person tracking and the other is small box-style for asset tracking. 5 Simulation and Experiment We performed a number of simulations and experiments to evaluate AUITS performance, mainly on coverage, accuracy and robustness. Please refer to http://www.chipcon.com/ Please refer to http://www.mouser.com/kobitone/ Figure 7. Simulation in OMNet++ In our simulation, SD varies from cm to cm; TA varies from to 5 degree; and SU varies as, 6, 8. The coverage area of One POD is statistically obtained in Table.. 56

Table. Coverage area of POD according to variant parameter settings SD(cm) TA = o TA= 5 o SU = SU = 6 SU= 8 SU = SU = 6 SU = 8 6.6 8... 7. 56.8 6 7..9.8.7 5. 58. 8 8.. 6..5 5. 6.8 9.5 5.8. 56 65.9 The first point to note is that basically coverage of POD can be increased by surrounding US receivers, tilt angle and spread distance. The overall coverage area of POD varies from 6.6 m to 65.9m in different parameter setting. Especially, the largest coverage can be achieved at the case of SD = cm, TA = 5 o and SU = 8. Secondly, coverage area increases slightly with spread distance. For example, in case of SU=6 and TA= o, the coverage areas change relatively smaller when SD ranges from cm to cm. More exactly, only an increase of 6. m can be obtained when spread distance is increased. Thirdly, significant improvement can be achieved when the US receiver is rotated toward outside. For example, in case of SD=6cm and SU=6, the coverage area is 5.m when TA=5 o, yielding an improvement of.7% compared with TA= o. These results imply that POD can be designed more compact while preserving its coverage so that the accessibility of POD will be improved. To further improve POD prototype, we only need to shorten spread distance of POD and enlarge tilt angle accordingly. 5. Accuracy Experiments are carried out in our Labs. The room is 5 meters long and meters wide, surrounded by walls and there is a corridor beside the room. There are tables, chairs and a whiteboard in this room. A POD with a RF transceiver and 7 US receivers is mounted on the ceiling of this room. The height from POD to ground is.6m. The positions of POD in the plan view of the room are shown in Fig. 8. 5.. Stationary Test In stationary test, we choose three categories of test points for accuracy evaluation. Test points near the center of POD are indexed by {- 5} marked as small squares in Fig.8; Test points away from the center of POD are {6-} marked as small rectangles; Test point far from the center of POD are {-5} marked as circles. Corridor 8 6 POD Wall 6 7 8 9 5 6 7 5 5 Test points near POD center Test points away from POD center Test Points far from POD center 9 7 Test Points in error distribution evaluation Figure 8. Test Points in Stationary Evaluation Fig.9 gives the results of stationary position experiment. From the plot, we can firstly observe that AUITS system can yield highly accurate positioning results when the object is below and near POD center. The positioning error is less than cm with over 9% probability. Secondly, when the object is not directly below POD center, AUITS system also yields highly accurate positioning results, leading to 5cm positioning error with over 9% probability. Finally, when the object is far from POD center, the performance of accuracy declines sharply, because less US receivers can detect the US emitted from the transmitter far from POD. But the overall accuracy performance is still acceptable for most application cases. 5.. Error Distribution We further evaluate positioning error distribution affected by distance and angle. Test points are selected to form a line below POD that are indicated by cross point as illustrated in Fig.8. The error distribution result is shown in Fig.. The origin point of X-axis is the projection of POD center on the surface of the object and the X-axis represents the distance from object to the projection center of POD. 57

cumulative probability.9.8.7.6.5.... near POD center away from POD center far from POD center 5 5 5 5 Positioning Error (cm) Figure 9. Cumulative Distribution of Position Error for Stationary Test Positioning error(cm) 8 6 8 6 --6-- -8-6 8 Distance from POD center(cm) Figure. Position Error According to Distance From Transmitter to POD Center According to the result, positioning error increases slowly as the distance increases from zero to two meters, yet increases rapidly when the distance is larger than two meters. The overall positioning error is less than 5cm, indicating a good accuracy performance of AUITS. 5.. Dynamic Test Dynamic tests evaluate the system s refresh rates and positioning accuracy as the object is moving. In this test, the US transmitter is put on the back of a swivel chair. It moves along the circular track as the chair is turned around. Four experiments are carried out. Fig. shows the comparison of the estimated tracks with the true circular track.the mean errors and standard derivations of the four experimental tracks are also plotted. The results show that as the transmitter moves dynamically, its position can be well tracked by the AUITS system. The overall mean error are less than ± cm. y(cm) Positioning error (cm) - - - - - - - - x(cm) Experimental Tracks True track Experimental track Experimental track Experimental track Experimental track Figure. Position Error in Dynamic Test 5. Robustness We also design test cases for evaluating the robustness of the system. In particular, we focus on investigating the influence of people moving to the system because mobility is quite common and may block or reflect the US signals. In that case, it is a very severe threat to current ultrasonic indoor location systems. Here, we also evaluate the case of Stationary Test and Dynamic Test. In order to investigate robustness, when the tag broadcasts US, a person keeps moving around the tag, and blocked the tag with hand or arm occasionally. 5.. Stationary Test cumulative probability.9.8.7.6.5.... Near POD Center with noise Away from POD center with noise 5 5 5 5 Positioning Error (cm) Figure. Position Error for Stationary Test in Noisy Environment For stationary test, we can see from Fig. that the accuracy performance degrades when noises are introduced. More exactly, when the object is near POD center, the positioning error is around 5 cm with 9% probability. As the object is away from POD center, the performance drops to less than cm with 9% probability. The reason for 58

performance degradation is that reflections and blocks can cause errors for TOA measurement. 5.. Dynamic Test y(cm) Positioning Error (cm) - - - - - - x(cm) - - Experimental Tracks True track Experimental track Experimental track Figure. Position Error for Dynamic Test in Noisy Environment For dynamic test, two experimental tracks are tested and the estimated tracks are plotted in Fig.. Comparing Fig. and, we can see the tracking performance becomes worse when noises are introduced. But the AUITS system can still provide a reasonable position estimation in this dynamic and noisy environment. 6 Conclusion In this paper, we designed, implemented and evaluated AUITS - an ultrasound-based system for locating and tracking mobile objects inside a building. AUITS demonstrates many desirable properties including ease of installation, auto-calibration and high accuracy. The design philosophy we followed is positioning on one device with structural topology, thus making the POD feasible and accessible as a practical location system. Besides, a structural localization algorithm is proposed to improve the positioning accuracy and reduce computational cost. In the future, there are several directions which might be pursued in order to further improve the ideas and algorithms presented in this paper, such as localization fusion of multiple POD for large application scenario and anti-collision protocol design for multiple tag tracking. References [] M. Weiser. The Computer for the st Century. Scientific American (September 99) [] J. Aspnes, T. Eren, D. K. Goldenberg, A. S.Morse, W.Whiteley, Y. R. Yang, B. D. O. Anderson, and P. N. Belhumeur, A Theory of Network Localization, IEEE Transactions onmobile Computing, vol. 5, no., pp. 66-678, Dec. 6. [] A. Asthana, M. Cravatts, and P. Krzyzanowski. An Indoor Wireless System for Personalized Shopping Assistance. In Proceedings of IEEE Workshop on Mobile Computing Systems and Applications, pages 69-7, Santa Cruz, California, December 99. IEEE Computer Society Press. [] R. Want, etc, The Active Badge Location System, ACM Transactions on Information Systems (TOIS), Vol., Issue, Pages: 9 -, 99. [5] P. Bahl and V. Padmanabhan. RADAR: An In-Building RFbased User Location and Tracking System. In Proc. IEEE INFOCOM (Tel-Aviv, Israel, Mar. ). [6] B. Kusy, A. Ledeczi and X. Koutsoukos, Tracking Mobile Nodes Using RF Doppler Shifts. in SenSys 7: Proceedings of the 5th international conference on Embedded networked sensor systems. Sydney, Australia, ACM Press, pp. 9 -. [7] J. Hightower, C. Vakili, G. Borriello, and R. Want. Design and Calibration of the SpotON Ad-Hoc Location Sensing System. August. [8] L. M. Ni, Y. Liu, Y. C. Lau, and A. P. Patil. LANDMARC: Indoor Location Sensing Using Active RFID. In Proceedings of IEEE PerCom, Dallas, TX, USA, March. [9] A. Ward, A. Jones, and A. Hopper. A New Location Technique for the Active Office. In IEEE Personal Communications, Volume, no.5, October 997. [] Nissanka B. Priyantha, A. Chakraborty, and H. Balakrishnan. The Cricket Location-Support System. In Proceedings of the Sixth International Conference on Mobile Computing and Networking (ACM MobiCom), Boston, Massachusetts, USA, August. [] C. Randell and H.L. Muller, Exploring the Dynamic Measurement of Position, Proc.6th Int l Symp. Wearable Computers (ISWC ), IEEE CS Press,, pp. 7-. [] S. Holm, O. Hovind, S. Rostad, and R. Holm, Indoors Data Communications Using Airborne Ultrasound. In Proceeding of ICASSP5, Philadelphia, PA, USA, pp 957-96. [] J. Scott and B. Dragovic. Audio Location: Accurate Lowcost Location Sensing. Pervasive 5, pp. -8. [] Z. Yang and Y. Liu, Quality of Trilateration: Confidence based Iterative Localization, in proceeding of IEEE ICDCS 8, Pages: 6-5. [5] A. Varga, The OMNeT++ Discrete Event Simulation System, in Proceedings of the 5th European Simulation Multi conference (ESM ). European Council for Modeling and Simulation, Nottingham, UK, May. 59