Mobile Target Tracking Using Radio Sensor Network Nic Auth Grant Hovey Advisor: Dr. Suruz Miah Department of Electrical and Computer Engineering Bradley University 1501 W. Bradley Avenue Peoria, IL, 61625, USA Saturday, April 28, 2018 N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 1 / 44
Outline 1 Introduction 2 Background Study 3 Mapping and Tracking Methods 4 Simulation 5 Implementation 6 Experimentation 7 Conclusion and Future Directions N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 2 / 44
Introduction Motivation Motivation Mobile robotics is an area of active research Mobile robotics is an interdisciplinary field with many applications No literature on active RF Mobile Target Tracking N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 3 / 44
Introduction Objective Problem Description A mobile target is moving randomly in an unknown environment where its position and trajectory are also unknown. A mobile robot is to follow the mobile target while maintaining a set distance and avoiding obstacles in its path. Problem Statement Develop a modular mobile target tracking strategy using RF signal strength measurements Build a simulation to test the EKF-SLAM with mobile target tracking algorithm Implement the mobile target tracking strategy using ROS on the Pioneer 3-DX mobile robot platform N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 4 / 44
Introduction Applications Warehouses Factories Search and rescue Research and education N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 5 / 44
Introduction Challenges Overcoming noisy received signal strength measurements Localization of moving target Speed of radio sensor signal acquisition N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 6 / 44
Introduction Frequently used terms EKF: Extended Kalman Filter SLAM: Simultaneous Localization and Mapping RSSI: Received Signal Strength Indicator ROS: Robot Operating System N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 7 / 44
Overview 1 Introduction 2 Background Study 3 Mapping and Tracking Methods 4 Simulation 5 Implementation 6 Experimentation 7 Conclusion and Future Directions N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 8 / 44
Background Study Literature Radio signal strength to calculate range Parabolic reflector to estimate angle of arrival Simultaneous localization and mapping using RFID tags Tracking of radio signal emitting mobile target N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 9 / 44
Background Study Prior Work Radio receiver and robot control hardware Radio sensor network EKF-SLAM Simulation and Implementation (a) Operating environment in simulation. (b) Customized radio transceiver. N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 10 / 44
Overview 1 Introduction 2 Background Study 3 Mapping and Tracking Methods 4 Simulation 5 Implementation 6 Experimentation 7 Conclusion and Future Directions N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 11 / 44
Mapping and Tracking Methods System Block Diagram Mobile target trajectory + - Σ Tracking algorithm Mobile robot Robot's trajectory Sensory information N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 12 / 44
Mapping and Tracking Methods EKF-SLAM Algorithm EKF: Extended Kalman Filter SLAM: Simultaneous Localization and Mapping Widely popular for resilience to noise. Three main steps: 1 Predict 2 Observe 3 Update N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 13 / 44
Mapping and Tracking Methods EKF-SLAM Algorithm: Prediction Predict Step Predict the state of the robot, the mobile target, and the measurements to be made ˆq k+1 = ˆq+ k + CT f r (ˆq + k,r, u k, 0), P k+1,rr = F kp + k,rr FT k + L kq k L T k, P k+1,rb = F kp + k,rb, (1a) (1b) (1c) P k+1,br = (P k+1,rb) T (1d) N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 14 / 44
Mapping and Tracking Methods EKF-SLAM Algorithm: Observe Observations Take range and bearing measurements of the radio sensor network Y t = [r t, θ t ] T (2) N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 15 / 44
Mapping and Tracking Methods EKF-SLAM Algorithm: Update Update Step Update the predictions based on the measurements gathered Update the Kalman gain covariances S = [ H r K k+1 = ] [ P k+1,rr P k+1,rb H j b j [ P k+1,rr P k+1,br P k+1,b j r P k+1,rb j P k+1,bb j P k+1,b j b j ] [H T r H T b j ] [H T r H T b j ] S 1, ] + R, (3a) (3b) ˆq + k+1 = ˆq k+1 + K k+1v, P + k+1 = P k+1 K k+1sk T k+1, (3c) (3d) N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 16 / 44
Mapping and Tracking Methods EKF-SLAM Algorithm: Augment Augment Add any new landmarks gathered Increase the size of the prediction covariance so more covariance matricies can be stored [ q + ] q k+1 = k+1 b s+1 P k+1 = [ ] P + k+1 P T b (s+1) q P b (s+1) q P b (s+1) b (s+1) N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 17 / 44
Mapping and Tracking Methods Robot Model Discrete time model: x k+1 = x k + T ν k cos(θ k + γ k ), y k+1 = y k + T ν k sin(θ k + γ k ), θ k+1 = θ k + T ν k sin(γ k ) l N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 18 / 44
Mapping and Tracking Methods Measurement Model Model of RSSI z [j] k z [j] k z [j] k P ref 10η log 10 r [j] k (4) measured in dbm, P ref is the reference signal strength in dbm at 1m, η is the signal propagation constant, r [j] k is the range in m between the robot and the [j] th radio sensor Bearing β k of each radio sensor is determined from a set of RSSI measurements N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 19 / 44
Mapping and Tracking Methods Measurement Model Range is calculated using the RSSI r k = 10 RSSI P ref 10η (5) RSSI is assumed to be greatest when the parabolic dish is directly facing the Xbee. This angle is determined to be the bearing β k. N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 20 / 44
Mapping and Tracking Methods Subsystem Level Diagram Initial target measurement + - Σ Tracking algorithm Motion controller EKF-SLAM Mobile robot Robot's trajectory Radio sensor location estimates Radio sensor network Measurement Model N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 21 / 44
Overview 1 Introduction 2 Background Study 3 Mapping and Tracking Methods 4 Simulation 5 Implementation 6 Experimentation 7 Conclusion and Future Directions N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 22 / 44
Simulation Virtual Robot Experimentation Platform Commercial robotics simulator Accurate models of many robots including the Pioneer 3-DX N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 23 / 44
Simulation Setup Obstacle Radio Sensors Mobile target Mobile robot Figure: Virtual environment Purpose: To verify the EKF-SLAM and Mobile Target Tracking algorithms before implementing N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 24 / 44
Simulation Simulation Case I *Play video of V-Rep and Matlab work* N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 25 / 44
Simulation Simulation Case I: Results 3.5 3 2.5 j = 1 j = 2 j = 3 j = 4 1 0.9 0.8 0.7 e [j] (t) [m] 2 1.5 1 0.5 e [M] (t) [m] 0.6 0.5 0.4 0.3 0.2 0.1 0 0 5 10 15 20 25 30 35 40 Time [sec] (a) Radio sensor estimation errors 0 0 5 10 15 20 25 30 35 40 Time [sec] (b) Mobile target estimation error N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 26 / 44
Simulation Simulation Case II *Play video of Matlab work* N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 27 / 44
Simulation Simulation Case II: Results e b [j] [k], [m] 1.5 1 0.5 j = 1 j = 2 j = 3 j = 4 e b [j] [k], [m] 1.4 1.2 1 0.8 0.6 j = 5 0.4 0 0 200 400 600 800 1000 Discrete time index, k (a) Radio sensor estimation errors 0.2 0 200 400 600 800 1000 Discrete time index, k (b) Mobile target estimation error N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 28 / 44
Overview 1 Introduction 2 Background Study 3 Mapping and Tracking Methods 4 Simulation 5 Implementation 6 Experimentation 7 Conclusion and Future Directions N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 29 / 44
Implementation Software Full featured operating system Easily modifiable and open source Version adapted for beaglebone black N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 30 / 44
Implementation Software Collection of robotics middle-ware Hardware abstraction Node based system TCP/IP based communication N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 31 / 44
Implementation Software MATLAB 1 Feature rich scripting language 2 ROS support with Robotics System Toolbox 3 Used to process data and perform SLAM algorithm C++ 1 Fast yet high level programming language perfect for embedded applications 2 CMake build tools included with ROS 3 Used to operate customized radio transceiver N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 32 / 44
Implementation Hardware Zigbee Radio Protocol 2.4 GHz Frequency 10 to 20 meter range Low power consumption N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 33 / 44
Implementation Hardware 1 GHz Cortex A-8 ARM Processor UART Interface Wifi Capable Low Cost - $55.00 N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 34 / 44
Implementation Hardware Purpose built for research 500 bit wheel encoders 8 on board sonar sensors ARIA framework N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 35 / 44
Implementation Customized Radio Transceiver Figure: Customized radio transceiver N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 36 / 44
Implementation Communication Diagram ZIGBEE UART WIFI GPIO ZIGBEE USB N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 37 / 44
Overview 1 Introduction 2 Background Study 3 Mapping and Tracking Methods 4 Simulation 5 Implementation 6 Experimentation 7 Conclusion and Future Directions N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 38 / 44
Experimentation Radio Localization e b [j] [k], [m] 0.8 0.6 0.4 0.2 j = 1 j = 2 j = 3 j = 4 Y [m] 10 9 8 7 6 5 4 3 2 0 0 200 400 600 800 1000 Discrete time index, k (a) Radio sensor estimation errors 1 0 i = 1000-1 -2 0 2 4 6 8 10 X [m] (b) Testing environment N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 39 / 44
Experimentation Video *Play video of implementation* N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 40 / 44
Overview 1 Introduction 2 Background Study 3 Mapping and Tracking Methods 4 Simulation 5 Implementation 6 Experimentation 7 Conclusion and Future Directions N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 41 / 44
Future Directions Improve speed of radio sensor signal acquisition Reduce error due to multipath propagation Potentially incorporate other sensor types such as LIDAR N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 42 / 44
Conclusion Excellent performance in simulation Adequate performance in actual implementation Room for improvement or expansion of scope N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 43 / 44
For Further Reading I F. Martinelli. A robot localization system combining rssi and phase shift in... IEEE Transactions on Control Systems Technology, vol.23, no. 5, pp. 1782 1796. E. DiGampaolo. A robot localization system using the phase of passive uhf-rfid... IEEE Transactions on Control Systems Technology, vol.61, no. 1, pp. 365 376. E. Xu. Target tracking and mobile sensor navigation in wireless sensor... IEEE Transactions on Mobile Computing, vol.12, no. 1, pp. 177 186. www.mobilerobots.com/libraries/downloads/pioneer3dx-p3dx- RevA.sflb.ash N. Auth,G. Hovey (Bradley University) Mobile Target Tracking Using Radio Sensor Network(Proposal) April 28, 2018 44 / 44