Autonomous UAV support for rescue forces using Onboard Pattern Recognition
|
|
- Sophia Ellis
- 6 years ago
- Views:
Transcription
1 Autonomous UAV support for rescue forces using Onboard Pattern Recognition Chen-Ko Sung a, *, Florian Segor b a Fraunhofer IOSB, Fraunhoferstr. 1, Karlsruhe, Country address: chen-ko.sung@iosb.fraunhofer.de * address: chen-ko.sung@sung.de b Fraunhofer IOSB, Fraunhoferstr. 1, Karlsruhe, Germany address: florian.segor@iosb.fraunhofer.de Abstract During search and rescue operations in case of man-made or natural disasters the application forces need exact information about the situation as soon as possible. At the Fraunhofer IOSB a security and supervision system is developed which uses varied modern sensor systems for this purpose. Beside land robots, maritime vessels, sensor networks and fixed cameras also miniature flight drones are used to transport the most different payloads and sensors. To gain a higher level of autonomy for these UAVs, different onboard process chains of image exploitation for tracking landmarks and of control technologies for UAV navigation were implemented and examined to achieve a redundant and reliable UAV precision landing. First experiments have allowed to validate the process chains and to develop a demonstration system for the tracking of landmarks in order to prevent and to minimize any confusion on landings. Keyword: AMFIS, mobile sensor carrier systems, adaptive, guiding point, information fusion, landing system, rescue team, automatic landmark tracking 1. Introduction The civil security and supervision system AMFIS was developed at the Fraunhofer IOSB as a mobile support system for rescue forces in accidents or disasters. The system is designed as an open integration hub for a large number of heterogeneous sensors, sensor networks and sensor carriers to support rescue forces optimally. Beside cameras, sensor knots, ground robots, and underwater robots, unmanned aerial vehicles (UAVs) [1] are also used. This concern in most cases vertical take-off and landing (VTOL) systems, which navigate themselves on the basis of the global positioning system (GPS). To gain a higher level of autonomy for these systems different onboard process chains of image exploitation for tracking landmarks and of control technologies for UAV navigation were implemented and examined to achieve a redundant and reliable UAV precision landing.
2 The benefits of onboard process chains are multiple: the data transmission from the UAV to the ground station is reduced and the level of autonomy for UAV operations is increased. The methods used for the automatic landmark tracking are invariant to rotation and scaling. They are efficient, robust, and adaptive regardless of the flight level of the UAV. In this paper, the selected onboard process chains for the automatic landmark tracking, for UAV navigation and for conversion of landmark positions from image coordinates to world coordinates in video sequences are presented. First experiments have allowed to validate the process chains and to develop a demonstration system for the tracking of landmarks in order to prevent and to minimize any confusion on landing. 2. System Overview The security and surveillance system AMFIS developed as a technology demonstrator at the Fraunhofer IOSB is designed as a support system for rescue and emergency units. Assuming that stationary but also highly mobile sensor systems will become more and more relevant in the near future, the system provides a homogeneous an intuitive workspace to simplify the use of heterogeneous systems. To make this possible different attempts are realized and tested. Besides, the reduction of the operating complexity as well as the fusion of data from different data sources to generate a comprehensive situation picture, the construction of the user interfaces plays a central and important role. In addition, an essential factor is the modularity and hence the adaptability of the system. The sensors and sensor carriers used in the technology demonstrator can be seen as a place holder and therefore can be exchanged or complemented very simple to provide a suitable system for different purposes. To test the AMFIS system in different situations and application scenarios it was equipped exemplarily with a rather big range of diverging sensor systems. Primarily EO and IR cameras are used as sensors for surveillance purposes. These sensors are complemented with movement dispatch riders, gas or vibration sensors and a huge number of secondary sensors, like GPS, acceleration sensors or attitude sensors. These sensors are installed either on fixed positions, or are carried by mobile systems to their destination. On this occasion different flight platforms, ground robot, as well as over and under water vessels are used. The ground station allows the application of these different systems by providing the operator always with the same or an only slightly modified interface regardless of the type of the used asset. What is valid for the hardware assets is also considered by the development of the support systems for the operator. Thus, new backend systems can complement the available ones when required or substituted. To guarantee an easy, quick and efficient application of the different subsystems the operator is supported by different backend systems. Work
3 routines which are not necessarily relevant for application or only stress the operator needlessly are simplified as far as possible or completely automated. The aim is to use the integrated mobile systems as autonomous as possible and to process the data stream in such a way that an overflow can be precluded. Especially in case of the miniature flight drones this principle can be used efficiently. A great number of functions which are keeping the UAV alive and deals with the fulfillment of its job can be automated. Collision control, positioning, reaction to certain events up to heading to a desired position or flying over a defined area are done by the ground station when needed which therefore reduces the working load on the operator. A parallel application of different systems becomes possible. Additional intelligent analyzing systems support the work with the incoming data. Video analyzing systems as for example ABUL [2] can be integrated easily and simplify therefore the processing of the data. 3. Application Scenarios The security and surveillance system AMFIS [3] has been developed as an adaptive system of systems to be capable of dealing with a large number of different demands. Besides, changing surroundings, advances in the field of sensor technology and future demands had to be considered on creating the system. Hence, the essential application scenario can become very basically formulated. If in situ sensors and sensor systems are not sufficient or even do not exist to provide enough relevant information about the current situation, the advantages of small sensor carriers in combination with the most different sensors conformist on the situation can take effect. Because particularly UAVs can operate independent from infrastructure like paths or streets and regardless of the state of the ground, their application is examined under a special focus. Sophisticated multi rotor systems are equipped with a large number of sensors which support automatic flight. This allows only a short-term but extremely mobile aerial reconnaissance, in particular by providing a view into threatened or dangerous areas without endangering human life or by creating images of areas which are only very hardly accessible. In addition, the bird's-eye view can be also be used to receive a comprehensive overview about complex situations [4]. Beside the function as a sensor carrier for cameras the aerial systems are also used for the transport of other sensors as for example chemical measuring systems to analyze poisonous materials in the air. Thus, invisible menaces can be more exactly determined and allows a better protection of people and rescue forces. As big as the advantages of an aerial reconnaissance are, as complicated and, however, time-luxurious is the application of flying drones. To make this generally possible the
4 operating complexity has been strongly reduced by the AMFIS ground control station (GCS) and the autonomy of the drones. This is primarily possible because the drones are equipped with GPS systems. The positioning system GPS allows quick automatic starting, a position regulation and the homing, so that no pilot is required in these cases to manually take over control. Though, the landing using GPS is possible, a lot of space is required to provide a secure area on account of the inaccuracy of the GPS. To reduce the positioning error and to provide a UAV capable of a precise automatic landing without any manual intervention a system was designed, which allows real time onboard pattern detection. The detected guiding point is used to improve the positioning of the UAV in world coordinates and to reduce the inaccuracies of the inertial measurement unit (IMU). The hard- and software components used in this landing system are fully integrated into the AMFIS GCS to further reduce the workload on the operators. The following chapters describe the mark-based recognition procedure for positioning. 4. Landmark Detection using an adaptive operation The investigation concentrated on the visual detection of a man-made landmark with a fish-eye lens. For this purpose we assume, that the mark must always be clearly visible from the image sensor, independent of the flight level of the UAV during the in-flight detection process. Numbers and characters are good land marks, because they have a system behind them, and can encode with high information content. For the validation of the process chains and for the development of a demonstration system the character H is used for the mark of the landing site. To test the generality of our algorithm of the landmark detection and pattern recognition, other characters or patterns will be used in the future. Many segmentation methods have been developed and implemented in the past in order to reduce the search area for the detection of target objects [5, 6 and 7]. One of the methods is the so called binarization. An image is first binarized using the method of foreground-background separation. The binarization is performed using one or more threshold-values and creates a black and white image (blob image) as result. The white areas are intended to represent target images and the black areas the background. Crucial for a good binarization according to the respective task is an appropriate threshold setting. Such an adapted threshold determination is generally not trivial, if the gray or color value ranges for the relevant image regions are not known in advance. If an image is binarized with a lower threshold, the foreground gets too many pixels. If the image is binarized with a higher threshold, the target loses its signature or pixels. In our setup we assume that the landmarks have man-made special forms with selected colors. A color-to-gray conversion algorithm converts the color images to gray value images. The colors of a landmark are assigned to higher gray values of a gray value image. The adaptive
5 and selective multi-target method [8] is used to separate the landmarks from the background. Without reducing the original image resolution, for example by Gaussian pyramid, the images are segmented after a binarization and noise reduction. The search areas for the detection of landmarks are therefore drastically reduced to some blobs or regions of interest (ROIs). The blobs are candidates for the detection of a landmark on a landing site in image. Figure 1 shows the selected ROI with his vertices and green bounding box as a detected landmark. 5. Recognization and Inerpretation of Landmark Images The vertices of the blobs (see Figure 1c) are calculated for the correction of pattern distortion caused by the camera pose and fish-eye lens. The image data that lie within the vertices must be transformed back to a standard position with a standard size before the pattern recognition is applied. This step ensures a rotation and scale invariant pattern recognition. Many pattern recognition methods can be used for the interpretation of the transformed regions where the blobs are contained [9]. Knowledge-intensive and intensive learning methodologies do not fit the system requirement because the computational power is low within the flying platform. For the onboard image evaluation a non-compute-intensive process - so-called zigzag method - was developed and applied. This process analyzes how many binary values of relevant parts in the transformed region are correlated with the expected values. If a back-transformed region has a high correlation, this region is recognized as a landmark and interpreted as the capital character "H". The position and rotation of the landmark in the image are calculated from coordinates of their vertices. a) b) c) Figure 1: The search areas for the detection of landmarks are drastically reduced to some blobs or regions of interest (ROIs). a) An original image. b) Blobs after the binarization and noise reduction. c) A selected RIO with his vertices and green bounding box as a detected landmark.
6 6. Results A fish-eye lens must be used sometimes in order to capture more area, because sometimes the activities in the surroundings of the landing site should also be known. In this case the imaged landmarks may be distorted due to the fish-eye lens and rotational motion (see Figure 2). Nevertheless, the distorted landmark can still be correctly detected and recognized at a low height of about 10 meters. That means all parameters in the process chains are well matched for that case. No rectification for distorted images is made because there is no more processing power onboard the UAV. The resolution of the landmark is drastically impaired if the machine ascends to a higher flight level. Figure 3 shows the X- and Y-Positions of the detected and recognized landmark in image over 1000 images with green x. 164 images with unrecognized landmark and 281 images with no landmark are registered with red +. About 16.4% (= 164 / 1000) of input images are unrecognized. Thus the detection rate and the recognition rate is about 83.6%. The results after the rotation and scale-invariant pattern recognition in image sequences are shown by Figure 4. The feature detection and pattern recognition in the process chain are working properly, even when the UAV rotates around the landing site. The center of the recognized pattern is marked with a red circle. Independent of the sensor pose, the position of the landing site also on the image border in images is detected correctly. The image coordinates of the center of the landing site are transferred to world coordinates in order to calculate the UAV pose. Figure 7 shows that the UAV approached the landing site and then flew away. landmark Figure 2: The imaged landmarks may be distorted due to fish-eye lens and rotational motion. The resolution of the landmark is drastically impaired if the machine flies height.
7 Figure 3: The X- and Y-Positions of the detected and recognized landmark over 1000 images are registered with green x. The images with no landmark and unrecognized landmark are registered with red +. Figure 4: The pictures above show the fly maneuver over the landing site. The process chain works well with image sequences that are captured with a fish-eye lens.
8 7. Conclusions and Future Work In this paper we present a system to support rescue forces in disasters or accidents. To provide a better data basis for creating situation awareness different sensor assets are used to generate information. On account of their special qualities, on this occasion, a main focus lies on the application of flying miniature drones. To make their application possible important functions not relevant for application must be automated. For this purpose a concept for onboard pattern recognition for autonomous UAV landing has been presented. The cumulative histogram is used to find out backwards the adaptive threshold value for the detection of pattern images in image sequences. The extracted pattern can be recognized by using a so-called zigzag method. The results of the investigations motivated us to add more characters or patterns and active components. Goals are to develop a system for precision landing using an active landmark that is recognized by the drone, allowing an additional visual control of the air component, including the necessary procedures for the evaluation of multi-sensor image data. 8. References [1] Bürkle, A., Collaborating Miniature Drones for Surveillance and Reconnaissance, Proc. of SPIE Vol. 7480, 74800H, Berlin, Germany, 1-2 September (2009). [2] Heinze, N., Esswein, M., Krüger, W. and Saur, G., Image exploitation algorithms for reconnaissance and surveillance with UAV, Proc. of SPIE Vol. 7668, Airborne intelligence, surveillance, reconnaissance (ISR) systems and applications VII (2010). [3] Leuchter, S., Partmann, T., Berger, L., Blum, E.J. and Schönbein, R., Karlsruhe generic agile ground station, Beyerer J. (ed.), Future Security, 2nd Security Research Conference, Fraunhofer Defense and Security Alliance, (2007). [4] Segor, F., Bürkle, A., Kollmann, M. and Schönbein, R., Instantaneous Autonomous Aerial Reconnaissance for Civil Applications - A UAV based approach to support security and rescue forces, The 6th International Conference on Systems ICONS 2011, St. Maarten, The Netherlands Antilles, January (2011). [5] Sung, C.-K., Extraktion von typischen und komplexen Vorgängen aus einer Bildfolge einer Verkehrsszene, Bunke, H., Kübler, O., Stucki, P. (Hrsg.), Mustererkennung 1988, Informatik-Fachberichte 180, (1988). [6] Navon, E., Miller, O. and Averbuch, A., Color image segmentation based on adaptive local thresholds, Image and Vision Computering, Vol. 23, (2005). [7] Sezgin, M. and Sankur, B., "Survey over image thresholding techniques and quantitative performance evaluation", Journal of Electronic Imaging, Vol. 13, Issue 1, (2004). [8] Sung, C.-K., Adaptive and Selective Multi-Target-Tracker, Proc. of SPIE Vol. 8137, 81370T-1, San Diego, California, USA, 23 August [9] Wood, J., Invariant pattern recognition: a review, Pattern Recognition, Vol. 29, No. 1, 1-17 (1996).
OBSTACLE DETECTION AND COLLISION AVOIDANCE USING ULTRASONIC DISTANCE SENSORS FOR AN AUTONOMOUS QUADROCOPTER
OBSTACLE DETECTION AND COLLISION AVOIDANCE USING ULTRASONIC DISTANCE SENSORS FOR AN AUTONOMOUS QUADROCOPTER Nils Gageik, Thilo Müller, Sergio Montenegro University of Würzburg, Aerospace Information Technology
More informationPractical Results for Buoy-Based Automatic Maritime IR-Video Surveillance
Automatic Maritime IR-Video Surveillance Zigmund Orlov / Wolfgang Krüger / Norbert Heinze Fraunhofer Institute of Optronics, System Technologies and Image Exploitation IOSB Fraunhoferstraße 1, 76131 Karlsruhe
More informationApplying Multisensor Information Fusion Technology to Develop an UAV Aircraft with Collision Avoidance Model
Applying Multisensor Information Fusion Technology to Develop an UAV Aircraft with Collision Avoidance Model by Dr. Buddy H Jeun and John Younker Sensor Fusion Technology, LLC 4522 Village Springs Run
More informationWide-area Motion Imagery for Multi-INT Situational Awareness
Wide-area Motion Imagery for Multi-INT Situational Awareness Bernard V. Brower Jason Baker Brian Wenink Harris Corporation TABLE OF CONTENTS ABSTRACT... 3 INTRODUCTION WAMI HISTORY... 4 WAMI Capabilities
More informationFraunhofer Institute for High frequency physics and radar techniques FHR. Unsere Kernkompetenzen
Fraunhofer Institute for High frequency physics and radar techniques FHR Unsere Kernkompetenzen Unsere Kernkompetenzen KEY TECHnology radar 1 2 ABOUT Fraunhofer FHR As one of the largest radar research
More informationROBOTICS 01PEEQW. Basilio Bona DAUIN Politecnico di Torino
ROBOTICS 01PEEQW Basilio Bona DAUIN Politecnico di Torino What is Robotics? Robotics studies robots For history and definitions see the 2013 slides http://www.ladispe.polito.it/corsi/meccatronica/01peeqw/2014-15/slides/robotics_2013_01_a_brief_history.pdf
More informationZJU Team Entry for the 2013 AUVSI. International Aerial Robotics Competition
ZJU Team Entry for the 2013 AUVSI International Aerial Robotics Competition Lin ZHANG, Tianheng KONG, Chen LI, Xiaohuan YU, Zihao SONG Zhejiang University, Hangzhou 310027, China ABSTRACT This paper introduces
More informationWalking and Flying Robots for Challenging Environments
Shaping the future Walking and Flying Robots for Challenging Environments Roland Siegwart, ETH Zurich www.asl.ethz.ch www.wysszurich.ch Lisbon, Portugal, July 29, 2016 Roland Siegwart 29.07.2016 1 Content
More informationMULTI-LAYERED HYBRID ARCHITECTURE TO SOLVE COMPLEX TASKS OF AN AUTONOMOUS MOBILE ROBOT
MULTI-LAYERED HYBRID ARCHITECTURE TO SOLVE COMPLEX TASKS OF AN AUTONOMOUS MOBILE ROBOT F. TIECHE, C. FACCHINETTI and H. HUGLI Institute of Microtechnology, University of Neuchâtel, Rue de Tivoli 28, CH-2003
More informationWide-Area Motion Imagery for Multi-INT Situational Awareness
Bernard V. Brower (U.S.) Jason Baker (U.S.) Brian Wenink (U.S.) Harris Corporation Harris Corporation Harris Corporation bbrower@harris.com JBAKER27@harris.com bwenink@harris.com 332 Initiative Drive 800
More information* Intelli Robotic Wheel Chair for Specialty Operations & Physically Challenged
ADVANCED ROBOTICS SOLUTIONS * Intelli Mobile Robot for Multi Specialty Operations * Advanced Robotic Pick and Place Arm and Hand System * Automatic Color Sensing Robot using PC * AI Based Image Capturing
More informationLane Detection in Automotive
Lane Detection in Automotive Contents Introduction... 2 Image Processing... 2 Reading an image... 3 RGB to Gray... 3 Mean and Gaussian filtering... 5 Defining our Region of Interest... 6 BirdsEyeView Transformation...
More informationHelicopter Aerial Laser Ranging
Helicopter Aerial Laser Ranging Håkan Sterner TopEye AB P.O.Box 1017, SE-551 11 Jönköping, Sweden 1 Introduction Measuring distances with light has been used for terrestrial surveys since the fifties.
More informationProf. Emil M. Petriu 17 January 2005 CEG 4392 Computer Systems Design Project (Winter 2005)
Project title: Optical Path Tracking Mobile Robot with Object Picking Project number: 1 A mobile robot controlled by the Altera UP -2 board and/or the HC12 microprocessor will have to pick up and drop
More informationHeterogeneous Control of Small Size Unmanned Aerial Vehicles
Magyar Kutatók 10. Nemzetközi Szimpóziuma 10 th International Symposium of Hungarian Researchers on Computational Intelligence and Informatics Heterogeneous Control of Small Size Unmanned Aerial Vehicles
More informationApplying Multisensor Information Fusion Technology to Develop an UAV Aircraft with Collision Avoidance Model
1 Applying Multisensor Information Fusion Technology to Develop an UAV Aircraft with Collision Avoidance Model {Final Version with
More informationNCCT IEEE PROJECTS ADVANCED ROBOTICS SOLUTIONS. Latest Projects, in various Domains. Promise for the Best Projects
NCCT Promise for the Best Projects IEEE PROJECTS in various Domains Latest Projects, 2009-2010 ADVANCED ROBOTICS SOLUTIONS EMBEDDED SYSTEM PROJECTS Microcontrollers VLSI DSP Matlab Robotics ADVANCED ROBOTICS
More informationISTAR Concepts & Solutions
ISTAR Concepts & Solutions CDE Call Presentation Cardiff, 8 th September 2011 Today s Brief Introduction to the programme The opportunities ISTAR challenges The context Requirements for Novel Integrated
More informationThe Oil & Gas Industry Requirements for Marine Robots of the 21st century
The Oil & Gas Industry Requirements for Marine Robots of the 21st century www.eninorge.no Laura Gallimberti 20.06.2014 1 Outline Introduction: fast technology growth Overview underwater vehicles development
More informationThe EDA SUM Project. Surveillance in an Urban environment using Mobile sensors. 2012, September 13 th - FMV SENSORS SYMPOSIUM 2012
Surveillance in an Urban environment using Mobile sensors 2012, September 13 th - FMV SENSORS SYMPOSIUM 2012 TABLE OF CONTENTS European Defence Agency Supported Project 1. SUM Project Description. 2. Subsystems
More informationTeam Kanaloa: research initiatives and the Vertically Integrated Project (VIP) development paradigm
Additive Manufacturing Renewable Energy and Energy Storage Astronomical Instruments and Precision Engineering Team Kanaloa: research initiatives and the Vertically Integrated Project (VIP) development
More informationRobotic Technology for Port and Maritime Automation
Industrial/Service Robots Field Robots Robotic Technology for Port and Maritime Automation Presenter: Assoc Prof Chen I-Ming Director, Robotics Research Center & Intelligent Systems Center School of Mechanical
More informationJager UAVs to Locate GPS Interference
JIFX 16-1 2-6 November 2015 Camp Roberts, CA Jager UAVs to Locate GPS Interference Stanford GPS Research Laboratory and the Stanford Intelligent Systems Lab Principal Investigator: Sherman Lo, PhD Area
More informationIntroduction Objective and Scope p. 1 Generic Requirements p. 2 Basic Requirements p. 3 Surveillance System p. 3 Content of the Book p.
Preface p. xi Acknowledgments p. xvii Introduction Objective and Scope p. 1 Generic Requirements p. 2 Basic Requirements p. 3 Surveillance System p. 3 Content of the Book p. 4 References p. 6 Maritime
More informationAutonomous Mobile Robot Design. Dr. Kostas Alexis (CSE)
Autonomous Mobile Robot Design Dr. Kostas Alexis (CSE) Course Goals To introduce students into the holistic design of autonomous robots - from the mechatronic design to sensors and intelligence. Develop
More informationAuthor s Name Name of the Paper Session. DYNAMIC POSITIONING CONFERENCE October 10-11, 2017 SENSORS SESSION. Sensing Autonomy.
Author s Name Name of the Paper Session DYNAMIC POSITIONING CONFERENCE October 10-11, 2017 SENSORS SESSION Sensing Autonomy By Arne Rinnan Kongsberg Seatex AS Abstract A certain level of autonomy is already
More informationUAV BASED MONITORING SYSTEM AND OBJECT DETECTION TECHNIQUE DEVELOPMENT FOR A DISASTER AREA
UAV BASED MONITORING SYSTEM AND OBJECT DETECTION TECHNIQUE DEVELOPMENT FOR A DISASTER AREA Afzal Ahmed 1, Dr. Masahiko Nagai 2, Dr. Chen Tianen 2, Prof. Ryosuke SHIBASAKI The University of Tokyo Shibasaki
More informationThe Evolution of Nano-Satellite Proximity Operations In-Space Inspection Workshop 2017
The Evolution of Nano-Satellite Proximity Operations 02-01-2017 In-Space Inspection Workshop 2017 Tyvak Introduction We develop miniaturized custom spacecraft, launch solutions, and aerospace technologies
More information1 st IFAC Conference on Mechatronic Systems - Mechatronics 2000, September 18-20, 2000, Darmstadt, Germany
1 st IFAC Conference on Mechatronic Systems - Mechatronics 2000, September 18-20, 2000, Darmstadt, Germany SPACE APPLICATION OF A SELF-CALIBRATING OPTICAL PROCESSOR FOR HARSH MECHANICAL ENVIRONMENT V.
More informationOFFensive Swarm-Enabled Tactics (OFFSET)
OFFensive Swarm-Enabled Tactics (OFFSET) Dr. Timothy H. Chung, Program Manager Tactical Technology Office Briefing Prepared for OFFSET Proposers Day 1 Why are Swarms Hard: Complexity of Swarms Number Agent
More informationIntelligent driving TH« TNO I Innovation for live
Intelligent driving TNO I Innovation for live TH«Intelligent Transport Systems have become an integral part of the world. In addition to the current ITS systems, intelligent vehicles can make a significant
More informationExperimental Cooperative Control of Fixed-Wing Unmanned Aerial Vehicles
Experimental Cooperative Control of Fixed-Wing Unmanned Aerial Vehicles Selcuk Bayraktar, Georgios E. Fainekos, and George J. Pappas GRASP Laboratory Departments of ESE and CIS University of Pennsylvania
More informationROBOTICS ENG YOUSEF A. SHATNAWI INTRODUCTION
ROBOTICS INTRODUCTION THIS COURSE IS TWO PARTS Mobile Robotics. Locomotion (analogous to manipulation) (Legged and wheeled robots). Navigation and obstacle avoidance algorithms. Robot Vision Sensors and
More informationCS 599: Distributed Intelligence in Robotics
CS 599: Distributed Intelligence in Robotics Winter 2016 www.cpp.edu/~ftang/courses/cs599-di/ Dr. Daisy Tang All lecture notes are adapted from Dr. Lynne Parker s lecture notes on Distributed Intelligence
More informationRequirements Specification Minesweeper
Requirements Specification Minesweeper Version. Editor: Elin Näsholm Date: November 28, 207 Status Reviewed Elin Näsholm 2/9 207 Approved Martin Lindfors 2/9 207 Course name: Automatic Control - Project
More informationROBOTICS 01PEEQW. Basilio Bona DAUIN Politecnico di Torino
ROBOTICS 01PEEQW Basilio Bona DAUIN Politecnico di Torino What is Robotics? Robotics is the study and design of robots Robots can be used in different contexts and are classified as 1. Industrial robots
More informationThe Autonomous Robots Lab. Kostas Alexis
The Autonomous Robots Lab Kostas Alexis Who we are? Established at January 2016 Current Team: 1 Head, 1 Senior Postdoctoral Researcher, 3 PhD Candidates, 1 Graduate Research Assistant, 2 Undergraduate
More informationDeveloping a New Type of Light System in an Automobile and Implementing Its Prototype. on Hazards
page Seite 12 KIT Developing a New Type of Light System in an Automobile and Implementing Its Prototype Spotlight on Hazards An innovative new light function offers motorists more safety and comfort during
More informationCEPT Workshop on Spectrum for Drones / UAS. Detection of Drones - Research Project AMBOS - Copenhagen, 29 June 2018
Abwehr von unbemannten Flugobjekten für Behörden und Organisationen mit Sicherheitsaufgaben CEPT Workshop on Spectrum for Drones / UAS Detection of Drones - Research Project AMBOS - Copenhagen, 29 June
More informationQUADROTOR ROLL AND PITCH STABILIZATION USING SYSTEM IDENTIFICATION BASED REDESIGN OF EMPIRICAL CONTROLLERS
QUADROTOR ROLL AND PITCH STABILIZATION USING SYSTEM IDENTIFICATION BASED REDESIGN OF EMPIRICAL CONTROLLERS ANIL UFUK BATMAZ 1, a, OVUNC ELBIR 2,b and COSKU KASNAKOGLU 3,c 1,2,3 Department of Electrical
More informationComputer-Aided Safety and Risk Prevention Pushing collaborative robotics from isolated pilots to large scale deployment
Pushing collaborative robotics from isolated pilots to large scale deployment INRS, Nancy, France J. Saenz, C. Vogel, R. Behrens, E. Schulenburg, C. Walter, N. Elkmann 30.03.2017 Fraunhofer IFF Fraunhofer
More informationCS594, Section 30682:
CS594, Section 30682: Distributed Intelligence in Autonomous Robotics Spring 2003 Tuesday/Thursday 11:10 12:25 http://www.cs.utk.edu/~parker/courses/cs594-spring03 Instructor: Dr. Lynne E. Parker ½ TA:
More informationGPS data correction using encoders and INS sensors
GPS data correction using encoders and INS sensors Sid Ahmed Berrabah Mechanical Department, Royal Military School, Belgium, Avenue de la Renaissance 30, 1000 Brussels, Belgium sidahmed.berrabah@rma.ac.be
More informationSENLUTION Miniature Angular & Heading Reference System The World s Smallest Mini-AHRS
SENLUTION Miniature Angular & Heading Reference System The World s Smallest Mini-AHRS MotionCore, the smallest size AHRS in the world, is an ultra-small form factor, highly accurate inertia system based
More informationMobile Robots (Wheeled) (Take class notes)
Mobile Robots (Wheeled) (Take class notes) Wheeled mobile robots Wheeled mobile platform controlled by a computer is called mobile robot in a broader sense Wheeled robots have a large scope of types and
More informationDetection and classification of turnouts using eddy current sensors
Detection and classification of turnouts using eddy current sensors A. Geistler & F. Böhringer Institut für Mess- und Regelungstechnik, University of Karlsruhe, Germany Abstract New train operating systems,
More informationRicoh's Machine Vision: A Window on the Future
White Paper Ricoh's Machine Vision: A Window on the Future As the range of machine vision applications continues to expand, Ricoh is providing new value propositions that integrate the optics, electronic
More informationAn Agent-based Heterogeneous UAV Simulator Design
An Agent-based Heterogeneous UAV Simulator Design MARTIN LUNDELL 1, JINGPENG TANG 1, THADDEUS HOGAN 1, KENDALL NYGARD 2 1 Math, Science and Technology University of Minnesota Crookston Crookston, MN56716
More informationImage Processing and Particle Analysis for Road Traffic Detection
Image Processing and Particle Analysis for Road Traffic Detection ABSTRACT Aditya Kamath Manipal Institute of Technology Manipal, India This article presents a system developed using graphic programming
More informationIntelligent Sensor Platforms for Remotely Piloted and Unmanned Vehicles. Dr. Nick Krouglicof 14 June 2012
Intelligent Sensor Platforms for Remotely Piloted and Unmanned Vehicles Dr. Nick Krouglicof 14 June 2012 Project Overview Project Duration September 1, 2010 to June 30, 2016 Primary objective(s) / outcomes
More informationKALMAN FILTER APPLICATIONS
ECE555: Applied Kalman Filtering 1 1 KALMAN FILTER APPLICATIONS 1.1: Examples of Kalman filters To wrap up the course, we look at several of the applications introduced in notes chapter 1, but in more
More informationCMRE La Spezia, Italy
Innovative Interoperable M&S within Extended Maritime Domain for Critical Infrastructure Protection and C-IED CMRE La Spezia, Italy Agostino G. Bruzzone 1,2, Alberto Tremori 1 1 NATO STO CMRE& 2 Genoa
More informationFreeMotionHandling Autonomously flying gripping sphere
FreeMotionHandling Autonomously flying gripping sphere FreeMotionHandling Flying assistant system for handling in the air 01 Both flying and gripping have a long tradition in the Festo Bionic Learning
More informationMeasurement Level Integration of Multiple Low-Cost GPS Receivers for UAVs
Measurement Level Integration of Multiple Low-Cost GPS Receivers for UAVs Akshay Shetty and Grace Xingxin Gao University of Illinois at Urbana-Champaign BIOGRAPHY Akshay Shetty is a graduate student in
More informationImage Processing Based Vehicle Detection And Tracking System
Image Processing Based Vehicle Detection And Tracking System Poonam A. Kandalkar 1, Gajanan P. Dhok 2 ME, Scholar, Electronics and Telecommunication Engineering, Sipna College of Engineering and Technology,
More informationTHE modern airborne surveillance and reconnaissance
INTL JOURNAL OF ELECTRONICS AND TELECOMMUNICATIONS, 2011, VOL. 57, NO. 1, PP. 37 42 Manuscript received January 19, 2011; revised February 2011. DOI: 10.2478/v10177-011-0005-z Radar and Optical Images
More informationA Review of Optical Character Recognition System for Recognition of Printed Text
IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 17, Issue 3, Ver. II (May Jun. 2015), PP 28-33 www.iosrjournals.org A Review of Optical Character Recognition
More informationAdvances in Vehicle Periphery Sensing Techniques Aimed at Realizing Autonomous Driving
FEATURED ARTICLES Autonomous Driving Technology for Connected Cars Advances in Vehicle Periphery Sensing Techniques Aimed at Realizing Autonomous Driving Progress is being made on vehicle periphery sensing,
More informationAccurate Automation Corporation. developing emerging technologies
Accurate Automation Corporation developing emerging technologies Unmanned Systems for the Maritime Applications Accurate Automation Corporation (AAC) serves as a showcase for the Small Business Innovation
More informationCognitive robots and emotional intelligence Cloud robotics Ethical, legal and social issues of robotic Construction robots Human activities in many
Preface The jubilee 25th International Conference on Robotics in Alpe-Adria-Danube Region, RAAD 2016 was held in the conference centre of the Best Western Hotel M, Belgrade, Serbia, from 30 June to 2 July
More informationA Solution for Identification of Bird s Nests on Transmission Lines with UAV Patrol. Qinghua Wang
International Conference on Artificial Intelligence and Engineering Applications (AIEA 2016) A Solution for Identification of Bird s Nests on Transmission Lines with UAV Patrol Qinghua Wang Fuzhou Power
More informationCountering Weapons of Mass Destruction (CWMD) Capability Assessment Event (CAE)
Countering Weapons of Mass Destruction (CWMD) Capability Assessment Event (CAE) Overview 08-09 May 2019 Submit NLT 22 March On 08-09 May, SOFWERX, in collaboration with United States Special Operations
More informationUNCLASSIFIED R-1 ITEM NOMENCLATURE FY 2013 OCO
Exhibit R-2, RDT&E Budget Item Justification: PB 2013 Air Force DATE: February 2012 BA 3: Advanced Development (ATD) COST ($ in Millions) Program Element 75.103 74.009 64.557-64.557 61.690 67.075 54.973
More informationSummary of robot visual servo system
Abstract Summary of robot visual servo system Xu Liu, Lingwen Tang School of Mechanical engineering, Southwest Petroleum University, Chengdu 610000, China In this paper, the survey of robot visual servoing
More informationLEARNING FROM THE AVIATION INDUSTRY
DEVELOPMENT Power Electronics 26 AUTHORS Dipl.-Ing. (FH) Martin Heininger is Owner of Heicon, a Consultant Company in Schwendi near Ulm (Germany). Dipl.-Ing. (FH) Horst Hammerer is Managing Director of
More informationTeam KMUTT: Team Description Paper
Team KMUTT: Team Description Paper Thavida Maneewarn, Xye, Pasan Kulvanit, Sathit Wanitchaikit, Panuvat Sinsaranon, Kawroong Saktaweekulkit, Nattapong Kaewlek Djitt Laowattana King Mongkut s University
More informationAutomatic Licenses Plate Recognition System
Automatic Licenses Plate Recognition System Garima R. Yadav Dept. of Electronics & Comm. Engineering Marathwada Institute of Technology, Aurangabad (Maharashtra), India yadavgarima08@gmail.com Prof. H.K.
More informationInternational Conference on Computer, Communication, Control and Information Technology (C 3 IT 2009) Paper Code: DSIP-024
Paper Code: DSIP-024 Oral 270 A NOVEL SCHEME FOR BINARIZATION OF VEHICLE IMAGES USING HIERARCHICAL HISTOGRAM EQUALIZATION TECHNIQUE Satadal Saha 1, Subhadip Basu 2 *, Mita Nasipuri 2, Dipak Kumar Basu
More informationDevelopment of a Sense and Avoid System
Infotech@Aerospace 26-29 September 2005, Arlington, Virginia AIAA 2005-7177 Development of a Sense and Avoid System Mr. James Utt * Defense Research Associates, Inc., Beavercreek, OH 45431 Dr. John McCalmont
More informationSmart License Plate Recognition Using Optical Character Recognition Based on the Multicopter
Smart License Plate Recognition Using Optical Character Recognition Based on the Multicopter Sanjaa Bold Department of Computer Hardware and Networking. University of the humanities Ulaanbaatar, Mongolia
More informationP1.4. Light has to go where it is needed: Future Light Based Driver Assistance Systems
Light has to go where it is needed: Future Light Based Driver Assistance Systems Thomas Könning¹, Christian Amsel¹, Ingo Hoffmann² ¹ Hella KGaA Hueck & Co., Lippstadt, Germany ² Hella-Aglaia Mobile Vision
More informationRECOGNITION OF EMERGENCY AND NON-EMERGENCY LIGHT USING MATROX AND VB6 MOHD NAZERI BIN MUHAMMAD
RECOGNITION OF EMERGENCY AND NON-EMERGENCY LIGHT USING MATROX AND VB6 MOHD NAZERI BIN MUHAMMAD This thesis is submitted as partial fulfillment of the requirements for the award of the Bachelor of Electrical
More informationNAV CAR Lane-sensitive positioning and navigation for innovative ITS services AMAA, May 31 st, 2012 E. Schoitsch, E. Althammer, R.
NAV CAR Lane-sensitive positioning and navigation for innovative ITS services AMAA, May 31 st, 2012 E. Schoitsch, E. Althammer, R. Kloibhofer (AIT), R. Spielhofer, M. Reinthaler, P. Nitsche (ÖFPZ), H.
More informationTarget Recognition and Tracking based on Data Fusion of Radar and Infrared Image Sensors
Target Recognition and Tracking based on Data Fusion of Radar and Infrared Image Sensors Jie YANG Zheng-Gang LU Ying-Kai GUO Institute of Image rocessing & Recognition, Shanghai Jiao-Tong University, China
More informationAutomated Driving Car Using Image Processing
Automated Driving Car Using Image Processing Shrey Shah 1, Debjyoti Das Adhikary 2, Ashish Maheta 3 Abstract: In day to day life many car accidents occur due to lack of concentration as well as lack of
More informationInternational Journal of Informative & Futuristic Research ISSN (Online):
Reviewed Paper Volume 2 Issue 4 December 2014 International Journal of Informative & Futuristic Research ISSN (Online): 2347-1697 A Survey On Simultaneous Localization And Mapping Paper ID IJIFR/ V2/ E4/
More informationREAL-TIME GPS ATTITUDE DETERMINATION SYSTEM BASED ON EPOCH-BY-EPOCH TECHNOLOGY
REAL-TIME GPS ATTITUDE DETERMINATION SYSTEM BASED ON EPOCH-BY-EPOCH TECHNOLOGY Dr. Yehuda Bock 1, Thomas J. Macdonald 2, John H. Merts 3, William H. Spires III 3, Dr. Lydia Bock 1, Dr. Jeffrey A. Fayman
More informationAutomatic License Plate Recognition System using Histogram Graph Algorithm
Automatic License Plate Recognition System using Histogram Graph Algorithm Divyang Goswami 1, M.Tech Electronics & Communication Engineering Department Marudhar Engineering College, Raisar Bikaner, Rajasthan,
More informationAirborne Satellite Communications on the Move Solutions Overview
Airborne Satellite Communications on the Move Solutions Overview High-Speed Broadband in the Sky The connected aircraft is taking the business of commercial airline to new heights. In-flight systems are
More informationTECHNOLOGY DEVELOPMENT AREAS IN AAWA
TECHNOLOGY DEVELOPMENT AREAS IN AAWA Technologies for realizing remote and autonomous ships exist. The task is to find the optimum way to combine them reliably and cost effecticely. Ship state definition
More informationFLCS V2.1. AHRS, Autopilot, Gyro Stabilized Gimbals Control, Ground Control Station
AHRS, Autopilot, Gyro Stabilized Gimbals Control, Ground Control Station The platform provides a high performance basis for electromechanical system control. Originally designed for autonomous aerial vehicle
More information23270: AUGMENTED REALITY FOR NAVIGATION AND INFORMATIONAL ADAS. Sergii Bykov Technical Lead Machine Learning 12 Oct 2017
23270: AUGMENTED REALITY FOR NAVIGATION AND INFORMATIONAL ADAS Sergii Bykov Technical Lead Machine Learning 12 Oct 2017 Product Vision Company Introduction Apostera GmbH with headquarter in Munich, was
More informationHanuman KMUTT: Team Description Paper
Hanuman KMUTT: Team Description Paper Wisanu Jutharee, Sathit Wanitchaikit, Boonlert Maneechai, Natthapong Kaewlek, Thanniti Khunnithiwarawat, Pongsakorn Polchankajorn, Nakarin Suppakun, Narongsak Tirasuntarakul,
More informationTeleoperation Assistance for an Indoor Quadrotor Helicopter
Teleoperation Assistance for an Indoor Quadrotor Helicopter Christoph Hürzeler 1, Jean-Claude Metzger 2, Andreas Nussberger 2, Florian Hänni 3, Adrian Murbach 3, Christian Bermes 1, Samir Bouabdallah 4,
More informationUAV Technologies for 3D Mapping. Rolf Schaeppi Director Geospatial Solutions APAC / India
UAV Technologies for 3D Mapping Rolf Schaeppi Director Geospatial Solutions APAC / India Some main application areas? Market situation Analyst statements billion dollars 7,3 defense market 2,5 civil market
More informationUSE OF IMPROVISED REMOTELY SENSED DATA FROM UAV FOR GIS AND MAPPING, A CASE STUDY OF GOMA CITY, DR CONGO
USE OF IMPROVISED REMOTELY SENSED DATA FROM UAV FOR GIS AND MAPPING, A CASE STUDY OF GOMA CITY, DR CONGO Cung Chin Thang United Nations Global Support Center, Brindisi, Italy, Email: thang@un.org KEY WORDS:
More informationCAPACITIES FOR TECHNOLOGY TRANSFER
CAPACITIES FOR TECHNOLOGY TRANSFER The Institut de Robòtica i Informàtica Industrial (IRI) is a Joint University Research Institute of the Spanish Council for Scientific Research (CSIC) and the Technical
More informationRange Sensing strategies
Range Sensing strategies Active range sensors Ultrasound Laser range sensor Slides adopted from Siegwart and Nourbakhsh 4.1.6 Range Sensors (time of flight) (1) Large range distance measurement -> called
More informationA 3D Gesture Based Control Mechanism for Quad-copter
I J C T A, 9(13) 2016, pp. 6081-6090 International Science Press A 3D Gesture Based Control Mechanism for Quad-copter Adarsh V. 1 and J. Subhashini 2 ABSTRACT Objectives: The quad-copter is one of the
More informationMOD(ATLA) s Technology Strategy
MOD(ATLA) s Technology Strategy These documents were published on August 31. 1. Japan Defense Technology Strategy (JDTS) The main body of MOD(ATLA) s technology strategy 2. Medium-to-Long Term Defense
More informationNumber Plate Recognition System using OCR for Automatic Toll Collection
IJSTE - International Journal of Science Technology & Engineering Volume 2 Issue 10 April 2016 ISSN (online): 2349-784X Number Plate Recognition System using OCR for Automatic Toll Collection Mohini S.Karande
More informationThe Z/I Imaging Digital Aerial Camera System
Hinz 109 The Z/I Imaging Digital Aerial Camera System ALEXANDER HINZ, Oberkochen ABSTRACT With the availability of a digital camera, it is possible to completely close the digital chain from image recording
More informationOughtToPilot. Project Report of Submission PC128 to 2008 Propeller Design Contest. Jason Edelberg
OughtToPilot Project Report of Submission PC128 to 2008 Propeller Design Contest Jason Edelberg Table of Contents Project Number.. 3 Project Description.. 4 Schematic 5 Source Code. Attached Separately
More informationCOGNITIVE MODEL OF MOBILE ROBOT WORKSPACE
COGNITIVE MODEL OF MOBILE ROBOT WORKSPACE Prof.dr.sc. Mladen Crneković, University of Zagreb, FSB, I. Lučića 5, 10000 Zagreb Prof.dr.sc. Davor Zorc, University of Zagreb, FSB, I. Lučića 5, 10000 Zagreb
More informationSituational Awareness A Missing DP Sensor output
Situational Awareness A Missing DP Sensor output Improving Situational Awareness in Dynamically Positioned Operations Dave Sanderson, Engineering Group Manager. Abstract Guidance Marine is at the forefront
More informationImproving registration metrology by correlation methods based on alias-free image simulation
Improving registration metrology by correlation methods based on alias-free image simulation D. Seidel a, M. Arnz b, D. Beyer a a Carl Zeiss SMS GmbH, 07745 Jena, Germany b Carl Zeiss SMT AG, 73447 Oberkochen,
More informationDesign of a Remote-Cockpit for small Aerospace Vehicles
Design of a Remote-Cockpit for small Aerospace Vehicles Muhammad Faisal, Atheel Redah, Sergio Montenegro Universität Würzburg Informatik VIII, Josef-Martin Weg 52, 97074 Würzburg, Germany Phone: +49 30
More informationMAV-ID card processing using camera images
EE 5359 MULTIMEDIA PROCESSING SPRING 2013 PROJECT PROPOSAL MAV-ID card processing using camera images Under guidance of DR K R RAO DEPARTMENT OF ELECTRICAL ENGINEERING UNIVERSITY OF TEXAS AT ARLINGTON
More informationToward autonomous airships: research and developments at LAAS/CNRS
Toward autonomous airships: research and developments at LAAS/CNRS Simon LACROIX LAAS / CNRS 7, Ave du Colonel Roche F-31077 TOULOUSE Cedex FRANCE E-mail: Simon.Lacroix@laas.fr Phone: +33 561 33 62 66
More informationFace Detection using 3-D Time-of-Flight and Colour Cameras
Face Detection using 3-D Time-of-Flight and Colour Cameras Jan Fischer, Daniel Seitz, Alexander Verl Fraunhofer IPA, Nobelstr. 12, 70597 Stuttgart, Germany Abstract This paper presents a novel method to
More information