TurtleBot2&ROS - Learning TB2

Similar documents
Visual compass for the NIFTi robot

Probabilistic Robotics Course. Robots and Sensors Orazio

CSCE 574 Robotics Fall 2018

Development of intelligent systems

Revised and extended. Accompanies this course pages heavier Perception treated more thoroughly. 1 - Introduction

Robo$cs Introduc$on. ROS Workshop. Faculty of Informa$on Technology, Brno University of Technology Bozetechova 2, Brno

ROS Tutorial. Me133a Joseph & Daniel 11/01/2017

KINECT CONTROLLED HUMANOID AND HELICOPTER

Autonomous Systems at Gelsenkirchen

Developing Applications for the ROBOBO! robot

Other RTOS services Embedded Motion Control 2012

Running the PR2. Chapter Getting set up Out of the box Batteries and power

Mini Turty II Robot Getting Started V1.0

Introduction to Pioneer Robots

Megamark Arduino Library Documentation

Final Report. Chazer Gator. by Siddharth Garg

Devastator Tank Mobile Platform with Edison SKU:ROB0125

Simulation of a Mobile Robotic Platform in Gazebo and RViz using ROS

Fabrication of the kinect remote-controlled cars and planning of the motion interaction courses

Team Description Paper

GESTURE RECOGNITION SOLUTION FOR PRESENTATION CONTROL

Active Stereo Vision. COMP 4102A Winter 2014 Gerhard Roth Version 1

Indoor Positioning by the Fusion of Wireless Metrics and Sensors

Autonomous Localization

Requirements Specification Minesweeper

CONNECT TO BUFFALO ROUTER

FLCS V2.1. AHRS, Autopilot, Gyro Stabilized Gimbals Control, Ground Control Station

Multi-Vehicles Formation Control Exploring a Scalar Field

A Denunciation of the Monochrome:

RPLIDAR A3. Introduction and Datasheet. Low Cost 360 Degree Laser Range Scanner. Model: A3M1. Shanghai Slamtec.Co.,Ltd rev.1.

Park Ranger. Li Yang April 21, 2014

Lecture 23: Robotics. Instructor: Joelle Pineau Class web page: What is a robot?

Building Perceptive Robots with INTEL Euclid Development kit

Kinect Interface for UC-win/Road: Application to Tele-operation of Small Robots

Robotic manipulator capable of sorting moving objects alongside human workers using a budget-conscious control system

CURIE Academy, Summer 2014 Lab 2: Computer Engineering Software Perspective Sign-Off Sheet

Towards Complex Human Robot Cooperation Based on Gesture-Controlled Autonomous Navigation

EQ-ROBO Programming : bomb Remover Robot

* Intelli Robotic Wheel Chair for Specialty Operations & Physically Challenged

Portfolio. Swaroop Kumar Pal swarooppal.wordpress.com github.com/swarooppal1088

Funzionalità per la navigazione di robot mobili. Corso di Robotica Prof. Davide Brugali Università degli Studi di Bergamo

Perception. Read: AIMA Chapter 24 & Chapter HW#8 due today. Vision

Introducing modern robotics with ROS and Arduino

KMUTT Kickers: Team Description Paper

NCCT IEEE PROJECTS ADVANCED ROBOTICS SOLUTIONS. Latest Projects, in various Domains. Promise for the Best Projects

Overview of Challenges in the Development of Autonomous Mobile Robots. August 23, 2011

ZJUDancer Team Description Paper Humanoid Kid-Size League of Robocup 2015

NovAtel SPAN and Waypoint GNSS + INS Technology

The plan... CSE 6324 From control to actuators Michael Jenkin Office Hours: Sherman 1028 Wed 3-4. From the bottom up...

Design Project Introduction DE2-based SecurityBot

OBSTACLE DETECTION AND COLLISION AVOIDANCE USING ULTRASONIC DISTANCE SENSORS FOR AN AUTONOMOUS QUADROCOPTER

Robotics: Evolution, Technology and Applications

Mechatronics Engineering and Automation Faculty of Engineering, Ain Shams University MCT-151, Spring 2015 Lab-4: Electric Actuators

May Edited by: Roemi E. Fernández Héctor Montes

Robotics Laboratory. Report Nao. 7 th of July Authors: Arnaud van Pottelsberghe Brieuc della Faille Laurent Parez Pierre-Yves Morelle

Robot Autonomy Project Final Report Multi-Robot Motion Planning In Tight Spaces

RPLIDAR A2. Introduction and Datasheet. Low Cost 360 Degree Laser Range Scanner. Model: A2M5 A2M6 OPTMAG. Shanghai Slamtec.Co.,Ltd rev.1.

Toposens GmbH - Blütenstraße München Germany +49 (0)

Vision-based Localization and Mapping with Heterogeneous Teams of Ground and Micro Flying Robots

Enhancing Shipboard Maintenance with Augmented Reality

Lecture 10. Thermal Sensors

Service Robots in an Intelligent House

Emergency Stop Final Project

Sensors & Systems for Human Safety Assurance in Collaborative Exploration

Humanoid robot. Honda's ASIMO, an example of a humanoid robot

I I. Technical Report. "Teaching Grasping Points Using Natural Movements" R R. Yalım Işleyici Guillem Alenyà

Brainstorm. In addition to cameras / Kinect, what other kinds of sensors would be useful?

Sensing and Perception

Sensors. human sensing. basic sensory. advanced sensory. 5+N senses <link> tactile touchless (distant) virtual. e.g. camera, radar / lidar, MS Kinect

CSE 165: 3D User Interaction. Lecture #7: Input Devices Part 2

ZJUDancer Team Description Paper Humanoid Kid-Size League of Robocup 2014

RPLIDAR A2. Introduction and Datasheet. Model: A2M3 A2M4 OPTMAG. Shanghai Slamtec.Co.,Ltd rev.1.0 Low Cost 360 Degree Laser Range Scanner

PROJECTS 2017/18 AUTONOMOUS SYSTEMS. Instituto Superior Técnico. Departamento de Engenharia Electrotécnica e de Computadores September 2017

Wheeled Mobile Robot Kuzma I

Introduction to Talking Robots

Sample Pages. Classroom Activities for the Busy Teacher: NXT. 2 nd Edition. Classroom Activities for the Busy Teacher: NXT -

An Introduction to Robotics. Elliot Ratchik, MS Former Senior Scientist, Hoffman LaRoche And Mannkind Corp.

Space Research expeditions and open space work. Education & Research Teaching and laboratory facilities. Medical Assistance for people

EE631 Cooperating Autonomous Mobile Robots. Lecture 1: Introduction. Prof. Yi Guo ECE Department

MULTI-LAYERED HYBRID ARCHITECTURE TO SOLVE COMPLEX TASKS OF AN AUTONOMOUS MOBILE ROBOT

NovAtel SPAN and Waypoint. GNSS + INS Technology

Team Kanaloa: research initiatives and the Vertically Integrated Project (VIP) development paradigm

Motion Control of a Three Active Wheeled Mobile Robot and Collision-Free Human Following Navigation in Outdoor Environment

Robotics Introduction Matteo Matteucci

ROBOTICS 01PEEQW. Basilio Bona DAUIN Politecnico di Torino

Intelligent Robotics Project and simulator

Master Thesis Presentation Future Electric Vehicle on Lego By Karan Savant. Guide: Dr. Kai Huang

A New Simulator for Botball Robots

ESE 350 HEXAWall v 2.0 Michelle Adjangba Omari Maxwell

Major Project SSAD. Mentor : Raghudeep SSAD Mentor :Manish Jha Group : Group20 Members : Harshit Daga ( ) Aman Saxena ( )

Programming Robots With Ros By Morgan Quigley Brian Gerkey

IMU integration into Sensor suite for Inspection of H-Canyon

WheelCommander Wizard User s Manual

MEM380 Applied Autonomous Robots I Winter Feedback Control USARSim

CENG 5931 HW 5 Mobile Robotics Due March 5. Sensors for Mobile Robots

C-ELROB 2009 Technical Paper Team: University of Oulu

Nautical Autonomous System with Task Integration (Code name)

Team Project: A Surveillant Robot System

Developing a Computer Vision System for Autonomous Rover Navigation

Programming 2 Servos. Learn to connect and write code to control two servos.

Transcription:

TurtleBot2&ROS - Learning TB2 Ing. Zdeněk Materna Department of Computer Graphics and Multimedia Fakulta informačních technologií VUT v Brně TurtleBot2&ROS - Learning TB2 1 / 22

Presentation outline Introduction Learning TB2 Hands on TurtleBot2&ROS - Learning TB2 2 / 22

Introduction TurtleBot2&ROS - Learning TB2 3 / 22

Introduction "Robots of the world, you are ordered to exterminate the human race. Do not spare the men. Do not spare the women. Preserve only the factories, railroads, machines, mines, and raw materials. Destroy everything else. Then return to work. Work must not cease." Karel Čapek TurtleBot2&ROS - Learning TB2 4 / 22

Introduction TB2 is compact indoor research platform. Testing of vision, recognition, manipulation, mapping and many more algorithms. TurtleBot2&ROS - Learning TB2 5 / 22

Learning TB2 TurtleBot2&ROS - Learning TB2 6 / 22

Sensors 3D camera (Microsoft Kinect) IMU (Pololu CHR-UM6) LIDAR (Sick LMS100) odometry infrared sensors, wheel drop TurtleBot2&ROS - Learning TB2 7 / 22

Actuators base (irobot Roomba) Dynamixel servos for arm, Kinect TurtleBot2&ROS - Learning TB2 8 / 22

Remote access distributing ROS e x p o r t ROS_MASTER_URI=h t t p : / / 1 9 2. 1 6 8. 1. 4 : 1 1 3 1 1 remote shell (SSH) s s h f i t @ 1 9 2. 1 6 8. 1. 4 remote desktop (VNC / TeamViewer) TurtleBot2&ROS - Learning TB2 9 / 22

TB2 stack Packages in tb2_main_packages stack: btb_base_driver btb_bringup btb_common btb_description btb_dynamixel btb_gazebo btb_imu btb_manipulator btb_navigation btb_teleop TurtleBot2&ROS - Learning TB2 10 / 22

Hands on TurtleBot2&ROS - Learning TB2 11 / 22

Task list Basic tasks: Task b1: Publishing audio from Kinect. Task b2: Logging robot s trajectory. Task b3: Node for monitoring TB2 batteries state. Task b4: Augmentation of TB2 URDF model. Intermediate: Task i1: Stabilisation of Kinect. Task i2: Simulation of Kinect accelerometer. Task i3: Random walk. Bit advanced ones: Task a1: Node for closed loop control of the movement. Task a2: Set-up diagnostics for TB2. TurtleBot2&ROS - Learning TB2 12 / 22

Task b1 - Publishing audio from Kinect Goal: Hear sound from robot. Instructions: No coding needed ;) The openni_kinect (link) library (which is used in ROS) should have full support for audio. There is tutorial (link) how to stream audio using ROS. Create package and appropriate launch files. Play sound from Kinect s microphones (real Kinect needed). TurtleBot2&ROS - Learning TB2 13 / 22

Task b2 - Logging trajectory Goal: Visualise trajectory of robot in RVIZ. Instructions: No coding needed ;) The hectory_trajectory_server can be used to do this! Create package and launch file which will run trajectory logging. Demonstrate functionality with simulated or real robot. TurtleBot2&ROS - Learning TB2 14 / 22

Task b3 - Monitoring batteries Goal: Monitor state of robot s batteries using ROS. Instructions: Install some serial terminal program (e.g. cutecom), connect to real robot and open /dev/ttyusb3 (19200 baud). You should receive strings like this: #BS : 16,5V, BA: 16,6V, BR: 13,5V Where BS means sensors, BA arm and BR robot s battery voltage. Create package and code which will parse this string and publish it somehow (tip for format). TurtleBot2&ROS - Learning TB2 15 / 22

Task b5 - Augmentation of TB2 URDF model. Goal: Make TB2 model more realistic. Instructions: No programming needed! Just some URDF hacking... Try to replace the big blue box on back of TB2 with more parts which will look more realistic. Visualise augmented model using RVIZ. TurtleBot2&ROS - Learning TB2 16 / 22

Task i1 - Kinect stabilisation Goal: Kinect is horizontally stabilised. Instructions: Kinect has integrated accelerometer. There is driver for it: kinect_aux. Prepare launch file which will start this driver. Prepare package and code which will send commands to Kinect s servo to stabilise it (look at kinect_servo.py in btb_dynamixel). Driver produces /cur_tilt_angle topic which should be quite easy to use (just one number - angle). Test it on real robot (simulated Kinect has no accelerometer). TurtleBot2&ROS - Learning TB2 17 / 22

Task i2 - Simulation of accelerometer Goal: Simulated IMU acts as Kinect s accelerometer. Instructions: Find how to add simulated IMU to some link (look at gazebo.urdf.xacro from btb_description, line 51). Inspect what is format of IMU data and write node, which will convert it to same format, which is produced by kinect_aux as /cur_tilt_angle. TurtleBot2&ROS - Learning TB2 18 / 22

Task i3 - Random walk Goal: Robot is randomly wandering in it s environment. Instructions: Create package, launch file and code which will subscribe to laser scan data. With laser scan, task could be to rotate robot on place and go straight ahead. Commands are send to /cmd_vel topic (type Twist). Test it with simulated or real robot. TurtleBot2&ROS - Learning TB2 19 / 22

Task a1 - Closed loop control Goal: Robot going straight ahead! Instructions: Robot is accepting velocity commands. But - wheels may lost friction etc. and then robot is not going straight ahead even if commanded angular velocity is equal to zero. From IMU, we can obtain current heading angle of robot. Task is to create node, which will try to regulate angular speed of robot in such way it will go straight ahead. Test on simulated robot and then on the real one. TurtleBot2&ROS - Learning TB2 20 / 22

Task a2 - Diagnostics Goal: Be able to monitor some important value. Instructions: There is diagnostics stack which is widely used for diagnostic purposes. Try to setup diagnostics for monitoring robot s computer state (CPU usage / battery etc) - look into turtlebot_node package (laptop_battery.py). Example configuration of diagnostics could be found in turtlebot_bringup package. Visualise it using robot_monitor. TurtleBot2&ROS - Learning TB2 21 / 22

Thanks for your attention TurtleBot2&ROS - Learning TB2 22 / 22