BEST2015 Autonomous Mobile Robots Lecture 1: Introduction Renaud Ronsse renaud.ronsse@uclouvain.be École polytechnique de Louvain, UCLouvain July 2015 1 Université catholique de Louvain Raised in 1425. Oldest university of the Benelux. Prestigious alumni: Erasmus (1502), Vésale (1530), Georges Lemaître (1930), Christian de Duve (Nobel price in 1974), etc... 1864: Creation of special engineering schools. 2
Université catholique de Louvain Late 60 s - early 70 s: linguistic troubles in Belgium splitting of the university in two distinct universities: KULeuven (Flemish, Leuven), and Université catholique de Louvain (Frenchspeaking, Louvain-la-Neuve and Brussels). 3 Université catholique de Louvain 4
Studying robotics at UCL Master in mechatronics. All course given in English, starting in 2015: http://www.uclouvain.be/en-prog-2015-elme2m 5 Research in robotics at UCL Center for Research in Energy and Mechatronics: http://www.cerem.be 6
Research in robotics at UCL Center for Research in Energy and Mechatronics: Raised in 2003 6 professors and about 35 staff members 4 research fields: Electrical Power Systems Medical and Bio- Robotics Multibody and Multiphysic Modeling Optimal Design Approaches 7 Medical robotics @ CEREM 8
Medical robotics @ CEREM Surgical robotics Active scope-holder for laparoscopic surgery EVOLAP 9 Medical robotics @ CEREM Rehabilitation robotics (upper-limb): Spin-off project: Axinesis 10
Medical robotics @ CEREM Ankle prosthesis: c MCBF 2015 11 Medical robotics @ CEREM Rehabilitation robotics (lower-limb): CYBERLEGs project (FP7) 02/2012-01/2015. www.cyberlegs.eu 12
Humanoid robotics @ CEREM: WALK-MAN project (FP7) Joint work with EPFL. 09/2013-08/2017. www.walk-man.eu 13 Robotics is a field/discipline requiring integration main objective of this course. 14
1 Université catholique de Louvain 2 Example of Tasks 3 Learning outcomes, implementation, evaluation 4 History of Robotics 5 Examples of industrial robots 6 Future Trends in Robotics 7 Examples of service robots 8 Typical features of industrial and service robots 9 References 15 Example of Task mobile robot c Siegwart et al., 2011, Fig. 5.6, p. 276 Move the robot from A to B, while keeping track of own position localization. 16
Example of Task industrial robot c Spong et al., 2006, Fig. 1.19, p. 20 Move the manipulator from home to A, then follow the surface S at constant velocity, while maintaining a prescribed force F normal to the surface (cutting, grinding, painting). 17 What do we need to solve? Forward Kinematics: describe positions in a common coordinate system (world coordinate) c Spong et al., 2006, Fig. 1.20, p. 21 c Siegwart et al., 2011, ETH-Z lecture slides x = f x (θ 1, θ 2 )? y = f y (θ 1, θ 2 )? Geometry in space, trigonometry 18
What do we need to solve? Inverse Kinematics: θ 1 = f θ1 (x, y)? θ 2 = f θ2 (x, y)? Not a unique solution in general... c Spong et al., 2006, Fig. 1.21, p. 22 Geometry in space, trigonometry 19 What do we need to solve? Velocity Kinematics: ẋ = fẋ(θ 1, θ 2, θ 1, θ 2 )? ẏ = fẏ(θ 1, θ 2, θ 1, θ 2 )? The relationships ẋ = J θ is linear, where J is called the Jacobian. Inverse: θ = J 1ẋ. When det J = 0, singularity. Example: c Spong et al., 2006, Fig. 1.23, p. 25 Mathematics, linear algebra 20
What do we need to solve? Path Planning and Trajectory Generation Independent Joint Control: c Bajd et al., 2010, Fig. 6.2, p. 71 Mathematics, linear algebra c Spong et al., 2006, Fig. 1.24, p. 26 Linear control 21 What do we need to solve? Dynamics: characterize the dynamical coupling between the links: D(q) q + C(q, q) q + g(q) = τ and take the actuators into account: J m θm + B m θm = u m where θ m = rq m. Mechanics, electrical eng. 22
What do we need to solve? Multivariable Control: Advanced control taking the dynamic interactions into account. System dynamics, (non)linear control Force Control: Requires to measure the interface force (force sensor). Hybrid control, impedance control. System dynamics, (non)linear control Computer Vision and Vision-based Control: Towards autonomous robots... Computer sciences, (non)linear control Electromechanical design: Selection of sensors, actuators, etc... Electromechanics, electronics 23 1 Université catholique de Louvain 2 Example of Tasks 3 Learning outcomes, implementation, evaluation 4 History of Robotics 5 Examples of industrial robots 6 Future Trends in Robotics 7 Examples of service robots 8 Typical features of industrial and service robots 9 References 24
Learning outcomes At the end of this course, you will be able to: Derive a kinematic model of a simple mobile robot. Propose a trajectory planning method, and some classical localization and control approaches, taking this model into account. Implement fundamental concepts like localization and trajectory planning to the particular field of mobile robotics, both in a simulation environment and on a real robot. but also... Conduct on an ambitious group project in less than one week! 25 Schedule Wed, July 22, 2015 Thu, July 23, 2015 Fri, July 24, 2015 Sat, July 25, 2015 Sun, July 26, 2015 Mon, July 27, 2015 Lab: speed control and Lecture: Mobile Robot 9:00-10:45 Lecture: introduction Lab: transfer to the real robot odometry Planning and Navigation 10:00-12:45 Lab: first trial of 10:45-11:00 Break Break Break Break transfer to the real robot Lecture: Mobile Robot Lab: calibration and beacon Lab: calibration and beacon Lecture: humanoid robot and 11:00-12:45 Kinematics and Control localization (1/2) localization (2/2) course wrap-up 12:45-14:00 Lunch break Lunch break Lunch break No class Lab: path planning and 14:00-15:45 Lab: project kick-off integration (1/2) Visit of a company: Belrobotics No class No class 15:45-16:00 Break Break http://www.belrobotics.com Lecture: Mobile Robot Lab: path planning and 16:00-17:45 Localization integration (2/2) 26
Commitment One problem-based learning (PBL) project, about trajectory planning and low-level control of a mobile robot: Speed control Localization Odometry Calibration Obstacle detection Potential field path planning Groups of 4-5 students. Collaborations are moderately allowed! 27 Support One main reference books: Introduction to Autonomous Mobile Robots (2nd Edition) Siegwart et al.; The MIT Press, 2011 http://www.mobilerobots.ethz.ch http://www.amazon.fr/introduction-autonomous-mobile-robots-2e/ dp/0262015358 (minimum: about 40e) The bible of robotics is also worth being mentioned: Springer Handbook of Robotics Siciliano and Khatib (Eds.); Springer, 2008 Available on-line from the UCL network! 28
Support Teaching staff: Renaud Ronsse renaud.ronsse@uclouvain.be http://perso.uclouvain.be/renaud.ronsse/ Nicolas Van der Noot François Heremans Victor de Beco On-line resource: http://perso.uclouvain.be/renaud.ronsse/teach.html Lecture slides. Project statement. 29 Evaluation No report is due for the project but a group mark will be awarded at the end of the project, depending on the robot performances and the group dedication: A: outstanding performance, the group went much beyond our expectations B: very good performance, the group covered all segments of the project and achieve very good performances C: good performance, the group covered all segments of the project and achieve normal performances D: normal performance, the group covered most segments of the project and achieve normal performances F: failed, the group did not manage to get through the project on a satisfying way Obtaining more than a F is conditioned to attending all of the lectures! 30
1 Université catholique de Louvain 2 Example of Tasks 3 Learning outcomes, implementation, evaluation 4 History of Robotics 5 Examples of industrial robots 6 Future Trends in Robotics 7 Examples of service robots 8 Typical features of industrial and service robots 9 References 31 Where does the word robot come from? 1 From the Japanese word robota = very efficient automation. 2 From the abbreviation Rendering Original Behavior along Optimal Trajectories. 3 From a Czech drama in the early 20 s. Make your choice... 32
Where does the word robot come from? 3 From a Czech drama in the early 20 s. Make your choice... 33 Rossum s Universal Robots Karel Čapek, 1921. Robot = artificial human being which is a brilliant worker, deprived of all unnecessary qualities: feelings, creativity and capacity for feeling pain. Robots are not people. They are mechanically more perfect than we are, they have an astounding intellectual capacity, but they have no soul. The creation of an engineer is technically more refined than the product of nature. robota = subordinate labour 34
Robots in science-fiction Isaac Asimov, Runaround (1942): 1 A robot may not injure a human being or, through inaction, allow a human being to come to harm. 2 A robot must obey the orders given to it by human beings, except where such orders would conflict with the First Law. 3 A robot must protect its own existence as long as such protection does not conflict with the First or Second Laws. Introduction of the term robotics, as a new field/science. 35 Robots in science-fiction Google image, October 13th, 2014. 36
Industrial robot Born out of the marriage of two earlier technologies: 1 Teleoperators: master-slave devices to handle radioactive materials (2nd WW); 2 Numerically controlled milling machines, or Computer numerical control (CNC) machines: precise machining of mechanical components (e.g. aircrafts). First industrial robot: Unimate, General Motors, 1961 37 Robot Manipulator Robot manipulator = robot arm + robot wrist + robot gripper c Bajd et al., 2010, Fig. 1.4, p. 4 Task: place the object grasped by the gripper into an arbitrary pose. 38
Robot Arm Serial chain of (at least) 3 rigid bodies (segments). Connected through robot joints (either rotational/revolute or translational/prismatic). c Spong et al., 2006, Fig. 1.3, p. 5 Each joint = one DOF (usually). Classical notation: angle θ (revolute) and distance d (prismatic). 39 Different configurations of robot arm 3 DOFs, with parallel or perpendicular axis 36 configurations. 5 are found on the market: Anthropomorphic Spherical SCARA Cylindrical c Bajd et al., 2010, Figs. 1.6 to 1.10, pp. 5-7 Cartesian 40
Different configurations Anthropomorphic (or articulated, or revolute, or elbow): ±67% of the market. c Spong et al., 2006, Fig. 1.9, p. 13 / ABB IRB1400 41 Different configurations SCARA (Selected Compliance Assembly Robot Arm) manipulator: c Spong et al., 2006, Figs. 1.13 and 1.14, pp. 15-16 / Adept Cobra Smart 600 Tailored for assembly operations (e.g. pick-and-place). 42
Different configurations Cartesian manipulator (gantry): c Spong et al., 2006, Fig. 1.16, p. 17 / Epson Cartesian Robot ±21% of the market. Simplest kinematic and dynamic description. 43 Typical workspaces taking actuator limits into account Anthropomorphic (top) Spherical (a) SCARA (b) Cylindrical (c) Cartesian (d) c Spong et al., 2006, Figs. 1.10 and 1.17, pp. 13 and 18 44
Revolute or prismatic joint? c Spong et al., 2006, Fig. 1.5, p. 10 Revolute joints occupy a smaller working volume and are better able to maneuver around obstacles, but induce large kinematic and dynamic coupling between segments. 45 Parallel robots Some subsets of the links form a closed chain. c Spong et al., 2006, Fig. 1.18, p. 19 / ABB IRB940 Tricept Advantages? 46
47 Robot wrist Most common wrist: spherical wrist, 3 revolute joints, whose axes intersect at a common point. c Spong et al., 2006, Fig. 1.6, p. 11 effectively decouples the position (arm) and orientation (wrist) of the end effector. 48
Robot griper = robot end-effector = robot hand = robot tool... Simplest... to more complex: c Spong et al., 2006, Figs. 1.7 and 1.8, pp. 11-12 49 Robot griper Ishikawa Komuro Lab (University of Tokyo) 50
Standards in (industrial) robotics Three basic international robotic standards: ISO 9946: characteristics of industrial robot manipulators; ISO 9787: Coordinate Systems and Motions; ISO 9283: performance criteria and methods for testing of industrial robot manipulators. Getting an ISO standard is not free: ISO 9946 costs CHF 86.00, ISO 9787 costs CHF 66.00, and ISO 9283 costs CHF 162.00 (May 2nd, 2012). http://www.iso.org 51 Timeline (Spong et al., 2006) 1947 - The first servoed electric powered teleoperator is developed. 1948 - A teleoperator is developed incorporating force feedback. 1949 - Research on numerically controlled milling machine is initiated. 1954 - George Devol designs the first programmable robot. 1956 - Joseph Engelberger, a Columbia University physics student, buys the rights to Devol s robot and founds the Unimation Company. 1961 - The first Unimate robot is installed in at Trenton, New Jersey plant of General Motors to tend a die casting machine. 1961 - The first robot incorporating force feedback is developed. 1963 - The first robot vision system is developed. 52
Timeline (Spong et al., 2006) 1971 - The Stanford Arm is developed at Stanford University. 1973 - The first robot programming language (WAVE) is developed at Stanford. 1974 - Cincinnati Milacron introduced the T 3 robot with computer control. 1975 - Unimation Inc. registers its first financial profit. 1976 - The Remote Center Compliance (RCC) device for part insertion in assembly is developed at Draper Labs in Boston. 1976 - Robot arms are used on the Viking I and II space probes and land on Mars. 1978 - Unimation introduces the PUMA robot, based on designs from a General Motors study. 1979 - The SCARA robot design is introduced in Japan. 53 Timeline (Spong et al., 2006) 1981 - The first direct-drive robot is developed at Carnegie-Mellon University. 1982 - Fanuc of Japan and General Motors form GM Fanuc to market robots in North America. 1983 - Adept Technology is founded and successfully markets the diret-drive robot. 1986 - The underwater robot, Jason, of the Woods Hole Oceanographic Institute, explores the wreck of the Titanic, found a year earlier by Dr. Robert Barnard. 1988 - Stäubli Group purchases Unimation from Westinghouse. 1988 - The IEEE Robotics and Automation Society is formed. 54
Timeline (Spong et al., 2006) 1993 - The experimental robot, ROTEX, of the German Aerospace Agency (DLR) was flown aboard the space shuttle Columbia and performed a variety of tasks under both teleoperated and sensor-based offline programmed modes. 1996 - Honda unveils its Humanoid robot; a project begun in secret in 1986. 1997 - The first robot soccer competition, RoboCup-97, is held in Nagoya, Japan and draws 40 teams from around the world. 1997 - The Sojourner mobile robot travels to Mars aboard NASA s Mars PathFinder mission. 2001 - Sony begins to mass produce the first household robot, a robot dog named Aibo. 2001 - The Space Station Remote Manipulation System (SSRMS) is launched in space on board the space shuttle Endeavor to facilitate continued construction of the space station. 55 Timeline (Spong et al., 2006) 2001 - The first telesurgery is performed when surgeons in New York perform a laparoscopic gall bladder removal on a woman in Strasbourg, France. 2001 - Robots are used to search for victims at the World Trade Center site after the September 11th tragedy. 2002 - Honda s Humanoid Robot ASIMO rings the opening bell at the New York Stock Exchange on February 15th. 2005 - ROKVISS (Robotic Component Verification on board the International Space Station), the experimental teleoperated arm built by the German Aerospace Center (DLR), undergoes its first tests in space.... 2011 - The International Consortium on Rehabilitation Robotics is formed. 56
1 Université catholique de Louvain 2 Example of Tasks 3 Learning outcomes, implementation, evaluation 4 History of Robotics 5 Examples of industrial robots 6 Future Trends in Robotics 7 Examples of service robots 8 Typical features of industrial and service robots 9 References 57 Examples Industrial applications: manipulation (pick-and-place) assembly spray painting and coating arc welding spot welding with pneumatic or servo-controlled gun laser cutting and welding gluing and sealing mechanical finishing operations (deburring, grinding) 58
Examples Very fancy robots ABB IRB 7600 (youtube) 59 Examples Cooperating Arc Welding Cooperating KUKA Robots (youtube) 60
Examples Windshields deburring R-2000iA handling windshields (youtube) 61 Examples Parallel robot ABB Flex Picker (youtube) 62
Examples SCARA robot Adept Cobra Fastest SCARA Robot (youtube) 63 Examples Also out of the industry... KUKA Robot Universal Studio L.A. The Fast and the Furious (youtube) 64
1 Université catholique de Louvain 2 Example of Tasks 3 Learning outcomes, implementation, evaluation 4 History of Robotics 5 Examples of industrial robots 6 Future Trends in Robotics 7 Examples of service robots 8 Typical features of industrial and service robots 9 References 65 Future Trends in Robotics Statistics in research... Source: ISI Web of Knowledge. Keyword: robot Moving from industrial robotics to service robotics. 66
Future Trends in Robotics Statistics in research... Source: ISI Web of Knowledge. Keyword: robot Moving from industrial robotics to service robotics. 67 Future Trends in Robotics Statistics in research... Source: ISI Web of Knowledge. Keyword: robot Moving from industrial robotics to service robotics. 68
Same requirements? DLR, Germany 69 1 Université catholique de Louvain 2 Example of Tasks 3 Learning outcomes, implementation, evaluation 4 History of Robotics 5 Examples of industrial robots 6 Future Trends in Robotics 7 Examples of service robots 8 Typical features of industrial and service robots 9 References 70
Examples of service robots defense field (agriculture) medical logistic construction mobile platforms cleaning inspection underwater rescue and security... Most of these applications require the robot to be mobile. 71 Examples of service robots Military robot Big Dog (youtube) 72
Examples of service robots Surgical robot Da Vinci (youtube) 73 Examples of service robots Rehabilitation and assistive robot LOPES (University of Twente) Ankle prosthesis (UCL) 74
Examples of service robots Security/telepresence: Jazz Connect (youtube) 75 Examples of service robots Mobile robot (1/2) Swarm: Robot Swarm EPFL (youtube) 76
Examples of service robots Mobile robot (2/2) Amphibious: Salamandra robotica http://biorob.epfl.ch 77 Examples of service robots Home assistance robot (1/2): Home Assistant Robot http://www.lunegate.com (youtube) 78
Examples of service robots Home assistance robot (2/2): Autonomous folding UC Berkeley (youtube) 79 Examples of service robots Humanoid robot (1/3): Honda ASIMO (youtube) 80
Examples of service robots Humanoid robot (2/3): Toyota Music Robot (youtube) 81 Examples of service robots Humanoid robot (3/3): Geminoid Prof. Ishiguro Univ. Osaka (youtube) 82
1 Université catholique de Louvain 2 Example of Tasks 3 Learning outcomes, implementation, evaluation 4 History of Robotics 5 Examples of industrial robots 6 Future Trends in Robotics 7 Examples of service robots 8 Typical features of industrial and service robots 9 References 83 Typical features of industrial and service robots Structured vs. unstructured environment; reprogrammable vs. autonomous; repetitive vs. flexible; high degree of precision vs. high degree of compliance; position control vs. force control 84
High degree of precision vs... ABB Robotics Fanta Can Challenge (youtube) 85... high degree of compliance SPARKy ankle prosthesis Arizona State University (youtube) 86
From industrial robots...... to human-friendly industrial robots DLR Germany http://www.phriends.eu 87 References for this lecture Robotics, Bajd, Mihelj, Lenarčič, Stanovnik, and Munih; Springer, 2010 Robot Modeling and Control, Spong, Hutchinson, and Vidyasagar; Wiley, 2006 88
References on the Internet http://www.ifr.org http://www.ieee-ras.org http://www.robotics.org http://www.roboticsonline.org http://www.jautomatise.com http://www.robotics.utexas.edu http://www.dlr.de/rm/en/ 89 References for research IEEE Transactions on Robotics (previously IEEE Transactions on Robotics and Automation) IEEE Robotics and Automation Magazine International Journal of Robotics Research Robotics and Autonomous Systems Journal of Robotic Systems Robotica Journal of Intelligent and Robotic Systems Autonomous Robots Advanced Robotics 90