COOPERATIVE STRATEGY BASED ON ADAPTIVE Q- LEARNING FOR ROBOT SOCCER SYSTEMS
|
|
- Frederica Oliver
- 5 years ago
- Views:
Transcription
1 COOPERATIVE STRATEGY BASED ON ADAPTIVE Q- LEARNING FOR ROBOT SOCCER SYSTEMS Soft Computing Alfonso Martínez del Hoyo Canterla 1
2 Table of contents 1. Introduction Cooperative strategy design Strategy selection design Role assignment Behaviors design Simulation Conclusion
3 1. Introduction The objective of the paper is to develop a self-learning cooperative strategy for robot soccer systems. The robots can learn from successes or failures to improve the performance gradually. A robot soccer game is a proper platform to implement a multiagent system (MAS). Many methods are being proposed about cooperation in MAS: genetic algorithms, neural networks, reinforcement learning In this case they use reinforcement learning: the agent selects an action that gives the highest reward (maximizes a numerical signal) It is implemented by Q- learning, a temporal-difference (TD) method. Simplest TD update method: Q-learning algorithm: The learning in the system is implemented in the strategy selection and in the sidekick behavior. 3
4 2. Cooperative strategy design There are 3 aspects to design the strategy: Strategy selection Role assignment Behaviors of all roles individually First the strategy selection observes the state from the environment, after some time it observes the total reward given to see if the decision is good. Then the role arbiter chooses an attacker, defenders and sidekicks. Finally each robot executes their individual tasks, and a reward will be individually given to them according to their performances. The complete cooperative strategy architecture: 4
5 2.1 Strategy selection design The strategy design selects the number of robots in each position. It uses the following information: the current state of the environment and the reward from past actions. The environment information: we make it fuzzy with the following membership functions: The dimension of the inputs is 3x4, so we need 12 inference rules: We obtain a fuzzy value for the state (S) using Mamdani s minimum implication rule 5
6 The reward: it is calculated as follows:! Given the state and the reward we select one of the 3 possible actions: 6
7 2.2 Role assignment The main purpose is to find a proper robot to be an attacker, and others to be defenders or sidekicks. Find the attacker: Select the robot closest to the ball facing the opponent goal: 7
8 If there are no robot behind the ball, select the suitable robot according to the distance to the ball, the direction of the velocity of the ball and the possible obstacles (select the robot that maximizes Attacker_value): Find the defenders: Select the robots closer to our goal. Find the sidekicks: Select the remaining robots. 8
9 2.3 Behaviors design Common behavior (Obstacle-avoidance): If a robot wants to go to the ball, all the robots are positrons and the ball is a negatron. If the robot just wants to go to a position, the ball is also a positron, and the position is negatron. There is an avoidance range D. 9
10 Attacker behavior: If the goal is close to the ball, the robot tries to shoot, other wise it passes the ball. The attacker must be behind the ball, so if it cannot kick the ball directly, it will use the obstacle avoidance behavior. Defender behavior: The number of defenders varies from 1 to 3. They are assigned to different positions (there are 2 zones). The defender robot tries to block the ball when the opponent shoots, so it finds a suitable location according to the velocity of the ball. Sidekick behavior: It has learning ability. There can be 1 to 3 sidekicks. The sidekicks objective is to find good positions. States classification: the robot takes in consideration the angle of the attacker, the angle of the closest opponent to the ball and whether the attacker is closer to the ball than the closest opponent. Actions: the robot chooses a position, selecting the best distance and angle from a predefined group of possible positions with respect to the ball. Rewards: the sidekicks objective is to find good positions so that they can become an attacker or to prevent the ball from being closer to the goal. The reward is positive if they change often to attacker and negative if the ball is close to the goal. It is obtained with a fuzzy system: The procedure to find the final consequence is the same than before, but now the consequence in the rules is crisp so we directly obtain a crisp value when we compute the maximum. 10
11 There is an extra reward of +25 if we kick the ball to the opponent goal, and -25 if the opponent does so.! The final reward is the sum of the fuzzy and the extra rewards. 11
12 3. Simulation The robot team played 100 matches with a team designed with another nonlearning strategy. Everything was simulated in a computer. Goals from our team. Goals from the opponent. 12
13 Difference of goals. Summary of the results: 13
14 4. Conclusion The main objective of the fuzzy is to evaluate the rewards and the states. It gives flexibility: We can change the membership functions to modify the way the robots cooperate and coordinate with each other without big modifications in the strategy architecture. The learning part is carried by the Q-learning algorithm. The cooperative strategy is effective: there is a tendency on rise to get better results. 14
Strategy for Collaboration in Robot Soccer
Strategy for Collaboration in Robot Soccer Sng H.L. 1, G. Sen Gupta 1 and C.H. Messom 2 1 Singapore Polytechnic, 500 Dover Road, Singapore {snghl, SenGupta }@sp.edu.sg 1 Massey University, Auckland, New
More informationHierarchical Controller for Robotic Soccer
Hierarchical Controller for Robotic Soccer Byron Knoll Cognitive Systems 402 April 13, 2008 ABSTRACT RoboCup is an initiative aimed at advancing Artificial Intelligence (AI) and robotics research. This
More informationSwarm AI: A Solution to Soccer
Swarm AI: A Solution to Soccer Alex Kutsenok Advisor: Michael Wollowski Senior Thesis Rose-Hulman Institute of Technology Department of Computer Science and Software Engineering May 10th, 2004 Definition
More informationUSING A FUZZY LOGIC CONTROL SYSTEM FOR AN XPILOT COMBAT AGENT ANDREW HUBLEY AND GARY PARKER
World Automation Congress 21 TSI Press. USING A FUZZY LOGIC CONTROL SYSTEM FOR AN XPILOT COMBAT AGENT ANDREW HUBLEY AND GARY PARKER Department of Computer Science Connecticut College New London, CT {ahubley,
More informationRoboCup. Presented by Shane Murphy April 24, 2003
RoboCup Presented by Shane Murphy April 24, 2003 RoboCup: : Today and Tomorrow What we have learned Authors Minoru Asada (Osaka University, Japan), Hiroaki Kitano (Sony CS Labs, Japan), Itsuki Noda (Electrotechnical(
More informationTUD Poker Challenge Reinforcement Learning with Imperfect Information
TUD Poker Challenge 2008 Reinforcement Learning with Imperfect Information Outline Reinforcement Learning Perfect Information Imperfect Information Lagging Anchor Algorithm Matrix Form Extensive Form Poker
More informationA GAME THEORETIC MODEL OF COOPERATION AND NON-COOPERATION FOR SOCCER PLAYING ROBOTS. M. BaderElDen, E. Badreddin, Y. Kotb, and J.
A GAME THEORETIC MODEL OF COOPERATION AND NON-COOPERATION FOR SOCCER PLAYING ROBOTS M. BaderElDen, E. Badreddin, Y. Kotb, and J. Rüdiger Automation Laboratory, University of Mannheim, 68131 Mannheim, Germany.
More informationFuzzy Logic for Behaviour Co-ordination and Multi-Agent Formation in RoboCup
Fuzzy Logic for Behaviour Co-ordination and Multi-Agent Formation in RoboCup Hakan Duman and Huosheng Hu Department of Computer Science University of Essex Wivenhoe Park, Colchester CO4 3SQ United Kingdom
More informationCOMPACT FUZZY Q LEARNING FOR AUTONOMOUS MOBILE ROBOT NAVIGATION
COMPACT FUZZY Q LEARNING FOR AUTONOMOUS MOBILE ROBOT NAVIGATION Handy Wicaksono, Khairul Anam 2, Prihastono 3, Indra Adjie Sulistijono 4, Son Kuswadi 5 Department of Electrical Engineering, Petra Christian
More informationCooperative Behavior Acquisition in A Multiple Mobile Robot Environment by Co-evolution
Cooperative Behavior Acquisition in A Multiple Mobile Robot Environment by Co-evolution Eiji Uchibe, Masateru Nakamura, Minoru Asada Dept. of Adaptive Machine Systems, Graduate School of Eng., Osaka University,
More informationDealing with parameterized actions in behavior testing of commercial computer games
Dealing with parameterized actions in behavior testing of commercial computer games Jörg Denzinger, Kevin Loose Department of Computer Science University of Calgary Calgary, Canada denzinge, kjl @cpsc.ucalgary.ca
More informationTeam Edinferno Description Paper for RoboCup 2011 SPL
Team Edinferno Description Paper for RoboCup 2011 SPL Subramanian Ramamoorthy, Aris Valtazanos, Efstathios Vafeias, Christopher Towell, Majd Hawasly, Ioannis Havoutis, Thomas McGuire, Seyed Behzad Tabibian,
More informationAdjustable Group Behavior of Agents in Action-based Games
Adjustable Group Behavior of Agents in Action-d Games Westphal, Keith and Mclaughlan, Brian Kwestp2@uafortsmith.edu, brian.mclaughlan@uafs.edu Department of Computer and Information Sciences University
More informationCAMBADA 2015: Team Description Paper
CAMBADA 2015: Team Description Paper B. Cunha, A. J. R. Neves, P. Dias, J. L. Azevedo, N. Lau, R. Dias, F. Amaral, E. Pedrosa, A. Pereira, J. Silva, J. Cunha and A. Trifan Intelligent Robotics and Intelligent
More informationCHAPTER 6 NEURO-FUZZY CONTROL OF TWO-STAGE KY BOOST CONVERTER
73 CHAPTER 6 NEURO-FUZZY CONTROL OF TWO-STAGE KY BOOST CONVERTER 6.1 INTRODUCTION TO NEURO-FUZZY CONTROL The block diagram in Figure 6.1 shows the Neuro-Fuzzy controlling technique employed to control
More informationNational University of Singapore
National University of Singapore Department of Electrical and Computer Engineering EE4306 Distributed Autonomous obotic Systems 1. Objectives...1 2. Equipment...1 3. Preparation...1 4. Introduction...1
More informationImplementing a Fuzzy Logic Control of a Shower
Implementing a Fuzzy Logic Control of a Shower ABSTRACT Krishankumar Assistant Professor, Department of Electrical Engineering, Guru Jambheshwar University of Science & Technology, Hissar, Haryana, India
More informationModular Q-learning based multi-agent cooperation for robot soccer
Robotics and Autonomous Systems 35 (2001) 109 122 Modular Q-learning based multi-agent cooperation for robot soccer Kui-Hong Park, Yong-Jae Kim, Jong-Hwan Kim Department of Electrical Engineering and Computer
More informationNeuro-Fuzzy and Soft Computing: Fuzzy Sets. Chapter 1 of Neuro-Fuzzy and Soft Computing by Jang, Sun and Mizutani
Chapter 1 of Neuro-Fuzzy and Soft Computing by Jang, Sun and Mizutani Outline Introduction Soft Computing (SC) vs. Conventional Artificial Intelligence (AI) Neuro-Fuzzy (NF) and SC Characteristics 2 Introduction
More informationMulti-Agent Control Structure for a Vision Based Robot Soccer System
Multi- Control Structure for a Vision Based Robot Soccer System Yangmin Li, Wai Ip Lei, and Xiaoshan Li Department of Electromechanical Engineering Faculty of Science and Technology University of Macau
More informationNuBot Team Description Paper 2008
NuBot Team Description Paper 2008 1 Hui Zhang, 1 Huimin Lu, 3 Xiangke Wang, 3 Fangyi Sun, 2 Xiucai Ji, 1 Dan Hai, 1 Fei Liu, 3 Lianhu Cui, 1 Zhiqiang Zheng College of Mechatronics and Automation National
More informationSPQR RoboCup 2016 Standard Platform League Qualification Report
SPQR RoboCup 2016 Standard Platform League Qualification Report V. Suriani, F. Riccio, L. Iocchi, D. Nardi Dipartimento di Ingegneria Informatica, Automatica e Gestionale Antonio Ruberti Sapienza Università
More informationBehavior generation for a mobile robot based on the adaptive fitness function
Robotics and Autonomous Systems 40 (2002) 69 77 Behavior generation for a mobile robot based on the adaptive fitness function Eiji Uchibe a,, Masakazu Yanase b, Minoru Asada c a Human Information Science
More informationSonar Behavior-Based Fuzzy Control for a Mobile Robot
Sonar Behavior-Based Fuzzy Control for a Mobile Robot S. Thongchai, S. Suksakulchai, D. M. Wilkes, and N. Sarkar Intelligent Robotics Laboratory School of Engineering, Vanderbilt University, Nashville,
More informationA Robotic Simulator Tool for Mobile Robots
2016 Published in 4th International Symposium on Innovative Technologies in Engineering and Science 3-5 November 2016 (ISITES2016 Alanya/Antalya - Turkey) A Robotic Simulator Tool for Mobile Robots 1 Mehmet
More informationLearning and Using Models of Kicking Motions for Legged Robots
Learning and Using Models of Kicking Motions for Legged Robots Sonia Chernova and Manuela Veloso Computer Science Department Carnegie Mellon University Pittsburgh, PA 15213 {soniac, mmv}@cs.cmu.edu Abstract
More informationGilbert Peterson and Diane J. Cook University of Texas at Arlington Box 19015, Arlington, TX
DFA Learning of Opponent Strategies Gilbert Peterson and Diane J. Cook University of Texas at Arlington Box 19015, Arlington, TX 76019-0015 Email: {gpeterso,cook}@cse.uta.edu Abstract This work studies
More informationBehaviour Patterns Evolution on Individual and Group Level. Stanislav Slušný, Roman Neruda, Petra Vidnerová. CIMMACS 07, December 14, Tenerife
Behaviour Patterns Evolution on Individual and Group Level Stanislav Slušný, Roman Neruda, Petra Vidnerová Department of Theoretical Computer Science Institute of Computer Science Academy of Science of
More informationChapter 1: Introduction to Neuro-Fuzzy (NF) and Soft Computing (SC)
Chapter 1: Introduction to Neuro-Fuzzy (NF) and Soft Computing (SC) Introduction (1.1) SC Constituants and Conventional Artificial Intelligence (AI) (1.2) NF and SC Characteristics (1.3) Jyh-Shing Roger
More information2 Our Hardware Architecture
RoboCup-99 Team Descriptions Middle Robots League, Team NAIST, pages 170 174 http: /www.ep.liu.se/ea/cis/1999/006/27/ 170 Team Description of the RoboCup-NAIST NAIST Takayuki Nakamura, Kazunori Terada,
More informationSPQR RoboCup 2014 Standard Platform League Team Description Paper
SPQR RoboCup 2014 Standard Platform League Team Description Paper G. Gemignani, F. Riccio, L. Iocchi, D. Nardi Department of Computer, Control, and Management Engineering Sapienza University of Rome, Italy
More informationCPS331 Lecture: Agents and Robots last revised April 27, 2012
CPS331 Lecture: Agents and Robots last revised April 27, 2012 Objectives: 1. To introduce the basic notion of an agent 2. To discuss various types of agents 3. To introduce the subsumption architecture
More informationAttention! Choking hazard! Small pieces, not for children under three years old. Figure 01 - Set Up for Kick Off. corner arc. corner square.
Figure 01 - Set Up for Kick Off A B C D E F G H 1 corner square goal area corner arc 1 2 3 4 5 6 7 penalty area 2 3 4 5 6 7 8 center spin circle 8 rows 8 8 7 7 6 6 5 4 3 2 1 penalty arc penalty spot goal
More informationCS 354R: Computer Game Technology
CS 354R: Computer Game Technology Introduction to Game AI Fall 2018 What does the A stand for? 2 What is AI? AI is the control of every non-human entity in a game The other cars in a car game The opponents
More informationMulti-Robot Team Response to a Multi-Robot Opponent Team
Multi-Robot Team Response to a Multi-Robot Opponent Team James Bruce, Michael Bowling, Brett Browning, and Manuela Veloso {jbruce,mhb,brettb,mmv}@cs.cmu.edu Carnegie Mellon University 5000 Forbes Avenue
More informationTrajectory Generation for a Mobile Robot by Reinforcement Learning
1 Trajectory Generation for a Mobile Robot by Reinforcement Learning Masaki Shimizu 1, Makoto Fujita 2, and Hiroyuki Miyamoto 3 1 Kyushu Institute of Technology, Kitakyushu, Japan shimizu-masaki@edu.brain.kyutech.ac.jp
More informationTest Plan. Robot Soccer. ECEn Senior Project. Real Madrid. Daniel Gardner Warren Kemmerer Brandon Williams TJ Schramm Steven Deshazer
Test Plan Robot Soccer ECEn 490 - Senior Project Real Madrid Daniel Gardner Warren Kemmerer Brandon Williams TJ Schramm Steven Deshazer CONTENTS Introduction... 3 Skill Tests Determining Robot Position...
More informationUChile Team Research Report 2009
UChile Team Research Report 2009 Javier Ruiz-del-Solar, Rodrigo Palma-Amestoy, Pablo Guerrero, Román Marchant, Luis Alberto Herrera, David Monasterio Department of Electrical Engineering, Universidad de
More informationBiologically Inspired Embodied Evolution of Survival
Biologically Inspired Embodied Evolution of Survival Stefan Elfwing 1,2 Eiji Uchibe 2 Kenji Doya 2 Henrik I. Christensen 1 1 Centre for Autonomous Systems, Numerical Analysis and Computer Science, Royal
More informationReinforcement Learning Simulations and Robotics
Reinforcement Learning Simulations and Robotics Models Partially observable noise in sensors Policy search methods rather than value functionbased approaches Isolate key parameters by choosing an appropriate
More informationMulti-Platform Soccer Robot Development System
Multi-Platform Soccer Robot Development System Hui Wang, Han Wang, Chunmiao Wang, William Y. C. Soh Division of Control & Instrumentation, School of EEE Nanyang Technological University Nanyang Avenue,
More informationDesign of an Action Select Mechanism for Soccer Robot Systems Using Artificial Immune Network
Tamkang Journal of Science and Engineering, Vol. 11, No. 4, pp. 415424 (2008) 415 Design of an Action Select Mechanism for Soccer Robot Systems Using Artificial Immune Network Yin-Tien Wang* and Chia-Hsing
More informationGame Design Verification using Reinforcement Learning
Game Design Verification using Reinforcement Learning Eirini Ntoutsi Dimitris Kalles AHEAD Relationship Mediators S.A., 65 Othonos-Amalias St, 262 21 Patras, Greece and Department of Computer Engineering
More informationOverview Agents, environments, typical components
Overview Agents, environments, typical components CSC752 Autonomous Robotic Systems Ubbo Visser Department of Computer Science University of Miami January 23, 2017 Outline 1 Autonomous robots 2 Agents
More informationAutonomous Robot Soccer Teams
Soccer-playing robots could lead to completely autonomous intelligent machines. Autonomous Robot Soccer Teams Manuela Veloso Manuela Veloso is professor of computer science at Carnegie Mellon University.
More informationConflict Management in Multiagent Robotic System: FSM and Fuzzy Logic Approach
Conflict Management in Multiagent Robotic System: FSM and Fuzzy Logic Approach Witold Jacak* and Stephan Dreiseitl" and Karin Proell* and Jerzy Rozenblit** * Dept. of Software Engineering, Polytechnic
More informationDesign a Modular Architecture for Autonomous Soccer Robot Based on Omnidirectional Mobility with Distributed Behavior Control
Design a Modular Architecture for Autonomous Soccer Robot Based on Omnidirectional Mobility with Distributed Behavior Control S.Hamidreza Kasaei, S.Mohammadreza Kasaei and S.Alireza Kasaei Abstract The
More informationHierarchical Case-Based Reasoning Behavior Control for Humanoid Robot
Annals of University of Craiova, Math. Comp. Sci. Ser. Volume 36(2), 2009, Pages 131 140 ISSN: 1223-6934 Hierarchical Case-Based Reasoning Behavior Control for Humanoid Robot Bassant Mohamed El-Bagoury,
More informationCAMBADA 2014: Team Description Paper
CAMBADA 2014: Team Description Paper R. Dias, F. Amaral, J. L. Azevedo, R. Castro, B. Cunha, J. Cunha, P. Dias, N. Lau, C. Magalhães, A. J. R. Neves, A. Nunes, E. Pedrosa, A. Pereira, J. Santos, J. Silva,
More informationReinforcement Learning for CPS Safety Engineering. Sam Green, Çetin Kaya Koç, Jieliang Luo University of California, Santa Barbara
Reinforcement Learning for CPS Safety Engineering Sam Green, Çetin Kaya Koç, Jieliang Luo University of California, Santa Barbara Motivations Safety-critical duties desired by CPS? Autonomous vehicle control:
More informationReinforcement Learning in Games Autonomous Learning Systems Seminar
Reinforcement Learning in Games Autonomous Learning Systems Seminar Matthias Zöllner Intelligent Autonomous Systems TU-Darmstadt zoellner@rbg.informatik.tu-darmstadt.de Betreuer: Gerhard Neumann Abstract
More informationOptic Flow Based Skill Learning for A Humanoid to Trap, Approach to, and Pass a Ball
Optic Flow Based Skill Learning for A Humanoid to Trap, Approach to, and Pass a Ball Masaki Ogino 1, Masaaki Kikuchi 1, Jun ichiro Ooga 1, Masahiro Aono 1 and Minoru Asada 1,2 1 Dept. of Adaptive Machine
More informationOnline Evolution for Cooperative Behavior in Group Robot Systems
282 International Dong-Wook Journal of Lee, Control, Sang-Wook Automation, Seo, and Systems, Kwee-Bo vol. Sim 6, no. 2, pp. 282-287, April 2008 Online Evolution for Cooperative Behavior in Group Robot
More informationAction-Based Sensor Space Categorization for Robot Learning
Action-Based Sensor Space Categorization for Robot Learning Minoru Asada, Shoichi Noda, and Koh Hosoda Dept. of Mech. Eng. for Computer-Controlled Machinery Osaka University, -1, Yamadaoka, Suita, Osaka
More informationObstacle avoidance based on fuzzy logic method for mobile robots in Cluttered Environment
Obstacle avoidance based on fuzzy logic method for mobile robots in Cluttered Environment Fatma Boufera 1, Fatima Debbat 2 1,2 Mustapha Stambouli University, Math and Computer Science Department Faculty
More informationNAVIGATION OF MOBILE ROBOT USING THE PSO PARTICLE SWARM OPTIMIZATION
Journal of Academic and Applied Studies (JAAS) Vol. 2(1) Jan 2012, pp. 32-38 Available online @ www.academians.org ISSN1925-931X NAVIGATION OF MOBILE ROBOT USING THE PSO PARTICLE SWARM OPTIMIZATION Sedigheh
More informationCMDragons: Dynamic Passing and Strategy on a Champion Robot Soccer Team
CMDragons: Dynamic Passing and Strategy on a Champion Robot Soccer Team James Bruce, Stefan Zickler, Mike Licitra, and Manuela Veloso Abstract After several years of developing multiple RoboCup small-size
More informationFU-Fighters. The Soccer Robots of Freie Universität Berlin. Why RoboCup? What is RoboCup?
The Soccer Robots of Freie Universität Berlin We have been building autonomous mobile robots since 1998. Our team, composed of students and researchers from the Mathematics and Computer Science Department,
More informationRobo-Erectus Jr-2013 KidSize Team Description Paper.
Robo-Erectus Jr-2013 KidSize Team Description Paper. Buck Sin Ng, Carlos A. Acosta Calderon and Changjiu Zhou. Advanced Robotics and Intelligent Control Centre, Singapore Polytechnic, 500 Dover Road, 139651,
More informationRapid Control Prototyping for Robot Soccer
Proceedings of the 17th World Congress The International Federation of Automatic Control Rapid Control Prototyping for Robot Soccer Junwon Jang Soohee Han Hanjun Kim Choon Ki Ahn School of Electrical Engr.
More informationDeveloping Frogger Player Intelligence Using NEAT and a Score Driven Fitness Function
Developing Frogger Player Intelligence Using NEAT and a Score Driven Fitness Function Davis Ancona and Jake Weiner Abstract In this report, we examine the plausibility of implementing a NEAT-based solution
More informationAdaptive Neuro-Fuzzy Controler With Genetic Training For Mobile Robot Control
Int. J. of Computers, Communications & Control, ISSN 1841-9836, E-ISSN 1841-9844 Vol. VII (2012), No. 1 (March), pp. 135-146 Adaptive Neuro-Fuzzy Controler With Genetic Training For Mobile Robot Control
More informationCSCI 4150 Introduction to Artificial Intelligence, Fall 2004 Assignment 7 (135 points), out Monday November 22, due Thursday December 9
CSCI 4150 Introduction to Artificial Intelligence, Fall 2004 Assignment 7 (135 points), out Monday November 22, due Thursday December 9 Learning to play blackjack In this assignment, you will implement
More informationPrinciples of Computer Game Design and Implementation. Lecture 20
Principles of Computer Game Design and Implementation Lecture 20 utline for today Sense-Think-Act Cycle: Thinking Acting 2 Agents and Virtual Player Agents, no virtual player Shooters, racing, Virtual
More informationMulti-Robot Coordination. Chapter 11
Multi-Robot Coordination Chapter 11 Objectives To understand some of the problems being studied with multiple robots To understand the challenges involved with coordinating robots To investigate a simple
More informationArtificial Intelligence for Games
Artificial Intelligence for Games CSC404: Video Game Design Elias Adum Let s talk about AI Artificial Intelligence AI is the field of creating intelligent behaviour in machines. Intelligence understood
More informationDesign of Fuzzy Adaptive Resonance Theory Structures with VLSI: A Design Approach
Design of Fuzzy Adaptive Resonance Theory Structures with VLSI: A Design Approach Ashwini S. Gawarle 1, Amol Y.Deshmukh 2 and Dr. A.G.Keskar 3 1 Research Scholar,GHRCE, Nagpur, ashwini_bamnote@rediffmail.com
More informationMultiple Agents. Why can t we all just get along? (Rodney King)
Multiple Agents Why can t we all just get along? (Rodney King) Nash Equilibriums........................................ 25 Multiple Nash Equilibriums................................. 26 Prisoners Dilemma.......................................
More informationA. Rules of blackjack, representations, and playing blackjack
CSCI 4150 Introduction to Artificial Intelligence, Fall 2005 Assignment 7 (140 points), out Monday November 21, due Thursday December 8 Learning to play blackjack In this assignment, you will implement
More informationAtif I. Chaudhry Prof. Raffaello D Andrea Prof. Mark Campbell
RoboFlag A Framework for Exploring Control, Planning, and Human Interface Issues Related to Coordinating Multiple Robots in a Realtime Dynamic Environment Atif I. Chaudhry Prof. Raffaello D Andrea Prof.
More informationCognitive Robotics. Behavior Control. Hans-Dieter Burkhard June 2014
Cognitive Robotics Behavior Control Hans-Dieter Burkhard June 2014 Introduction Control Architectures Aspects of Rationality BDI Architectures Behavior Based Robotics Overview Burkhard Cognitive Robotics
More informationHfutEngine3D Soccer Simulation Team Description Paper 2012
HfutEngine3D Soccer Simulation Team Description Paper 2012 Pengfei Zhang, Qingyuan Zhang School of Computer and Information Hefei University of Technology, China Abstract. This paper simply describes the
More informationHumanoid Robot NAO: Developing Behaviors for Football Humanoid Robots
Humanoid Robot NAO: Developing Behaviors for Football Humanoid Robots State of the Art Presentation Luís Miranda Cruz Supervisors: Prof. Luis Paulo Reis Prof. Armando Sousa Outline 1. Context 1.1. Robocup
More informationROBOT SOCCER STRATEGY ADAPTATION
ROBOT SOCCER STRATEGY ADAPTATION Václav Svatoň (a), Jan Martinovič (b), Kateřina Slaninová (c), Václav Snášel (d) (a),(b),(c),(d) IT4Innovations, VŠB - Technical University of Ostrava, 17. listopadu 15/2172,
More informationTeam KMUTT: Team Description Paper
Team KMUTT: Team Description Paper Thavida Maneewarn, Xye, Pasan Kulvanit, Sathit Wanitchaikit, Panuvat Sinsaranon, Kawroong Saktaweekulkit, Nattapong Kaewlek Djitt Laowattana King Mongkut s University
More informationAcquiring Mobile Robot Behaviors by Learning Trajectory Velocities
Acquiring Mobile Robot Behaviors by Learning Trajectory Velocities KOREN WARD School of Information Technology and Computer Science, The University of Wollongong Wollongong, NSW, Australia, 2522. koren@uow.edu.au
More informationTask Allocation: Role Assignment. Dr. Daisy Tang
Task Allocation: Role Assignment Dr. Daisy Tang Outline Multi-robot dynamic role assignment Task Allocation Based On Roles Usually, a task is decomposed into roleseither by a general autonomous planner,
More informationApplication of Soft Computing Techniques in Water Resources Engineering
International Journal of Dynamics of Fluids. ISSN 0973-1784 Volume 13, Number 2 (2017), pp. 197-202 Research India Publications http://www.ripublication.com Application of Soft Computing Techniques in
More informationJavaSoccer. Tucker Balch. Mobile Robot Laboratory College of Computing Georgia Institute of Technology Atlanta, Georgia USA
JavaSoccer Tucker Balch Mobile Robot Laboratory College of Computing Georgia Institute of Technology Atlanta, Georgia 30332-208 USA Abstract. Hardwaxe-only development of complex robot behavior is often
More informationA Comparative Study on different AI Techniques towards Performance Evaluation in RRM(Radar Resource Management)
A Comparative Study on different AI Techniques towards Performance Evaluation in RRM(Radar Resource Management) Madhusudhan H.S, Assistant Professor, Department of Information Science & Engineering, VVIET,
More informationThe Autonomous Performance Improvement of Mobile Robot using Type-2 Fuzzy Self-Tuning PID Controller
, pp.182-187 http://dx.doi.org/10.14257/astl.2016.138.37 The Autonomous Performance Improvement of Mobile Robot using Type-2 Fuzzy Self-Tuning PID Controller Sang Hyuk Park 1, Ki Woo Kim 1, Won Hyuk Choi
More informationROBOCODE PROJECT AIBOT - MARKOV MODEL DRIVEN AIMING COMBINED WITH Q LEARNING FOR MOVEMENT
ROBOCODE PROJECT AIBOT - MARKOV MODEL DRIVEN AIMING COMBINED WITH Q LEARNING FOR MOVEMENT PATRICK HALUPTZOK, XU MIAO Abstract. In this paper the development of a robot controller for Robocode is discussed.
More informationTEMPORAL DIFFERENCE LEARNING IN CHINESE CHESS
TEMPORAL DIFFERENCE LEARNING IN CHINESE CHESS Thong B. Trinh, Anwer S. Bashi, Nikhil Deshpande Department of Electrical Engineering University of New Orleans New Orleans, LA 70148 Tel: (504) 280-7383 Fax:
More informationCPS331 Lecture: Agents and Robots last revised November 18, 2016
CPS331 Lecture: Agents and Robots last revised November 18, 2016 Objectives: 1. To introduce the basic notion of an agent 2. To discuss various types of agents 3. To introduce the subsumption architecture
More informationImplicit Fitness Functions for Evolving a Drawing Robot
Implicit Fitness Functions for Evolving a Drawing Robot Jon Bird, Phil Husbands, Martin Perris, Bill Bigge and Paul Brown Centre for Computational Neuroscience and Robotics University of Sussex, Brighton,
More informationCMDragons 2009 Team Description
CMDragons 2009 Team Description Stefan Zickler, Michael Licitra, Joydeep Biswas, and Manuela Veloso Carnegie Mellon University {szickler,mmv}@cs.cmu.edu {mlicitra,joydeep}@andrew.cmu.edu Abstract. In this
More informationGA-based Learning in Behaviour Based Robotics
Proceedings of IEEE International Symposium on Computational Intelligence in Robotics and Automation, Kobe, Japan, 16-20 July 2003 GA-based Learning in Behaviour Based Robotics Dongbing Gu, Huosheng Hu,
More informationThe Dutch AIBO Team 2004
The Dutch AIBO Team 2004 Stijn Oomes 1, Pieter Jonker 2, Mannes Poel 3, Arnoud Visser 4, Marco Wiering 5 1 March 2004 1 DECIS Lab, Delft Cooperation on Intelligent Systems 2 Quantitative Imaging Group,
More informationCS295-1 Final Project : AIBO
CS295-1 Final Project : AIBO Mert Akdere, Ethan F. Leland December 20, 2005 Abstract This document is the final report for our CS295-1 Sensor Data Management Course Final Project: Project AIBO. The main
More informationLearning and Using Models of Kicking Motions for Legged Robots
Learning and Using Models of Kicking Motions for Legged Robots Sonia Chernova and Manuela Veloso Computer Science Department Carnegie Mellon University Pittsburgh, PA 15213 {soniac, mmv}@cs.cmu.edu Abstract
More informationRobocup Electrical Team 2006 Description Paper
Robocup Electrical Team 2006 Description Paper Name: Strive2006 (Shanghai University, P.R.China) Address: Box.3#,No.149,Yanchang load,shanghai, 200072 Email: wanmic@163.com Homepage: robot.ccshu.org Abstract:
More informationAn Artificially Intelligent Ludo Player
An Artificially Intelligent Ludo Player Andres Calderon Jaramillo and Deepak Aravindakshan Colorado State University {andrescj, deepakar}@cs.colostate.edu Abstract This project replicates results reported
More informationCS510 \ Lecture Ariel Stolerman
CS510 \ Lecture04 2012-10-15 1 Ariel Stolerman Administration Assignment 2: just a programming assignment. Midterm: posted by next week (5), will cover: o Lectures o Readings A midterm review sheet will
More informationThe UT Austin Villa 3D Simulation Soccer Team 2008
UT Austin Computer Sciences Technical Report AI09-01, February 2009. The UT Austin Villa 3D Simulation Soccer Team 2008 Shivaram Kalyanakrishnan, Yinon Bentor and Peter Stone Department of Computer Sciences
More informationAPPLICATION OF FUZZY BEHAVIOR COORDINATION AND Q LEARNING IN ROBOT NAVIGATION
APPLICATION OF FUZZY BEHAVIOR COORDINATION AND Q LEARNING IN ROBOT NAVIGATION Handy Wicaksono 1, Prihastono 2, Khairul Anam 3, Rusdhianto Effendi 4, Indra Adji Sulistijono 5, Son Kuswadi 6, Achmad Jazidie
More informationImproving the Kicking Accuracy in a Soccer Robot
Improving the Kicking Accuracy in a Soccer Robot Ricardo Dias ricardodias@ua.pt Bernardo Cunha mbc@det.ua.pt João Silva joao.m.silva@ua.pt António J. R. Neves an@ua.pt José Luis Azevedo jla@ua.pt Nuno
More informationLearning Reactive Neurocontrollers using Simulated Annealing for Mobile Robots
Learning Reactive Neurocontrollers using Simulated Annealing for Mobile Robots Philippe Lucidarme, Alain Liégeois LIRMM, University Montpellier II, France, lucidarm@lirmm.fr Abstract This paper presents
More informationPOWER TRANSFORMER PROTECTION USING ANN, FUZZY SYSTEM AND CLARKE S TRANSFORM
POWER TRANSFORMER PROTECTION USING ANN, FUZZY SYSTEM AND CLARKE S TRANSFORM 1 VIJAY KUMAR SAHU, 2 ANIL P. VAIDYA 1,2 Pg Student, Professor E-mail: 1 vijay25051991@gmail.com, 2 anil.vaidya@walchandsangli.ac.in
More informationIntelligent Humanoid Robot
Intelligent Humanoid Robot Prof. Mayez Al-Mouhamed 22-403, Fall 2007 http://www.ccse.kfupm,.edu.sa/~mayez Computer Engineering Department King Fahd University of Petroleum and Minerals 1 RoboCup : Goal
More informationThe Behavior Evolving Model and Application of Virtual Robots
The Behavior Evolving Model and Application of Virtual Robots Suchul Hwang Kyungdal Cho V. Scott Gordon Inha Tech. College Inha Tech College CSUS, Sacramento 253 Yonghyundong Namku 253 Yonghyundong Namku
More information