Swarm AI: A Solution to Soccer

Similar documents
Swarm AI: A General-Purpose Swarm Intelligence Design Technique

COOPERATIVE STRATEGY BASED ON ADAPTIVE Q- LEARNING FOR ROBOT SOCCER SYSTEMS

Adjustable Group Behavior of Agents in Action-based Games

Using Reactive Deliberation for Real-Time Control of Soccer-Playing Robots

Objectives. Game AI: Collaborative Diffusion. Project: The Sims. Advance from simple game to very sophisticated games

1) Complexity, Emergence & CA (sb) 2) Fractals and L-systems (sb) 3) Multi-agent systems (vg) 4) Swarm intelligence (vg) 5) Artificial evolution (vg)

Hierarchical Controller for Robotic Soccer

2 Our Hardware Architecture

Artificial Intelligence. Cameron Jett, William Kentris, Arthur Mo, Juan Roman

ARTIFICIAL INTELLIGENCE (CS 370D)

IMPROVING TOWER DEFENSE GAME AI (DIFFERENTIAL EVOLUTION VS EVOLUTIONARY PROGRAMMING) CHEAH KEEI YUAN

the gamedesigninitiative at cornell university Lecture 8 Prototyping

Using Artificial intelligent to solve the game of 2048

RoboCup. Presented by Shane Murphy April 24, 2003

Soccer-Swarm: A Visualization Framework for the Development of Robot Soccer Players

AI Agent for Ants vs. SomeBees: Final Report

Modeling Security Decisions as Games

Programmable self-assembly in a thousandrobot

ConvNets and Forward Modeling for StarCraft AI

Cooperative Behavior Acquisition in A Multiple Mobile Robot Environment by Co-evolution

COMP219: COMP219: Artificial Intelligence Artificial Intelligence Dr. Annabel Latham Lecture 12: Game Playing Overview Games and Search

Swarming the Kingdom: A New Multiagent Systems Approach to N-Queens

Strategy for Collaboration in Robot Soccer

Multi-Agent Control Structure for a Vision Based Robot Soccer System

Crowd-steering behaviors Using the Fame Crowd Simulation API to manage crowds Exploring ANT-Op to create more goal-directed crowds

Artificial Intelligence ( CS 365 ) IMPLEMENTATION OF AI SCRIPT GENERATOR USING DYNAMIC SCRIPTING FOR AOE2 GAME

CS325 Artificial Intelligence Ch. 5, Games!

How Students Teach Robots to Think The Example of the Vienna Cubes a Robot Soccer Team

TUD Poker Challenge Reinforcement Learning with Imperfect Information

USING A FUZZY LOGIC CONTROL SYSTEM FOR AN XPILOT COMBAT AGENT ANDREW HUBLEY AND GARY PARKER

Design of intelligent surveillance systems: a game theoretic case. Nicola Basilico Department of Computer Science University of Milan

SWARM INTELLIGENCE. Mario Pavone Department of Mathematics & Computer Science University of Catania

ER-Force Team Description Paper for RoboCup 2010

FU-Fighters. The Soccer Robots of Freie Universität Berlin. Why RoboCup? What is RoboCup?

Tac Due: Sep. 26, 2012

COMP219: Artificial Intelligence. Lecture 13: Game Playing

Adaptive Multi-Robot Behavior via Learning Momentum

Game Playing for a Variant of Mancala Board Game (Pallanguzhi)

Design of intelligent surveillance systems: a game theoretic case. Nicola Basilico Department of Computer Science University of Milan

Analysis of Game Balance

Game Artificial Intelligence ( CS 4731/7632 )

Practice Session 2. HW 1 Review

Artificial Neural Networks. Artificial Intelligence Santa Clara, 2016

Playing Atari Games with Deep Reinforcement Learning

Balancing automated behavior and human control in multi-agent systems: a case study in Roboflag

Today. Types of Game. Games and Search 1/18/2010. COMP210: Artificial Intelligence. Lecture 10. Game playing

Autonomous Robot Soccer Teams

Moving Path Planning Forward

Multi-Platform Soccer Robot Development System

Operation Blue Metal Event Outline. Participant Requirements. Patronage Card

Fuzzy Logic for Behaviour Co-ordination and Multi-Agent Formation in RoboCup

HUJI AI Course 2012/2013. Bomberman. Eli Karasik, Arthur Hemed

TEMPORAL DIFFERENCE LEARNING IN CHINESE CHESS

The CMUnited-97 Robotic Soccer Team: Perception and Multiagent Control

History and Philosophical Underpinnings

National University of Singapore

Swarm Robotics. Clustering and Sorting

CS 188: Artificial Intelligence Fall AI Applications

Biologically-inspired Autonomic Wireless Sensor Networks. Haoliang Wang 12/07/2015

The Implementation of Artificial Intelligence and Machine Learning in a Computerized Chess Program

CSCI 4150 Introduction to Artificial Intelligence, Fall 2004 Assignment 7 (135 points), out Monday November 22, due Thursday December 9

Asymmetric potential fields

SPQR RoboCup 2014 Standard Platform League Team Description Paper

Optimal Rhode Island Hold em Poker

COMP3211 Project. Artificial Intelligence for Tron game. Group 7. Chiu Ka Wa ( ) Chun Wai Wong ( ) Ku Chun Kit ( )

Soccer Server: a simulator of RoboCup. NODA Itsuki. below. in the server, strategies of teams are compared mainly

CS 1571 Introduction to AI Lecture 12. Adversarial search. CS 1571 Intro to AI. Announcements

Current Trends in Technology and Science ISSN: Volume: VI, Issue: VI

the gamedesigninitiative at cornell university Lecture 10 Game Architecture

Opponent Models and Knowledge Symmetry in Game-Tree Search

Distributed, Play-Based Coordination for Robot Teams in Dynamic Environments

Games (adversarial search problems)

Attention! Choking hazard! Small pieces, not for children under three years old. Figure 01 - Set Up for Kick Off. corner arc. corner square.

Learning Artificial Intelligence in Large-Scale Video Games

the question of whether computers can think is like the question of whether submarines can swim -- Dijkstra

Artificial Intelligence for Games

LECTURE 26: GAME THEORY 1

Multiple Agents. Why can t we all just get along? (Rodney King)

Extending the STRADA Framework to Design an AI for ORTS

Design of Adaptive Collective Foraging in Swarm Robotic Systems

Electronic Research Archive of Blekinge Institute of Technology

Swarm Intelligence. Corey Fehr Merle Good Shawn Keown Gordon Fedoriw

CS494/594: Software for Intelligent Robotics

Training a Neural Network for Checkers

Design of an Action Select Mechanism for Soccer Robot Systems Using Artificial Immune Network

Robotic Systems ECE 401RB Fall 2007

Improvement of Robot Path Planning Using Particle. Swarm Optimization in Dynamic Environments. with Mobile Obstacles and Target

CS594, Section 30682:

MASON. A Java Multi-agent Simulation Library. Sean Luke Gabriel Catalin Balan Liviu Panait Claudio Cioffi-Revilla Sean Paus

Multi-threat containment with dynamic wireless neighborhoods

Discussion of Emergent Strategy

CS 599: Distributed Intelligence in Robotics

Building a Better Battle The Halo 3 AI Objectives System

Multi-Robot Team Response to a Multi-Robot Opponent Team

AI in Computer Games. AI in Computer Games. Goals. Game A(I?) History Game categories

FreeCiv Learner: A Machine Learning Project Utilizing Genetic Algorithms

Towards Strategic Kriegspiel Play with Opponent Modeling

CS 2710 Foundations of AI. Lecture 9. Adversarial search. CS 2710 Foundations of AI. Game search

Reinforcement Learning in Games Autonomous Learning Systems Seminar

CMUnited-97: RoboCup-97 Small-Robot World Champion Team

Transcription:

Swarm AI: A Solution to Soccer Alex Kutsenok Advisor: Michael Wollowski Senior Thesis Rose-Hulman Institute of Technology Department of Computer Science and Software Engineering May 10th, 2004

Definition of Swarm AI Swarm intelligence is a relatively new AI method, modeled after Swarm-like insects like bees and ants. A sophisticated group behavior that emerges from a multitude of simple individual behaviors Swarm AI: The 3 Principles 1) split problem into parts and assign them to agents 2) agents are given a simplified or incomplete view of the environment 3) agents communicate with each other

My Objective I want to use Swarm AI as a tool to control artificial agents playing soccer. 3 soccer sub-problems: defensive coverage moving without the ball on offense deciding when to pass For comparison, I will play it against a centralized rule-based AI architecture (CRAI)

Why Do This Project Swarm AI has mostly been used to solve pathfinding problems like the TSP, VRP, and even reallife networking issues Alexis Drogoul came up with Swarm Chess a simple approach the pieces think for themselves a different use for Swarm AI Are there other unlikely uses for insect thinking? I am seeing if Swarm Intelligence can work in a dynamic strategic environment where things change on the fly and the agents have a limited amount of time to decide how to act

Why This Is Swarm Intelligence Swarm Defense no centralized algorithm to tell them who to guard players only think about locations, not velocities because they use the Openness Heuristic they communicate by painting enemies Swarm Defender and Forward Runs each player decides where he should go forwards ignore teammates, defenders ignore enemies works without communication, but can be improved with it, so a good area for Future Work. Is flocking for now. Swarm Passing players without the ball do thinking in addition to passer players only think about locations, not velocities communicate by painting themselves

Questions? Thank you for your time!

Swarm AI: Defensive Coverage Each shift turn, the players on the Swarm AI team individually decide whom or what they will be covering defensively 5 enemies and the friendly penalty zone = 6 targets Each Swarm player looks at the costs and benefits of guarding each target and chooses appropriately: Individual Paint Decision Algorithm (IPDA) Openness Heuristic: how many enemies are within a radius of 100 pixels how close are those enemies

Swarm AI: Defensive Coverage Each shift turn, the players on the Swarm AI team individually decide whom or what they will be covering defensively 5 enemies and the friendly penalty zone = 6 targets Each Swarm player looks at the costs and benefits of guarding each target and chooses appropriately: Individual Paint Decision Algorithm (IPDA) Openness Heuristic: how many enemies are within a radius of 100 pixels how close are those enemies

SAI: More on Defensive Coverage Reward Heuristic more reward for covering enemies who are open, close to the friendly goal, and who are ball carriers Cost Heuristic is time to intercept the target is distance/speed if can t intercept IPDA calculates the profit of guarding each target; it s run separately by each player a covered target is painted by that player Initial Profit = Reward- Cost for a player target Initial Profit = 100 for guarding the zone if target has being painted by another teammate, Profit= Initial Profit / 4 if painted target is the ball carrier, then only divide by 2 cover the target with largest Profit, paint it your color IPDA Example

Swarm AI: Offensive Player Movement Without the Ball In soccer it is a good idea for players without the ball to make runs to get open; this inspired the Swarm strategy. 2 Kinds of roles: Forward and Defender a player is pulled in several directions based on role sum up these vectors to get the direction for the player s movement velocity Forwards away from enemies within 200 units toward enemy goal toward ball Defenders away from friendlies within 200 units toward friendly goal toward ball