Adjustable Group Behavior of Agents in Action-based Games
|
|
- Mervin Ramsey
- 5 years ago
- Views:
Transcription
1 Adjustable Group Behavior of Agents in Action-d Games Westphal, Keith and Mclaughlan, Brian Department of Computer and Information Sciences University of Arkansas - Fort Smith Abstract Non-player characters (NPCs) within a single-player action-d game have historically been easy to kill and often do not work as a team to overwhelm the players. In addition, they generally do not adjust strategies d on the player s behavior. This research proposes that these s should have adjustable behavior parameters that allow them to adapt to the behaviors of their opponents. In particular, this research proposes these NPC s have an adjustable ness towards the player giving them an option on whether to hide or to attack. Also, it examines the utility of s that attempt to attack together and work in a group using simple decision making rather than being individuals. We developed a simulation that gathers information regarding the win percentages of teams of s that have various behavior combinations versus different types of opponents. Behavior parameters examined include individuality versus teamwork and posture versus defensive posture. Results showed that certain behavior combinations have significant utility when the behavior of the opposing team is identified. Index Terms Artificial Intelligence, Agent, NPC, Group decision making, MMO (Massively Multiplayer Online Games), and game loop I. Introduction AI-controlled non-player characters (NPCs) are the basis for opposition in single-player and cooperative team video games. These NPCs have historically been easy to destroy and often do not work as a team to overwhelm the players. In addition, they generally do not adjust strategies d on player behavior. When a skilled player plays against NPCs, the game can become rather easy. Fortunately, computer opponents have evolved from the simple behaviors found in games such as Pac Man and Pong into the realistic war games of today such as Killzone, Modern Warfare, and the Battlefield games. With these recent increases in AI technology in video games, the AI of a game has become a significant selling point. Modern game reviewers now keep a place on their notepad just for rating the AI in these games, and when many players hear that the game has a great AI, they are more likely to want to play it. Unfortunately, most of a game s AI resources are focused on individual NPC tactics [1]. In the latest generation of video games, the AI controlling the NPCs will hide if shot at, will also run away from grenades, and will look for advantages locations. However, they are far from acting as a team. Some of the best games out do have communication between their AI s to assist in making the game more difficult for the player. Nevertheless, communication alone is still rather far from group decision-making. In action-d games such as FPS games, going solo is almost guaranteed to get you killed being as the best you can hope for is a 1-on-1 match up. However when running in groups, s have a much better chance to come across match ups that are more in their favor. This paper postulates that coordinating the group behavior and adjusting it d upon the behaviors of the opposing force can lead to increased success for the NPC team and a more rewarding play experience for the players. Currently, the primary work being done in group decision-making in the field of Artificial Intelligence is in the game of football (soccer in USA) [2]. Being a complex sport with many rules, this research is a great starting point within the field of group decision-making. However in the case of action games where destruction is very possible, it is not the best starting platform. There have been a number of approaches to this topic. Semsar-Kazerooni proposes a game theory approach to team cooperation, particularly team grouping [3]. Abraham has shown research into NPC team-mates
2 that assist the players [4]. In addition, psychological research examines the basis for human grouping and movement [5]. II. Approach In order to test these hypotheses, two teams of five s are placed on a map containing three s as shown in figure [1]. The goal of the game is to capture all three s. Alternatively, a team can win by eliminating all of the opposing team, as it is assumed the remaining team would then be able to freely capture all the s. Figure 1: A typical game setup In this game framework, various combinations of grouping and aggression are assigned to each team. Agents on a team can tend to group together or spread apart. They can tend towards making risky moves or attempt to remain in the relative safety of a. Finally, when given a choice, they can focus more on capturing s or eliminating enemies. III. The Agents Agents have multiple attributes that allow them to persist and interact within the game world. During the development of the s we wanted to make sure that the s were as individualistic and anonymous as possible to ensure that any results were affected by only changes within the itself. These attributes include: 1. Aggressiveness towards s versus s 2. How the is towards its target 3. Minimum and maximum distance to other teammates Any of these attributes when changed will affect the outcome of each simulation. The s two targets, s and s, make the choose a particular type of target with a much higher certainty. The minimum distance and the maximum distance restrict each s movement to a certain area around other s of its own team. This facilitates our version of grouping. In addition, the s have an armor rating, an attack rating, and a sighting distance. These values affect the s abilities to take damage, to deal damage, and to see targets. These values are not varied between s in these experiments. A. Agent Decisions The s group together by continually staying at a certain distance to and from the other s in its group. When s are set to stay in a group the maximum distance is set to 5 while the minimum distance is set to 3 which will restrict the s from moving to far from each other. However when the s are set to be non-grouping their maximum distance is set to be 25 with the minimum distance staying at 3. Having their maximum distance set to 25 allows the s to move freely throughout the map as individuals. The aggression of the s on each team is d off of an algorithm that determines where the will attempt to move. This algorithm is d on the notion of temperature. Agents in the system are attracted to higher temperatures. Each has a temperature that can fluctuate depending on the amount of activity at the. Each s temperature is d on its health. As each of the s is injured and has its health reduced its temperature goes up drawing other s towards it. The aggression algorithm is d off of the temperatures of both the and the s. The equation becomes the temperature divided by the distance plus the s corresponding aggression (temperature/distance)+aggression and the object that has the highest value becomes the s target. If an is deemed to be towards a certain object this value is increased by 1 if the target that the is evaluating is one of these objects. When an is, it is only towards s on the other team and s owned by the other team. If an is then it is not only towards s of the other team but also ones that are not owned by any team. In this context we deemed that an
3 Aggression constant of 1 as an appropriate number as it will not cause an to give up a very good opportunity to attack an object that it is not toward but is enough to cause it to move toward its aggressed target most often. If this algorithm were to be moved to a larger map with different temperatures this additional number would need to be changed to suit the environment. A typical aggression scenario is shown in figure [2]. draw s and players alike, together. In MMOs (Massively Multiplayer Online) and FPS games, s are used to increase the amount of people in a fight creating a much higher pace of action throughout the game. Without anything to draw players and s together the fighting becomes slow and there is a great reduction in the amount of fighting, thus reducing the appeal that the game has. Along with the s, the s also have attributes that affect the outcome of each simulation. These attributes include: 1. Radius 2. Temperature 3. Owner Figure 2 [In this figure the square team is while the triangle team is.] B. Agent Actions Movement the s have two main functions allowing movement, a rotate towards function and a move forward function. Each plans its movement, and then all s move at the same time, preventing either team from benefiting from additional knowledge. Attack When an comes within another s radius these s are allowed to attack one another. This ability to attack other s within the environment is the key ingredient to any action d game. When an attacks another, it only gets to attack one time toward one on each trip through the game loop. When each attacks, it removes the amount of attack it has from the enemy s armor amount. Take a As an moves around the map it will attempt to move toward s and s. When an comes within a s radius it will attempt to take the. When an takes a, it removes a certain amount of temperature from the adjacent. IV. Bases Bases represent another key attribute to many action d games. Bases create hot zones that tend to The radius of the defines how far away an has to be to be able to capture the. When a s temperature reaches the is considered taken and its owner becomes the team number of the that captured the. When all three s have the same owner the corresponding team wins. In order to draw s back to that the s temperature is increased by 1 each time the game loop progresses. The initial map set up included five s on each team placed just on the outside of the s on the right side of the map (Figure [1]). This style of map placement is traditional in both MMO style and also online FPS games during any sort of capture the style gameplay. The primary reason for placing the s like this is that it gives both teams easy access to a and then equal access to the third. This placement promotes a fair playing field to make sure that the map placement of the s did not affect the outcome of the simulations. To reinsure that this map placement did not affect the outcome of our simulations we rearrange the placement of the s giving each team a chance to start from either the top or bottom right s. This change produced near exactly the same results allowing for the conclusion that the map has no effect on the results. V. Data Each of the scenarios is divided into wins via killing off the other team and via capturing all of the s. All of the tested variables did make a significant impact on the outcome of the scenarios. In general when each team was given a more tendency towards a certain object, they tended to win according to the winning scenario of that object more often. Figure [3] depicts the wins d on Team 1 as and team as and both teams grouping.
4 Figure 3 [wins for teams that are grouping with ness towards s] When the teams are more towards s they tend to capture s more often than kill off the other team, the same can be said about when s are more towards other s. This tendency proves to us that the attributes in our when changed are having an effect on the outcome of our results. According to our results both and ness improves the teams chance of survival and victory. In general when s play against non s the s win more than times out of. 4 team = team = team 1 team team = Figure 4 [both teams grouping] team = team = team = In the starting hypothesis we decided that due to when s spread out they tend to attack as solo s and that each solo will become easily overwhelmed by the group of s. When the simulation was run, the data depicted in figure [6] on almost every account showed this exact result. The s that were grouping won more often than the s that were non-grouping. The only time that the non-grouping team won was when the non-grouping team was and the grouping team was. Thus pointing towards our hypothesis that it is good to stick together For each different set of attributes the simulation was run times in order to eliminate any outliers within the series. The attributes were tested with both teams set as grouping as in figure [4], both teams as non-grouping as in figure [5], and with one team as grouping and the other as non-grouping as in figure [6] (each of these figures depicts wins for each team pertaining to the scenario). In figure [4] the general outline of the data is even across the board besides when placing an team against a non- team. We believe that the reason for this is when a team groups up their ability to make it to all of the s is restricted because the s pull the whole team to one and then another and can t attack multiple s at a time thus making it an even playing field for wins. However when the teams group up they are able to kill other teams of s very efficiently, thus increasing their ability to win via killing the s on the other team. The difference in the amount of wins when run with two different kinds of ness can be attributed to the fact that our s have no survival instincts, meaning that if a team that is turns towards a it may decide to move towards the rather than returning fire. This would allow the s that are to kill the s with no resistance. team = team = Team 1 Team team = Figure 5 [both teams non-grouping] team = team = team =
5 In figure [5] the general outline of the data differs quite a lot from figure [4] there are 2 extremes in this data rather than just the one in figure [4] and, those are when you change both ness and ness. We believe that the change in ness is due to the same reason as when teams group up, being that the s tend to allow the s kill them, however when changing the ness in non-grouping s we see a large increase in wins. We believe that this is due to the fact that when non-grouping s are they divide and conquer and are able to take multiple s at a time rather than just one, this conclusion is d off of the fact that in our data the teams win by s almost 2 to 1 compared to winning with kills. In figure [6] we see the primary data, what happens when you change the way the teams group up and also their ness. We see a dramatic change in the amount of wins for the team that groups up. Our data shows that these extra wins are nearly always wins from killing the other team. We believe that this is due to the effect of swarming each that strays from its group is quickly overwhelmed by the team of s that is grouped up. VI. Future Work This project given the time limitations was not able to fulfill all of the desired outcomes. This project can take many new directions if given more work and time. 1. Advanced group decision making. At this point, only basic decisions are being made. It is possible that complex decisions such as having some team members assuming behavior while other team members remain behind to guard s could yield interesting results. 2. Complex survival instincts. In their current form, more s do not appear to have any benefits. If s could choose between ly pursuing a target versus taking cover or moving out of field of fire, survivability could be increased. 3. Enemy strategy discovery. Further work needs to be done to allow the team to determine which combination of parameters the enemy team is adopting in order to counter that strategy. VII. References 4 team = team = Team 1 Team 2 team = team = team = team = [1] Beij, A., and van der Sterren, W. (5). Killzone s AI: Dynamic Procedural Tactics Game Developer Conference, March 1, 5. [2] Semsar-Kazerooni, S. (June, 9). A game theory approach to multi- team cooperation. [3] Abraham, Aswin T. "AI for Dynamic Team- mate Adaptation in Games." (21): n. pag.ieee. Web. 4 Jan [4] Ruiz, Myriam A. "Team Agent Behavior Architecture in Robot Soccer." (n.d.): n. pag. IEEE. Web. 4 Jan [5] Derks, Belle. "Working for the Self or Working for the Group: How Self- Versus Group Affirmation Affects Collective Behavior in Low-Status Groups." Journal of Personality and Social Psychology 96.1 (9): IEEE. Web. 4 Jan Figure 6 [Team 1 as grouping Team as non-grouping]
Opponent Modelling In World Of Warcraft
Opponent Modelling In World Of Warcraft A.J.J. Valkenberg 19th June 2007 Abstract In tactical commercial games, knowledge of an opponent s location is advantageous when designing a tactic. This paper proposes
More informationUSING A FUZZY LOGIC CONTROL SYSTEM FOR AN XPILOT COMBAT AGENT ANDREW HUBLEY AND GARY PARKER
World Automation Congress 21 TSI Press. USING A FUZZY LOGIC CONTROL SYSTEM FOR AN XPILOT COMBAT AGENT ANDREW HUBLEY AND GARY PARKER Department of Computer Science Connecticut College New London, CT {ahubley,
More informationSwarm AI: A Solution to Soccer
Swarm AI: A Solution to Soccer Alex Kutsenok Advisor: Michael Wollowski Senior Thesis Rose-Hulman Institute of Technology Department of Computer Science and Software Engineering May 10th, 2004 Definition
More informationIMPROVING TOWER DEFENSE GAME AI (DIFFERENTIAL EVOLUTION VS EVOLUTIONARY PROGRAMMING) CHEAH KEEI YUAN
IMPROVING TOWER DEFENSE GAME AI (DIFFERENTIAL EVOLUTION VS EVOLUTIONARY PROGRAMMING) CHEAH KEEI YUAN FACULTY OF COMPUTING AND INFORMATICS UNIVERSITY MALAYSIA SABAH 2014 ABSTRACT The use of Artificial Intelligence
More informationArtificial Intelligence Paper Presentation
Artificial Intelligence Paper Presentation Human-Level AI s Killer Application Interactive Computer Games By John E.Lairdand Michael van Lent ( 2001 ) Fion Ching Fung Li ( 2010-81329) Content Introduction
More informationAn analysis of Cannon By Keith Carter
An analysis of Cannon By Keith Carter 1.0 Deploying for Battle Town Location The initial placement of the towns, the relative position to their own soldiers, enemy soldiers, and each other effects the
More informationDota2 is a very popular video game currently.
Dota2 Outcome Prediction Zhengyao Li 1, Dingyue Cui 2 and Chen Li 3 1 ID: A53210709, Email: zhl380@eng.ucsd.edu 2 ID: A53211051, Email: dicui@eng.ucsd.edu 3 ID: A53218665, Email: lic055@eng.ucsd.edu March
More informationA NEW SIMULATION FRAMEWORK OF OPERATIONAL EFFECTIVENESS ANALYSIS FOR UNMANNED GROUND VEHICLE
A NEW SIMULATION FRAMEWORK OF OPERATIONAL EFFECTIVENESS ANALYSIS FOR UNMANNED GROUND VEHICLE 1 LEE JAEYEONG, 2 SHIN SUNWOO, 3 KIM CHONGMAN 1 Senior Research Fellow, Myongji University, 116, Myongji-ro,
More informationWhen placed on Towers, Player Marker L-Hexes show ownership of that Tower and indicate the Level of that Tower. At Level 1, orient the L-Hex
Tower Defense Players: 1-4. Playtime: 60-90 Minutes (approximately 10 minutes per Wave). Recommended Age: 10+ Genre: Turn-based strategy. Resource management. Tile-based. Campaign scenarios. Sandbox mode.
More informationOperation Blue Metal Event Outline. Participant Requirements. Patronage Card
Operation Blue Metal Event Outline Operation Blue Metal is a Strategic event that allows players to create a story across connected games over the course of the event. Follow the instructions below in
More informationAnalysis of Game Balance
Balance Type #1: Fairness Analysis of Game Balance 1. Give an example of a mostly symmetrical game. If this game is not universally known, make sure to explain the mechanics in question. What elements
More informationArtificial Intelligence for Games
Artificial Intelligence for Games CSC404: Video Game Design Elias Adum Let s talk about AI Artificial Intelligence AI is the field of creating intelligent behaviour in machines. Intelligence understood
More informationSTEEL-CLAD MANHUNT INTRODUCTION BATTLEFIELD SET-UP FOWW SCP
FOWW SCP-012-111 STEEL-CLAD MANHUNT INTRODUCTION PLAYER 1 DEPLOYMENT ZONE The game of cat and mouse between you and your opponent has lead you both to an old RobCo testing field. Amidst the rusty carcasses
More informationThe Level is designed to be reminiscent of an old roman coliseum. It has an oval shape that
Staging the player The Level is designed to be reminiscent of an old roman coliseum. It has an oval shape that forces the players to take one path to get to the flag but then allows them many paths when
More informationEmpires at War. 2. Win conditions Your main objective is destroy all unit cards of the opposing player. You can recognize unit
Empires at War 1. About game Empires at War is a competitive card game set during I World War. Players create unique decks and take control over armies of conflicted nations. To win, you have to break
More informationI-95 GAMERS. Domination Missions
I-95 GAMERS Domination Missions I-95 GAMERS Domination Missions Design notes Domination special rules Domination Frontline Domination Blind Domination Blitzkrieg Domination Early war Blitzkrieg Domination
More informationGame Artificial Intelligence ( CS 4731/7632 )
Game Artificial Intelligence ( CS 4731/7632 ) Instructor: Stephen Lee-Urban http://www.cc.gatech.edu/~surban6/2018-gameai/ (soon) Piazza T-square What s this all about? Industry standard approaches to
More informationAI in Computer Games. AI in Computer Games. Goals. Game A(I?) History Game categories
AI in Computer Games why, where and how AI in Computer Games Goals Game categories History Common issues and methods Issues in various game categories Goals Games are entertainment! Important that things
More informationWho am I? AI in Computer Games. Goals. AI in Computer Games. History Game A(I?)
Who am I? AI in Computer Games why, where and how Lecturer at Uppsala University, Dept. of information technology AI, machine learning and natural computation Gamer since 1980 Olle Gällmo AI in Computer
More informationFPS Assignment Call of Duty 4
FPS Assignment Call of Duty 4 Name of Game: Call of Duty 4 2007 Platform: PC Description of Game: This is a first person combat shooter and is designed to put the player into a combat environment. The
More informationCONFEDERACY GAME OVERVIEW. Components 60 Troop tiles 20 double sided Order/Wound Tokens 2 player aids 6 dice This ruleset
MODERN #1 CONFEDERACY GAME OVERVIEW Pocket Battles is a series of fast and portable wargames. Each game comes with two armies that can be lined up one versus the other, or against any other army in the
More informationCPS331 Lecture: Intelligent Agents last revised July 25, 2018
CPS331 Lecture: Intelligent Agents last revised July 25, 2018 Objectives: 1. To introduce the basic notion of an agent 2. To discuss various types of agents Materials: 1. Projectable of Russell and Norvig
More informationCOOPERATIVE STRATEGY BASED ON ADAPTIVE Q- LEARNING FOR ROBOT SOCCER SYSTEMS
COOPERATIVE STRATEGY BASED ON ADAPTIVE Q- LEARNING FOR ROBOT SOCCER SYSTEMS Soft Computing Alfonso Martínez del Hoyo Canterla 1 Table of contents 1. Introduction... 3 2. Cooperative strategy design...
More informationFAQ WHAT ARE THE MOST NOTICEABLE DIFFERENCES FROM TOAW III?
1 WHAT ARE THE MOST NOTICEABLE DIFFERENCES FROM TOAW III? a) Naval warfare has been radically improved. b) Battlefield Time Stamps have radically altered the turn burn issue. c) The User Interface has
More informationStrategic and Tactical Reasoning with Waypoints Lars Lidén Valve Software
Strategic and Tactical Reasoning with Waypoints Lars Lidén Valve Software lars@valvesoftware.com For the behavior of computer controlled characters to become more sophisticated, efficient algorithms are
More informationSCENARIO LIST. (In no particular order) SEIZE GROUND. - As per page #91 of the Warhammer 40,000 Rulebook -
The following is the complete list of scenarios that may be played at the 2011 Ultimate Warhammer 40K tournament. Four of these will be used by all players in the first four rounds of the tournament (pre-determined
More informationWarhammer 40K Golden Rhino Tournament
CREATED BY IAN PIETILA FOR USE AT THE HIGHLAND PUBLIC LIBRARY Warhammer 40K Golden Rhino Tournament JULY 28TH 1ST ANNUAL List Requirements and Structure INSIDE YOU LL FIND Army list requirements and structure.
More informationBAPC The Problem Set
BAPC 2012 The 2012 Benelux Algorithm Programming Contest The Problem Set A B C D E F G H I J Another Dice Game Black Out Chess Competition Digit Sum Encoded Message Fire Good Coalition Hot Dogs in Manhattan
More informationAD VICTORIAM INTRODUCTION BATTLEFIELD SET-UP FOWW SCP
FOWW SCP-001-111 AD VICTORIAM INTRODUCTION The scouts reported that three Power Armor suits were laying around this part. Trap or not, those suits are too valuable to ignore. We must seize them! SCAVENGER
More informationGalaxy of D 1/ About the Components: the Map The war takes place in Galaxy of D (the hexes are called sectors).
3.1. About the Components: the Map The war takes place in Galay of D (the hees are called sectors). A TWO Players he & counter space combat game Fast, brutal and diceless combat! 1. INTRODUCTION Once again,
More informationASSAULT OBJECTIVES DEPLOYMENT HEXADOME SCORING ZONE END-GAME CONDITIONS. SCENARIOS v 1.3
SCENARIOS v 1.3 ASSAULT Being the only player with one or more Characters inside the Scoring Zone at the end of the Round (3 Victory Points). of the Round than the opponent (2 Victory Points, but only
More informationAbstract Games Issue 9 Spring 2002
1 of 8 8/29/2008 10:02 AM Abstract Games Issue 9 Spring 2002 ealm is a wonderful and unique two-person abstract strategy game. It involves capturing territory and blocking and immobilizing the other player's
More informationCPS331 Lecture: Agents and Robots last revised November 18, 2016
CPS331 Lecture: Agents and Robots last revised November 18, 2016 Objectives: 1. To introduce the basic notion of an agent 2. To discuss various types of agents 3. To introduce the subsumption architecture
More informationApproximation Models of Combat in StarCraft 2
Approximation Models of Combat in StarCraft 2 Ian Helmke, Daniel Kreymer, and Karl Wiegand Northeastern University Boston, MA 02115 {ihelmke, dkreymer, wiegandkarl} @gmail.com December 3, 2012 Abstract
More informationDefenders of the Realm: Battlefields 1. Player seating arrangement -
Defenders of the Realm: Battlefields is a competitive fantasy battle game for 2 to 4 players. In the game, one side takes the role of the Dark Lord s invading army and minions while the other side represents
More informationCapturing and Adapting Traces for Character Control in Computer Role Playing Games
Capturing and Adapting Traces for Character Control in Computer Role Playing Games Jonathan Rubin and Ashwin Ram Palo Alto Research Center 3333 Coyote Hill Road, Palo Alto, CA 94304 USA Jonathan.Rubin@parc.com,
More informationGeneral Rules. 1. Game Outline DRAGON BALL SUPER CARD GAME OFFICIAL RULE The act of surrendering is not affected by any cards.
DRAGON BALL SUPER CARD GAME OFFICIAL RULE MANUAL ver.1.03 Last update: 10/04/2017 1-2-5. The act of surrendering is not affected by any cards. Players can never be forced to surrender due to card effects,
More informationFULL RULEBOOK GAME FLOW TABLE OF CONTENTS. Playing Scenarios... 17
T FULL RULEBOOK his book includes the complete rules for the game, followed by the Scenario section on page 17. This rulebook is not intended as a method for learning the game, and especially not as a
More informationCMSC 671 Project Report- Google AI Challenge: Planet Wars
1. Introduction Purpose The purpose of the project is to apply relevant AI techniques learned during the course with a view to develop an intelligent game playing bot for the game of Planet Wars. Planet
More informationGeneral Rules. 1. Game Outline DRAGON BALL SUPER CARD GAME OFFICIAL RULE When all players simultaneously fulfill loss conditions, the MANUAL
DRAGON BALL SUPER CARD GAME OFFICIAL RULE MANUAL ver.1.071 Last update: 11/15/2018 1-2-3. When all players simultaneously fulfill loss conditions, the game is a draw. 1-2-4. Either player may surrender
More informationGeneral Rules. 1. Game Outline DRAGON BALL SUPER CARD GAME OFFICIAL RULE. conditions. MANUAL
DRAGON BALL SUPER CARD GAME OFFICIAL RULE MANUAL ver.1.062 Last update: 4/13/2018 conditions. 1-2-3. When all players simultaneously fulfill loss conditions, the game is a draw. 1-2-4. Either player may
More informationGame Turn 11 Soviet Reinforcements: 235 Rifle Div can enter at 3326 or 3426.
General Errata Game Turn 11 Soviet Reinforcements: 235 Rifle Div can enter at 3326 or 3426. Game Turn 11 The turn sequence begins with the Axis Movement Phase, and the Axis player elects to be aggressive.
More informationTEMPORAL DIFFERENCE LEARNING IN CHINESE CHESS
TEMPORAL DIFFERENCE LEARNING IN CHINESE CHESS Thong B. Trinh, Anwer S. Bashi, Nikhil Deshpande Department of Electrical Engineering University of New Orleans New Orleans, LA 70148 Tel: (504) 280-7383 Fax:
More informationGame Designers. Understanding Design Computing and Cognition (DECO1006)
Game Designers Understanding Design Computing and Cognition (DECO1006) Rob Saunders web: http://www.arch.usyd.edu.au/~rob e-mail: rob@arch.usyd.edu.au office: Room 274, Wilkinson Building Who are these
More informationFederico Forti, Erdi Izgi, Varalika Rathore, Francesco Forti
Basic Information Project Name Supervisor Kung-fu Plants Jakub Gemrot Annotation Kung-fu plants is a game where you can create your characters, train them and fight against the other chemical plants which
More informationExtending the STRADA Framework to Design an AI for ORTS
Extending the STRADA Framework to Design an AI for ORTS Laurent Navarro and Vincent Corruble Laboratoire d Informatique de Paris 6 Université Pierre et Marie Curie (Paris 6) CNRS 4, Place Jussieu 75252
More informationCPS331 Lecture: Agents and Robots last revised April 27, 2012
CPS331 Lecture: Agents and Robots last revised April 27, 2012 Objectives: 1. To introduce the basic notion of an agent 2. To discuss various types of agents 3. To introduce the subsumption architecture
More informationSequence of Play This rulebook is organized according to this Sequence of Play.
Introduction...1 Sequence of Play...2 Campaign Set-Up...2 Start of Week...10 Pre-Combat...11 Combat...14 Post-Combat...19 End of Week...20 End of Campaign...22 Optional Rules...22 Credits...22 Sample Game...23
More informationSample Game Instructions and Rule Book
Card Game Sample Game Instructions and Rule Book Game Design by Mike Fitzgerald Sample Game by Bob Morss Artwork by Peter Pracownik Publisher U.S. GAMES SYSTEMS, INC. 179 Ludlow Street, Stamford, CT 06902
More informationA Thunderbolt + Apache Leader TDA
C3i Magazine, Nr.3 (1994) A Thunderbolt + Apache Leader TDA by Jeff Petraska Thunderbolt+Apache Leader offers much more variety in terms of campaign strategy, operations strategy, and mission tactics than
More informationReinforcement Learning Applied to a Game of Deceit
Reinforcement Learning Applied to a Game of Deceit Theory and Reinforcement Learning Hana Lee leehana@stanford.edu December 15, 2017 Figure 1: Skull and flower tiles from the game of Skull. 1 Introduction
More informationNotes about the Kickstarter Print and Play: Components List (Core Game)
Introduction Terminator : The Board Game is an asymmetrical strategy game played across two boards: one in 1984 and one in 2029. One player takes control of all of Skynet s forces: Hunter-Killer machines,
More informationDistribution in Poland: Rebel Sp. z o.o. ul. Budowlanych 64c, Gdańsk
1 Game rules: Fréderic Moyersoen Project management: Krzysztof Szafrański and Maciej Teległow Editing and proofreading: Wojciech Ingielewicz DTP: Maciej Goldfarth and Łukasz S. Kowal Illustrations: Jarek
More informationLest We Forget A Solitaire Small Scale Ground Combat Game from WWI to Present Rules of Play
Lest We Forget A Solitaire Small Scale Ground Combat Game from WWI to Present Rules of Play c Wesley H. Fung Version. Introduction An infantry card with HIT. Lest We Forget (abbrev LWF) is a solitaire
More informationSolitaire Rules Deck construction Setup Terrain Enemy Forces Friendly Troops
Solitaire Rules Deck construction In the solitaire game, you take on the role of the commander of one side and battle against the enemy s forces. Construct a deck, both for yourself and the opposing side,
More informationGLOSSARY USING THIS REFERENCE THE GOLDEN RULES ACTION CARDS ACTIVATING SYSTEMS
TM TM USING THIS REFERENCE This document is intended as a reference for all rules queries. It is recommended that players begin playing Star Wars: Rebellion by reading the Learn to Play booklet in its
More informationRANDOM MISSION CONTENTS TAKING OBJECTIVES WHICH MISSION? WHEN DO YOU WIN THERE ARE NO DRAWS PICK A MISSION RANDOM MISSIONS
i The 1 st Brigade would be hard pressed to hold another attack, the S-3 informed Bannon in a workman like manner. Intelligence indicates that the Soviet forces in front of 1 st Brigade had lost heavily
More informationGame Mechanics Minesweeper is a game in which the player must correctly deduce the positions of
Table of Contents Game Mechanics...2 Game Play...3 Game Strategy...4 Truth...4 Contrapositive... 5 Exhaustion...6 Burnout...8 Game Difficulty... 10 Experiment One... 12 Experiment Two...14 Experiment Three...16
More information"Skill" Ranking in Memoir '44 Online
Introduction "Skill" Ranking in Memoir '44 Online This document describes the "Skill" ranking system used in Memoir '44 Online as of beta 13. Even though some parts are more suited to the mathematically
More informationAirship! Airship Creation
Airship! The Steampunk Adventure Table Game Captain? It s been some time. Thank you for agreeing to meet with me. There s trouble out west. The kind of trouble you specialize in solving. We re giving you
More informationAggression. Mary Jane O Neill, Stephanie Fan. August 6, 2013
Aggression Mary Jane O Neill, Stephanie Fan August 6, 2013 Abstract Aggression is an unsolved game in which no previous research has been conducted. We have analyzed the game to find the optimal strategy.
More informationCOMPONENT OVERVIEW Your copy of Modern Land Battles contains the following components. COUNTERS (54) ACTED COUNTERS (18) DAMAGE COUNTERS (24)
GAME OVERVIEW Modern Land Battles is a fast-paced card game depicting ground combat. You will command a force on a modern battlefield from the 1970 s to the modern day. The unique combat system ensures
More informationRobot Factory Rulebook
Robot Factory Rulebook Sam Hopkins The Vrinski Accord gave each of the mining cartels their own chunk of the great beyond... so why is Titus 316 reporting unidentified robotic activity? No time for questions
More informationGame Overview 2 Setting 3 Story 3 Main Objective 3. Game Components 3. Rules 4 Game Setup 4 Turn Sequence 5 General Rules 9 End Game Conditions 9
P a g e 1 Game Overview 2 Setting 3 Story 3 Main Objective 3 Game Components 3 Rules 4 Game Setup 4 Turn Sequence 5 General Rules 9 End Game Conditions 9 FAQ 10 Credits 10 Game Piece Appendix 11 Resource
More informationLearning Dota 2 Team Compositions
Learning Dota 2 Team Compositions Atish Agarwala atisha@stanford.edu Michael Pearce pearcemt@stanford.edu Abstract Dota 2 is a multiplayer online game in which two teams of five players control heroes
More informationUnofficial Bolt Action Scenario Book. Leopard, aka Dale Needham
Unofficial Bolt Action Scenario Book Leopard, aka Dale Needham Issue 0.1, August 2013 2 Chapter 1 Introduction Warlord Game s Bolt Action system includes a number of scenarios on pages 107 120 of the main
More informationSTRATEGO EXPERT SYSTEM SHELL
STRATEGO EXPERT SYSTEM SHELL Casper Treijtel and Leon Rothkrantz Faculty of Information Technology and Systems Delft University of Technology Mekelweg 4 2628 CD Delft University of Technology E-mail: L.J.M.Rothkrantz@cs.tudelft.nl
More informationFleet Engagement. Mission Objective. Winning. Mission Special Rules. Set Up. Game Length
Fleet Engagement Mission Objective Your forces have found the enemy and they are yours! Man battle stations, clear for action!!! Mission Special Rules None Set Up velocity up to three times their thrust
More informationPredicting outcomes of professional DotA 2 matches
Predicting outcomes of professional DotA 2 matches Petra Grutzik Joe Higgins Long Tran December 16, 2017 Abstract We create a model to predict the outcomes of professional DotA 2 (Defense of the Ancients
More informationCONTENTS INTRODUCTION Compass Games, LLC. Don t fire unless fired upon, but if they mean to have a war, let it begin here.
Revised 12-4-2018 Don t fire unless fired upon, but if they mean to have a war, let it begin here. - John Parker - INTRODUCTION By design, Commands & Colors Tricorne - American Revolution is not overly
More informationIntro to Interactive Entertainment Spring 2017 Syllabus CS 1010 Instructor: Tim Fowers
Intro to Interactive Entertainment Spring 2017 Syllabus CS 1010 Instructor: Tim Fowers Email: tim@fowers.net 1) Introduction Basics of Game Design: definition of a game, terminology and basic design categories.
More informationGilbert Peterson and Diane J. Cook University of Texas at Arlington Box 19015, Arlington, TX
DFA Learning of Opponent Strategies Gilbert Peterson and Diane J. Cook University of Texas at Arlington Box 19015, Arlington, TX 76019-0015 Email: {gpeterso,cook}@cse.uta.edu Abstract This work studies
More informationAnalyzing Games.
Analyzing Games staffan.bjork@chalmers.se Structure of today s lecture Motives for analyzing games With a structural focus General components of games Example from course book Example from Rules of Play
More informationGnome Wars User Manual
Gnome Wars User Manual Contents Game Installation... 2 Running the Game... 2 Controls... 3 The Rules of War... 3 About the Game Screen... 3 Combat Progression... 4 Moving Gnomes... 5 Fighting... 5 Characters...
More informationCOMPONENTS. 2 Special Square tiles. 12 Command Board tiles 4 double-sided Special Square tiles
Following decades of battles, warring factions realized that it was essential to support warships in combat. Therefore, specialized ships began to appear during battle: the Technical Ships. The first vessel
More informationCampaign Notes for a Grand-Strategic Game By Aaron W. Throne (This article was originally published in Lone Warrior 127)
Campaign Notes for a Grand-Strategic Game By Aaron W. Throne (This article was originally published in Lone Warrior 127) When I moved to Arlington, Virginia last August, I found myself without my computer
More informationHierarchical Controller for Robotic Soccer
Hierarchical Controller for Robotic Soccer Byron Knoll Cognitive Systems 402 April 13, 2008 ABSTRACT RoboCup is an initiative aimed at advancing Artificial Intelligence (AI) and robotics research. This
More informationKARP: Kids and Adults Role-Playing
KARP: Kids and Adults Role-Playing a card and dice-based game about fighting things, making and spending money, and special abilities Ages 8 and up by Conall Kavanagh, 2003 KARP is a free-form, mechanics-lite
More informationRU L E S REFERENCE USING THIS RULES REFERENCE
TM TM RU L E S REFERENCE USING THIS RULES REFERENCE This document is a reference for all Star Wars: Armada rules queries. Unlike the Learn to Play booklet, the Rules Reference booklet does not teach players
More informationthe gamedesigninitiative at cornell university Lecture 23 Strategic AI
Lecture 23 Role of AI in Games Autonomous Characters (NPCs) Mimics personality of character May be opponent or support character Strategic Opponents AI at player level Closest to classical AI Character
More informationA nostalgic edition for contemporary times. Attack and capture the flag!
A nostalgic edition for contemporary times. Attack and capture the flag! Stratego_Masters_Rules.indd 1 06-05-14 15:59 Historic background It s the year 1958... The British artist Gerald Holtom designs
More informationEvolving robots to play dodgeball
Evolving robots to play dodgeball Uriel Mandujano and Daniel Redelmeier Abstract In nearly all videogames, creating smart and complex artificial agents helps ensure an enjoyable and challenging player
More information2.0 The Battlefield. 2.1 Terrain Hexes. 2.2 Terrain Types. 3.0 Command Cards (10 each) 3.1 Order Cards (7 each)
Advanced Vive l Empereur Introduction Advanced Vive l Empereur is a Histo Command Dice System Game and allows you to simulate on a grand-tactical level the battles of the Napoleonic era. The player is
More informationDC Tournament RULES June 2017 v1.1
DC Tournament RULES June 2017 v1.1 BASIC RULES DC Tournament games will be played using the latest version of the DC Universe Miniature Game rules from Knight Models, including expansions and online material
More informationHoneycomb Hexertainment. Design Document. Zach Atwood Taylor Eedy Ross Hays Peter Kearns Matthew Mills Camoran Shover Ben Stokley
Design Document Zach Atwood Taylor Eedy Ross Hays Peter Kearns Matthew Mills Camoran Shover Ben Stokley 1 Table of Contents Introduction......3 Style...4 Setting...4 Rules..5 Game States...6 Controls....8
More informationCS 1571 Introduction to AI Lecture 12. Adversarial search. CS 1571 Intro to AI. Announcements
CS 171 Introduction to AI Lecture 1 Adversarial search Milos Hauskrecht milos@cs.pitt.edu 39 Sennott Square Announcements Homework assignment is out Programming and experiments Simulated annealing + Genetic
More informationFRIDAY :: MARCH 24 ZONE MORTALIS #1
FRIDAY :: MARCH 24 2:00 PM 5:00 PM ZONE MORTALIS #1 Do not lose this packet! It contains all necessary missions and results sheets required for you to participate in today s tournament. It is your responsibility
More informationExplanation of terms. BRITANNIA II SOLITAIRE RULES by Moritz Eggert Version 1.1, March 15,
Britannia II Solitaire Rules page 1 of 12 BRITANNIA II SOLITAIRE RULES by Moritz Eggert Version 1.1, March 15, 2006-03-15 The following rules should enable you to replace any nation on the board by an
More informationNoppon Prakannoppakun Department of Computer Engineering Chulalongkorn University Bangkok 10330, Thailand
ECAI 2016 - International Conference 8th Edition Electronics, Computers and Artificial Intelligence 30 June -02 July, 2016, Ploiesti, ROMÂNIA Skill Rating Method in Multiplayer Online Battle Arena Noppon
More informationWhat is Trust and How Can My Robot Get Some? AIs as Members of Society
What is Trust and How Can My Robot Get Some? Benjamin Kuipers Computer Science & Engineering University of Michigan AIs as Members of Society We are likely to have more AIs (including robots) acting as
More informationINTRODUCTION TO GAME AI
CS 387: GAME AI INTRODUCTION TO GAME AI 3/31/2016 Instructor: Santiago Ontañón santi@cs.drexel.edu Class website: https://www.cs.drexel.edu/~santi/teaching/2016/cs387/intro.html Outline Game Engines Perception
More informationAsymmetric potential fields
Master s Thesis Computer Science Thesis no: MCS-2011-05 January 2011 Asymmetric potential fields Implementation of Asymmetric Potential Fields in Real Time Strategy Game Muhammad Sajjad Muhammad Mansur-ul-Islam
More informationSATURDAY APRIL :00AM 10:30PM 5:00PM 10:00PM :00PM
SATURDAY APRIL 20 ------------------ 9:00AM 10:30PM 5:00PM 10:00PM ------------------ 9:00AM 9:00PM WARHAMMER 40K COMBAT PATROL Do not lose this packet! It contains all necessary missions and results sheets
More informationCreating Dynamic Soundscapes Using an Artificial Sound Designer
46 Creating Dynamic Soundscapes Using an Artificial Sound Designer Simon Franco 46.1 Introduction 46.2 The Artificial Sound Designer 46.3 Generating Events 46.4 Creating and Maintaining the Database 46.5
More informationDistributed, Play-Based Coordination for Robot Teams in Dynamic Environments
Distributed, Play-Based Coordination for Robot Teams in Dynamic Environments Colin McMillen and Manuela Veloso School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, U.S.A. fmcmillen,velosog@cs.cmu.edu
More informationAchieving Desirable Gameplay Objectives by Niched Evolution of Game Parameters
Achieving Desirable Gameplay Objectives by Niched Evolution of Game Parameters Scott Watson, Andrew Vardy, Wolfgang Banzhaf Department of Computer Science Memorial University of Newfoundland St John s.
More informationFive-In-Row with Local Evaluation and Beam Search
Five-In-Row with Local Evaluation and Beam Search Jiun-Hung Chen and Adrienne X. Wang jhchen@cs axwang@cs Abstract This report provides a brief overview of the game of five-in-row, also known as Go-Moku,
More information3rd Edition. Game Overview...2 Component Overview...2 Set-Up...6 Sequence of Play...8 Victory...9 Details of How to Play...9 Assigning Hostiles...
3rd Edition Game Overview...2 Component Overview...2 Set-Up...6 Sequence of Play...8 Victory...9 Details of How to Play...9 Assigning Hostiles...23 Hostile Turn...23 Campaigns...26 Optional Rules...28
More informationWARHAMMER 40K COMBAT PATROL
9:00AM 2:00PM ------------------ SUNDAY APRIL 22 11:30AM 4:30PM WARHAMMER 40K COMBAT PATROL Do not lose this packet! It contains all necessary missions and results sheets required for you to participate
More informationOperation Deep Jungle Event Outline. Participant Requirements. Patronage Card
Operation Deep Jungle Event Outline Operation Deep Jungle is a Raid event that concentrates on a player s units and how they grow through upgrades, abilities, and even fatigue over the course of the event.
More information