Prepared by Vaishnavi Moorthy Asst Prof- Dept of Cse

Similar documents
Game Playing. Dr. Richard J. Povinelli. Page 1. rev 1.1, 9/14/2003

Game playing. Chapter 5, Sections 1{5. AIMA Slides cstuart Russell and Peter Norvig, 1998 Chapter 5, Sections 1{5 1

Adversary Search. Ref: Chapter 5

Artificial Intelligence. Topic 5. Game playing

Game playing. Outline

Ch.4 AI and Games. Hantao Zhang. The University of Iowa Department of Computer Science. hzhang/c145

Outline. Game playing. Types of games. Games vs. search problems. Minimax. Game tree (2-player, deterministic, turns) Games

Game playing. Chapter 6. Chapter 6 1

Games vs. search problems. Game playing Chapter 6. Outline. Game tree (2-player, deterministic, turns) Types of games. Minimax

Adversarial Search and Game- Playing C H A P T E R 6 C M P T : S P R I N G H A S S A N K H O S R A V I

Game playing. Chapter 6. Chapter 6 1

Games vs. search problems. Adversarial Search. Types of games. Outline

ADVERSARIAL SEARCH. Chapter 5

Game playing. Chapter 5. Chapter 5 1

CS 380: ARTIFICIAL INTELLIGENCE ADVERSARIAL SEARCH. Santiago Ontañón

Game Playing. Philipp Koehn. 29 September 2015

Game Playing: Adversarial Search. Chapter 5

CS 380: ARTIFICIAL INTELLIGENCE

Games CSE 473. Kasparov Vs. Deep Junior August 2, 2003 Match ends in a 3 / 3 tie!

CS 1571 Introduction to AI Lecture 12. Adversarial search. CS 1571 Intro to AI. Announcements

Adversarial search (game playing)

Artificial Intelligence. Minimax and alpha-beta pruning

Module 3. Problem Solving using Search- (Two agent) Version 2 CSE IIT, Kharagpur

Adversarial Search and Game Playing. Russell and Norvig: Chapter 5

CS 2710 Foundations of AI. Lecture 9. Adversarial search. CS 2710 Foundations of AI. Game search

Foundations of AI. 6. Adversarial Search. Search Strategies for Games, Games with Chance, State of the Art. Wolfram Burgard & Bernhard Nebel

Game playing. Chapter 5, Sections 1 6

Algorithms for Data Structures: Search for Games. Phillip Smith 27/11/13

ARTIFICIAL INTELLIGENCE (CS 370D)

Game-playing AIs: Games and Adversarial Search FINAL SET (w/ pruning study examples) AIMA

CS 440 / ECE 448 Introduction to Artificial Intelligence Spring 2010 Lecture #5

Outline. Game Playing. Game Problems. Game Problems. Types of games Playing a perfect game. Playing an imperfect game

Adversarial Search and Game Playing

Artificial Intelligence Adversarial Search

CS440/ECE448 Lecture 11: Stochastic Games, Stochastic Search, and Learned Evaluation Functions

Computer Science and Software Engineering University of Wisconsin - Platteville. 4. Game Play. CS 3030 Lecture Notes Yan Shi UW-Platteville

4. Games and search. Lecture Artificial Intelligence (4ov / 8op)

Game Playing. Chapter 8

Lecture 5: Game Playing (Adversarial Search)

Game-Playing & Adversarial Search

2/5/17 ADVERSARIAL SEARCH. Today. Introduce adversarial games Minimax as an optimal strategy Alpha-beta pruning Real-time decision making

Foundations of AI. 6. Board Games. Search Strategies for Games, Games with Chance, State of the Art

CS 771 Artificial Intelligence. Adversarial Search

Adversarial Search. Chapter 5. Mausam (Based on slides of Stuart Russell, Andrew Parks, Henry Kautz, Linda Shapiro) 1

Game Playing AI Class 8 Ch , 5.4.1, 5.5

Set 4: Game-Playing. ICS 271 Fall 2017 Kalev Kask

Games and Adversarial Search II

CS 4700: Artificial Intelligence

Adversarial Search Aka Games

CS 331: Artificial Intelligence Adversarial Search II. Outline

Artificial Intelligence

Foundations of Artificial Intelligence

CS885 Reinforcement Learning Lecture 13c: June 13, Adversarial Search [RusNor] Sec

Game Playing. Why do AI researchers study game playing? 1. It s a good reasoning problem, formal and nontrivial.

CS 4700: Foundations of Artificial Intelligence

2 person perfect information

Last update: March 9, Game playing. CMSC 421, Chapter 6. CMSC 421, Chapter 6 1

Adversarial Search 1

Adversarial Search (Game Playing)

CS440/ECE448 Lecture 9: Minimax Search. Slides by Svetlana Lazebnik 9/2016 Modified by Mark Hasegawa-Johnson 9/2017

Artificial Intelligence

Foundations of Artificial Intelligence

Game Engineering CS F-24 Board / Strategy Games

Artificial Intelligence 1: game playing

Adversarial Search. Soleymani. Artificial Intelligence: A Modern Approach, 3 rd Edition, Chapter 5

Foundations of AI. 5. Board Games. Search Strategies for Games, Games with Chance, State of the Art. Wolfram Burgard and Luc De Raedt SA-1

Intuition Mini-Max 2

Artificial Intelligence. 4. Game Playing. Prof. Bojana Dalbelo Bašić Assoc. Prof. Jan Šnajder

CS510 \ Lecture Ariel Stolerman

Contents. Foundations of Artificial Intelligence. Problems. Why Board Games?

Artificial Intelligence Search III

COMP219: COMP219: Artificial Intelligence Artificial Intelligence Dr. Annabel Latham Lecture 12: Game Playing Overview Games and Search

Game Playing AI. Dr. Baldassano Yu s Elite Education

ADVERSARIAL SEARCH. Today. Reading. Goals. AIMA Chapter , 5.7,5.8

Adversarial Search. Rob Platt Northeastern University. Some images and slides are used from: AIMA CS188 UC Berkeley

Artificial Intelligence, CS, Nanjing University Spring, 2018, Yang Yu. Lecture 4: Search 3.

Adversarial Search Lecture 7

COMP9414: Artificial Intelligence Adversarial Search

ADVERSARIAL SEARCH. Today. Reading. Goals. AIMA Chapter Read , Skim 5.7

CPS331 Lecture: Search in Games last revised 2/16/10

Adversarial Search. CMPSCI 383 September 29, 2011

More Adversarial Search

CMPUT 396 Tic-Tac-Toe Game

Today. Types of Game. Games and Search 1/18/2010. COMP210: Artificial Intelligence. Lecture 10. Game playing

Game Playing Beyond Minimax. Game Playing Summary So Far. Game Playing Improving Efficiency. Game Playing Minimax using DFS.

CS 540: Introduction to Artificial Intelligence

CS 188: Artificial Intelligence Spring Announcements

Adversarial Search. CS 486/686: Introduction to Artificial Intelligence

Games we will consider. CS 331: Artificial Intelligence Adversarial Search. What makes games hard? Formal Definition of a Game.

Today. Nondeterministic games: backgammon. Algorithm for nondeterministic games. Nondeterministic games in general. See Russell and Norvig, chapter 6

Game-playing: DeepBlue and AlphaGo

Playing Games. Henry Z. Lo. June 23, We consider writing AI to play games with the following properties:

Game-playing AIs: Games and Adversarial Search I AIMA

Lecture 14. Questions? Friday, February 10 CS 430 Artificial Intelligence - Lecture 14 1

game tree complete all possible moves

CS 730/730W/830: Intro AI

Adverserial Search Chapter 5 minmax algorithm alpha-beta pruning TDDC17. Problems. Why Board Games?

Games (adversarial search problems)

CS 331: Artificial Intelligence Adversarial Search. Games we will consider

Path Planning as Search

Transcription:

UNIT II-REPRESENTATION OF KNOWLEDGE (9 hours) Game playing - Knowledge representation, Knowledge representation using Predicate logic, Introduction tounit-2 predicate calculus, Resolution, Use of predicate calculus, Knowledge representation using other logic-structured representation of knowledge. Prepared by Vaishnavi Moorthy Asst Prof- Dept of Cse

Game playing

Effectiveness of a search based problem solving program Legal move generator- not promising Plausible move generator-small number of promising moves are generated As the number of legal moves increases, promising heuristic is applied. Incorporating knowledge in both tester and generator, the performance of the overall system can be improved

In the amount of time given- ply in the game playing is limited in a game graph or tree Static evaluation function Eg. Samuels Checkers game Chess game piece advantage by Turing Decidng which series of actions are responsible for particular outcome is Credit assignment problem Eg. A* algorithm- inadequate for chess Minmax procedure- works on both standard problem solving trees and on game tress

Static evaluation function -10 win for the opponent 0 for even match 10 win for us Two ply search

DEPTH = 2 BRANCHING FACTOR= 3 B D = TOTAL NO OF TERMINAL NODES TERMINAL NODE

States where the game has ended are called terminal states. A utility (payoff) function determines the value of terminal states, e.g. win=+10, draw=0, lose=-10. In two-player games, assume one is called MAX (tries to maximize utility) and one is called MIN (tries to minimize utility). In the search tree, first layer is move by MAX, next layer by MIN, and alternate to terminal states. Each layer in the search is called a ply.

Variety of factors affecting the decision

Best Move for Current Position Depth-first and depth-limited search. At the player choice, maximize the static evaluation of the next position. At the opponent choice, minimize the static evaluation of the next position.

Alpha Beta Pruning Alpha = the value of the best choice we ve found so far for MAX (highest) Beta = the value of the best choice we ve found so far for MIN (lowest) When maximizing, cut off values lower than Alpha When minimizing, cut off values greater than Beta USE THRESH- used to compute cutoffs PASS THRESH-passed to next level

Adding Alpha Beta Cutoffs An alpha cutoff

Alpha Beta Cutoffs

Best Move for Current Position

Alpha-Beta Pruning Example

Alpha-Beta Pruning Example

Alpha-Beta Pruning Example

Alpha-Beta Pruning Example

Alpha-Beta Pruning Example

Additional Requirements Waiting for Quiescence Avoids Horizon effect

Secondary Search- combating horizon effect (double check) Using book moves Alternatives to Minimax- predicting weaker move

Iterative deepening Ply searches with branch and bound strategy Depth first iterative deepening

DFID is proportional to the number of nodes in that solution path DFID is slower by a constant factor

References on Specific Games Chess Checkers Go (difficult since average branching factor is very high) Backgammon- Neurogammon- automatic learning Othello Bridge Scrabble Dominoes Go-moku Hearts poker

MIN MAX PROBLEM General method for determining optimal move. Generate complete game tree down to terminal states. = g(f 1,f 2,.f n ) 1 where f- features of game g-function and - static value. The g is reduced to a linear squaring polynomial by multiplying a constant = c 1 f 1,c 2 f 2,.c n f n ) 2 Compute utility of each node bottom up from leaves toward root. At each MAX node, pick the move with maximum utility. At each MIN node, pick the move with minimum utility (assumes opponent always acts correctly to minimize utility). When reach the root, optimal move is determined.

ALGORITHM: function MINIMAX-DECISION(game) returns an operator for each op in OPERATORS[game] do VALUE[op] MINIMAX-VALUE(APPLY(op, game), game) end return the op with the highest VALUE[op] function MINIMAX-VALUE(state, game) returns a utility value if TERMINAL-TEST[game](state) then return UTILITY[game](state) else if MAX is to move in state then return the highest MINIMAX-VALUE of SUCCESSORS(state) else return the lowest MINIMAX-VALUE of SUCCESSORS(state)

Sample Problem 8 7 3 9 9 8 2 4 1 8 8 9 9 9 3 4

Representations and mappings

Sample 2 All dogs have tails Every dog has a tail

Approaches to knowledge representation

Simple Relational Knowledge

Inheritable knowledge

Inferential knowledge

Procedural knowledge

Representation Issues

Important attributes Instance Isa Relationship among attributes Inverses Existence in an isa hierarchy Techniques for reasoning about values Single values attributes

Inverses First approach Second approach taken for semantic net and frame based systems accompanied by knowledge acquisition tool

An isa hierarchy of attributes Attributes like height- physical attributes Generalization-specialization relationships support inheritance Constraints on the values that the attribute can have and mechanisms for computing those values

Techniques for reasoning about values

Single- valued attributes

Choosing the granularity of representation

Mary is Sue s cousin Another representation

Representation of sets of objects Extensional definition- list all members Intentional definition- needed members Evaluate the sentence true or false One extensional can have many intentional definitions

Finding the right structures as needed

Selecting an initial structure Indexing the sentence with significant English words Pointer to all structures- prospective structures On major clue in the problem description Revising the choice when necessary Select the fragments of the current structure- candidate structure- if matches then preserve it If failure- you can consider the related information and make excuses Use stroke lines to specify the direction (new) Isa (upward direction)- no conflict- use structure to provide knowledge representation else new structure