AI, AlphaGo and computer Hex
|
|
|
- Harvey Smith
- 5 years ago
- Views:
Transcription
1 a math and computing story computing.science university of alberta 2018 march
2 thanks Computer Research Hex Group Michael Johanson, Yngvi Björnsson, Morgan Kan, Nathan Po, Jack van Rijswijck, Broderick Arneson, Philip Henderson, Jakub Pawlewicz, Aja Huang AlphaGo, Kenny Young, Noah Weninger, Chao Gao, Martin Müller Fuego NSERC
3 1 evolution 2
4 (credit GoGameGuru)
5 1950 Shannon (credit Eisenstaedt/Life)
6 1950 Shannon gamebots gamebot search + knowledge + evaluation search? fixed depth mini-max 1949 chess 1 pawn 3 knight 3 bishop 5 rook 9 queen evaluation? player material opponent material
7 1950 Shannon gamebots 1950 hex evaluation electric circuit saddle-points
8 1950 Shannon gamebots 1950 bridg-it (bird cage) evaluation electric circuit current move order voltage drop
9 1950 Shannon gamebots (credit MIT museum)
10 1979 Berge (credit Hoang)
11 virtual connection A B C D E F G H I K L M N u u J v v w w x x y y z z z z z z z z
12 1992 Chinook/Schaeffer Tinsley (Jeopar)
13 1996 Hsu-Campbell (credit Newborn)
14 1997 Kasparov-DB 5 (credit chessgames.com)
15 Deep Blue - Kasparov why so soon?...accurate evaluation...
16 1992 Tesauro (credit IBM)
17 1992 Tesauro TD-Gammon search? 2-ply minimax evaluation? learned! how? neural network (function approximator) training? temporal difference learning improvement stops after self-play games
18 1995 Müller (credit Müller)
19 1995 Müller computer Go Explorer life and death Fuego open source gobot 2009 ICGA 9x9 gold
20 1998 Sutton reinforcement learning
21 2006 Coulom (credit Hiroshi Yamashita)
22 2006 Coulom Monte Carlo Tree Search exploitation best-first search exploration bandit arm selection (Kocsis-Czepesvari) evaluation? randomized playouts + knowledge (response patterns) 2006 ICGA 9x9 gold
23 2007 Silver (credit Silver)
24 2007 Silver 2007 Combining online and offline knowledge in UCT 2007 RL Local Shape Game of Go 2009 RL + simulation-based search in computer Go supervisors Müller-Sutton
25 2006 Arneson Bj H Henderson K (ICGA)
26 2010 Ewalds (credit ICGA)
27 2010 Hassabis (credit Hassabis)
28 2010 Hassabis et al. DeepMind Silver consultant, University College London Silver DM fulltime 2013
29 Fleet (credit UofT)
30 2012 Hinton (credit UofT)
31 2012 Hinton image classification
32 2012 Hinton image classification
33 2012 Hinton image classification Imagenet Classification with DCNNs
34 2013 Pawlewicz H Huang
35 2013 Huang 2003 gobot Erica 2011 phd supervisor Coulom UAlberta postdoc, supervisors Müller + Hayward 2013 ICGA Hex gold MoHex (H A H Huang Pawlewicz) 2014 Google DeepMind $.5 billion Huang joins DeepMind
36 2014 Coulom (credit Takashi Osato/Wired)
37 2014 Coulom 2010 Unbalance: Zen gobot competitor? commercial Crazystone Wired mystery of Go, ancient game that computers still can t solve 2014 UEC Cup Densei-sen crazystone +4 > Norimoto Yoda 9P
38 2014 Clark and Storkey
39 2014 Clark and Storkey Go and DCNNs Teaching DCNNs to play Go 2015 Maddison Huang Sutskever Silver Move Evaluation in Go Using DCNNs Go position policy net
40 meanwhile ICGA Leiden
41 meanwhile ICGA Leiden
42 meanwhile ICGA Leiden
43 meanwhile ICGA Leiden
44 2016 Jan 28 (credit nature)
45 2016 Jan 28 nature human game records: fast policy net fast net, self-play RL (gradient): stronger policy net strong net, self-play games RL (regression): value net mcts + value net + fast policy net 20 people, > TPU years AG 5-0 Fan Hui 2p (fast games 3-2)
46 2015 AG-Fan Hui (credit Deepmind)
47 2017 March Seoul AG vs LS
48 2017 March Seoul AG vs LS (credit ggg)
49 2017 March Seoul AG vs LS
50 2017 March Seoul AG vs LS
51 2017 March Seoul AG vs LS
52 2017 March Seoul AG vs LS
53 2017 March Seoul AG vs LS
54 2017 March Seoul AG vs LS
55 2017 March Seoul AG vs LS
56 post-match (Ewalds) it was incremental improvements, just elo per week :) [100 elo = 64 %]
57 post-match (Ewalds) If deepmind hadn t done it, someone else would ve done it within the year. Facebook was on the right track. Deepmind had published a neural network go paper in Jan a year ago, so I m sure all the other programs were working on it too.
58 post-match (Ewalds) It ll take a few years to scale this all down to run on reasonable hardware, though I m not sure who will do that. It ll happen though.
59 2017 Oct 19 nature Mastering the game of Go without human knowledge tabula rasa different network (more training?) after 40 days training: AG AG
60 2018 March AGM vs Ke Jie (credit google) online early 2017: fast games AG Master 60-0 humans 9P
61 2018 March AGM vs Ke Jie (credit google)
62 AG ( ) leela, fine art, crazystone, zen
63 AG ( ) unanswered? solve? 6x6 still open true komi? careful endgame play? distance from perfect play? handicap AG0 vs Ke Jie? 2 stones?
64 virtual connections
65 virtual connections
66 virtual connections
67 mustplay
68 mustplay
69 mustplay
70 mustplay
71 mustplay
72 mustplay
73 mustplay A B C D E
74 inferior cells: dead
75 inferior cells: dead
76 inferior cells: dead
77 inferior cells: captured
78 inferior cells: captured
79 inferior cells: permanent
80 inferior cells: permanent
81 inferior cells: permanent
82 inferior cells: permanent
83 inferior cells: permanent
84 inferior cells: permanent
85 inferior cells: handicap A B C D E F G H I J K
86 finding strategies up to 4x4... find 1pw? easy find win/loss value for each 1st move? not hard 5x5? harder 6x6?? unknown
87 winning hex openings
88 winning hex openings
89 winning hex openings
90 winning hex openings
91 winning hex openings
92 winning hex openings 1995 A B C D E F
93 winning hex openings 2004
94 winning hex openings 2009
95 winning hex openings 2013
96 winning hex openings 2014
97 twist and turn: story of Hex (2018)
98 thank you
Computer Go: from the Beginnings to AlphaGo. Martin Müller, University of Alberta
Computer Go: from the Beginnings to AlphaGo Martin Müller, University of Alberta 2017 Outline of the Talk Game of Go Short history - Computer Go from the beginnings to AlphaGo The science behind AlphaGo
Hex 2017: MOHEX wins the 11x11 and 13x13 tournaments
222 ICGA Journal 39 (2017) 222 227 DOI 10.3233/ICG-170030 IOS Press Hex 2017: MOHEX wins the 11x11 and 13x13 tournaments Ryan Hayward and Noah Weninger Department of Computer Science, University of Alberta,
Andrei Behel AC-43И 1
Andrei Behel AC-43И 1 History The game of Go originated in China more than 2,500 years ago. The rules of the game are simple: Players take turns to place black or white stones on a board, trying to capture
Google DeepMind s AlphaGo vs. world Go champion Lee Sedol
Google DeepMind s AlphaGo vs. world Go champion Lee Sedol Review of Nature paper: Mastering the game of Go with Deep Neural Networks & Tree Search Tapani Raiko Thanks to Antti Tarvainen for some slides
Blunder Cost in Go and Hex
Advances in Computer Games: 13th Intl. Conf. ACG 2011; Tilburg, Netherlands, Nov 2011, H.J. van den Herik and A. Plaat (eds.), Springer-Verlag Berlin LNCS 7168, 2012, pp 220-229 Blunder Cost in Go and
Game-playing: DeepBlue and AlphaGo
Game-playing: DeepBlue and AlphaGo Brief history of gameplaying frontiers 1990s: Othello world champions refuse to play computers 1994: Chinook defeats Checkers world champion 1997: DeepBlue defeats world
Aja Huang Cho Chikun David Silver Demis Hassabis. Fan Hui Geoff Hinton Lee Sedol Michael Redmond
CMPUT 396 3 hr closedbook 6 pages, 7 marks/page page 1 1. [3 marks] For each person or program, give the label of its description. Aja Huang Cho Chikun David Silver Demis Hassabis Fan Hui Geoff Hinton
CS 380: ARTIFICIAL INTELLIGENCE MONTE CARLO SEARCH. Santiago Ontañón
CS 380: ARTIFICIAL INTELLIGENCE MONTE CARLO SEARCH Santiago Ontañón so367@drexel.edu Recall: Adversarial Search Idea: When there is only one agent in the world, we can solve problems using DFS, BFS, ID,
Monte Carlo Tree Search
Monte Carlo Tree Search 1 By the end, you will know Why we use Monte Carlo Search Trees The pros and cons of MCTS How it is applied to Super Mario Brothers and Alpha Go 2 Outline I. Pre-MCTS Algorithms
Challenges in Monte Carlo Tree Search. Martin Müller University of Alberta
Challenges in Monte Carlo Tree Search Martin Müller University of Alberta Contents State of the Fuego project (brief) Two Problems with simulations and search Examples from Fuego games Some recent and
Mastering the game of Go without human knowledge
Mastering the game of Go without human knowledge David Silver, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang, Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, Adrian Bolton,
Mastering Chess and Shogi by Self- Play with a General Reinforcement Learning Algorithm
Mastering Chess and Shogi by Self- Play with a General Reinforcement Learning Algorithm by Silver et al Published by Google Deepmind Presented by Kira Selby Background u In March 2016, Deepmind s AlphaGo
CSC321 Lecture 23: Go
CSC321 Lecture 23: Go Roger Grosse Roger Grosse CSC321 Lecture 23: Go 1 / 21 Final Exam Friday, April 20, 9am-noon Last names A Y: Clara Benson Building (BN) 2N Last names Z: Clara Benson Building (BN)
Analyzing the Impact of Knowledge and Search in Monte Carlo Tree Search in Go
Analyzing the Impact of Knowledge and Search in Monte Carlo Tree Search in Go Farhad Haqiqat and Martin Müller University of Alberta Edmonton, Canada Contents Motivation and research goals Feature Knowledge
TTIC 31230, Fundamentals of Deep Learning David McAllester, April AlphaZero
TTIC 31230, Fundamentals of Deep Learning David McAllester, April 2017 AlphaZero 1 AlphaGo Fan (October 2015) AlphaGo Defeats Fan Hui, European Go Champion. 2 AlphaGo Lee (March 2016) 3 AlphaGo Zero vs.
Automated Suicide: An Antichess Engine
Automated Suicide: An Antichess Engine Jim Andress and Prasanna Ramakrishnan 1 Introduction Antichess (also known as Suicide Chess or Loser s Chess) is a popular variant of chess where the objective of
46.1 Introduction. Foundations of Artificial Intelligence Introduction MCTS in AlphaGo Neural Networks. 46.
Foundations of Artificial Intelligence May 30, 2016 46. AlphaGo and Outlook Foundations of Artificial Intelligence 46. AlphaGo and Outlook Thomas Keller Universität Basel May 30, 2016 46.1 Introduction
How AI Won at Go and So What? Garry Kasparov vs. Deep Blue (1997)
How AI Won at Go and So What? Garry Kasparov vs. Deep Blue (1997) Alan Fern School of Electrical Engineering and Computer Science Oregon State University Deep Mind s vs. Lee Sedol (2016) Watson vs. Ken
Hex: Passing on the Torch
Hex: Passing on the Torch Philip Henderson November 3, 2010 1 Introduction This document is intended to help those contributing to the University of Alberta s Computing Science Hex research group. Whether
By David Anderson SZTAKI (Budapest, Hungary) WPI D2009
By David Anderson SZTAKI (Budapest, Hungary) WPI D2009 1997, Deep Blue won against Kasparov Average workstation can defeat best Chess players Computer Chess no longer interesting Go is much harder for
Computing Science (CMPUT) 496
Computing Science (CMPUT) 496 Search, Knowledge, and Simulations Martin Müller Department of Computing Science University of Alberta mmueller@ualberta.ca Winter 2017 Part IV Knowledge 496 Today - Mar 9
Game AI Challenges: Past, Present, and Future
Game AI Challenges: Past, Present, and Future Professor Michael Buro Computing Science, University of Alberta, Edmonton, Canada www.skatgame.net/cpcc2018.pdf 1/ 35 AI / ML Group @ University of Alberta
AlphaGo and Artificial Intelligence GUEST LECTURE IN THE GAME OF GO AND SOCIETY
AlphaGo and Artificial Intelligence HUCK BENNET T (NORTHWESTERN UNIVERSITY) GUEST LECTURE IN THE GAME OF GO AND SOCIETY AT OCCIDENTAL COLLEGE, 10/29/2018 The Game of Go A game for aliens, presidents, and
CS 331: Artificial Intelligence Adversarial Search II. Outline
CS 331: Artificial Intelligence Adversarial Search II 1 Outline 1. Evaluation Functions 2. State-of-the-art game playing programs 3. 2 player zero-sum finite stochastic games of perfect information 2 1
Success Stories of Deep RL. David Silver
Success Stories of Deep RL David Silver Reinforcement Learning (RL) RL is a general-purpose framework for decision-making An agent selects actions Its actions influence its future observations Success
Foundations of Artificial Intelligence Introduction State of the Art Summary. classification: Board Games: Overview
Foundations of Artificial Intelligence May 14, 2018 40. Board Games: Introduction and State of the Art Foundations of Artificial Intelligence 40. Board Games: Introduction and State of the Art 40.1 Introduction
Analyzing Simulations in Monte Carlo Tree Search for the Game of Go
Analyzing Simulations in Monte Carlo Tree Search for the Game of Go Sumudu Fernando and Martin Müller University of Alberta Edmonton, Canada {sumudu,mmueller}@ualberta.ca Abstract In Monte Carlo Tree Search,
Recent Progress in Computer Go. Martin Müller University of Alberta Edmonton, Canada
Recent Progress in Computer Go Martin Müller University of Alberta Edmonton, Canada 40 Years of Computer Go 1960 s: initial ideas 1970 s: first serious program - Reitman & Wilcox 1980 s: first PC programs,
SDS PODCAST EPISODE 110 ALPHAGO ZERO
SDS PODCAST EPISODE 110 ALPHAGO ZERO Show Notes: http://www.superdatascience.com/110 1 Kirill: This is episode number 110, AlphaGo Zero. Welcome back ladies and gentlemen to the SuperDataSceince podcast.
CS440/ECE448 Lecture 11: Stochastic Games, Stochastic Search, and Learned Evaluation Functions
CS440/ECE448 Lecture 11: Stochastic Games, Stochastic Search, and Learned Evaluation Functions Slides by Svetlana Lazebnik, 9/2016 Modified by Mark Hasegawa Johnson, 9/2017 Types of game environments Perfect
CS 4700: Foundations of Artificial Intelligence
CS 4700: Foundations of Artificial Intelligence selman@cs.cornell.edu Module: Adversarial Search R&N: Chapter 5 Part II 1 Outline Game Playing Optimal decisions Minimax α-β pruning Case study: Deep Blue
Generalized Rapid Action Value Estimation
Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence (IJCAI 2015) Generalized Rapid Action Value Estimation Tristan Cazenave LAMSADE - Universite Paris-Dauphine Paris,
COMP219: Artificial Intelligence. Lecture 13: Game Playing
CMP219: Artificial Intelligence Lecture 13: Game Playing 1 verview Last time Search with partial/no observations Belief states Incremental belief state search Determinism vs non-determinism Today We will
CS 387: GAME AI BOARD GAMES
CS 387: GAME AI BOARD GAMES 5/28/2015 Instructor: Santiago Ontañón santi@cs.drexel.edu Class website: https://www.cs.drexel.edu/~santi/teaching/2015/cs387/intro.html Reminders Check BBVista site for the
6. Games. COMP9414/ 9814/ 3411: Artificial Intelligence. Outline. Mechanical Turk. Origins. origins. motivation. minimax search
COMP9414/9814/3411 16s1 Games 1 COMP9414/ 9814/ 3411: Artificial Intelligence 6. Games Outline origins motivation Russell & Norvig, Chapter 5. minimax search resource limits and heuristic evaluation α-β
Artificial Intelligence Adversarial Search
Artificial Intelligence Adversarial Search Adversarial Search Adversarial search problems games They occur in multiagent competitive environments There is an opponent we can t control planning again us!
School of EECS Washington State University. Artificial Intelligence
School of EECS Washington State University Artificial Intelligence 1 } Classic AI challenge Easy to represent Difficult to solve } Zero-sum games Total final reward to all players is constant } Perfect
Foundations of Artificial Intelligence
Foundations of Artificial Intelligence 6. Board Games Search Strategies for Games, Games with Chance, State of the Art Joschka Boedecker and Wolfram Burgard and Bernhard Nebel Albert-Ludwigs-Universität
Contents. Foundations of Artificial Intelligence. Problems. Why Board Games?
Contents Foundations of Artificial Intelligence 6. Board Games Search Strategies for Games, Games with Chance, State of the Art Wolfram Burgard, Bernhard Nebel, and Martin Riedmiller Albert-Ludwigs-Universität
Foundations of Artificial Intelligence
Foundations of Artificial Intelligence 6. Board Games Search Strategies for Games, Games with Chance, State of the Art Joschka Boedecker and Wolfram Burgard and Frank Hutter and Bernhard Nebel Albert-Ludwigs-Universität
Monte Carlo Tree Search. Simon M. Lucas
Monte Carlo Tree Search Simon M. Lucas Outline MCTS: The Excitement! A tutorial: how it works Important heuristics: RAVE / AMAF Applications to video games and real-time control The Excitement Game playing
Foundations of AI. 6. Board Games. Search Strategies for Games, Games with Chance, State of the Art
Foundations of AI 6. Board Games Search Strategies for Games, Games with Chance, State of the Art Wolfram Burgard, Andreas Karwath, Bernhard Nebel, and Martin Riedmiller SA-1 Contents Board Games Minimax
MOVE EVALUATION IN GO USING DEEP CONVOLUTIONAL NEURAL NETWORKS
MOVE EVALUATION IN GO USING DEEP CONVOLUTIONAL NEURAL NETWORKS Chris J. Maddison University of Toronto cmaddis@cs.toronto.edu Aja Huang 1, Ilya Sutskever 2, David Silver 1 Google DeepMind 1, Google Brain
Adversarial Search and Game Playing
Games Adversarial Search and Game Playing Russell and Norvig, 3 rd edition, Ch. 5 Games: multi-agent environment q What do other agents do and how do they affect our success? q Cooperative vs. competitive
Intelligent Non-Player Character with Deep Learning. Intelligent Non-Player Character with Deep Learning 1
Intelligent Non-Player Character with Deep Learning Meng Zhixiang, Zhang Haoze Supervised by Prof. Michael Lyu CUHK CSE FYP Term 1 Intelligent Non-Player Character with Deep Learning 1 Intelligent Non-Player
CSE 473: Artificial Intelligence. Outline
CSE 473: Artificial Intelligence Adversarial Search Dan Weld Based on slides from Dan Klein, Stuart Russell, Pieter Abbeel, Andrew Moore and Luke Zettlemoyer (best illustrations from ai.berkeley.edu) 1
More on games (Ch )
More on games (Ch. 5.4-5.6) Alpha-beta pruning Previously on CSci 4511... We talked about how to modify the minimax algorithm to prune only bad searches (i.e. alpha-beta pruning) This rule of checking
All about Go, the ancient game in which AI bested a master 10 March 2016, by Youkyung Lee
All about Go, the ancient game in which AI bested a master 10 March 2016, by Youkyung Lee WHAT IS GO? In Go, also known as baduk in Korean and weiqi in Chinese, two players take turns putting black or
Adversarial Reasoning: Sampling-Based Search with the UCT algorithm. Joint work with Raghuram Ramanujan and Ashish Sabharwal
Adversarial Reasoning: Sampling-Based Search with the UCT algorithm Joint work with Raghuram Ramanujan and Ashish Sabharwal Upper Confidence bounds for Trees (UCT) n The UCT algorithm (Kocsis and Szepesvari,
Feature Learning Using State Differences
Feature Learning Using State Differences Mesut Kirci and Jonathan Schaeffer and Nathan Sturtevant Department of Computing Science University of Alberta Edmonton, Alberta, Canada {kirci,nathanst,jonathan}@cs.ualberta.ca
COMP219: COMP219: Artificial Intelligence Artificial Intelligence Dr. Annabel Latham Lecture 12: Game Playing Overview Games and Search
COMP19: Artificial Intelligence COMP19: Artificial Intelligence Dr. Annabel Latham Room.05 Ashton Building Department of Computer Science University of Liverpool Lecture 1: Game Playing 1 Overview Last
CPS 570: Artificial Intelligence Two-player, zero-sum, perfect-information Games
CPS 57: Artificial Intelligence Two-player, zero-sum, perfect-information Games Instructor: Vincent Conitzer Game playing Rich tradition of creating game-playing programs in AI Many similarities to search
Combining tactical search and deep learning in the game of Go
Combining tactical search and deep learning in the game of Go Tristan Cazenave PSL-Université Paris-Dauphine, LAMSADE CNRS UMR 7243, Paris, France Tristan.Cazenave@dauphine.fr Abstract In this paper we
CS 188: Artificial Intelligence
CS 188: Artificial Intelligence Adversarial Search Prof. Scott Niekum The University of Texas at Austin [These slides are based on those of Dan Klein and Pieter Abbeel for CS188 Intro to AI at UC Berkeley.
CS229 Project: Building an Intelligent Agent to play 9x9 Go
CS229 Project: Building an Intelligent Agent to play 9x9 Go Shawn Hu Abstract We build an AI to autonomously play the board game of Go at a low amateur level. Our AI uses the UCT variation of Monte Carlo
Using Neural Network and Monte-Carlo Tree Search to Play the Game TEN
Using Neural Network and Monte-Carlo Tree Search to Play the Game TEN Weijie Chen Fall 2017 Weijie Chen Page 1 of 7 1. INTRODUCTION Game TEN The traditional game Tic-Tac-Toe enjoys people s favor. Moreover,
Monte-Carlo Game Tree Search: Advanced Techniques
Monte-Carlo Game Tree Search: Advanced Techniques Tsan-sheng Hsu tshsu@iis.sinica.edu.tw http://www.iis.sinica.edu.tw/~tshsu 1 Abstract Adding new ideas to the pure Monte-Carlo approach for computer Go.
A Bandit Approach for Tree Search
A An Example in Computer-Go Department of Statistics, University of Michigan March 27th, 2008 A 1 Bandit Problem K-Armed Bandit UCB Algorithms for K-Armed Bandit Problem 2 Classical Tree Search UCT Algorithm
A Deep Q-Learning Agent for the L-Game with Variable Batch Training
A Deep Q-Learning Agent for the L-Game with Variable Batch Training Petros Giannakopoulos and Yannis Cotronis National and Kapodistrian University of Athens - Dept of Informatics and Telecommunications
Adversarial Search Lecture 7
Lecture 7 How can we use search to plan ahead when other agents are planning against us? 1 Agenda Games: context, history Searching via Minimax Scaling α β pruning Depth-limiting Evaluation functions Handling
Improving MCTS and Neural Network Communication in Computer Go
Improving MCTS and Neural Network Communication in Computer Go Joshua Keller Oscar Perez Worcester Polytechnic Institute a Major Qualifying Project Report submitted to the faculty of Worcester Polytechnic
Game Playing: Adversarial Search. Chapter 5
Game Playing: Adversarial Search Chapter 5 Outline Games Perfect play minimax search α β pruning Resource limits and approximate evaluation Games of chance Games of imperfect information Games vs. Search
Experiments with Tensor Flow Roman Weber (Geschäftsführer) Richard Schmid (Senior Consultant)
Experiments with Tensor Flow 23.05.2017 Roman Weber (Geschäftsführer) Richard Schmid (Senior Consultant) WEBGATE CONSULTING Gegründet Mitarbeiter CH Inhaber geführt IT Anbieter Partner 2001 Ex 29 Beratung
Game Playing State-of-the-Art CSE 473: Artificial Intelligence Fall Deterministic Games. Zero-Sum Games 10/13/17. Adversarial Search
CSE 473: Artificial Intelligence Fall 2017 Adversarial Search Mini, pruning, Expecti Dieter Fox Based on slides adapted Luke Zettlemoyer, Dan Klein, Pieter Abbeel, Dan Weld, Stuart Russell or Andrew Moore
AI in Tabletop Games. Team 13 Josh Charnetsky Zachary Koch CSE Professor Anita Wasilewska
AI in Tabletop Games Team 13 Josh Charnetsky Zachary Koch CSE 352 - Professor Anita Wasilewska Works Cited Kurenkov, Andrey. a-brief-history-of-game-ai.png. 18 Apr. 2016, www.andreykurenkov.com/writing/a-brief-history-of-game-ai/
A Study of UCT and its Enhancements in an Artificial Game
A Study of UCT and its Enhancements in an Artificial Game David Tom and Martin Müller Department of Computing Science, University of Alberta, Edmonton, Canada, T6G 2E8 {dtom, mmueller}@cs.ualberta.ca Abstract.
V. Adamchik Data Structures. Game Trees. Lecture 1. Apr. 05, Plan: 1. Introduction. 2. Game of NIM. 3. Minimax
Game Trees Lecture 1 Apr. 05, 2005 Plan: 1. Introduction 2. Game of NIM 3. Minimax V. Adamchik 2 ü Introduction The search problems we have studied so far assume that the situation is not going to change.
Adversarial Search. Soleymani. Artificial Intelligence: A Modern Approach, 3 rd Edition, Chapter 5
Adversarial Search CE417: Introduction to Artificial Intelligence Sharif University of Technology Spring 2017 Soleymani Artificial Intelligence: A Modern Approach, 3 rd Edition, Chapter 5 Outline Game
Building Opening Books for 9 9 Go Without Relying on Human Go Expertise
Journal of Computer Science 8 (10): 1594-1600, 2012 ISSN 1549-3636 2012 Science Publications Building Opening Books for 9 9 Go Without Relying on Human Go Expertise 1 Keh-Hsun Chen and 2 Peigang Zhang
ON THE TACTICAL AND STRATEGIC BEHAVIOUR OF MCTS WHEN BIASING RANDOM SIMULATIONS
On the tactical and strategic behaviour of MCTS when biasing random simulations 67 ON THE TACTICAL AND STATEGIC BEHAVIOU OF MCTS WHEN BIASING ANDOM SIMULATIONS Fabien Teytaud 1 Julien Dehos 2 Université
Adversarial Search. Human-aware Robotics. 2018/01/25 Chapter 5 in R&N 3rd Ø Announcement: Slides for this lecture are here:
Adversarial Search 2018/01/25 Chapter 5 in R&N 3rd Ø Announcement: q Slides for this lecture are here: http://www.public.asu.edu/~yzhan442/teaching/cse471/lectures/adversarial.pdf Slides are largely based
CITS3001. Algorithms, Agents and Artificial Intelligence. Semester 2, 2016 Tim French
CITS3001 Algorithms, Agents and Artificial Intelligence Semester 2, 2016 Tim French School of Computer Science & Software Eng. The University of Western Australia 8. Game-playing AIMA, Ch. 5 Objectives
Neural Networks Learning the Concept of Influence in Go
Proceedings of the Twenty-Ninth International Florida Artificial Intelligence Research Society Conference Neural Networks Learning the Concept of Influence in Go Gabriel Machado Santos, Rita Maria Silva
More Adversarial Search
More Adversarial Search CS151 David Kauchak Fall 2010 http://xkcd.com/761/ Some material borrowed from : Sara Owsley Sood and others Admin Written 2 posted Machine requirements for mancala Most of the
More on games (Ch )
More on games (Ch. 5.4-5.6) Announcements Midterm next Tuesday: covers weeks 1-4 (Chapters 1-4) Take the full class period Open book/notes (can use ebook) ^^ No programing/code, internet searches or friends
Small and large MCTS playouts applied to Chinese Dark Chess stochastic game
Small and large MCTS playouts applied to Chinese Dark Chess stochastic game Nicolas Jouandeau 1 and Tristan Cazenave 2 1 LIASD, Université de Paris 8, France n@ai.univ-paris8.fr 2 LAMSADE, Université Paris-Dauphine,
Games and Adversarial Search
1 Games and Adversarial Search BBM 405 Fundamentals of Artificial Intelligence Pinar Duygulu Hacettepe University Slides are mostly adapted from AIMA, MIT Open Courseware and Svetlana Lazebnik (UIUC) Spring
Game Playing. Philipp Koehn. 29 September 2015
Game Playing Philipp Koehn 29 September 2015 Outline 1 Games Perfect play minimax decisions α β pruning Resource limits and approximate evaluation Games of chance Games of imperfect information 2 games
If we did all the things we are capable of, we would literally astound ourselves. Thomas A. Edison
If we did all the things we are capable of, we would literally astound ourselves. Thomas A. Edison University of Alberta PLAYING AND SOLVING THE GAME OF HEX by Philip Thomas Henderson A thesis submitted
43.1 Introduction. Foundations of Artificial Intelligence Introduction Monte-Carlo Methods Monte-Carlo Tree Search. 43.
May 6, 20 3. : Introduction 3. : Introduction Malte Helmert University of Basel May 6, 20 3. Introduction 3.2 3.3 3. Summary May 6, 20 / 27 May 6, 20 2 / 27 Board Games: Overview 3. : Introduction Introduction
CSE 40171: Artificial Intelligence. Adversarial Search: Games and Optimality
CSE 40171: Artificial Intelligence Adversarial Search: Games and Optimality 1 What is a game? Game Playing State-of-the-Art Checkers: 1950: First computer player. 1994: First computer champion: Chinook
Artificial Intelligence Search III
Artificial Intelligence Search III Lecture 5 Content: Search III Quick Review on Lecture 4 Why Study Games? Game Playing as Search Special Characteristics of Game Playing Search Ingredients of 2-Person
Application of UCT Search to the Connection Games of Hex, Y, *Star, and Renkula!
Application of UCT Search to the Connection Games of Hex, Y, *Star, and Renkula! Tapani Raiko and Jaakko Peltonen Helsinki University of Technology, Adaptive Informatics Research Centre, P.O. Box 5400,
Adversarial Search. CS 486/686: Introduction to Artificial Intelligence
Adversarial Search CS 486/686: Introduction to Artificial Intelligence 1 Introduction So far we have only been concerned with a single agent Today, we introduce an adversary! 2 Outline Games Minimax search
AI in Games: Achievements and Challenges. Yuandong Tian Facebook AI Research
AI in Games: Achievements and Challenges Yuandong Tian Facebook AI Research Game as a Vehicle of AI Infinite supply of fully labeled data Controllable and replicable Low cost per sample Faster than real-time
Monte-Carlo Tree Search Enhancements for Havannah
Monte-Carlo Tree Search Enhancements for Havannah Jan A. Stankiewicz, Mark H.M. Winands, and Jos W.H.M. Uiterwijk Department of Knowledge Engineering, Maastricht University j.stankiewicz@student.maastrichtuniversity.nl,
Proposal and Evaluation of System of Dynamic Adapting Method to Player s Skill
1,a) 1 2016 2 19, 2016 9 6 AI AI AI AI 0 AI 3 AI AI AI AI AI AI AI AI AI 5% AI AI Proposal and Evaluation of System of Dynamic Adapting Method to Player s Skill Takafumi Nakamichi 1,a) Takeshi Ito 1 Received:
Poker AI: Equilibrium, Online Resolving, Deep Learning and Reinforcement Learning
Poker AI: Equilibrium, Online Resolving, Deep Learning and Reinforcement Learning Nikolai Yakovenko NVidia ADLR Group -- Santa Clara CA Columbia University Deep Learning Seminar April 2017 Poker is a Turn-Based
Lecture 14. Questions? Friday, February 10 CS 430 Artificial Intelligence - Lecture 14 1
Lecture 14 Questions? Friday, February 10 CS 430 Artificial Intelligence - Lecture 14 1 Outline Chapter 5 - Adversarial Search Alpha-Beta Pruning Imperfect Real-Time Decisions Stochastic Games Friday,
Monte Carlo Tree Search and AlphaGo. Suraj Nair, Peter Kundzicz, Kevin An, Vansh Kumar
Monte Carlo Tree Search and AlphaGo Suraj Nair, Peter Kundzicz, Kevin An, Vansh Kumar Zero-Sum Games and AI A player s utility gain or loss is exactly balanced by the combined gain or loss of opponents:
Today. Types of Game. Games and Search 1/18/2010. COMP210: Artificial Intelligence. Lecture 10. Game playing
COMP10: Artificial Intelligence Lecture 10. Game playing Trevor Bench-Capon Room 15, Ashton Building Today We will look at how search can be applied to playing games Types of Games Perfect play minimax
Computer Go and Monte Carlo Tree Search: Book and Parallel Solutions
Computer Go and Monte Carlo Tree Search: Book and Parallel Solutions Opening ADISSERTATION SUBMITTED TO THE FACULTY OF THE GRADUATE SCHOOL OF THE UNIVERSITY OF MINNESOTA BY Erik Stefan Steinmetz IN PARTIAL
Ar#ficial)Intelligence!!
Introduc*on! Ar#ficial)Intelligence!! Roman Barták Department of Theoretical Computer Science and Mathematical Logic So far we assumed a single-agent environment, but what if there are more agents and
Two-Player Perfect Information Games: A Brief Survey
Two-Player Perfect Information Games: A Brief Survey Tsan-sheng Hsu tshsu@iis.sinica.edu.tw http://www.iis.sinica.edu.tw/~tshsu 1 Abstract Domain: two-player games. Which game characters are predominant
Computer Science and Software Engineering University of Wisconsin - Platteville. 4. Game Play. CS 3030 Lecture Notes Yan Shi UW-Platteville
Computer Science and Software Engineering University of Wisconsin - Platteville 4. Game Play CS 3030 Lecture Notes Yan Shi UW-Platteville Read: Textbook Chapter 6 What kind of games? 2-player games Zero-sum
Adversarial Search. CMPSCI 383 September 29, 2011
Adversarial Search CMPSCI 383 September 29, 2011 1 Why are games interesting to AI? Simple to represent and reason about Must consider the moves of an adversary Time constraints Russell & Norvig say: Games,
Games solved: Now and in the future
Games solved: Now and in the future by H. J. van den Herik, J. W. H. M. Uiterwijk, and J. van Rijswijck Tsan-sheng Hsu tshsu@iis.sinica.edu.tw http://www.iis.sinica.edu.tw/~tshsu 1 Abstract Which game
Last update: March 9, Game playing. CMSC 421, Chapter 6. CMSC 421, Chapter 6 1
Last update: March 9, 2010 Game playing CMSC 421, Chapter 6 CMSC 421, Chapter 6 1 Finite perfect-information zero-sum games Finite: finitely many agents, actions, states Perfect information: every agent
CS 4700: Foundations of Artificial Intelligence
CS 4700: Foundations of Artificial Intelligence selman@cs.cornell.edu Module: Adversarial Search R&N: Chapter 5 1 Outline Adversarial Search Optimal decisions Minimax α-β pruning Case study: Deep Blue
Training a Back-Propagation Network with Temporal Difference Learning and a database for the board game Pente
Training a Back-Propagation Network with Temporal Difference Learning and a database for the board game Pente Valentijn Muijrers 3275183 Valentijn.Muijrers@phil.uu.nl Supervisor: Gerard Vreeswijk 7,5 ECTS