Soemers, Dennis JNJ and Samothrakis, Spyridon and Piette, Éric and Stephenson, Matthew (2023) Extracting tactics learned from self-play in general games. Information Sciences, 624. pp. 277-298. DOI https://doi.org/10.1016/j.ins.2022.12.080
Soemers, Dennis JNJ and Samothrakis, Spyridon and Piette, Éric and Stephenson, Matthew (2023) Extracting tactics learned from self-play in general games. Information Sciences, 624. pp. 277-298. DOI https://doi.org/10.1016/j.ins.2022.12.080
Soemers, Dennis JNJ and Samothrakis, Spyridon and Piette, Éric and Stephenson, Matthew (2023) Extracting tactics learned from self-play in general games. Information Sciences, 624. pp. 277-298. DOI https://doi.org/10.1016/j.ins.2022.12.080
Abstract
Local, spatial state-action features can be used to effectively train linear policies from self-play in a wide variety of board games. Such policies can play games directly, or be used to bias tree search agents. However, the resulting feature sets can be large, with a significant amount of overlap and redundancies between features. This is a problem for two reasons. Firstly, large feature sets can be computationally expensive, which reduces the playing strength of agents based on them. Secondly, redundancies and correlations between features impair the ability for humans to analyse, interpret, or understand tactics learned by the policies. We look towards decision trees for their ability to perform feature selection, and serve as interpretable models. Previous work on distilling policies into decision trees uses states as inputs, and distributions over the complete action space as outputs. In contrast, we propose and evaluate a variety of decision tree types, which take state-action pairs as inputs, and provide various different types of outputs on a per-action basis. An empirical evaluation over 43 different board games is presented, and two of those games are used as case studies where we attempt to interpret the discovered features.
Item Type: | Article |
---|---|
Uncontrolled Keywords: | Games; Feature selection; Decision trees; Explainable AI |
Divisions: | Faculty of Science and Health Faculty of Science and Health > Computer Science and Electronic Engineering, School of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 19 Jan 2023 15:47 |
Last Modified: | 16 May 2024 21:38 |
URI: | http://repository.essex.ac.uk/id/eprint/34483 |
Available files
Filename: 1-s2.0-S0020025522015754-main.pdf
Licence: Creative Commons: Attribution 4.0