Research Repository

Estimating learning rates in evolution and TDL: Results on a simple grid-world problem

Lucas, Simon M (2010) Estimating learning rates in evolution and TDL: Results on a simple grid-world problem. In: 2010 IEEE Symposium on Computational Intelligence and Games (CIG), 2010-08-18 - 2010-08-21.

Full text not available from this repository.


When learning to play a game or perform some task, it is important to learn as quickly and effectively as possible by making best use of the available information. Interesting insights can be gained by studying the learning process from an information theory perspective, and analysing the learning speed in terms of the maximum number of bits that could be learned per game/task, or per action. Previous work has applied this analysis to co-evolution and to temporal difference learning (TDL) for a simple board game with a fixed number of moves. This paper analyses a grid-world problem and calculates the upper bounds on the information rates for evolution and for TDL. The results show an interesting relationship between the upper bounds of the learning rates and the actual information acquisition rates that are achieved in practice. Also, which method works best is highly dependent on the choice of function approximator. © 2010 IEEE.

Item Type: Conference or Workshop Item (Paper)
Additional Information: Published proceedings: Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games, CIG2010
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Science and Health
Faculty of Science and Health > Computer Science and Electronic Engineering, School of
SWORD Depositor: Elements
Depositing User: Elements
Date Deposited: 19 Oct 2012 14:43
Last Modified: 15 Jan 2022 00:45

Actions (login required)

View Item View Item