Pisheh Var, Mahrad and Fairbank, Michael and Samothrakis, Spyros (2023) A Minimal “Functionally Sentient” Organism Trained with Backpropagation Through Time. Adaptive Behavior, 31 (6). pp. 531-544. DOI https://doi.org/10.1177/10597123231166416
Pisheh Var, Mahrad and Fairbank, Michael and Samothrakis, Spyros (2023) A Minimal “Functionally Sentient” Organism Trained with Backpropagation Through Time. Adaptive Behavior, 31 (6). pp. 531-544. DOI https://doi.org/10.1177/10597123231166416
Pisheh Var, Mahrad and Fairbank, Michael and Samothrakis, Spyros (2023) A Minimal “Functionally Sentient” Organism Trained with Backpropagation Through Time. Adaptive Behavior, 31 (6). pp. 531-544. DOI https://doi.org/10.1177/10597123231166416
Abstract
This article presents a scenario where a simple simulated organism must explore and exploit an environment containing a food pile. The organism learns to make observations of the environment, use memory to record those observations, and thus plan and navigate to the regions with the strongest food density. We compare different reinforcement learning algorithms with an adaptive dynamic programming algorithm and conclude that backpropagation through time can convincingly solve this recurrent neural-network challenge. Furthermore, we argue that this algorithm successfully mimics a minimal ‘functionally sentient’ organism’s fundamental objectives and mental environmental-mapping skills while seeking a food pile distributed statically or randomly in an environment.
Item Type: | Article |
---|---|
Uncontrolled Keywords: | adaptive behaviour; ADP algorithm; Back propagation through time; BPTT; control task; partially observable environment |
Divisions: | Faculty of Science and Health Faculty of Science and Health > Computer Science and Electronic Engineering, School of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 26 May 2023 12:00 |
Last Modified: | 16 May 2024 21:45 |
URI: | http://repository.essex.ac.uk/id/eprint/35641 |
Available files
Filename: A Minimal Functionally Sentient Organism Trained With Backpropagation Through Time.pdf
Licence: Creative Commons: Attribution 4.0