Samothrakis, Spyridon and Fasli, Maria and Perez, Diego and Lucas, Simon (2017) Default policies for global optimisation of noisy functions with severe noise. Journal of Global Optimization, 67 (4). pp. 893-907. DOI https://doi.org/10.1007/s10898-016-0482-9
Samothrakis, Spyridon and Fasli, Maria and Perez, Diego and Lucas, Simon (2017) Default policies for global optimisation of noisy functions with severe noise. Journal of Global Optimization, 67 (4). pp. 893-907. DOI https://doi.org/10.1007/s10898-016-0482-9
Samothrakis, Spyridon and Fasli, Maria and Perez, Diego and Lucas, Simon (2017) Default policies for global optimisation of noisy functions with severe noise. Journal of Global Optimization, 67 (4). pp. 893-907. DOI https://doi.org/10.1007/s10898-016-0482-9
Abstract
Global optimisation of unknown noisy functions is a daunting task that appears in domains ranging from games to control problems to meta-parameter optimisation for machine learning. We show how to incorporate heuristics to Stochastic Simultaneous Optimistic Optimization (STOSOO), a global optimisation algorithm that has very weak requirements from the function. In our case, heuristics come in the form of Covariance Matrix Adaptation Evolution Strategy (CMA-ES). The new algorithm, termed Guided STOSOO (STOSOO-G), combines the ability of CMA-ES for fast local convergence (due to the algorithm following the “natural” gradient) and the global optimisation abilities of STOSOO. We compare all three algorithms in the “harder” parts of the Comparing Continuous Optimisers on Black-Box Optimization Benchmarking benchmark suite, which provides a default set of functions for testing. We show that our approach keeps the best of both worlds, i.e. the almost optimal exploration/exploitation of STOSOO with the local optimisation strength of CMA-ES.
Item Type: | Article |
---|---|
Uncontrolled Keywords: | Global optimisation; Evolutionary computation; Monte Carlo tree search |
Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
Divisions: | Faculty of Science and Health Faculty of Science and Health > Computer Science and Electronic Engineering, School of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 17 Jan 2017 11:32 |
Last Modified: | 30 Oct 2024 20:26 |
URI: | http://repository.essex.ac.uk/id/eprint/18820 |
Available files
Filename: global-optimisation.pdf