Research Repository

Default policies for global optimisation of noisy functions with severe noise

Samothrakis, Spyridon and Fasli, Maria and Perez, Diego and Lucas, Simon (2017) 'Default policies for global optimisation of noisy functions with severe noise.' Journal of Global Optimization, 67 (4). pp. 893-907. ISSN 0925-5001

global-optimisation.pdf - Accepted Version

Download (1MB) | Preview


Global optimisation of unknown noisy functions is a daunting task that appears in domains ranging from games to control problems to meta-parameter optimisation for machine learning. We show how to incorporate heuristics to Stochastic Simultaneous Optimistic Optimization (STOSOO), a global optimisation algorithm that has very weak requirements from the function. In our case, heuristics come in the form of Covariance Matrix Adaptation Evolution Strategy (CMA-ES). The new algorithm, termed Guided STOSOO (STOSOO-G), combines the ability of CMA-ES for fast local convergence (due to the algorithm following the “natural” gradient) and the global optimisation abilities of STOSOO. We compare all three algorithms in the “harder” parts of the Comparing Continuous Optimisers on Black-Box Optimization Benchmarking benchmark suite, which provides a default set of functions for testing. We show that our approach keeps the best of both worlds, i.e. the almost optimal exploration/exploitation of STOSOO with the local optimisation strength of CMA-ES.

Item Type: Article
Uncontrolled Keywords: Global optimisation; Evolutionary computation; Monte Carlo tree search
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Science and Health
Faculty of Science and Health > Computer Science and Electronic Engineering, School of
SWORD Depositor: Elements
Depositing User: Elements
Date Deposited: 17 Jan 2017 11:32
Last Modified: 23 Sep 2022 18:46

Actions (login required)

View Item View Item