Research Repository

Default policies for global optimisation of noisy functions with severe noise

Samothrakis, Spyridon and Fasli, Maria and Perez, Diego and Lucas, Simon (2017) 'Default policies for global optimisation of noisy functions with severe noise.' Journal of Global Optimization, 67 (4). 893 - 907. ISSN 0925-5001

[img]
Preview
Text
global-optimisation.pdf - Accepted Version

Download (1MB) | Preview

Abstract

Global optimisation of unknown noisy functions is a daunting task that appears in domains ranging from games to control problems to meta-parameter optimisation for machine learning. We show how to incorporate heuristics to Stochastic Simultaneous Optimistic Optimization (STOSOO), a global optimisation algorithm that has very weak requirements from the function. In our case, heuristics come in the form of Covariance Matrix Adaptation Evolution Strategy (CMA-ES). The new algorithm, termed Guided STOSOO (STOSOO-G), combines the ability of CMA-ES for fast local convergence (due to the algorithm following the “natural” gradient) and the global optimisation abilities of STOSOO. We compare all three algorithms in the “harder” parts of the Comparing Continuous Optimisers on Black-Box Optimization Benchmarking benchmark suite, which provides a default set of functions for testing. We show that our approach keeps the best of both worlds, i.e. the almost optimal exploration/exploitation of STOSOO with the local optimisation strength of CMA-ES.

Item Type: Article
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Science and Health > Computer Science and Electronic Engineering, School of
Depositing User: Jim Jamieson
Date Deposited: 17 Jan 2017 11:32
Last Modified: 20 Jul 2018 15:15
URI: http://repository.essex.ac.uk/id/eprint/18820

Actions (login required)

View Item View Item