Adaptive sensor placement for continuous spaces

James A. Grant*, Alexis Boukouvalas, Ryan Rhys Griffiths, David S. Leslie, Sattar Vakili, Enrique Munoz de Cote

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We consider the problem of adaptively placing sensors along an interval to detect stochasticallygenerated events. We present a new formulation of the problem as a continuum-armed bandit problem with feedback in the form of partial observations of realisations of an inhomogeneous Poisson process. We design a solution method by combining Thompson sampling with nonparametric inference via increasingly granular Bayesian histograms and derive an Õ (T 2/3 ) bound on the Bayesian regret in T rounds. This is coupled with the design of an efficent optimisation approach to select actions in polynomial time. In simulations we demonstrate our approach to have substantially lower and less variable regret than competitor algorithms.

Original languageEnglish
Title of host publication36th International Conference on Machine Learning, ICML 2019
Subtitle of host publication9-15 June 2019, Long Beach, California, USA
EditorsKamalika Chaudhuri, Ruslan Salakhutdinov
PublisherInternational Machine Learning Society (IMLS)
Pages2385-2393
Number of pages9
Volume97
ISBN (Electronic)9781510886988
ISBN (Print)9781510886988
Publication statusPublished - 2019
Event36th International Conference on Machine Learning, ICML 2019 - Long Beach, United States
Duration: 9 Jun 201915 Jun 2019

Publication series

Name36th International Conference on Machine Learning, ICML 2019
Volume2019-June

Conference

Conference36th International Conference on Machine Learning, ICML 2019
Country/TerritoryUnited States
CityLong Beach
Period9/06/1915/06/19

Fingerprint

Dive into the research topics of 'Adaptive sensor placement for continuous spaces'. Together they form a unique fingerprint.

Cite this