• Home
  • Search
  • Measurement Maximizing Adaptive Sampling with Risk Bounding Functions
  • Open Access IconOpen Access
  • Cite Icon8
  • https://doi.org/10.1609/aaai.v33i01.33017511Copy DOI Icon

Measurement Maximizing Adaptive Sampling with Risk Bounding Functions

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

In autonomous exploration a mobile agent must adapt to new measurements to seek high reward, but disturbances cause a probability of collision that must be traded off against expected reward. This paper considers an autonomous agent tasked with maximizing measurements from a Gaussian Process while subject to unbounded disturbances. We seek an adaptive policy in which the maximum allowed probability of failure is constrained as a function of the expected reward. The policy is found using an extension to Monte Carlo Tree Search (MCTS) which bounds probability of failure. We apply MCTS to a sequence of approximating problems, which allows constraint satisfying actions to be found in an anytime manner. Our innovation lies in defining the approximating problems and replanning strategy such that the probability of failure constraint is guaranteed to be satisfied over the true policy. The approach does not need to plan for all measurements explicitly or constrain planning based only on the measurements that were observed. To the best of our knowledge, our approach is the first to enforce probability of failure constraints in adaptive sampling. Through experiments on real bathymetric data and simulated measurements, we show our algorithm allows an agent to take dangerous actions only when the reward justifies the risk. We then verify through Monte Carlo simulations that failure bounds are satisfied.

Similar Papers
  • Book Chapter
  • Citations5

MCTS Experiments on the Voronoi Game

  • Jan 01, 2012
  • Bruno Bouzy +2
  • Conference Article
  • Citations3

Monte Carlo Tree Search with Variable Simulation Periods for Continuously Running Tasks

  • Nov 01, 2019
  • Seydou Ba +4
  • Research Article
  • Citations15

Estimating Effect of Additional Sample on Uncertainty Reduction in Reliability Analysis Using Gaussian Process

  • Jun 16, 2020
  • Journal of Mechanical Design
  • Sangjune Bae +2
  • Conference Article
  • Citations5

A Tutorial Introduction to Monte Carlo Tree Search

  • Dec 14, 2020
  • Michael C Fu
  • Research Article
  • Citations5

삼목 게임에 적용된 몬테카를로 트리탐색

  • Jun 30, 2014
  • Journal of Korea Game Society
  • Byung-Doo Lee
  • Research Article
  • Citations5

Time-dependent reliability analysis for radionuclide migration in groundwater in near surface disposal facility using the enhanced Monte Carlo method

  • Sep 16, 2016
  • Georisk: Assessment and Management of Risk for Engineered Systems and Geohazards
  • S Sujitha +2
  • Conference Article
  • Citations1

ConstrainedZero: Chance-Constrained POMDP Planning Using Learned Probabilistic Failure Surrogates and Adaptive Safety Constraints

  • Aug 01, 2024
  • Chao Xu +3
  • Conference Article

A Confidence-Based Adaptive Sampling Approach for Dynamic Reliability Analysis

  • Aug 17, 2014
  • Zequn Wang +1
  • Book Chapter
  • Citations2

Linking Safety Factor and Probability of Failure Based on Monte Carlo Simulation in Fire Safety Design

  • Oct 05, 2016
  • Depeng Kong +2
  • Research Article
  • Citations20

Simulation-Based Algorithms for Markov Decision Processes: Monte Carlo Tree Search from AlphaGo to AlphaZero

  • Dec 01, 2019
  • Asia-Pacific Journal of Operational Research
  • Michael C Fu
  • Research Article
  • Citations72

The effect of interference of corrosion pits on the failure probability of a reinforced concrete beam

  • Feb 27, 2016
  • Engineering Structures
  • Mahdi M Kioumarsi +3
  • Research Article
  • Citations4

A Dynamic Programming Algorithm for Finding an Optimal Sequence of Informative Measurements.

  • Jan 30, 2023
  • Entropy
  • Peter N Loxley +1
  • PDF
  • Research Article

Tunnel Probabilistic Structural Analysis Using the FORM

  • Aug 12, 2015
  • Journal of Geological Research
  • Yousef Mirzaeian +2
  • Research Article
  • Citations5

Enhanced Adaptive Kriging Combined Adaptive Radial-Based Importance Sampling Method for Reliability Analysis

  • Feb 28, 2022
  • AIAA Journal
  • Wanying Yun +2
  • Research Article
  • Citations7

Incentive Learning in Monte Carlo Tree Search

  • Dec 01, 2013
  • IEEE Transactions on Computational Intelligence and AI in Games
  • Kuo-Yuan Kao +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.