• Home
  • Search
  • Robust Model Predictive Shielding for Safe Reinforcement Learning with Stochastic Dynamics
  • Open Access IconOpen Access
  • Cite Icon73
  • https://doi.org/10.1109/icra40945.2020.9196867Copy DOI Icon

Robust Model Predictive Shielding for Safe Reinforcement Learning with Stochastic Dynamics

  • May 1, 2020
  • Shuo Li +1 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

We propose a framework for safe reinforcement learning that can handle stochastic nonlinear dynamical systems. We focus on the setting where the nominal dynamics are known, and are subject to additive stochastic disturbances with known distribution. Our goal is to ensure the safety of a control policy trained using reinforcement learning, e.g., in a simulated environment. We build on the idea of model predictive shielding (MPS), where a backup controller is used to override the learned policy as needed to ensure safety. The key challenge is how to compute a backup policy in the context of stochastic dynamics. We propose to use a tube-based robust nonlinear model predictive controller (NMPC) as the backup controller. We estimate the tubes using sampled trajectories, leveraging ideas from statistical learning theory to obtain high-probability guarantees. We empirically demonstrate that our approach can ensure safety in stochastic systems, including cart-pole and a non-holonomic particle with random obstacles.

Similar Papers
  • Research Article
  • Citations34

Robust Nonlinear Model Predictive Control with Reduction of Uncertainty via Robust Optimal Experiment Design

  • Jan 01, 2014
  • IFAC Proceedings Volumes
  • Sergio Lucia +1
  • Research Article
  • Citations199

Dual-Loop Tube-Based Robust Model Predictive Attitude Tracking Control for Spacecraft With System Constraints and Additive Disturbances

  • May 07, 2021
  • IEEE Transactions on Industrial Electronics
  • Runqi Chai +4
  • PDF
  • Research Article
  • Citations10

Parallel Solution of Robust Nonlinear Model Predictive Control Problems in Batch Crystallization

  • Jun 30, 2016
  • Processes
  • Yankai Cao +3
  • Research Article
  • Citations129

Robust Nonlinear Model Predictive Control Based Visual Servoing of Quadrotor UAVs

  • Jan 21, 2021
  • IEEE/ASME Transactions on Mechatronics
  • Kunwu Zhang +2
  • Conference Article

Robust Multi-stage NMPC under Structural Plant-model Mismatch Without Full-State Measurements

  • Jun 01, 2019
  • Sakthi Thangavel +3
  • Conference Article
  • Citations13

Robust nonlinear model predictive controller design based on multi-scenario formulation

  • Jan 01, 2009
  • Rui Huang +1
  • Conference Article

Robust nonlinear model predictive control algorithm based on reduced precision solution criteria

  • Jul 01, 2012
  • Jiaona Wan +4
  • Research Article
  • Citations2

Treatment scheduling for HIV using robust nonlinear model predictive control

  • Jan 01, 2005
  • Australian Journal of Electrical and Electronics Engineering
  • Ryan Zurakowski +3
  • Research Article
  • Citations28

Robust Nonlinear Model Predictive Control with Constraint Satisfaction: A Relaxation-based Approach

  • Jan 01, 2014
  • IFAC Proceedings Volumes
  • Stefan Streif +3
  • Conference Article
  • Citations7

An efficient distributed algorithm for multi-stage robust nonlinear predictive control

  • Jul 01, 2015
  • Ruben Marti +5
  • Research Article
  • Citations9

Robust Dual Multi-stage NMPC using Guaranteed Parameter Estimation

  • Jan 01, 2018
  • IFAC-PapersOnLine
  • Sakthi Thangavel +4
  • Conference Article
  • Citations13

Reinforced approximate robust nonlinear model predictive control

  • Jun 01, 2021
  • Benjamin Karg +1
  • Research Article
  • Citations15

Flooding mitigation through safe & trustworthy reinforcement learning

  • Mar 24, 2023
  • Journal of Hydrology
  • Wenchong Tian +5
  • Research Article

Trajectory Tracking Control for Unmanned Underwater Vehicles via Robust Quasi‐Linear Parameter‐Varying Model Predictive Control Considering External Disturbances and Input Constraints

  • Dec 09, 2025
  • International Journal of Robust and Nonlinear Control
  • Shaowen Hao +4
  • Research Article
  • Citations1

A Computationally Efficient Robust Tube-Based MPC for Tracking of Linear Systems

  • Aug 29, 2020
  • Iranian Journal of Science and Technology, Transactions A: Science
  • Y Abbasi +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.