• Home
  • Search
  • Delayed reinforcement learning converges to intermittent control for human quiet stance
  • Cite Icon5
  • https://doi.org/10.1016/j.medengphy.2024.104197Copy DOI Icon

Delayed reinforcement learning converges to intermittent control for human quiet stance

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The neural control of human quiet stance remains controversial, with classic views suggesting a limited role of the brain and recent findings conversely indicating direct cortical control of muscles during upright posture. Conceptual neural feedback control models have been proposed and tested against experimental evidence. The most renowned model is the continuous impedance control model. However, when time delays are included in this model to simulate neural transmission, the continuous controller becomes unstable. Another model, the intermittent control model, assumes that the central nervous system (CNS) activates muscles intermittently, and not continuously, to counteract gravitational torque. In this study, a delayed reinforcement learning algorithm was developed to seek optimal control policy to balance a one-segment inverted pendulum model representing the human body. According to this approach, there was no a-priori strategy imposed on the controller but rather the optimal strategy emerged from the reward-based learning. The simulation results indicated that the optimal neural controller exhibits intermittent, and not continuous, characteristics, in agreement with the possibility that the CNS intermittently provides neural feedback torque to maintain an upright posture.

Similar Papers
  • Research Article
  • Citations273

Intermittent control: a computational theory of human control

  • Feb 01, 2011
  • Biological Cybernetics
  • Peter Gawthrop +3
  • PDF
  • Research Article
  • Citations21

Dynamic Determinants of the Uncontrolled Manifold during Human Quiet Stance

  • Dec 06, 2016
  • Frontiers in Human Neuroscience
  • Yasuyuki Suzuki +4
  • Research Article

Оптимизация цифрового регулятора системы автоматического регулирования непрерывного объекта

  • Feb 28, 2022
  • Vestnik of Astrakhan State Technical University. Series: Marine engineering and technologies
  • Vladimir Alekseevich Dorovskoy +4
  • Research Article

Universal neural controllers and stability analysis

  • Feb 01, 1996
  • International Journal of Systems Science
  • Cheng-Liang Chen +1
  • Conference Article
  • Citations4

Passivity-based neural network adaptive output feedback control for nonlinear nonnegative dynamical systems

  • Dec 01, 2003
  • T Hayakawa +3
  • Research Article
  • Citations1

Nonlinear hybrid control model for accurate steady-state predictions

  • Aug 01, 2023
  • Computers & Chemical Engineering
  • Valentin Krespach +4
  • Research Article
  • Citations18

Biomechanical effects of pedicle screw fixation on adjacent segments

  • Jan 22, 2014
  • European Journal of Orthopaedic Surgery & Traumatology
  • Thein Aung Kyaw +5
  • Conference Article
  • Citations12

Approach to Supporting Continuity of Usage in Location-Based Access Control

  • Jan 01, 2008
  • Maria Luisa Damiani +2
  • Research Article
  • Citations16

Stability and stabilization of evolutionary games with time delays via matrix method

  • Jun 27, 2019
  • Asian Journal of Control
  • Xiaoye Gao +2
  • Research Article
  • Citations8

A new view on visuomotor channels: The case of the disappearing dynamics

  • Oct 01, 2004
  • Human Movement Science
  • Peter D Neilson +1
  • Conference Article
  • Citations3

Review on control model of reheating furnace in hot rolling line

  • Jul 01, 2014
  • Xuedong Zhang +2
  • Research Article
  • Citations6

Finite approximation of the first passage models for discrete-time Markov decision processes with varying discount factors

  • Jan 25, 2015
  • Discrete Event Dynamic Systems
  • Xiao Wu +1
  • Conference Article

Research on speed adaptive DTC strategy for induction motor

  • Jun 01, 2014
  • Pan Zhifeng +5
  • Research Article
  • Citations18

Time-Complemented Event-Driven Architecture for Distributed Automation Systems

  • Aug 01, 2015
  • IEEE Transactions on Systems, Man, and Cybernetics: Systems
  • Cheng Pang +2
  • PDF
  • Research Article

Universal Singular Optimal Control: Affine Systems

  • Apr 01, 2022
  • American Journal of Engineering and Applied Sciences
  • Andres Gabriel Garcia +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.