• Home
  • Search
  • Robotic arm control system based on augmented reality brain-computer interface and computer vision
  • Cite Icon6
  • https://doi.org/10.7507/1001-5515.202011039Copy DOI Icon

Robotic arm control system based on augmented reality brain-computer interface and computer vision

  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Brain-computer interface (BCI) has great potential to replace lost upper limb function. Thus, there has been great interest in the development of BCI-controlled robotic arm. However, few studies have attempted to use noninvasive electroencephalography (EEG)-based BCI to achieve high-level control of a robotic arm. In this paper, a high-level control architecture combining augmented reality (AR) BCI and computer vision was designed to control a robotic arm for performing a pick and place task. A steady-state visual evoked potential (SSVEP)-based BCI paradigm was adopted to realize the BCI system. Microsoft's HoloLens was used to build an AR environment and served as the visual stimulator for eliciting SSVEPs. The proposed AR-BCI was used to select the objects that need to be operated by the robotic arm. The computer vision was responsible for providing the location, color and shape information of the objects. According to the outputs of the AR-BCI and computer vision, the robotic arm could autonomously pick the object and place it to specific location. Online results of 11 healthy subjects showed that the average classification accuracy of the proposed system was 91.41%. These results verified the feasibility of combing AR, BCI and computer vision to control a robotic arm, and are expected to provide new ideas for innovative robotic arm control approaches.

Similar Papers
  • PDF
  • Research Article
  • Citations63

A Hybrid BCI Based on SSVEP and EOG for Robotic Arm Control.

  • Nov 20, 2020
  • Frontiers in Neurorobotics
  • Yuanlu Zhu +3
  • Front Matter
  • Citations1

Editorial: Advances in hybrid and application-driven BCI systems.

  • Oct 22, 2024
  • Frontiers in human neuroscience
  • Minkyu Ahn +4
  • Research Article
  • Citations89

Adaptive asynchronous control system of robotic arm based on augmented reality-assisted brain–computer interface

  • Nov 12, 2021
  • Journal of Neural Engineering
  • Lingling Chen +10
  • Conference Article

Real-Time BCI-Controlled Humanoid Robotic Arm Using SSVEP and SVM Classification with Augmented Reality in ROS

  • Nov 12, 2025
  • Raul D' Armando +3
  • Research Article

Virtual Reality-Based Control and Simulation of a Real Robotic Arm

  • Mar 24, 2026
  • Journal of Control Engineering and Applied Informatics
  • Eda Derya Toper +2
  • Conference Article
  • Citations1

Brain machine interface available in eyes-closed state in terms of event-related desynchronization and synchronization during a mental task

  • Oct 01, 2015
  • Seiji Nishifuji +2
  • Conference Article
  • Citations7

A SSVEP brain-computer interface with the hybrid stimuli of SSVEP and P300

  • May 01, 2013
  • Luzheng Bi +3
  • Conference Article
  • Citations9

Single-Channel EEG SSVEP-based BCI for Robot Arm Control

  • Aug 23, 2021
  • Sanduni P Karunasena +5
  • Research Article
  • Citations80

A comparison of three brain–computer interfaces based on event-related desynchronization, steady state visual evoked potentials, or a hybrid approach using both signals

  • Mar 24, 2011
  • Journal of Neural Engineering
  • C Brunner +3
  • PDF
  • Abstract

Assisted closed-loops for brain-computer interfaces

  • Jul 01, 2013
  • BMC Neuroscience
  • Jacobo Fernandez-Vargas +3
  • Research Article
  • Citations37

Effects of stimulation frequency and stimulation waveform on steady-state visual evoked potentials using a computer monitor

  • Oct 10, 2019
  • Journal of Neural Engineering
  • Xiaogang Chen +4
  • Conference Article
  • Citations1

Study on Novel Designs with Reduced Fatigue for Steady State Motion Visual Evoked Potentials

  • Nov 01, 2019
  • Raika Karimi +4
  • Research Article

Monocular vision-based visual control for SCARA-type robotic arms: a depth mapping approach

  • Nov 01, 2025
  • Indonesian Journal of Electrical Engineering and Computer Science
  • Diego Chambi Tula +4
  • Conference Article
  • Citations7

The relationship between a location of visual stimulus and SSVEP

  • Oct 01, 2015
  • Akitoshi Itai +1
  • Conference Article
  • Citations8

Brain Computer Interface based on SSVEP for controlling a remote control car

  • Feb 01, 2015
  • A Gonzalez-Mendoza +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.