• Home
  • Search
  • Multi-Modal Sleep Stage Classification With Two-Stream Encoder-Decoder.
  • Cite Icon12
  • https://doi.org/10.1109/tnsre.2024.3394738Copy DOI Icon

Multi-Modal Sleep Stage Classification With Two-Stream Encoder-Decoder.

  • Abstract
  • Highlights & Summary
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Sleep staging serves as a fundamental assessment for sleep quality measurement and sleep disorder diagnosis. Although current deep learning approaches have successfully integrated multimodal sleep signals, enhancing the accuracy of automatic sleep staging, certain challenges remain, as follows: 1) optimizing the utilization of multi-modal information complementarity, 2) effectively extracting both long- and short-range temporal features of sleep information, and 3) addressing the class imbalance problem in sleep data. To address these challenges, this paper proposes a two-stream encode-decoder network, named TSEDSleepNet, which is inspired by the depth sensitive attention and automatic multi-modal fusion (DSA2F) framework. In TSEDSleepNet, a two-stream encoder is used to extract the multiscale features of electrooculogram (EOG) and electroencephalogram (EEG) signals. And a self-attention mechanism is utilized to fuse the multiscale features, generating multi-modal saliency features. Subsequently, the coarser-scale construction module (CSCM) is adopted to extract and construct multi-resolution features from the multiscale features and the salient features. Thereafter, a Transformer module is applied to capture both long- and short-range temporal features from the multi-resolution features. Finally, the long- and short-range temporal features are restored with low-layer details and mapped to the predicted classification results. Additionally, the Lovász loss function is applied to alleviate the class imbalance problem in sleep datasets. Our proposed method was tested on the Sleep-EDF-39 and Sleep-EDF-153 datasets, and it achieved classification accuracies of 88.9% and 85.2% and Macro-F1 scores of 84.8% and 79.7%, respectively, thus outperforming conventional traditional baseline models. These results highlight the efficacy of the proposed method in fusing multi-modal information. This method has potential for application as an adjunct tool for diagnosing sleep disorders.

Similar Papers
  • Conference Article

Simultaneous Sleep Events Detection and Stages Classification Using a Multi-Task Deep-Learning Approach

  • Nov 01, 2024
  • Adriana Anido-Alonso +1
  • Research Article
  • Citations1

Diagnosis of sleep disorders in optimized time slot based machine learning techniques on EEG energy level patterns

  • Jul 28, 2021
  • Materials Today: Proceedings
  • Shivam Tiwari +1
  • Research Article
  • Citations69

Exploratory Polysomnographic Evaluation of Pregabalin on Sleep Disturbance in Patients with Epilepsy

  • Aug 15, 2007
  • Journal of Clinical Sleep Medicine
  • Sanne De Haas +5
  • Research Article

An Eye Mask-Based Wearable System Toward Tailored Sleep Monitoring

  • Nov 15, 2025
  • IEEE Sensors Journal
  • Adili Tuheti +7
  • Research Article
  • Citations3

Sleep stages classification by fusing the time-related synchronization analysis and brain activations

  • Jun 22, 2024
  • Brain Research Bulletin
  • Cunbo Li +7
  • Research Article
  • Citations15

Sleep disorders medicine

  • Jan 01, 2013
  • Journal of the Korean Medical Association
  • Seung Bong Hong
  • Research Article
  • Citations14

Cardiovascular Disease and Sleep Disordered Breathing: Are Children Vulnerable?

  • Oct 01, 2009
  • Sleep
  • Rakesh Bhattacharjee +1
  • Research Article
  • Citations40

Management of Sleep Disorders in Community‐Dwelling Older Women and Men at the Time of Diagnosis

  • Jun 21, 2019
  • Journal of the American Geriatrics Society
  • Paula Pop +11
  • Research Article
  • Citations18

Consecutive transcranial magnetic stimulation twitches reduce flow limitation during sleep in apnoeic patients

  • Jun 04, 2013
  • Experimental Physiology
  • César Augusto Melo‐Silva +3
  • Research Article
  • Citations5

SleepFC: Feature Pyramid and Cross-Scale Context Learning for Sleep Staging.

  • Jan 01, 2024
  • IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society
  • Wei Li +3
  • Research Article
  • Citations32

Sleep time and efficiency in patients undergoing laboratory-based polysomnography.

  • Mar 19, 2021
  • Journal of Clinical Sleep Medicine
  • Elizabeth I Harrison +7
  • Research Article
  • Citations6

Sleep Disorders and Cognitive Aging Among Cognitively Impaired Versus Unimpaired Older Adults.

  • Nov 07, 2023
  • The Gerontologist
  • Soomi Lee +8
  • Research Article
  • Citations1

Sleep restriction and emotion, electroencephalography (EEG) and dream recall, and insomnia and punctuality

  • May 19, 2012
  • Journal of Sleep Research
  • Derk‐Jan Dijk
  • Research Article
  • Citations59

Chinese agricultural diseases and pests named entity recognition with multi-scale local context features and self-attention mechanism

  • Nov 07, 2020
  • Computers and Electronics in Agriculture
  • Xuchao Guo +6
  • Research Article
  • Citations17

A lightweight automatic sleep staging method for children using single-channel EEG based on edge artificial intelligence.

  • Dec 30, 2021
  • World Wide Web
  • Liqiang Zhu +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.