• Home
  • Search
  • Fusion of Learned Representations for Multimodal Sensor Data Classification
  • https://doi.org/10.1007/978-3-031-34111-3_34Copy DOI Icon

Fusion of Learned Representations for Multimodal Sensor Data Classification

  • Jan 1, 2023
  • Lee B Hinkle +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Time-Series data collected using body-worn sensors can be used to recognize activities of interest in various medical applications such as sleep studies. Recent advances in other domains, such as image recognition and natural language processing have shown that unlabeled data can still be useful when self-supervised techniques such as contrastive learning are used to generate meaningful feature space representations. Labeling data for Human Activity Recognition (HAR) and sleep disorder diagnosis (polysomnography) is difficult and requires trained professionals. In this work, we apply learned feature representation techniques to multimodal time-series data. By using signal-specific representations, based on self-supervised and supervised learning, the channels can be evaluated to determine if they are likely to contribute to correct classification. The learned representation embeddings are then used to process each channel into a new feature space that serves as input into a neural network. This results in a better understanding of the importance of each signal modality as well as the potential applicability of newer self-supervised techniques to time-series data.

Similar Papers
  • Research Article
  • Citations136

Contrastive Predictive Coding for Human Activity Recognition

  • Jun 23, 2021
  • Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
  • Harish Haresamudram +2
  • Research Article
  • Citations460

Multimodal Intelligence: Representation Learning, Information Fusion, and Applications

  • Mar 01, 2020
  • IEEE Journal of Selected Topics in Signal Processing
  • Chao Zhang +3
  • Research Article

Abstract 5059: Self-supervised representation learning of somatic mutational data

  • Apr 21, 2025
  • Cancer Research
  • Marzieh Haghighi +2
  • Research Article
  • Citations4

Non-parametric Representation Learning with Kernels

  • Mar 24, 2024
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Pascal Esser +2
  • Research Article
  • Citations128

Using unlabeled data in a sparse-coding framework for human activity recognition

  • May 29, 2014
  • Pervasive and Mobile Computing
  • Sourav Bhattacharya +3
  • PDF
  • Research Article
  • Citations11

Outdoor activity classification using smartphone based inertial sensor measurements

  • Feb 20, 2024
  • Multimedia Tools and Applications
  • Rushikesh Bodhe +4
  • Research Article
  • Citations7

ProInterVal: Validation of Protein-Protein Interfaces through Learned Interface Representations.

  • Mar 25, 2024
  • Journal of chemical information and modeling
  • Damla Ovek +2
  • Supplementary Content
  • Citations2

Representation Learning and Learning from Limited Labeled Data for Community Question Answering

  • Jan 01, 2021
  • TUbilio (Technical University of Darmstadt)
  • Andreas Rücklé
  • Research Article
  • Citations350

A comparison review of transfer learning and self-supervised learning: Definitions, applications, advantages and limitations

  • Dec 02, 2023
  • Expert Systems with Applications
  • Zehui Zhao +4
  • Research Article

Using a Semi-supervised Learning Model for Recognition of Human Daily Activities from Wearable Sensor Data

  • Jun 03, 2024
  • International Journal of Artificial Intelligence Research
  • Tien Manh Nguyen
  • Research Article
  • Citations1

Representation-based ECG signal prediction forneural networks pre-training

  • Apr 04, 2025
  • Herald of Advanced Information Technology
  • Serhii G Stavychenko +1
  • Research Article
  • Citations40

Management of Sleep Disorders in Community‐Dwelling Older Women and Men at the Time of Diagnosis

  • Jun 21, 2019
  • Journal of the American Geriatrics Society
  • Paula Pop +11
  • Conference Article
  • Citations1

Review of Semi-Supervised Learning Methods for Medical Computer-Aided Diagnosis Systems

  • Oct 05, 2020
  • Bohdan Chapaliuk +1
  • PDF
  • Research Article
  • Citations6

ReliaMatch: Semi-Supervised Classification with Reliable Match

  • Jul 31, 2023
  • Applied Sciences
  • Tao Jiang +4
  • Research Article
  • Citations2

Spatiotemporal self-supervised predictive learning for atmospheric variable prediction via multi-group multi-attention

  • Jun 13, 2024
  • Knowledge-Based Systems
  • Zhensheng Shi +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.