• Home
  • Search
  • Towards LLMs for Sensor Data: Multi-Task Self-Supervised Learning
  • Cite Icon9
  • https://doi.org/10.1145/3594739.3610745Copy DOI Icon

Towards LLMs for Sensor Data: Multi-Task Self-Supervised Learning

  • Oct 8, 2023
  • Tsuyoshi Okita +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

LLMs for vision and NLP domain has been popular by the widespread use of ChatGPT and GPT-4. This paper tackles to build LLMs for sensor domain of one-dimensional signals whose downstream task is activity recognition and emotion detection. We propose a new architecture of Transformer-based self-supervised learner which we name SENvT. This SENvT builds the LLMs for sensor data using 7 pretext objectives in multi-task learning together with contrastive learning. Experimental results show these three. First, we obtained better results for contrastive learning and the masked token task but not for other pretext tasks. Second, the masked token task was better in 60% rather than in 10%. Third, the RGW worked best in accuracy while the masked token task worked best in F1.

Similar Papers
  • Research Article

MBLKNet: a large kernel convolution-driven network with multi-task self-supervised learning for SAR maritime target classification

  • Nov 28, 2025
  • Geo-spatial Information Science
  • Shuang Yang +10
  • Research Article
  • Citations17

Evaluation of regularized multi-task leaning algorithms for single/multi-view human action recognition

  • Feb 16, 2017
  • Multimedia Tools and Applications
  • Z Gao +5
  • Research Article
  • Citations10

CMNet: Classification-oriented multi-task network for hyperspectral pansharpening

  • Sep 16, 2022
  • Knowledge-Based Systems
  • Xiande Wu +4
  • Conference Article
  • Citations3

Coupling Deep Imputation with Multitask Learning for Downstream Tasks on Omics Data

  • Jul 18, 2022
  • Sophie Peacock +2
  • Research Article

Retrieval of leaf area index from the Landsat surface reflectance using multi-task adversarial transfer learning

  • Jul 09, 2025
  • International Journal of Digital Earth
  • Juan Li +4
  • PDF
  • Research Article
  • Citations9

A Contrastive Predictive Coding-Based Classification Framework for Healthcare Sensor Data.

  • Mar 15, 2022
  • Journal of healthcare engineering
  • Chaoxu Ren +2
  • PDF
  • Research Article
  • Citations1

PatchLoc: Embedded Patch Localization Pretext Task for Tumor Segmentation in Medical Images

  • Jan 01, 2024
  • IEEE Access
  • Ramchandra Cheke +3
  • Research Article
  • Citations7

GenSelfDiff-HIS: Generative Self-Supervision Using Diffusion for Histopathological Image Segmentation.

  • Feb 01, 2025
  • IEEE transactions on medical imaging
  • Vishnuvardhan Purma +4
  • Research Article
  • Citations403

Hierarchical Clustering Multi-Task Learning for Joint Human Action Grouping and Recognition.

  • Mar 02, 2016
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • An-An Liu +3
  • Research Article
  • Citations39

Spatial and temporal saliency based four-stream network with multi-task learning for action recognition

  • Dec 05, 2022
  • Applied Soft Computing
  • Ming Zong +3
  • Research Article
  • Citations2

Contrastive fine-tuning for low-resource graph-level transfer learning

  • Jan 02, 2024
  • Information Sciences
  • Yutai Duan +3
  • Research Article

Social graph diffusion and disentangled representations learning for multimodal recommendation

  • Mar 10, 2026
  • Journal of King Saud University - Computer and Information Sciences
  • Zhigao Zhang +3
  • PDF
  • Conference Article
  • Citations1

UU-Tax at SemEval-2022 Task 3: Improving the generalizability of language models for taxonomy classification through data augmentation

  • Jan 01, 2022
  • Injy Sarhan +2
  • Research Article
  • Citations5

Self-Supervised Video Representation Learning by Serial Restoration With Elastic Complexity

  • Jan 01, 2024
  • IEEE Transactions on Multimedia
  • Ziyu Chen +2
  • Research Article
  • Citations13

Multitask Deep Learning for Human Activity, Speed, and Body Weight Estimation Using Commercial Smart Insoles

  • Sep 15, 2023
  • IEEE Internet of Things Journal
  • Jaeho Kim +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.