• Home
  • Search
  • SF-SER: An Efficient Speech-Only Model with Semantic Funnel for Speech Emotion Recognition
  • https://doi.org/10.3233/faia240929Copy DOI Icon

SF-SER: An Efficient Speech-Only Model with Semantic Funnel for Speech Emotion Recognition

Show More
  • Abstract
  • Literature Map
  • Similar Papers
Abstract

In practical life, the transcription of speech into text via automatic speech recognition (ASR) models has become very common due to the essential semantic information contained in speech. However, in speech emotion recognition, multimodal models that combine speech and text significantly outperform speech-only models. For this phenomenon, this paper provides an explanation that the existing speech emotion datasets are insufficient for speech-only models to effectively extract crucial semantic information, thereby affecting generalization capability. Based on this explanation, this paper proposes an efficient speech-only model, called semantic funnel speech emotion recognition (SF-SER) model, which excludes the textual input by introducing and integrating some parameters and structures from the ASR model, and then filters the valuable semantic information by the semantic funnel, thus achieving performance better than the speech+text multimodal model. Finally, experimental results show that the SF-SER model achieves significant performance on both the IEMOCAP and EMODB datasets.

Similar Papers
  • Conference Article

Speech Emotion Recognition using Threshold Fusion for Enhancing Audio Sensitivity

  • Dec 06, 2023
  • Zhaojie Luo +3
  • Research Article
  • Citations51

Robust emotion recognition in noisy speech via sparse representation

  • Mar 29, 2013
  • Neural Computing and Applications
  • Xiaoming Zhao +2
  • Research Article
  • Citations6

Automated speech emotion polarization for a distance education system based on orbital local binary pattern and an appropriate sub-band selection technique

  • Apr 03, 2023
  • Multimedia Tools and Applications
  • Dahiru Tanko +4
  • Dissertation

Speech emotion recognition using multimodal data

  • Jan 01, 2025
  • Chung Soo Ahn
  • Research Article
  • Citations3

Adversarial Attack and Defense for Commercial Black-box Chinese-English Speech Recognition Systems

  • Dec 11, 2024
  • ACM Transactions on Privacy and Security
  • Xuejing Yuan +6
  • Conference Article
  • Citations33

A Hybrid Machine Learning Model for Emotion Recognition From Speech Signals

  • Sep 01, 2020
  • Deepak Bharti +1
  • Conference Article
  • Citations10

I-Vector Algorithm with Gaussian Mixture Model for Efficient Speech Emotion Recognition

  • Dec 01, 2015
  • Joan Gomes +1
  • Conference Article
  • Citations2

Semi-Supervised Learning for Multimodal Speech and Emotion Recognition

  • Oct 18, 2021
  • Yuanchao Li
  • Conference Article
  • Citations1

STERM: A Multimodal Speech Emotion Recognition Model in Filipino Gaming Settings

  • Dec 01, 2022
  • Giorgio Armani G Magno +2
  • Research Article
  • Citations19

ETEH: Unified Attention-Based End-to-End ASR and KWS Architecture

  • Jan 01, 2022
  • IEEE/ACM Transactions on Audio, Speech, and Language Processing
  • Gaofeng Cheng +4
  • Research Article
  • Citations4

A novel speech emotion recognition model using mean update of particle swarm and whale optimization-based deep belief network

  • Apr 17, 2020
  • Data Technologies and Applications
  • Rajasekhar B +2
  • Book Chapter
  • Citations8

On the Evaluation and Implementation of LSTM Model for Speech Emotion Recognition Using MFCC

  • Jan 01, 2022
  • Sheetal U Bhandari +3
  • PDF
  • Research Article
  • Citations62

EdgeRNN: A Compact Speech Recognition Network With Spatio-Temporal Features for Edge Computing

  • Jan 01, 2020
  • IEEE Access
  • Shunzhi Yang +5
  • PDF
  • Research Article
  • Citations23

Transfer Subspace Learning for Unsupervised Cross-Corpus Speech Emotion Recognition

  • Jan 01, 2021
  • IEEE Access
  • Na Liu +6
  • Video Transcripts

OkwuGbé: End-to-End Speech Recognition for Fon and Igbo

  • Oct 21, 2021
  • Underline Science Inc.
  • Bonaventure F P Dossou +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.