• Home
  • Search
  • Recognition of speech emotion in Call Centre conversations in a multilingual environment
  • Cite Icon1
  • https://doi.org/10.51415/10321/3801Copy DOI Icon

Recognition of speech emotion in Call Centre conversations in a multilingual environment

  • Oct 15, 2021
  • Kudakwashe Zvarevashe
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The use of customer call centres has increased exponentially in the modern business world and is the heart of marketing in the customer services industry. Previous studies have shown that the quality of services that customers receive from the call centres paint a picture of how they view the company. Reliance on the use of suggestion boxes to crowdsource customer views on call centre services is not adequate and at times, may not give a correct record about the services in question. Therefore, speech emotion recognition has been applied in customer call centres as a tool for evaluating customer service perception, emotion, and sentiment. This approach presents several advantages, for instance, the performance of call centre agents can adequately be scrutinised because their emotions can be automatically classified based on machine learning methods for emotion recognition. In recent times, various techniques and methods have been used to develop robust speech emotion recognition systems for customer call centres, but the primary problem associated with these novel applications is that most of them do not perform well in multilingual environments. In addition, most of the proposed models do not properly recognise the fear archetype of emotion. The effectiveness of a speech emotion recognition system depends largely on the strength of the features used. Consequently, the purpose of this research was to discover the most efficacious features in recognising speech emotion in call centre conversations. Therefore, this thesis reports on the development of hybrid acoustic features based on spectral and prosodic descriptors. The set of hybrid features proposed in this study comprises the logarithm of energy, fundamental frequency, zero-crossing rate, spectral roll- off point, spectral flux, spectral centroid, spectral compactness, spectral variability, fast Fourier transform, Mel frequency cepstral coefficients, and linear prediction cepstral coefficients. Furthermore, this thesis reports on the development of a novel stacked ensemble machine learning algorithm based on a combination of inducers and ensemble classifiers. The discovery of effective speech emotion features and the development of an efficient machine learning algorithm are essential stages of effective speech emotion recognition in call centre conversations. The verification and validation of the proposed speech emotion recognition methods based on feature extraction and feature classification for applications in call centre conversions were done using a series of experiments. This was accomplished by testing the crafted hybrid acoustic features on five distinct speech emotion databases. The acoustic features were evaluated against deep learning auto-generated features and a hybrid of popular acoustic features. In addition, a set of four ensemble algorithms were evaluated against the newly invented stacked ensemble algorithm. The performance of the developed stacked ensemble algorithm in this study was analysed based on the widely used statistical evaluation metrics of accuracy, precision, F-score, area under the receiver operating characteristic curve and computation time. The results have indeed demonstrated that the newly developed stacked ensemble algorithm coupled with the crafted hybrid acoustic features have consistently performed better than many other state-of-the-art algorithms and speech features across various standard speech corpora.

Similar Papers
  • PDF
  • Research Article
  • Citations139

Speech Emotion Recognition Based on Multiple Acoustic Features and Deep Convolutional Neural Network

  • Feb 07, 2023
  • Electronics
  • Kishor Bhangale +1
  • Research Article
  • Citations108

Emotional speech Recognition using CNN and Deep learning techniques

  • Jun 28, 2023
  • Applied Acoustics
  • C Hema +1
  • Research Article
  • Citations2

TOWARD ROBUST SPEECH EMOTION RECOGNITION AND CLASSIFICATION USING NATURAL LANGUAGE PROCESSING WITH DEEP LEARNING MODEL

  • Jan 01, 2025
  • Fractals
  • Saad Alahmari +5
  • Research Article
  • Citations69

Speech emotion recognition using cepstral features extracted with novel triangular filter banks based on bark and ERB frequency scales

  • May 11, 2020
  • Digital Signal Processing
  • Sugan Nagarajan +4
  • PDF
  • Research Article
  • Citations147

A Novel Approach for Classification of Speech Emotions Based on Deep and Acoustic Features

  • Jan 01, 2020
  • IEEE Access
  • Mehmet Bilal Er
  • Conference Article
  • Citations12

Speech emotion recognition based on convolutional neural network

  • Dec 01, 2021
  • Chen Jie
  • Conference Article
  • Citations15

Speech Emotion Recognition Using Minimum Extracted Features

  • Nov 01, 2018
  • Wisal Hashim Abdulsalam +2
  • Research Article
  • Citations12

Speech Emotion Recognition Using Machine Learning Techniques

  • Apr 30, 2022
  • Revue d intelligence artificielle
  • Anil Kumar Pagidirayi +1
  • Research Article
  • Citations16

Speech emotion recognition using semi-NMF feature optimization

  • Sep 18, 2019
  • TURKISH JOURNAL OF ELECTRICAL ENGINEERING & COMPUTER SCIENCES
  • Surekha Reddy Bandela +1
  • Research Article
  • Citations8

Real-time prediction of upcoming respiratory events via machine learning using snoring sound signal.

  • Apr 12, 2021
  • Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine
  • Bochun Wang +6
  • PDF
  • Research Article
  • Citations5

Stressed Speech Emotion Recognition Using Teager Energy and Spectral Feature Fusion with Feature Optimization.

  • Jan 01, 2023
  • Computational Intelligence and Neuroscience
  • Surekha Reddy Bandela +4
  • Research Article
  • Citations27

Investigation of multilingual and mixed-lingual emotion recognition using enhanced cues with data augmentation

  • Jul 22, 2020
  • Applied Acoustics
  • S Lalitha +3
  • Research Article
  • Citations75

Cultural dependency analysis for understanding speech emotion

  • Nov 18, 2011
  • Expert Systems with Applications
  • Norhaslinda Kamaruddin +2
  • Research Article
  • Citations3

ASERS-LSTM: Arabic Speech Emotion Recognition System Based on LSTM Model

  • Feb 28, 2022
  • Signal & Image Processing : An International Journal
  • Ohammed Tajalsir +2
  • PDF
  • Conference Article

Speech Signal Imaging and Emotion Recognition Based on Symmetric-Diagonal Matrix Model

  • Jan 01, 2023
  • Zijun Yang +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.