Emotion recognition with AI: Techniques and applications

Artificial Intelligence: The Future of Maxillofacial Prognosis and Diagnosis?

-- Speech signals are being considered as most effective means of communication between human beings. Many researchers have found different methods or systems to identify emotions from speech signals. Here, the various features of speech are used to classify emotions. Features like pitch, tone, intensity are essential for classification. Large number of the datasets are available for speech emotion recognition. Firstly, the extraction of features from speech emotion is carried out and then another important part is classification of emotions based upon speech. Hence, different classifiers are used to classify emotions such as Happy, Sad, Anger, Surprise, Neutral, etc. Although, there are other approaches based on machine learning algorithms for identifying emotions. Speech Emotion Recognition is a current research topic because of its wide range of applications and it became a challenge in the field of speech processing too. We have carried out a brief study on Speech Emotion Analysis along with Emotion Recognition. Speech Emotion Recognition (SER) can be defined as extraction of the emotional state of the speaker from his or her speech signal. There are few universal emotions including Neutral, Anger, we have worked on different tools to be used in SER. SER is tough because emotions are subjective and annotating audio is challenging task. Emotion recognition is the part of speech recognition which is gaining more popularity and need for it increases enormously. We have classified based on different type of emotions to detect from speech. Key Words: Speech Emotion Recognition, Affective Computing, Machine Learning, Deep Learning, Audio Signal Processing, Emotion Classification, Feature Extraction, Prosodic Features, Spectral Features, Mel-Frequency Cepstral Coefficients (MFCCs), Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN), Long Short-Term Memory (LSTM), Attention Mechanisms, Multimodal Emotion Recognition, Speaker-Independent SER, Real-Time Emotion Detection, Noise-Robust Emotion Recognition, Data Augmentation, Emotion-Aware Applications

BackgroundAlthough capsule endoscopy (CE) is a crucial tool for diagnosing small bowel diseases, the need to process a vast number of images imposes a significant workload on physicians, leading to a high risk of missed diagnoses. This study aims to develop an artificial intelligence (AI) model and application based on convolutional neural networks that can automatically recognize various lesions in small bowel capsule endoscopy.MethodsThree small bowel capsule endoscopy datasets were used for AI model training, validation, and testing, encompassing 12 categories of images. The model’s performance was evaluated using metrics such as AUC, sensitivity, specificity, precision, accuracy, and F1 score to select the best model. A human-machine comparison experiment was conducted using the best model and endoscopists with varying levels of experience. Model interpretability was analyzed using Grad-CAM and SHAP techniques. Finally, a clinical application was developed based on the best model using PyQt5 technology.ResultsA total of 34,303 images were included in this study. The best model, MobileNetv3-large, achieved a weighted average sensitivity of 87.17%, specificity of 98.77%, and an AUC of 0.9897 across all categories. The application developed based on this model performed exceptionally well in comparison with endoscopists, achieving an accuracy of 87.17% and a processing speed of 75.04 frames per second, surpassing endoscopists of varying experience levels.ConclusionThe AI model and application developed based on convolutional neural networks can quickly and accurately identify 12 types of small bowel lesions. With its high sensitivity, this system can effectively assist physicians in interpreting small bowel capsule endoscopy images.Future studies will validate the AI system for video evaluations and real-world clinical integration.Supplementary InformationThe online version contains supplementary material available at 10.1186/s12876-024-03482-7.

There has been a lot of progress in recent years in the fields of expert systems, artificial intelligence (AI) and human machine interface (HMI). The use of voice commands to engage with machinery or instruct it to do a certain task is becoming more common. Numerous consumer electronics have SIRI, Alexa, Cortana, and Google Assistant built in. In the field of human-device interaction, emotion recognition from speech is a complex research subject. We can't imagine modern life without machines, so naturally there's a need to create a more robust framework for human-machine communication. A number of academics are now working on speech emotion recognition (SER) in an effort to improve the interaction between humans and machines. We aimed to identify four fundamental emotions: angry, unhappy, neutral and joyful from speech in our experiment. As you can hear below, we trained and tested our model using audio data of brief Manipuri speeches taken from films. This task makes use of convolutional neural networks (CNNs) to extract functions from speech in order to recognize different moods using the Mel-frequency cepstral coefficient (MFCC).

Context-aware computing has become an essential component of modern wearable technology, enabling devices to sense, interpret, and respond to users’ environments and affective states. By integrating contextual intelligence, smart systems can adapt their own behavior to better align with user needs, enhancing efficiency, personalization, and user experience. A critical aspect of context awareness is the ability to recognize a user’s internal state, particularly emotions, which influence decision-making, communication, and overall well-being. While emotion recognition is traditionally approached through multimodal sensing—using cameras, microphones, or physiological sensors such as Electroencephalography (EEG), Electrocardiography (ECG), and Electro-dermal Activity (EDA)—these methods often require multiple sensors, leading to challenges related to power consumption, complexity, and privacy. The demand for a more efficient and unobtrusive approach to emotion and context recognition has driven research toward minimal-sensor solutions that can extract meaningful affective and contextual information with reduced hardware requirements. Restricting sensing sources of contextual information by using only limited number of sensors might come at the expense of constraining the ultimate goal of context-awareness. Such expense can be mitigated by “doing more with less” i.e. delving into the opportunities of using a single sensor for multiple purposes. What is desirable is a minimal-sensor solution capable of capturing both motion and physiological signals for both robust emotion recognition and additional context estimation. Among wearable sensors, chest-worn Inertial Measurement Units (IMUs) stand out as promising candidates for comprehensive context estimation, as they are well-positioned to capture motion patterns, and physiological vibrations, being the subtle cardio-respiratory signals. This raises the question of whether a single chest-worn IMU could serve as a minimal yet effective sensor for simultaneously estimating both emotional and contextual information, offering a practical alternative to traditional multi-sensor approaches. To address the challenge of using chest-worn IMU for multiple context sensing, I investigated the potential of using Seismocardiography (SCG) and Accelerometry-Derived Respiration (ADR) to estimate emotional states. First, I explored the existing capabilities of chest-worn IMUs in capturing cardio-respiratory vibrations and motion data, which I used as a knowledge base for embedding such IMUs in context sensing. Data plays a crucial role in this problem, therefore I developed a flexible software interface, ColEmo, to facilitate the scalable collection of emotion-related data and introduced a novel dataset, EmoWear, integrating physiological and motion data for emotion recognition and context awareness. Then, I examined the feasibility of using SCG for emotion recognition, comparing its performance with traditional physiological signals and evaluating its effectiveness as a single-sensor solution. This thesis presents a detailed analysis of the potential of chest-worn IMUs for emotion and context recognition. It reports on the design and validation of a SCG-based wearable system, the development and characteristics of the EmoWear dataset, and the implementation of the ColEmo platform for emotion data collection. The research also examines machine learning techniques applied to the SCG and ADR signals, assessing their effectiveness in estimating emotional states. My findings indicate that SCG-based emotion recognition achieves performance comparable to conventional physiological counterparts, demonstrating the feasibility of using a single IMU sensor for affective computing. The publicly-available EmoWear dataset provides a valuable resource for future research, highlighting the potential of combining motion and physiological data for enhanced context awareness. Additionally, the ColEmo software interface, which I published open-source, proves to be an effective tool for multi-modal emotion data collection, facilitating further advancements in wearable emotion recognition. The results pave the way for a minimal-sensor approach for context information estimation that can significantly reduce system complexity while maintaining high performance. These findings confirm that chest-worn IMUs present an opportunity to further improve emotion recognition in addition to the motion-based context information estimation. My research highlights the need for standardized methodologies in affective computing and demonstrates the viability of motion-based physiological sensing for emotion estimation. By using a single chest-worn IMU, this work presents an alternative to multi-sensor systems, reducing power consumption, and privacy concerns while maintaining robust performance. Future research should focus on refining IMU-based emotion recognition using deep learning techniques and larger datasets to enhance classification accuracy. Further validation in real-world settings is necessary to assess the practical applicability of the proposed system. The EmoWear dataset should be explored for additional context-awareness applications, such as activity recognition and stress monitoring, to maximize its utility. The ColEmo platform offers opportunities for expansion beyond emotion recognition, including cognitive load estimation, stress monitoring, and human-computer interaction. This research moves wearable technology forward by using fewer sensors, helping make affective computing more efficient, versatile, and respectful of privacy.

Facial Emotion Detection and Music Recommendation System is a real-time facial emotion detection and personalized music recommendation system. It employs a trained Convolutional Neural Network (CNN) trained on the FER2013 database for seven emotion recognitions, i.e., anger, disgust, fear, happiness, sorrow, surprise, and neutrality. Everything is accomplished through Artificial Intelligence (AI) and Computer Vision technology. React and Flask are used to create the frontend and backend, while OpenCV is used to detect the facial emotion of the user through the webcam. The system does not pre-downloading playlists but dynamically uses the YouTube Data Application Programming Interface (API) to download appropriate music tracks depending on the emotional state of the user. Measures of precision, recall, accuracy (79.07%), and loss values are used to deploy the proposed system. The values indicate the viability of the application of Xpressify for use in real-time affect classification and customized music. With dynamic, interactive, and emotive-response music recommendations, the integration provides a more realistic experience for the user and is applicable in entertainment, mental health, and human-computer interaction.

Lung cancer remains one of the deadliest cancers worldwide, with survival rates significantly dependent on early detection. Traditional diagnostic methods, while effective, often identify lung cancer in advanced stages, limiting treatment options. Recently, artificial intelligence (AI) and deep learning (DL) models have gained attention for their potential to assist in early lung cancer diagnosis through radiological data, particularly computed tomography (CT) and X-ray imaging. This review examines recent advancements in AI and DL models specifically applied to early lung cancer detection, offering a comprehensive look at model architecture, data preprocessing techniques, and performance metrics. AI models, particularly those using convolutional neural networks (CNNs) and recurrent neural networks (RNNs), have shown significant promise in improving diagnostic accuracy. In studies published over the past two years, CNN-based models have achieved sensitivity rates upwards of 90% when applied to large datasets, such as the LIDC-IDRI, a publicly available database containing thousands of annotated lung scans. Furthermore, hybrid approaches combining AI models with radiologist expertise have demonstrated reduced false positives, a frequent challenge in automated image analysis. A critical factor in these advancements has been data quality and volume. Large, annotated datasets with high-resolution images have enabled more robust training and validation, essential for refining these models. However, challenges remain, particularly regarding the standardization of data across institutions, variations in scanner quality, and ethical concerns surrounding patient privacy. The review also highlights studies exploring multi-modal approaches, integrating radiological data with clinical records and genetic markers to create more personalized diagnostic tools. These multi-modal methods have the potential to improve predictive accuracy further, though they currently require more extensive validation. Overall, while AI and DL technologies offer transformative potential for early lung cancer detection, widespread implementation depends on continued research in model accuracy, data standardization, and ethical safeguards. This paper concludes by emphasizing the need for collaboration across disciplines—AI researchers, radiologists, and oncologists—to refine these models into reliable tools that can be integrated seamlessly into clinical workflows for timely and accurate lung cancer diagnosis.

Real-World Surveillance of FDA-Cleared Artificial Intelligence Models: Rationale and Logistics.

Artificial intelligence (AI) and machine learning (ML) are employed to make systems smarter. Today, the speech emotion recognition (SER) system evaluates the emotional state of the speaker by investigating his/her speech signal. Emotion recognition is a challenging task for a machine. In addition, making it smarter so that the emotions are efficiently recognized by AI is equally challenging. The speech signal is quite hard to examine using signal processing methods because it consists of different frequencies and features that vary according to emotions, such as anger, fear, sadness, happiness, boredom, disgust, and surprise. Even though different algorithms are being developed for the SER, the success rates are very low according to the languages, the emotions, and the databases. In this paper, we propose a new lightweight effective SER model that has a low computational complexity and a high recognition accuracy. The suggested method uses the convolutional neural network (CNN) approach to learn the deep frequency features by using a plain rectangular filter with a modified pooling strategy that have more discriminative power for the SER. The proposed CNN model was trained on the extracted frequency features from the speech data and was then tested to predict the emotions. The proposed SER model was evaluated over two benchmarks, which included the interactive emotional dyadic motion capture (IEMOCAP) and the berlin emotional speech database (EMO-DB) speech datasets, and it obtained 77.01% and 92.02% recognition results. The experimental results demonstrated that the proposed CNN-based SER system can achieve a better recognition performance than the state-of-the-art SER systems.

Artificial intelligence for diabetic retinopathy screening in Africa

This paper conducts a preliminary exploration of Artificial Intelligence (AI) for emotion recognition, particularly in its business applications. Employing adaptive technologies like machine learning algorithms and computer vision, AI systems analyze human emotions through facial expressions, speech patterns, and physiological signals. Ethical considerations and responsible deployment of these technologies are emphasized through an intense literature review. The study employs a comprehensive bibliometric analysis, utilizing tools such as VOSViewer, to trace the evolution of emotion-aware AI in business. Three key steps involve surveying the literature on emotion analysis, summarizing information on emotion in various contexts, and categorizing methods based on their areas of expertise. Comparative studies on emotion datasets reveal advancements in model fusion methods, exceeding human accuracy and enhancing applications in customer service and market research. The bibliometric analysis sheds light on a shift towards sophisticated, multimodal approaches in emotion recognition research, addressing challenges such as imbalanced datasets and interpretability issues. Visualizations depict keyword distributions in research papers, emphasizing the significance of “emotion recognition” and “deep learning.” The study concludes by offering insights gained from network visualization, showcasing core keywords and their density in research papers. Based on the literature, a SWOT analysis is also conducted to identify the strengths, weaknesses, opportunities, and threats associated with applying emotion recognition to business. Strengths include the technology’s high accuracy and real-time analysis capabilities, enabling diverse applications such as customer service and product quality improvement. However, weaknesses include data bias affecting the AI model’s quality and challenges in processing complex emotional expressions. Opportunities lie in the increasing number of studies, market size, and improving research outcomes, while threats include privacy concerns and growing competition.

The history of humanity has reached Industry 4.0 that aims to the integration of information technologies and especially artificial intelligence with all life-sustaining mechanisms in the 21st century, and consecutively, the transformation of Society 5.0 has begun. Society 5.0 means a smart society in which humans share life with physical robots and software robots as well as smart devices based on augmented reality. Industry 4.0 contains main structures such as the internet of things, big data analytics, digital transformation, cyber-physical systems, artificial intelligence, and business processes optimization. It is impossible to consider the machines to be without emotions and emotional intelligence within the transformation of smart tools and artificial intelligence, in addition, while it is planned to give most of the commands with voice and speaking, it became more important to develop algorithms that can detect emotions. In the smart society, new and rapid methods are needed for speech recognition, emotion recognition, and speech emotion recognition areas to maximize human-computer (HCI) or human-robot interaction (HRI) and collaboration. In this study, speech recognition and speech emotion recognition studies in robot technology are investigated and developments are revealed.

Statement of problem: Artificial intelligence (AI) applications are increasingly used in restorative process. But existing dentistry restoration effectiveness as well as growth and IA applications have not yet been systematically analyzed or documented. Purpose: The goal of such comprehensive evaluation is to discover & assess the abilities associated with artificial intelligence models in restorative dentistry for the analysis of caries as well as vertical tooth fracture, evaluate margins in preparing tooth, and analyze reconstructive failures. Methods: A systematic electronic review of 5 databases was carried out: PubMed/ MEDLINE, World of Science, EMBASE, Scopus and Cochrane. The investigation was carried out manually as well. Research using AI models was chosen on the basis of 4 criterion: dental caries diagnostics, diagnostics, vertical tooth fracture, tooth preparation recognition, & cause of failure of restoration. Both researchers rated the quality of the study for Critical Appraisal Checklist for Quasi-Experimental Studies (nonrandomized experimental studies). The 3rd author was asked for resolving the dispute. Results: 34 researches were made the part of this analysis: from which 29 contains artificial intelligence techniques including the diagnostics or treatment related to caries and its causes according to sensitivity models, 2 to diagnose vertical tooth fractures, 1 to prepare the teeth. Among the studied analysis, the accuracy of caries diagnosis in the AI models was tested from 76-88.3%, sensitivity from 73-90%, as well as specificity from 61.5-93%. In the study, the accuracy of predicted caries ranges from 83.6-97.1%. The performed research showed the accuracy of the analysis of a vertical tooth fracture from 88.3-95.7%. The study, which uses AI models to find a destination, had details with the range of 90.6-97.4%. Conclusions: AI models are a powerful tool for diagnosing caries as well as vertical tooth fractures, recognizing preparation margins and predicting restoration failures. But, the dental use of AI models continues to evolve. More research is needed to evaluate the clinical effectiveness of artificial intelligence models in restorative dentistry. Keyword: Artificial intelligence, restorative dentistry, vertical tooth fractures.

The acoustic cues that convey emotion in speech are similar to those that convey emotion in music, and recognition of emotion in both of these types of cue recruits overlapping networks in the brain. Given the similarities between music and speech prosody, developmental research is uniquely positioned to determine whether recognition of these cues develops in parallel. In the present study, we asked 60 children aged 6 to 11 years, and 51 university students, to judge the emotions of 10 musical excerpts, 10 inflected speech clips, and 10 affect burst clips. We presented stimuli intended to convey happiness, sadness, anger, fear, and pride. Each emotion was presented twice per type of stimulus. We found that recognition of emotions in music and speech developed in parallel, and adult-levels of recognition develop later for these stimuli than for affect bursts. We also found that sad stimuli were most easily recognised, followed by happiness, fear, and then anger. In addition, we found that recognition of emotion in speech and affect bursts can predict emotion recognition in music stimuli independently of age and musical training. Finally, although proud speech and affect bursts were not well recognised, children aged eight years and older showed adult-like responses in recognition of proud music.

With advancements in science and technology, there has been phenomenal developments in the application of neural networks in dentistry. This systematic review aimed to report on the effectiveness of artificial intelligence (AI) applications designed for endodontic diagnosis, decision-making, and prediction of prognosis. Studies reporting on AI applications in endodontics were identified from the electronic databases such as PubMed, Medline, Embase, Cochrane, Google Scholar, Scopus, and Web of Science, for original research articles published from January 1, 2000, to June 1, 2020. A total of 10 studies that met our eligibility criteria were further analyzed for qualitative data. QUADAS-2 was applied for synthesis of the quality of the studies included. A wide range of AI applications have been implemented in endodontics. The neural networks employed were mostly based on convolutional neural networks (CNNs) and artificial neural networks (ANNs) in their neural architectures. These AI models have been used for locating apical foramen, retreatment predictions, prediction of periapical pathologies, detection and diagnosis of vertical root fractures, and assessment of root morphologies. These studies suggest that the neural networks performed similar to the experienced professionals in terms of accuracy and precision. In some studies, these models have even outperformed the specialists. These models can be of greater assistance as an expert opinion for less experienced and nonspecialists.