Analysis of Influential Features with Spectral Features for Modeling Dialectal Variation in Malayalam Speech Using Deep Neural Networks

Maxout neurons for deep convolutional and LSTM neural networks in speech recognition

Automatic emotion recognition is a challenging task since emotion is communicated through different modalities. Deep Convolution Neural Networks (DCNN) and transfer learning have shown success in automatic emotion recognition using different modalities. However significant improvement in accuracy is still required for practical applications. Existing methods are still not effective in modelling the temporal relationships within emotional expressions or in identifying the salient features from different modes and fusing them to improve accuracies. In this paper, we present an automatic emotion recognition system using audio and visual modalities. VGG19 models are used to capture frame level facial features followed by a Long Short Term Memory (LSTM) to capture their temporal distribution at a segment level. A separate VGG19 model captures auditory features from Mel Frequency Cepstral Coefficients (MFCC). The extracted auditory and visual features are fused together and a Deep Neural Network (DNN) with attention is used in classification using majority voting. Voice Activity Detection (VAD) on the audio stream improves performance by reducing the outliers in learning. The system is evaluated using Leave One Subject Out (LOSO) and K-fold cross-validation and our system outperforms state of the art methods on two challenging databases.

Multi-microphone speech recognition integrating beamforming, robust feature extraction, and advanced DNN/RNN backend

Trajectory-level fog detection based on in-vehicle video camera with TensorFlow deep learning utilizing SHRP2 naturalistic driving data

The study presents the results of the development and testing of deep learning neural network architectures, which demonstrate high accuracy rates in classifying neurophysiological data, in particular hemodynamic brain activation patterns obtained by functional near-infrared spectroscopy, during solving mathematical problems on spatial-numerical associations. The analyzed signal represents a multidimensional time series of oxyhemoglobin and deoxyhemoglobin dynamics. Taking the specificity of the fNIRS signal into account, a comparative analysis of 2 types of neural network architectures was carried out: (1) architectures based on recurrent neural networks: recurrent neural network with long short-term memory, recurrent neural network with long short-term memory with fully connected layers, bidirectional recurrent neural network with long short-term memory, convolutional recurrent neural network with long short-term memory; (2) architectures based on convolutional neural networks with 1D convolutions: convolutional neural network, fully convolutional neural network, residual neural network. Trained long short-term memory recurrent neural network architectures showed worse results in accuracy in comparison with 1D convolutional neural network architectures. Residual neural network (model_Resnet) demonstrated the highest accuracy rates in three experimental conditions more than 88% in detecting age-related differences in brain activation during spatial-numerical association tasks considering the individual characteristics of the respondents’ signal.

-- Speech signals are being considered as most effective means of communication between human beings. Many researchers have found different methods or systems to identify emotions from speech signals. Here, the various features of speech are used to classify emotions. Features like pitch, tone, intensity are essential for classification. Large number of the datasets are available for speech emotion recognition. Firstly, the extraction of features from speech emotion is carried out and then another important part is classification of emotions based upon speech. Hence, different classifiers are used to classify emotions such as Happy, Sad, Anger, Surprise, Neutral, etc. Although, there are other approaches based on machine learning algorithms for identifying emotions. Speech Emotion Recognition is a current research topic because of its wide range of applications and it became a challenge in the field of speech processing too. We have carried out a brief study on Speech Emotion Analysis along with Emotion Recognition. Speech Emotion Recognition (SER) can be defined as extraction of the emotional state of the speaker from his or her speech signal. There are few universal emotions including Neutral, Anger, we have worked on different tools to be used in SER. SER is tough because emotions are subjective and annotating audio is challenging task. Emotion recognition is the part of speech recognition which is gaining more popularity and need for it increases enormously. We have classified based on different type of emotions to detect from speech. Key Words: Speech Emotion Recognition, Affective Computing, Machine Learning, Deep Learning, Audio Signal Processing, Emotion Classification, Feature Extraction, Prosodic Features, Spectral Features, Mel-Frequency Cepstral Coefficients (MFCCs), Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN), Long Short-Term Memory (LSTM), Attention Mechanisms, Multimodal Emotion Recognition, Speaker-Independent SER, Real-Time Emotion Detection, Noise-Robust Emotion Recognition, Data Augmentation, Emotion-Aware Applications

In this study, we investigate the effectiveness of various deep learning algorithms for customer segmentation in the banking sector, aiming to enhance targeted service delivery and customer experience. We employ a comprehensive pipeline encompassing data collection, preprocessing, feature selection, feature extraction, model development, and rigorous evaluation. Our dataset, derived from real-world banking customer profiles, was processed using normalization, encoding, and dimensionality reduction techniques. We implemented and compared eight models: Artificial Neural Network (ANN), Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), CNN-LSTM Hybrid, Autoencoder-Based Network, and Deep Neural Network (DNN). Among them, the Autoencoder-Based model achieved the highest accuracy of 91.56%, outperforming others in terms of segmentation clarity and computational efficiency. These findings suggest that deep learning methods, particularly Autoencoder-Based architectures, offer robust solutions for real-time banking customer segmentation, enabling institutions to tailor products and services more effectively.

A trademark may be a word, phrase, symbol, sound, color, scent or design, or combination of these, that identifies and distinguishes the goods or services of a particular source from those of others. Obtaining a trademark is a complex, time intensive and costly process that involves varied steps before the trademark can be registered including searching prior trademarks, filing of the trademark application, review of the trademark application and final publication for opposition by the public. One of the crucial aspect in the review of the trademark application is determining the international classes of the filed marks based on their goods and services description. Currently, the process of identifying the international classes of a filed mark is performed manually in the United States Patent and Trademark Office (USPTO) and takes significant amount of time. Recently, word embeddings and deep neural networks (DNNs) have revolutionized the field of computer vision and demonstrated excellent performance in various natural language processing (NLP) tasks such as machine translation, speech recognition, sentence and document classification etc. to name a few. In this study, we explored fastText and different neural networks such as Convolution Neural Networks (CNN), Long Short Term Memory (LSTM), bidirectional versions of both LSTM and Gated Recurrent Unit (GRU) and Recurrent Convolutional Neural Network (RCNN) to automate the international class identification for the filed marks based on their goods and services description. Overall, it was found that the trademark word embeddings with RCNN model outperformed the other models. Our study thereby seeks to provide a solution towards the manual, time intensive and laborious process of identifying international classes for the trademarks.

Semiconductor optical amplifier (SOA) is a promising solution for future O-band optical amplification. However, the SOA-induced nonlinearity will affect the quality of the signals and cause bit errors. Nowadays, the neural network is a hot topic in communication networks and has been considered a practical algorithm for signals equalization. In this paper, we investigate the performance of the three types of neural networks: deep neural networks (DNN), convolutional neural network (CNN), and long short term memory (LSTM) neural networks for the compensation of the SOA-induced nonlinearity. We first compare the fitting ability of the three neural networks on the saturated response of SOA. Based on the simulation result, LSTM has the best nonlinear expressiveness for the SOA-induced nonlinearity. Subsequently, we do some experimental validations in an intensity modulation and direct-detection (IM/DD) system, where the 100 Gbit/s pulse-amplitude-modulation-4 (PAM4) signals are transmitted over 80 km at O-band using an 18 GHz electro-absorption modulated laser (EML). The bit-error-ratio (BER) results show that the cell states in LSTM play a crucial role in nonlinearity compensation. Furthermore, LSTM offers the best equalization performance and can achieve a receiver sensitivity of −18.0 dBm.

Computer-aided diagnosis of liver cancer with improved SegNet and deep stacking ensemble model

Liquefaction susceptibility using machine learning based on SPT data

Deep learning (also known as deep structured learning, hierarchical learning, or deep machine learning) is a branch of machine learning based on a set of algorithms that attempt to model high-level abstractions in data by using a deep graph with multiple processing layers, composed of multiple linear and nonlinear transformations. Deep learning has been characterized as a class of machine learning algorithms with the following characteristics [257]: • They use a cascade of many layers of nonlinear processing units for feature extraction and transformation. Each successive layer uses the output from the previous layer as input. The algorithms may be supervised or unsupervised and applications include pattern analysis (unsupervised) and classification (supervised). • They are based on the (unsupervised) learning of multiple levels of features or representations of the data. Higher-level features are derived from lower-level features to form a hierarchical representation. • They are part of the broader machine learning field of learning representations of data. • They learn multiple levels of representations that correspond to different levels of abstraction; the levels form a hierarchy of concepts. These definitions have in common: multiple layers of nonlinear processing units and the supervised or unsupervised learning of feature representations in each layer, with the layers forming a hierarchy from low-level to high-level features. Various deep learning architectures such as deep neural networks, convolutional deep neural networks, deep belief networks (DBN), and recurrent neural networks have been applied to fields like computer vision, automatic speech recognition, natural language processing, audio recognition, and bioinformatics where they have been shown to produce state-of-the-art results on various tasks. In this chapter we start in Section 7.1 with an introduction, giving a brief history of this field, the relevant literature, and its applications. Then we study some basic concepts of deep learning such as convolutional neural networks, recurrent neural networks, backpropagation algorithm, restricted Boltzmann machines, and deep learning networks in Section 7.2. Then we illustrate three examples for Apache Spark implementation for mobile big data (MBD), user moving pattern extraction, and combination with nonparametric Bayesian learning, respectively, in Sections 7.3 through 7.5. Finally, we have summary in Section 7.6.

In recent years, with the rapid development of Deep Learning (DL) and the widespread uses of Deep Neural Networks (DNN), speech recognition technology has attracted great attention. This technology enables machines to convert human speech into text and plays an important role in some areas such as virtual assistants, conference transcription and smart home devices. Traditional models such as Hidden Markov Models (HMM) and Gaussian Mixture Models (GMM) used to play a key role in modeling and recognizing speech signals. Even though these methods still have challenges in dealing with high‐dimensional feature vectors as they struggle to efficiently learn large amounts of model parameters while maintaining good generalization performance. The emergence of DNNs has revolutionized the field of speech recognition, making it possible to automatically extract features from raw speech signals. Thereby, modern speech recognition systems can exhibit higher adaptability and generalization capabilities, achieving higher accuracy and stability under various conditions. This review explores the application of DL techniques to speech recognition, including convolutional neural networks (CNNs), recurrent neural networks (RNNs), and Transformer‐based architectures, etc. Advances in these techniques have dramatically improved recognition accuracy, noise immunity, and adaptability to multiple accents, thereby improving the total efficiency of automatic speech systems. By leveraging advanced feature extraction and modeling capabilities, deep learning‐based systems support real‐ time processing and minimize the dependency on traditional manually designed features. However, there are still limitations in terms of interpretability, computational efficiency, and fairness to different accents and languages, which impede the widespread use of these techniques. Future research should focus on solving these issues in order to achieve fairer, efficient, and scalable deep learning‐driven speech recognition schemes.

While the growing accessibility of technology improves usability, it also creates more opportunities for cybercriminals to exploit vulnerabilities, significantly accelerating the proliferation of cybersecurity attacks. Deep learning (DL) approaches present significant advancements over conventional machine learning (ML) techniques by automating feature selection and extraction while minimizing external dependencies. This study proposes a deep learning-based model to enhance cyberattack detection and ensure that data security goals are achieved. This study employs a quantitative research design, utilizing simulation and modeling as the primary analytical tools. The dataset used is the Canadian Institute for Cybersecurity Intrusion Detection System (CIC-IDS-2017) dataset. Three distinct DL algorithms are used to design the detection models, namely, Deep Neural Network (DNN), Long Short-Term Memory (LSTM), and Recurrent Neural Network (RNN). The performance comparison metrics are F1-score, accuracy, sensitivity, false positive rate (FPR), specificity, positive predictive value (PPV), false negative rate (FNR), and negative predictive value (NPV). Optimization concepts are integrated to enhance the detection efficiency in web-based systems, including loss functions, gradient-based optimization, and efficient model generalization techniques. The results of k-fold cross-validation show LSTM’s higher scores for F1-score (94.6%), recall (94.7%), accuracy (94.8%), and precision (94.6%). LSTM outperformed RNN and DNN, achieving the highest accuracy, precision, specificity, and sensitivity at 94.7%, 94.3%, 98.9%, and 94.7% respectively, validating LSTM's superior generalizability for cyberattack detection tasks.

Internet of Things (IoT) technology has been incorporated into the majority of people’s everyday lives and places of employment due to the quick development in information technology. Modern agricultural techniques increasingly use the well-known and superior approach of managing a farm known as “smart farming”. Utilizing a variety of information and agricultural technologies, crops are observed for their general health and productivity. This requires monitoring the condition of field crops and looking at many other indicators. The goal of smart agriculture is to reduce the amount of money spent on agricultural inputs while keeping the quality of the final product constant. The Internet of Things (IoT) has made smart agriculture possible through data collection and storage techniques. For example, modern irrigation systems use effective sensor networks to collect field data for the best plant irrigation. Smart agriculture will become more susceptible to cyber-attacks as its reliance on the IoT ecosystem grows, because IoT networks have a large number of nodes but limited resources, which makes security a difficult issue. Hence, it is crucial to have an intrusion detection system (IDS) that can address such challenges. In this manuscript, an IoT-based privacy-preserving anomaly detection model for smart agriculture has been proposed. The motivation behind this work is twofold. Firstly, ensuring data privacy in IoT-based agriculture is of the utmost importance due to the large volumes of sensitive information collected by IoT devices, including on environmental conditions, crop health, and resource utilization data. Secondly, the timely detection of anomalies in smart agriculture systems is critical to enable proactive interventions, such as preventing crop damage, optimizing resource allocation, and ensuring sustainable farming practices. In this paper, we propose a privacy-encoding-based enhanced deep learning framework for the difficulty of data encryption and intrusion detection. In terms of data encoding, a novel method of a sparse capsule-auto encoder (SCAE) is proposed along with feature selection, feature mapping, and feature normalization. An SCAE is used to convert information into a new encrypted format in order to prevent deduction attacks. An attention-based gated recurrent unit neural network model is proposed to detect the intrusion. An AGRU is an advanced version of a GRU which is enhanced by an attention mechanism. In the results section, the proposed model is compared with existing deep learning models using two public datasets. Parameters such as recall, precision, accuracy, and F1-score are considered. The proposed model has accuracy, recall, precision, and F1-score of 99.9%, 99.7%, 99.9%, and 99.8%, respectively. The proposed method is compared using a variety of machine learning techniques such as the deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), and long short-term memory (LSTM).