On effective cognitive state classification using novel feature extraction strategies.

Human cognitive state classification using Electroencephalogram (EEG) signal is one of the dynamic exploring regions in emerging smart machine systems. It motivates to build estimator for revealing the human cognitive behaviours for different environments. In this work, we present an operational human cognitive behaviour detection system based on ambulatory EEG signal analysis. A novel event driven environment is created using external stimuli to collect those signals. They are captured using 14 channel Emotiv neuro-headset. Mel-Frequency Cepstral Coefficients (MFCC) is a very popular feature extraction method in acoustic signal processing. In spite of it’s popularity, it has not been explored much when it comes to EEG signals. This paper proposes a novel technique of applying MFCC feature extraction method for ambulatory EEG signals and the results are found to be promising. Besides other feature extraction methods such as: Power Spectral Density (PSD), Discrete Wavelet Transformation (DWT) are used to extract intrinsic features from EEG signal. A statistical technique, Fisher Discriminant Ratio (FDR) is applied on them to evaluate the robustness of each feature. A higher FDR value is observed from MFCC features which demonstrate its discriminative power during classification. Different machine learning techniques such as Probabilistic neural network (P-NN), k-nearest neighbor (kNN), multi-class support vector machine (MCSVM) are applied for training, testing and validating the extracted features. A comparative analysis is discussed for each classifier coupled with each feature. It is found that P-NN with MFCC feature produces the maximum accuracy of 92.61% amongst all the remaining classifiers.

Baby crying is a common behavior among babies and is a means of verbal communication for babies who express their needs and desires. A baby’s cry identification system is needed because it makes it easy for adults to find out the meaning of a baby’s cry. This study proposes a system for classifying infant crying sounds using Linear Discriminant Analysis (LDA) with Discrete Wavelet Transform (DWT) and Mel-frequency Cepstral Coefficient (MFCC) as a feature extraction method. Based on experiments, the system can identify the sound of crying babies grouped into 5 (five) classes, namely discomfort, hunger, colds, burp, and drowsiness. The system achieves an accuracy of 94% and an average computing time of 1.5506 seconds. The performance of Linear Discriminant Analysis (LDA) outperformed Principal Component Analysis (LDA) in the identification of crying babies

Theft of private data became a threat of crime in cyberspace. This issue was in line with rapid development of data technology, especially online transactions. To attenuate this problem, voice biometrics was developed as an answer to keep up security identity. This paper develops the voice biometric framework based on Convolutional Neural Network Depthwise Separable Convolution (DSC) model and the fusion of Discrete Wavelet Transform (DWT) and Mel Frequency Cepstral Coefficients (MFCC). Such a scheme has targeted to increase the high accuracy, to reduce the burden of high computational costs and to speed up the performance of classification process time. We conduct three testing performance, i.e. voice Biometric Training Performance, speaker Recognition Performance (”Who is speaking?”), and Speech Recognition performance (”What keyword is uttered?”). For each of the testing, the results are compared with CNN Standard performance. The training results has shown that CNN DSC model has reduced the amount of training parameters to 364,506, leading to accelerate the performance of training process time to 5.12 minutes. The results of speaker recognition performance has attained the best performance with an accuracy 99.25%, precision 97.14%, recall 98.17% and F1-score 97.28%. The results of speech recognition performance has been able to improve the best performance with accuracy 100%. It can be concluded that CNN DSC with the fusion of DWT- MFCC has outperformed the CNN Standard. The framework can be applied for the identification and verification of user voices accurately, quickly and efficiently for any applications requiring better security performance.

The classification and recognition technology of underwater acoustic signal were always an important research content in the field of underwater acoustic signal processing. Currently, wavelet transform, Hilbert-Huang transform, and Mel frequency cepstral coefficients are used as a method of underwater acoustic signal feature extraction. In this paper, a method for feature extraction and identification of underwater noise data based on CNN and ELM is proposed. An automatic feature extraction method of underwater acoustic signals is proposed using depth convolution network. An underwater target recognition classifier is based on extreme learning machine. Although convolution neural networks can execute both feature extraction and classification, their function mainly relies on a full connection layer, which is trained by gradient descent-based; the generalization ability is limited and suboptimal, so an extreme learning machine (ELM) was used in classification stage. Firstly, CNN learns deep and robust features, followed by the removing of the fully connected layers. Then ELM fed with the CNN features is used as the classifier to conduct an excellent classification. Experiments on the actual data set of civil ships obtained 93.04% recognition rate; compared to the traditional Mel frequency cepstral coefficients and Hilbert-Huang feature, recognition rate greatly improved.

Generative models have been applied in many fields and can be evaluated with many methods. In the evaluation of generative models, the proper evaluation metric varies with the application field. Therefore, the evaluation of generative adversarial networks is inherently challenging. In this study, conditional deep convolutional generative adversarial networks were applied in mechanical fault diagnosis and then evaluated. We proposed three evaluation metrics of conditional deep convolutional generative adversarial networks: Jensen-Shannon divergence, kernel maximum mean discrepancy, and the 1-nearest neighbor classifier which were used to distinguish generated samples from real samples, test mode collapsing and detect overfitting based on the dataset of Electronic Engineering Laboratory of Case Western Reserve University and the planetary gearbox dataset measured in the laboratory. The Jensen-Shannon divergence could not well distinguish generated samples from real samples. However, the two metrics (maximum mean discrepancy and 1-nearest neighbor classifier) well-distinguished generated samples from real samples, thus verifying the applicability of conditional deep convolutional generative adversarial networks in the field of mechanical diagnosis.

Accurately identifying and discriminating between different brain states is a major emphasis of functional brain imaging research. Various machine learning techniques play an important role in this regard. However, when working with a small number of study participants, the lack of sufficient data and achieving meaningful classification results remain a challenge. In this study, we employ a classification strategy to explore stress and its impact on spatial activation patterns and brain connectivity caused by the Stroop color-word task (SCWT). To improve our results and increase our dataset, we use data augmentation with a deep convolutional generative adversarial network (DCGAN). The study is carried out at two separate times of day (morning and evening) and involves 21 healthy participants. Additionally, we introduce binaural beats (BBs) stimulation to investigate its potential for stress reduction. The morning session includes a control phase with 10 SCWT trials, whereas the afternoon session is divided into three phases: stress, mitigation (with 16 Hz BB stimulation), and post-mitigation, each with 10 SCWT trials. For a comprehensive evaluation, the acquired fNIRS data are classified using a variety of machine-learning approaches. Linear discriminant analysis (LDA) showed a maximum accuracy of 60%, whereas non-augmented data classified by a convolutional neural network (CNN) provided the highest classification accuracy of 73%. Notably, after augmenting the data with DCGAN, the classification accuracy increases dramatically to 96%. In the time series data, statistically significant differences were noticed in the data before and after BB stimulation, which showed an improvement in the brain state, in line with the classification results. These findings illustrate the ability to detect changes in brain states with high accuracy using fNIRS, underline the need for larger datasets, and demonstrate that data augmentation can significantly help when data are scarce in the case of brain signals.

Convolutional Neural Network (CNN) tend to have better results on large data sets and poor performance on small data sets, so the data augmentation is crucial for a CNN to get better performance based on the dataset with limited size. In this paper, Deep Convolution Generative Adversarial Network (DCGAN) was used to augment data to make the AlexNet perform better on an image classification task with small data sets. AlexNet was trained on a small anime face training set with only 160 samples to determine whether the anime face was male or female, and then tested its accuracy on a test set with 240 sample. Then, a pre-trained DCGAN was transferred to train on the male and female training sets respectively. And 2 DCGANs were obtained, one could generate male cartoon faces and another could generate female cartoon faces. The images generated by DCGANs were put in train set, which was used to train AlexNet again and the result was recorded. Other data augmentation methods such as cutout, cutmix and Noise Injection were compared as well. Finally, it is found that AlexNet has the best performance when using the DCGAN augmentation method, which can significantly improve the verification accuracy of the model.

Real-time smoke detection is of great significance for early warning of fire, which can avoid the serious loss caused by fire. Detecting smoke in actual scenes is still a challenging task due to large variance of smoke color, texture, and shapes. Moreover, the smoke detection in the actual scene is faced with the difficulties in data collection and insufficient smoke datasets, and the smoke morphology is susceptible to environmental influences. To improve the performance of smoke detection and solve the problem of too few datasets in real scenes, this paper proposes a model that combines a deep convolutional generative adversarial network and a convolutional neural network (DCG-CNN) to extract smoke features and detection. The vibe algorithm was used to collect smoke and nonsmoke images in the dynamic scene and deep convolutional generative adversarial network (DCGAN) used these images to generate images that are as realistic as possible. Besides, we designed an improved convolutional neural network (CNN) model for extracting smoke features and smoke detection. The experimental results show that the method has a good detection performance on the smoke generated in the actual scenes and effectively reduces the false alarm rate.

The unmanned aerial vehicle (UAV) industry is developing rapidly, and the application of UAVs is becoming increasingly widespread. Due to the lowering of the threshold for using UAVs, the random flight of UAVs poses safety hazards. In response to the safety risks associated with the unauthorized operation of UAVs, research on anti-UAV technology has become imperative. This study proposes an improved sound feature extraction method that utilizes the frequency distribution features of UAV sounds. By analyzing the spectrogram of UAV sounds, it was found that the classic Mel Frequency Cepstral Coefficients (MFCC) feature extraction method does not match the frequency bands of UAV sounds. Based on the MFCC feature extraction algorithm framework, an improved frequency band feature extraction method was proposed. This method replaces the Mel filter in the classic algorithm with a piecewise linear function with the frequency band weight as the slope, which can effectively suppress the influence of low- and high-frequency noise and fully focus on the different frequency band feature data of UAV sounds. In this study, the actual flight sounds of UAVs were collected, and the sound feature matrix of UAVs was extracted using the frequency band feature extraction method. The sound features were classified and recognized using a Convolutional Neural Network (CNN). The experimental results show that the frequency band feature extraction method has a better recognition effect compared to the classic MFCC feature extraction method.

Hearing disabilities affect people all over the world. Nearly 360 million people have a disabling hearing loss. In the recent years, there has been a rapid increase in the number of deaf and dumb victims due to birth defects, accidents and oral diseases. Since deaf and dumb people cannot communicate with a hearing person, they have to depend on some sort of visual communication. Sign Language is not understood by the majority of hearing people. The objective of our project is to form a bridge between the hearing-impaired community and the hearing community; to further commence a two-way communication. We propose a two-way sign language translator that converts Voice to sign language and vice versa in real time. We process the video frame by frame using the OpenCV Library in Python. Furthermore, we use background subtraction method called Gaussian Mixture-based Background/Foreground Segmentation Algorithm on each frame to subtract the background. Contours of this processed image are then passed into a Deep Neural Net (DNN) to classify the frame to the corresponding written language equivalent words. For conversion from sign language to voice, we use basic Natural Language Processing and gtts to accurately conserve the grammar in the sign language. The enrolment rate and literacy among the hearing-impaired children is far below the average for the population at large. This technology will then help the normal schools better integrate the hearing-impaired community thus making education more accessible and cheaper for them. Speech Emotion Recognition (SER) is a vital aspect of human-computer interaction and emotional intelligence applications. This SER that employs Mel- frequency cepstral coefficients (MFCC) as the basis for feature extraction, followed by a Convolutional Neural Network (CNN) with a customized architecture for emotion classification. The methodology 2 involves transforming audio samples into MFCC images, enabling the application of CNNs typically used in computer vision tasks. This fusion of traditional audio analysis with deep learning techniques harnesses the power of MFCC's spectral representation and CNN's spatial pattern recognition. By modifying the CNN architecture, the model can better discern emotional cues in the MFCC images, enhancing SER performance. This strategy offers SER a viable path forward, with the ability to identify complex emotional expressions. In order to increase the accuracy of emotion recognition, it tackles the requirement for feature-rich representations and sophisticated modelling techniques. KEYWORDS: OpenCV, DNN, SER, CNN, MFCC

In the field of emotion estimation from voice, a commonly adopted approach involves extracting Mel-Frequency Cepstral Coefficients (MFCC) from audio signals. Recently, a method for emotion estimation based on Convolutional Neural Networks (CNNs) has been devised using MFCC images which can be obtained by converting MFCC data into image format. This method benefits from CNNs’ strong ability to capture local spatial patterns. Recently, however, Transformer-based models, originally developed for natural language processing tasks, have demonstrated outstanding performance in image recognition, surpassing CNNs in various classification benchmarks. Among them, Vision Transformer (ViT) has received particular attention for its ability to model long-range dependencies by applying self- attention mechanisms to image patches.This study investigates the classification accuracy and effectiveness of ViT-based methods in comparison to conventional CNN-based approaches, using image-based MFCC inputs derived from emotional speech. To enhance the performance of ViT under limited training data conditions, data augmentation and learning rate scheduling techniques are incorporated. While this introduces some differences in training conditions compared to previous CNN-based studies, the results demonstrate that ViT achieves superior emotion recognition performance. These findings suggest that ViT holds strong potential for improving the accuracy and robustness of audio-based emotion estimation systems.

The Mel-Frequency Cepstral Coefficients (MFCC) feature extraction method is a leading approach for speech feature extraction and current research aims to identify performance enhancements. One of the recent MFCC implementations is the Delta-Delta MFCC, which improves speaker verification. In this paper, a new MFCC feature extraction method based on distributed Discrete Cosine Transform (DCT-II) is presented. Speaker verification tests are proposed based on three different feature extraction methods including: conventional MFCC, Delta-Delta MFCC and distributed DCT-II based Delta-Delta MFCC with a Gaussian Mixture Model (GMM) classifier.

paper, we focus on exploring the relationship between weave patterns and their mechanical properties in woven fiber composites through Machine Learning. Specifically, we explore the interactions between woven architectures and in-plane stiffness properties through Deep Convolutional Neural Network (DCNN) and Generative Adversarial Network (GAN). Our research is important for exploring how woven composite’s pattern is related to its mechanical properties and accelerating woven composite design as well as optimization. We focus on two tasks: (1) Stiffness prediction: Predicting in-plane stiffness properties for given weave patterns. Our DCNN extracts high-level features through several convolutional and fully connected layers to determine the final predictions. (2) Weave pattern prediction: Predicting weave patterns for target stiffness properties, which can be treated as the reverse task of the first one. Due to many-to-one mapping between weave patterns and the composite properties, we utilize a Decoder Neural Network as our baseline model and compare its performance with GAN and Genetic Algorithm. We represent the weave patterns as 2D checkerboard models and use finite element analysis (FEA) to determine in-plane stiffness properties, which serve as input data for our ML framework. We show that: (1) for stiffness prediction, DCNN can predict stiffness values for a given weave pattern with relatively high accuracy (above 93%); (2) for weave pattern prediction, the GAN model gives the best prediction accuracy (above 92%) while Decoder Neural Network has the best time efficiency. HAOTIAN FENG

Due to the real working conditions, the collected mechanical fault datasets are actually limited and always highly imbalanced, which restricts the diagnosis accuracy and stability. To solve these problems, we present an imbalanced fault diagnosis method based on the generative model of conditional-deep convolutional generative adversarial network (C-DCGAN) and provide a study in detail. Deep convolutional generative adversarial network (DCGAN), based on traditional generative adversarial networks (GAN), introduces convolutional neural network into the training for unsupervised learning to improve the effect of generative networks. Conditional generative adversarial network (CGAN) is a conditional model obtained through introducing conditional extension into GAN. C-DCGAN is a combination of DCGAN and CGAN. In C-DCGAN, based on the feature extraction ability of convolutional networks, through the structural optimization, conditional auxiliary generative samples are used as augmented data and applied in machine fault diagnosis. Two datasets (Bearing dataset and Planetary gear box dataset) are carried out to validate. The simulation experiments showed that the improved performance is mainly due to the generated signals from C-DCGAN to balance the dataset. The proposed method can deal with imbalanced fault classification problem much more effectively. This model could improve the accuracy of fault diagnosis and the generalization ability of the classifier in the case of small samples and display better fault diagnosis performance.

The fault diagnosis of hydrogen sensors is of great significance. However, it is difficult to collect data samples for some modes of hydrogen sensor signals, so the data samples may be unbalanced, which can seriously affect the fault diagnosis results. In this paper, we present a novel convolutional neural network (CNN)-based deep convolutional generative adversarial network (DCG) method (DCG-CNN) for gas sensor fault diagnosis. First, we transform the 1D fault signals of the gas sensor into 2D gray images for end-to-end conversion with no signal data information loss. Second, we use the DCG to enrich the 2D gray images of small fault data samples, which results in balanced sensor fault datasets. Third, we use the CNN method to improve the accuracy of fault diagnosis. In order to understand the internal mechanism of the CNN, we further visualize the learned feature maps of fault data samples in each layer of the CNN and try to analyze the reasons for the method's high performance. The fault diagnosis accuracy of the DCG-CNN is shown to be higher than that of other traditional methods.