Deep Neural Network and SVM-Based Multiclass Musical Instruments Classification Using MFCC, STFT, and Related Acoustic Features

The objective of the study was to enhance quality education in the traditional pre-school piano education. Deep Learning (DL) technology is applied to piano education of children to improve their interest in learning music. Firstly, the problems of the traditional piano education of children were analyzed with the teaching patterns discussed under educational psychology, and a targeted music education plan was established. Secondly, musical instrument recognition technology was introduced, and the musical instrument recognition model was implemented based on DL. Thirdly, the proposed model was applied to the piano education of children to guide the music learning of students and improve their interest in piano learning. The feature recognition and acquisition of the proposed model were improved. Finally, the different teaching patterns were comparatively analyzed through the Questionnaire Survey (QS). The experimental results showed that the instrument recognition accuracy of Hybrid Neural Network (HNN) is 97.2%, and with the increase of iterations, the recognition error rate of the model decreases and stabilizes. Therefore, the proposed HNN based on DL for musical instrument recognition can accurately identify musical features. The QS results showed that the introduction of musical instrument recognition technology in the piano education of children can improve their interest in piano learning. Therefore, the establishment of the piano education patterns based on the piano education model can improve the effectiveness of teaching piano to students. This research provides a reference for the intelligentization of children's piano education.

Early diagnosis of medical conditions in infants is crucial for ensuring timely and effective treatment. However, infants are unable to verbalize their symptoms, making it difficult for healthcare professionals to accurately diagnose their conditions. Crying is often the only way for infants to communicate their needs and discomfort. In this paper, we propose a medical diagnostic system for interpreting infants’ cry audio signals (CAS) using a combination of different audio domain features and deep learning (DL) algorithms. The proposed system utilizes a dataset of labeled audio signals from infants with specific pathologies. The dataset includes two infant pathologies with high mortality rates, neonatal respiratory distress syndrome (RDS), sepsis, and crying. The system employed the harmonic ratio (HR) as a prosodic feature, the Gammatone frequency cepstral coefficients (GFCCs) as a cepstral feature, and image-based features through the spectrogram which are extracted using a convolution neural network (CNN) pretrained model and fused with the other features to benefit multiple domains in improving the classification rate and the accuracy of the model. The different combination of the fused features is then fed into multiple machine learning algorithms including random forest (RF), support vector machine (SVM), and deep neural network (DNN) models. The evaluation of the system using the accuracy, precision, recall, F1-score, confusion matrix, and receiver operating characteristic (ROC) curve, showed promising results for the early diagnosis of medical conditions in infants based on the crying signals only, where the system achieved the highest accuracy of 97.50% using the combination of the spectrogram, HR, and GFCC through the deep learning process. The finding demonstrated the importance of fusing different audio features, especially the spectrogram, through the learning process rather than a simple concatenation and the use of deep learning algorithms in extracting sparsely represented features that can be used later on in the classification problem, which improves the separation between different infants’ pathologies. The results outperformed the published benchmark paper by improving the classification problem to be multiclassification (RDS, sepsis, and healthy), investigating a new type of feature, which is the spectrogram, using a new feature fusion technique, which is fusion, through the learning process using the deep learning model.

In this paper, we propose a novel scheme to supervised nonnegative matrix factorization (NMF). We formulate the supervised NMF as a sparse optimization problem assuming the availability of a set of basis vectors, some of which are irrelevant to a given matrix to be decomposed. The proposed scheme is presented in the context of music transcription and musical instrument recognition. In addition to the nonnegativity constraint, we introduce three regularization terms: (i) a block ℓ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sub> norm to select relevant basis vectors, and (ii) a temporal-continuity term plus the popular ℓ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sub> norm to estimate correct activation vectors. We present a state-of-the-art convex-analytic iterative solver which ensures global convergence. The number of basis vectors to be actively used is obtained as a consequence of optimization. Simulation results show the efficacy of the proposed scheme both in the case of perfect/imperfect basis matrices.

Classification of Bisyllabic Lexical Stress Patterns Using Deep Neural Networks

Heartbeat classification is a crucial step for arrhythmia diagnosis during electrocardiographic (ECG) analysis. The new scenario of wireless body sensor network- (WBSN-) enabled ECG monitoring puts forward a higher-level demand for this traditional ECG analysis task. Previously reported methods mainly addressed this requirement with the applications of a shallow structured classifier and expert-designed features. In this study, modified frequency slice wavelet transform (MFSWT) was firstly employed to produce the time-frequency image for heartbeat signal. Then the deep learning (DL) method was performed for the heartbeat classification. Here, we proposed a novel model incorporating automatic feature abstraction and a deep neural network (DNN) classifier. Features were automatically abstracted by the stacked denoising auto-encoder (SDA) from the transferred time-frequency image. DNN classifier was constructed by an encoder layer of SDA and a softmax layer. In addition, a deterministic patient-specific heartbeat classifier was achieved by fine-tuning on heartbeat samples, which included a small subset of individual samples. The performance of the proposed model was evaluated on the MIT-BIH arrhythmia database. Results showed that an overall accuracy of 97.5% was achieved using the proposed model, confirming that the proposed DNN model is a powerful tool for heartbeat pattern recognition.

In this paper, we describe a system for the recognition of musical instruments from isolated notes or drum samples. We first describe a baseline system that uses mel-frequency cepstral coefficients and their first derivatives as features, and continuous-density hidden Markov models (HMMs). Two improvements are proposed to increase the performance of this baseline system. First, transforming the features to a base with maximal statistical independence using independent component analysis can give an improvement of 9 percentage points in recognition accuracy. Secondly, discriminative training is shown to further improve the recognition accuracy of the system. The evaluation material consists of 5895 isolated notes of Western orchestral instruments, and 1798 drum hits.

Music is an indispensable artistic way to cultivate people's sentiments in people's lives. Recognizing the timbre of music can be done in an intelligent way through recognition technology. In musical instrument recognition, the timbre of the musical instrument needs to be distinguished. Under the conditions of modern technology, dynamic programming algorithms are used to design the data information in the system. If the time efficiency of the algorithm is not enough, the time efficiency of the dynamic programming algorithm is limited. Will produce optimization. The solution of the problem of dynamic programming algorithm requires the design of different models for experimental analysis. In this paper, the time–frequency function, cepstrum function, sparse attribute and probability are analyzed experimentally, which can confirm that the time–frequency domain of the timbre in the instrument can correctly identify the instrument. The frequency spectrum of deep learning time–frequency information can extract high-frequency situations and use it to identify musical instruments. The input of CNN can have a significant effect on abstract features, and the auditory spectrogram masters the time–frequency information of music. Under the same network structure, the accuracy of MFCC and spectrogram has been significantly improved. Because CNN has a weight distribution feature, the increase in the input size of the convolutional network will not significantly increase the training time, thereby greatly reducing the complexity of training.

In recent years, growing interest in deep learning neural networks has raised a question on how they can be used for effective processing of high-dimensional datasets produced by hyperspectral imaging (HSI). HSI, traditionally viewed as being within the scope of remote sensing, is used in non-invasive substance classification. One of the areas of potential application is forensic science, where substance classification on the scenes is important. An example problem from that area—blood stain classification—is a case study for the evaluation of methods that process hyperspectral data. To investigate the deep learning classification performance for this problem we have performed experiments on a dataset which has not been previously tested using this kind of model. This dataset consists of several images with blood and blood-like substances like ketchup, tomato concentrate, artificial blood, etc. To test both the classic approach to hyperspectral classification and a more realistic application-oriented scenario, we have prepared two different sets of experiments. In the first one, Hyperspectral Transductive Classification (HTC), both a training and a test set come from the same image. In the second one, Hyperspectral Inductive Classification (HIC), a test set is derived from a different image, which is more challenging for classifiers but more useful from the point of view of forensic investigators. We conducted the study using several architectures like 1D, 2D and 3D convolutional neural networks (CNN), a recurrent neural network (RNN) and a multilayer perceptron (MLP). The performance of the models was compared with baseline results of Support Vector Machine (SVM). We have also presented a model evaluation method based on t-SNE and confusion matrix analysis that allows us to detect and eliminate some cases of model undertraining. Our results show that in the transductive case, all models, including the MLP and the SVM, have comparative performance, with no clear advantage of deep learning models. The Overall Accuracy range across all models is 98–100% for the easier image set, and 74–94% for the more difficult one. However, in a more challenging inductive case, selected deep learning architectures offer a significant advantage; their best Overall Accuracy is in the range of 57–71%, improving the baseline set by the non-deep models by up to 9 percentage points. We have presented a detailed analysis of results and a discussion, including a summary of conclusions for each tested architecture. An analysis of per-class errors shows that the score for each class is highly model-dependent. Considering this and the fact that the best performing models come from two different architecture families (3D CNN and RNN), our results suggest that tailoring the deep neural network architecture to hyperspectral data is still an open problem.

In this article, we study the ability of deep neural networks (DNNs) to restore missing audio content based on its context, i.e., inpaint audio gaps. We focus on a condition which has not received much attention yet: gaps in the range of tens of milliseconds. We propose a DNN structure that is provided with the signal surrounding the gap in the form of time-frequency (TF) coefficients. Two DNNs with either complex-valued TF coefficient output or magnitude TF coefficient output were studied by separately training them on inpainting two types of audio signals (music and musical instruments) having 64-ms long gaps. The magnitude DNN outperformed the complex-valued DNN in terms of signal-to-noise ratios and objective difference grades. Although, for instruments, a reference inpainting obtained through linear predictive coding performed better in both metrics, it performed worse than the magnitude DNN for music. This demonstrates the potential of the magnitude DNN, in particular for inpainting signals that are more complex than single instrument sounds.

Musical instrument recognition becomes an important aspect of music information retrieval which can be used by Musician and lay man to understand it. In this paper, Dynamic time warping techniques is utilized to recognize Indian musical instruments using 39 MFCC features. Six Indian musical instruments from different families are considered in this work. A large audio database are collected and recorded in our Lab at 44.1 KHz sampling frequency. Training and test templates are generated using 39 MFCC features. Sixty three different features of instrument are studied including temporal, spectral and cepstral features. In this paper we have implemented MFCC algorithm, silence part removal using Energy and Zero crossing rate and DTW algorithm. For classification task, experimental results are provided using MFCC, delta MFCC, delta delta MFCC and DTW. It is proposed that higher recognition rates can be achieved using MFCC features with DTW which is useful for different time varying musical notes‥

Background Machine learning (ML) algorithm support vector machine (SVM) performed better than Thrombolysis in Myocardial Infarction (TIMI) score for ASIAN STEMI patients. However, Deep Learning (DL) effectiveness in the multiethnic ASIAN population has yet to be determined. DL has automatic learning of the feature from a given dataset without the need to conduct feature selection. However, the selected features by the algorithm is black box. Identifying features associated with mortality is essential to recognize characteristics of patients with high risk for better patient management. Purpose To develop a DL algorithm for in-hospital mortality in multiethnic STEMI patients using predictors identified from the SVM algorithm. To investigate DL performance constructed using predictors from SVM feature extraction and expert-recommended predictors. Methods We constructed four algorithms; a) DL and SVM algorithms with predictors identified from the SVM variable importance b) DL and SVM using predictors based on expert recommendation. We used registry data from the National Cardiovascular Disease Database of 11397 patient's. Fifty parameters including demographics, cardiovascular risk, medications and clinical variables were considered. The Area under the curve (AUC) is the performance evaluation metric. Algorithms were validated against the TIMI and tested using the same validation data. SVM variable importance with backward elimination was used to select and rank important variables. Results DL algorithms outperform SVM and TIMI on the validation dataset; i) DL with SVM selected predictors (15 predictors, AUC = 0.97), ii) DL with expert-recommended predictors (16 predictors, AUC = 0.96), iii) SVM with selected predictors (15 predictors, AUC = 0.92), iv) SVM with expert-recommended predictors (AUC = 0.89) and TIMI (AUC = 0.82). Common predictors across SVM feature selection, expert-recommendation and TIMI are: age, heart rate, Killip class, fasting blood glucose, systolic blood pressure, comorbid diseases and ST-elevation. SVM feature selection also identified diuretics, PCI and pharmacotherapy drugs as predictors that improve mortality prediction in STEMI patients. Our findings suggest that the TIMI score underestimates patients risk of mortality. DL algorithm using selected predictors classified 35% of nonsurvival patients as high risk (risk probabilities &amp;gt;50%) compared to only 12.7% nonsurvival patients by TIMI (score &amp;gt;5) (Figure below). Conclusions In the ASIAN population, patients with STEMI can be better classified using the DL algorithm compared to the ML and TIMI score. Combining ML feature selection with DL allows the identification of distinct factors in a unique ASIAN population for better mortality prediction than relying solely on an expert recommendation as it is a very subjective approach. Continuous validation on population-specific algorithms using DL and ML is needed before implementing in a real clinical setting. Funding Acknowledgement Type of funding sources: Public grant(s) – National budget only. Main funding source(s): Technology Development Fund 1 TIMI performance on validation setDL performance on validation set

Depression screening with textual and audio features based on large language models and machine learning.

With the continuous development of science, more and more research results have proved that machine learning is capable of diagnosing and studying the major depressive disorder (MDD) in the brain. We propose a deep learning network with multibranch and local residual feedback, for four different types of functional magnetic resonance imaging (fMRI) data produced by depressed patients and control people under the condition of listening to positive- and negative-emotions music. We use the large convolution kernel of the same size as the correlation matrix to match the features and obtain the results of feature matching of 264 regions of interest (ROIs). Firstly, four-dimensional fMRI data are used to generate the two-dimensional correlation matrix of one person’s brain based on ROIs and then processed by the threshold value which is selected according to the characteristics of complex network and small-world network. After that, the deep learning model in this paper is compared with support vector machine (SVM), logistic regression (LR), k-nearest neighbor (kNN), a common deep neural network (DNN), and a deep convolutional neural network (CNN) for classification. Finally, we further calculate the matched ROIs from the intermediate results of our deep learning model which can help related fields further explore the pathogeny of depression patients.

Technology has the profound impact in every sphere and the music industry has not been an exception to this. In this paper, we have illustrated the strategy for extracting a set of distinct features from audio samples based on the frequency domain analysis and shape analysis, which has been entitled as TMIR. From the specific range of frequency, the features have been retrieved that represents the distinct characteristics for individual musical instruments. We have considered the specific frequency range rather than the total frequency spectrum. The analyzed characteristics have been extracted by searching the onset position and maximum value of the frequency of transient length. We have trained Artificial Neural Network-based model using Normalized input data that have successfully been capable for identifying different types of musical instruments and has an accuracy rate of ~96.47%. To achieve higher performance, a new paradigm has additionally been implemented by modifying the position of onset of true fixed transient length and consequently the final accuracy rate of ~98.22% has been achieved.

Deep learning is a fast flattering highest development in the machine learning technique leading to augment performance in diverse medical applications. The tributary artificial intelligence is rapidly becoming metamorphic in the domain of Healthcare Technology rendering facility to analyze the medical data with high rapidity and exactness. Due to the overwhelming development of artificial intelligence (AI), the contemporary encroachments of deep learning employing advanced and futuristic deep learning methods has become a vivacious research domain for processing medical data in the health care industries. This paper presents a complete analysis about the deep structured learning based methods used in medical image analysis and also elucidate about the advancement of convolutional neural network which is a major class of deep neural networks used in medical image processing. It also gives insight about the fundamentals of deep learning methods and reviews in image interpretation. It also explains about the implementation of an integrated framework for medical image synthesis combining Speckle GAN and Di-Conv-AE-Net.