Various Approaches in Musical Instrument Identification

This paper examines the use of Mel-frequency Cepstral Coefficients in the classification of musical instruments. 2004 piano, violin and flute samples are analysed to get their coefficients. These coefficients are reduced using principal component analysis and used to train a multi-layered perceptron. The network is trained on the first 3, 4 and 5 principal components calculated from the envelope of the changes in the coefficients. This trained network is then used to classify novel input samples. By training and testing the network on a different number of coefficients, the optimum number of coefficients to include for identifying a musical instrument is determined. We conclude that using 4 principal components from the first 15 coefficients gives the most accurate classification results.

The advancement of machine learning algorithms has opened a wide scope for vibration-based SHM (Structural Health Monitoring). Vibration-based SHM is based on the fact that damage will alter the dynamic properties viz., structural response, frequencies, mode shapes, etc of the structure. The responses measured using sensors, which are high dimensional in nature, can be intelligently analyzed using machine learning techniques for damage assessment. Neural networks employing multilayer architectures are expressive models capable of capturing complex relationships between input-output pairs but do not account for uncertainty in network outputs. A BNN (Bayesian Neural Network) refers to extending standard networks with posterior inference. It is a neural network with a prior distribution on its weights. Deep learning architectures like CNN (Convolutional neural network) and LSTM(Long Short Term Memory) are good candidates for representation learning from high dimensional data. The advantage of using CNN over multi-layer neural networks is that they are good feature extractors as well as classifiers, which eliminates the need for generating hand-engineered features. LSTM networks are mainly used for sequence modeling. This paper presents both a Bayesian multi-layer perceptron and deep learning-based approach for damage detection and location identification in beam-like structures. Raw frequency response data simulated using finite element analysis is fed as the input of the network. As part of this, frequency response was generated for a series of simulations in the cantilever beam involving different damage scenarios. This case study shows the effectiveness of the above approaches to predict bending rigidity with an acceptable error rate.

This paper describes a method that identifies sounds of non-registered musical instruments (i.e., musical instruments that are not contained in the training data) at a category level. Although the problem of how to deal with non-registered musical instruments is essential in musical instrument identification, it has not been dealt with in previous studies. Our method solves this problem by distinguishing between registered and non-registered instruments and identifying the category name of the non-registered instruments. When a given sound is registered, its instrument name, e.g. violin, is identified. Even if it is not registered, its category name, e.g. strings, can be identified. The important issue in achieving such identification is to adopt a musical instrument hierarchy reflecting the acoustical similarity. We present a method for acquiring such a hierarchy from a musical instrument sound database. Experimental results show that around 77% of non-registered instrument sounds, on average, were correctly identified at the category level.

A deep CNN-LSTM model for predicting interface depth from gravity data over thrust and fold belts of North East India

Artificial Intelligence (AI) has revolutionized the field of music analysis by enabling advanced sound recognition and classification techniques. In the recent year, the music industry has had transformative evolution in recent years, significantly impacting user engagement, creativity, and technological innovation across various domains, including entertainment, education, and therapy. Musical instrument recognition is an emerging field within this landscape that could be used in applications such as automated music transcription and intelligent recommendation systems and adaptive music generation. Using Deep Learning (DL) alongside Artificial Intelligence has dramatically improved how we hear things as it has become a robust analytics tool for patterns in audio. The intricate signals from audio data together with overlapping frequencies and instrument diversity present significant challenges to accurate musical instrument prediction and classification. Traditional structured machine learning models cannot be applied successfully to dealing with complicated patterns, in contrast DL models possess superior designed system architectures and stronger feature extracting ability. Through the integration of these DNN with default layers with support vector machines, an instrument recognition framework is presented in this research, on publicly available dataset of diverse instruments with three second clips combined with Mel Spectrogram and its audio features. The standard measures are used for measuring performance of models such as accuracy, precision, recall and f1-score. The proposed model DNN achieves 98% classification precision over the SVM baseline with accuracy of 96% using musical instrument dataset with 24 classes. Using this research as the base of concept, it is shown that DL is better than current proposed methodologies at improving audio transformation processes, and it promises potential in improving the state of the art at musical instrument identification techniques that would yield useful results to intelligent music systems and AI audio analysis methodologies.

Gamelan consists of several musical instruments including kendang, saron, bonang, panerus, kempul, gender, gambang, kethuk, flute, siter, clempung, slenthem, demung, japan, kempyang, peking, and gong. Many people do not know the name of each gamelan instrument and how it sounds. In an effort to increase the popularity and introduction of gamelan as a traditional musical instrument to the community, this research proposes an analysis based on audio classification of gamelan musical instruments. Classification is done by data mining technique using backpropagation Neural Network (BPNN) method. Audio or sound data from gamelan recordings is conducted by preprocessing using Zero Crossing Rate and Short Time Energy before processed to Backpropagation Neural Network. This research only classifies 4 gamelan musical instruments namely gong, kenong, saron, and gambang. The experimental result shows accuracy at 82.5 %.

Singer identification is one of the important aspects of music information retrieval (MIR). In this work, traditional feature-based and trending convolutional neural network (CNN) based approaches are considered and compared for identifying singers. Two different datasets, namely artist20 and the Indian popular singers’ database with 20 singers are used in this work to evaluate proposed approaches. Cepstral features such as Mel-frequency cepstral coefficients (MFCCs) and linear prediction cepstral coefficients (LPCCs) are considered to represent timbre information. Shifted delta cepstral (SDC) features are also computed beside the cepstral coefficients to capture temporal information. In addition, chroma features are computed from 12 semitones of a musical octave, overall forming a 46-dimensional feature vector. Experiments are conducted with different feature combinations, and suitable features are selected using the genetic algorithm-based feature selection (GAFS) approach. Two different classification techniques, namely artificial neural networks (ANNs) and random forest (RF), are considered on the features mentioned above. Further, spectrograms and chromagrams of audio clips are directly fed to CNN for classification. The singer identification results obtained using CNNs seem to be better than the traditional isolated and ensemble classifiers. Average accuracy of around 75% is observed with CNN in the case of Indian popular singers database. Whereas, on artist20 dataset, the proposed configuration of feature-based approach and CNN could not give better than 60% accuracy.

As digital music production has become mainstream, the selection of appropriate virtual instruments plays a crucial role in determining the quality of music. To search the musical instrument samples or virtual instruments that make one’s desired sound, music producers use their ears to listen and compare each instrument sample in their collection, which is time-consuming and inefficient. In this paper, we call this task as Musical Instrument Retrieval and propose a method for retrieving desired musical instruments using reference mixture audio as a query. The proposed model consists of the Single-Instrument Encoder and the Multi-Instrument Encoder, both based on convolutional neural networks. The Single-Instrument Encoder is trained to classify the instruments used in single-track audio, and we take its penultimate layer’s activation as the instrument embedding. The Multi-Instrument Encoder is trained to estimate multiple instrument embeddings using the instrument embeddings computed by the Single-Instrument Encoder as a set of target embeddings. For more generalized training and realistic evaluation, we also propose a new dataset called Nlakh. Experimental results showed that the Single-Instrument Encoder was able to learn the mapping from the audio signal of unseen instruments to the instrument embedding space and the Multi-Instrument Encoder was able to extract multiple embeddings from the mixture audio and retrieve the desired instruments successfully. The code used for the experiment and audio samples are available at: https://github.com/minju0821/musical_instrument_retrieval

paper, we focus on exploring the relationship between weave patterns and their mechanical properties in woven fiber composites through Machine Learning. Specifically, we explore the interactions between woven architectures and in-plane stiffness properties through Deep Convolutional Neural Network (DCNN) and Generative Adversarial Network (GAN). Our research is important for exploring how woven composite’s pattern is related to its mechanical properties and accelerating woven composite design as well as optimization. We focus on two tasks: (1) Stiffness prediction: Predicting in-plane stiffness properties for given weave patterns. Our DCNN extracts high-level features through several convolutional and fully connected layers to determine the final predictions. (2) Weave pattern prediction: Predicting weave patterns for target stiffness properties, which can be treated as the reverse task of the first one. Due to many-to-one mapping between weave patterns and the composite properties, we utilize a Decoder Neural Network as our baseline model and compare its performance with GAN and Genetic Algorithm. We represent the weave patterns as 2D checkerboard models and use finite element analysis (FEA) to determine in-plane stiffness properties, which serve as input data for our ML framework. We show that: (1) for stiffness prediction, DCNN can predict stiffness values for a given weave pattern with relatively high accuracy (above 93%); (2) for weave pattern prediction, the GAN model gives the best prediction accuracy (above 92%) while Decoder Neural Network has the best time efficiency. HAOTIAN FENG

The study presents the results of the development and testing of deep learning neural network architectures, which demonstrate high accuracy rates in classifying neurophysiological data, in particular hemodynamic brain activation patterns obtained by functional near-infrared spectroscopy, during solving mathematical problems on spatial-numerical associations. The analyzed signal represents a multidimensional time series of oxyhemoglobin and deoxyhemoglobin dynamics. Taking the specificity of the fNIRS signal into account, a comparative analysis of 2 types of neural network architectures was carried out: (1) architectures based on recurrent neural networks: recurrent neural network with long short-term memory, recurrent neural network with long short-term memory with fully connected layers, bidirectional recurrent neural network with long short-term memory, convolutional recurrent neural network with long short-term memory; (2) architectures based on convolutional neural networks with 1D convolutions: convolutional neural network, fully convolutional neural network, residual neural network. Trained long short-term memory recurrent neural network architectures showed worse results in accuracy in comparison with 1D convolutional neural network architectures. Residual neural network (model_Resnet) demonstrated the highest accuracy rates in three experimental conditions more than 88% in detecting age-related differences in brain activation during spatial-numerical association tasks considering the individual characteristics of the respondents’ signal.

Musical instrument classification, as a fundamental task in music information retrieval (MIR), has broad applications in music analysis, education, and content management. However, existing research primarily focuses on short monophonic samples for classification, which fails to capture the timbral variation characteristics in real performance scenarios. Meanwhile, traditional deep learning models still have limitations in extracting complex timbral features. To address these challenges, this paper proposes ICKAN, a deep instrument classification model that incorporates the Kolmogorov-Arnold Network (KAN), and constructs a large-scale dataset containing 30,824 complete musical phrases. Experimental results demonstrate that ICKAN achieves a classification accuracy of 95.74% in a 20-class instrument classification task with 10-second audio segments, significantly outperforming current methods. This research introduces learnable nonlinear activation functions and comprehensive musical segments, offering new insights into improving the accuracy and practicality of instrument classification and contributing valuable references for the advancement of music information retrieval technology. The code and dataset are available at https://github.com/NMLAB8/ICKAN.

The report presents an algorithm for constructing a convolutional hierarchical neural network classifier, which is a modification of the algorithm for constructing hierarchical neural network classifiers suggested before. The original algorithm was designed to exploit intrinsic class hierarchy to build a class tree with a neural network in each node classifying groups of initial classes (in a non-terminal node) or a subset of original classes (in a terminal node). The convolutional modification utilizes convolutional neural networks instead of regular fully connected networks in order to apply the model to image classification tasks. Use of class hierarchy for image classification should reduce the number of adjusted neural network parameters compared to deep convolutional neural networks, and therefore it should reduce training and inference time. In this context the algorithm may be compared with some pruning techniques. The convolutional hierarchical neural network classifier inherits some hyperparameters of a conventional hierarchical neural network classifier, like the activation threshold and the threshold by the share of voting patterns. The goal of this study was to explore different strategies of choosing these hyperparameters. To test these strategies, we used the CIFAR-10 dataset. Also, for demonstration purposes we apply the convolutional hierarchical neural network classifier to the CIFAR-100 dataset.

In this paper, alternative direction finding methods have been proposed using deep learning techniques. Firstly, Regeression and Classification models have created by using Convolutional Neural Networks (CNNs). In the second Convolutional Neural Networks and Recurrent Neural Networks (RNNs) have been utilized in the proposed methods. Despite having vast amount of direction finding studies, utilization of neural networks is scarce in literature and past works mostly only includes usage of CNNs. In this study, direction finding is performed by learning signals reaching multiple antenna arrays by networks. Created neural networks have been fed with different data formats and their performances against noisy and no-noise data have been shown. In addition, comparative analysis of the developed models were made in the similar Signal-to-Noise Ratio (SNR) range with the subspace based MUSIC algorithm, which is frequently used in direction finding.

In this paper, the authors make an attempt to solve the convoluted problem of identifying musical instruments based on their audio excerpts, using a deep convolutional neural network. Continuous wavelet transform of audio signals are realized through Morse wavelet and two‐dimensional feature maps are formed, which are then fed to a simple yet robust convolutional neural network. The outcome is appreciable in the sense that training the model with just 20% of the data and testing on the rest gives a classification accuracy of 85%.

Predicting outdoor ultrafine particle number concentrations, particle size, and noise using street-level images and audio data