Speaker Recognition through Deep Learning Techniques

Speaker diarization is a task to identify the speaker when different speakers spoke in an audio or video recording environment. Artificial intelligence (AI) fields have effectively used Deep Learning (DL) to solve a variety of real-world application challenges. With effective applications in a wide range of subdomains, such as natural language processing, image processing, computer vision, speech and speaker recognition, and emotion recognition, cyber security, and many others, DL, a very innovative field of Machine Learning (ML), that is quickly emerging as the most potent machine learning technique. DL techniques have outperformed conventional approaches recently in speaker diarization as well as speaker recognition. The technique of assigning classes to speech recordings that correspond to the speaker's identity is known as speaker diarization, and it allows one to determine who spoke when. A crucial step in speech processing is speaker diarization, which divides an audio recording into different speaker areas. In-depth analysis of speaker diarization utilizing a variety of deep learning algorithms that are presented in this research paper. NIST-2000 CALLHOME and our in-house database ALSD-DB are the two voice corpora we used for this study's tests. TDNN-based embeddings with x-vectors, LSTM-based embeddings with d-vectors, and lastly embeddings fusion of both x-vector and d-vector are used in the tests for the basic system. For the NIST-2000 CALLHOME database, LSTM based embeddings with d-vector and embeddings integrating both x-vector and d-vector exhibit improved performance with DER of 8.25% and 7.65%, respectively, and of 10.45% and 9.65% for the local ALSD-DB database

With the development of information and technology, especially with the boom in big data, healthcare support systems are becoming much better. Patient data can be collected, retrieved, and stored in real time. These data are valuable and meaningful for monitoring, diagnosing, and further applications in data analysis and decision-making. Essentially, the data can be divided into three types, namely, statistical, image-based, and sequential data. Each type has a different method of retrieval, processing, and deployment. Additionally, the application of machine learning (ML) and deep learning (DL) in healthcare support systems is growing more rapidly than ever. Numerous high-performance architectures are proposed to optimize decision-making. As reliability and stability are the most important factors in the healthcare support system, enhancing the predicted performance and maintaining the stability of the model are always the top priority. The main idea of our study comes from ensemble techniques. Numerous studies and data science competitions show that by combining several weak models into one, ensemble models can attain outstanding performance and reliability. We propose three deep ensemble learning (DEL) approaches, each with stable and reliable performance, that are workable on the above-mentioned data types. These are deep-stacked generalization ensemble learning, gradient deep learning boosting, and deep aggregation learning. The experiment results show that our proposed approaches achieve more vigorous and reliable performance than traditional ML and DL techniques on statistical, image-based, and sequential benchmark datasets. In particular, on the Heart Disease UCI dataset, representing the statistical type, the gradient deep learning boosting approach dominates the others with accuracy, recall, F1-score, Matthews correlation coefficient, and area under the curve values of 0.87, 0.81, 0.83, 0.73, and 0.91, respectively. On the X-ray dataset, representing the image-based type, the deep aggregation learning approach shows the highest performance with values of 0.91, 0.97, 0.93, 0.80, and 0.94, respectively. On the Depresjon dataset, representing the sequence type, the deep-stacked generalization ensemble learning approach outperforms the others with values of 0.91, 0.84, 0.86, 0.8, and 0.94, respectively. Overall, we conclude that applying DL models using our proposed approaches is a promising method for the healthcare support system to enhance prediction and diagnosis performance. Furthermore, our study reveals that these approaches are flexible and easy to apply to achieve optimal performance.

In Speaker, identifying or recognizing human voices is a challenging task. Recently, the automatic speaker recognition technique has been developed by using deep learning techniques. However, there is a lot of wide-ranging reviews on the implementation of deep learning techniques. The authors of this work examine numerous main subtasks of automatic speaker recognition, such as speaker verification and identification, focusing on deep learning-based solutions. This article offers the groundwork for establishing effective voice recognition, automatic speaker recognition planning, and accurate quantitative voice recognition evaluation using deep learning classifiers. Finally, the authors have analyzed robust speaker recognition with two primary techniques like domain mismatch and noise difficulties, for speech improvement and domain adaption.

Most previous research focuses on finding Self-Admitted Technical Debt (SATD) or detecting bugs alone, rather to addressing the concurrent identification of both issues. These study investigations solely identify and classify the SATD or faults, without identifying or categorising bugs based on SATD. Furthermore, the majority of current methodologies do not incorporate contemporary deep learning techniques. This work presents an innovative method utilising deep learning techniques to discover and classify Self-Admitted Technical Debt (SATD) and to find defects in software comments associated with SATD. The proposed approach detects this issue and classifies and enhances the understanding and localization of defects. The methodology involves developing a deep learning model using diverse data from repositories, including Apache, Mozilla Firefox, and Eclipse. The chosen data set comprises projects, designated SATD examples, and bug instances, facilitating thorough model training and evaluation. The methodology comprises data analysis, preprocessing, and model training utilising deep learning architectures such as LSTM, BI-LSTM, GRU, and BI-GRU, with Transformer models like BERT and GPT-3, in conjunction with machine learning methods. The performance evaluation criteria, such as precision, recall, accuracy, and F1 score, illustrate the efficacy of the suggested method. Comparative assessment with existing methodologies underscores notable improvements, while cross-validation ensures model resilience. All deep learning models achieved an accuracy and precision of 0.98, and transformer models achieved slightly higher metrics. The GPT-3 achieved an overall accuracy of 0.984. We see that using the transfer learning approach the transformer model (GPT-3) outperformed the other as it achieved an overall accuracy of 0.96 and F1-Score of 0.96, precision of 0.96, and recall of 0.96, and deep learning models (LSTM, GRU) also give significant performance, but their accuracy is slightly lower than baseline model (Naive Bayes). The research has significant implications for software engineering, providing a comprehensive method for software quality assessment and maintenance. It enhances software architecture technical debt (SATD) and knowledge of bugs, as well as prioritization and resource allocation for software maintenance and evolution. The research's ramifications go beyond academia; it has a direct impact on business procedures and makes it easier to create software systems that are reliable and long-lasting.

Deep learning (DL) has been used to solve a range of real-time artificial intelligence (AI) challenges with great success. This is a cutting-edge area of machine learning (ML) that has been rapidly evolving. As a result, deep learning is quickly becoming one of the most popular and well-defined machine learning techniques, with applications in a wide range of fields, including image processing, computer vision, speech and speaker recognition, emotion recognition, natural language processing, hand-written character recognition, cyber-security, and many others. Over other prevalent methods, DL approaches have demonstrated superior performance in speech processing areas like as voice recognition and speaker recognition. We describe an experimental setup for speaker verification (SV) utilizing DL techniques, and discuss its performance and findings, as well as how it outperformed established approaches such as HMM, GMM-UBM, and SVM. In this research works, we analyse and review deep neural network (DNN) approaches employed in SV systems. With a 1.51% equal error rate (EER), the final result is the best performance of the SV systems of restricted Boltzmann machine (RBM)-based DNN.KeywordsSpeaker verificationMachine learningDeep learningDeep neural networkMFCC

In today’s complex and ever-changing world, Supply Chain Management (SCM) is increasingly becoming a cornerstone to any company to reckon with in this global era for all industries. The rapidly growing interest in the application of Deep Learning (a class of machine learning algorithms) in SCM, has urged the need for an up-to-date systematic review on the research development. The main purpose of this study is to provide a comprehensive vision by reviewing a set of 43 papers about applications of Deep Learning (DL) methods to the SCM, as well as the trends, perspectives, and potential research gaps. This review uses content analysis to answer three research questions namely: 1- What SCM problems have been solved by the use of DL techniques? 2- What DL algorithms have been used to solve these problems? 3- What alternative algorithms have been used to tackle the same problems? And do DL outperform these methods and through which evaluation metrics? This review also responds to this call by developing a conceptual framework in a value-adding perspective that provides a full picture of areas on where and how DL can be applied within the SCM context. This makes it easier to identify potential applications to corporations, in addition to potential future research areas to science. It might also provide businesses a competitive advantage over their competitors by allowing them to add value to their data by analyzing it quickly and precisely.

Deep learning has been successfully explored in addressing different multimedia topics recent years, ranging from object detection, semantic classification, entity annotation, to multimedia captioning, multimedia question answering and storytelling. Open source libraries and platforms such as Tensorflow, Caffe, MXnet significantly help promote the wide deployment of deep learning in solving real-world applications. On one hand, deep learning practitioners, while not necessary to understand the involved math behind, are able to set up and make use of a complex deep network. One recent deep learning tool based on Keras even provides the graphical interface to enable straightforward 'drag and drop' operation for deep learning programming. On the other hand, however, some general theoretical problems of learning such as the interpretation and generalization, have only achieved limited progress. Most deep learning papers published these days follow the pipeline of designing/modifying network structures - tuning parameters - reporting performance improvement in specific applications. We have even seen many deep learning application papers without one single equation. Theoretical interpretation and the science behind the study are largely ignored. While excited about the successful application of deep learning in classical and novel problems, we multimedia researchers are responsible to think and solve the fundamental topics in deep learning science. Prof. Guanrong Chen recently wrote an editorial note titled 'Science and Technology, not SciTech' [1]. This panel falls into similar discussion and aims to invite prestigious multimedia researchers and active deep learning practitioners to discuss the positioning of deep learning research now and in the future. Specifically, each panelist is asked to present their opinions on the following five questions: 1)How do you think the current phenomenon that deep learning applications are explosively growing, while the general theoretical problems remain slow progress? 2)Do you agree that deployment of deep learning techniques is getting easy (with a low barrier), while deep learning research is difficult (with a high barrier) 3)What do you think are the core problems for deep learning techniques? 4)What do you think are the core problems for deep learning science? 5)What's your suggestion on the multimedia research in the post-deep learning era?

Deep and machine learning techniques for medical imaging-based breast cancer: A comprehensive review

Institutions have been adopting work/study-from-home programs since the pandemic began. They primarily utilise Voice over Internet Protocol (VoIP) software to perform online meetings. This research introduces a new method to enhance VoIP calls experience using deep learning. In this paper, integration between two existing techniques, Speaker Separation and Speaker Identification (SSI), is performed using deep learning methods with effective results as introduced by state-of-the-art research. This integration is applied to VoIP system application. The voice signal is introduced to the speaker separation and identification system to be separated; then, the “main speaker voice” is identified and verified rather than any other human or non-human voices around the main speaker. Then, only this main speaker voice is sent over IP to continue the call process. Currently, the online call system depends on noise cancellation and call quality enhancement. However, this does not address multiple human voices over the call. Filters used in the call process only remove the noise and the interference (de-noising speech) from the speech signal. The presented system is tested with up to four mixed human voices. This system separates only the main speaker voice and processes it prior to the transmission over VoIP call. This paper illustrates the algorithm technologies integration using DNN, and voice signal processing advantages and challenges, in addition to the importance of computing power for real-time applications.

Coastal aquifers are vital for sustaining ecosystems and providing freshwater for agriculture and domestic use. However, rising groundwater salinity in these regions demands innovative approaches for accurate modeling and prediction. In recent decades, machine learning (ML) and deep learning (DL) techniques have been extensively used across various water resource management fields, often yielding promising outcomes. This review examines the growing usage of ML and DL techniques in modeling groundwater salinity in coastal aquifers. The analysis is based on 104 peer-reviewed journal articles including the review articles indexed in PubMed, ScienceDirect, Google Scholar, Scopus, and SpringerLink using keywords like "saltwater intrusion", "machine learning", “deep learning”, and "groundwater salinity". The review discusses recent advancements, challenges, and future directions for improving ML model accuracy and applicability. Studies reveal an increasing reliance on ML techniques to predict groundwater salinity and manage seawater intrusion across various coastal geological settings. Researchers have employed a range of ML models, from traditional methods like Artificial Neural Networks and Adaptive Neuro Fuzzy Inference Systems to advanced DL-based models like Convolutional Neural Networks and Long Short-Term Memory Networks, often using ensemble methods to enhance accuracy. Key findings include the top-tier output of ensemble and optimized models, including Random Forest and Grasshopper Optimization Algorithm-XGBoost. These studies highlight the importance of model selection, input variable ranking, and computational efficiency, demonstrating ML's global relevance in environmental management. The review highlights the prospects of ML, DL, and ensemble models to redefine groundwater management in coastal aquifers, offering more effective and sustainable solutions to the challenges posed by groundwater salinity and saltwater intrusion. Future advancements will focus on further integrating DL, explainable artificial intelligence, and ensemble approaches, along with other innovative techniques, to explore sparsely studied variables, model new or unique study areas, and apply ML methods for managing groundwater salinity.

Agriculture has been a vital sector for the majority of people, especially in countries like India. However, the increasing need for food production has led to intensive farming practices that have resulted in the deterioration of soil quality. This deterioration in soil quality poses significant challenges to both agricultural productivity and environmental sustainability. To address these challenges, advanced soil nutrient prediction systems that utilize machine learning and deep learning techniques are being developed. These advanced soil nutrient prediction systems utilize various sources of data, such as soil parameters, plant diseases, pests, fertilizer usage, and changes in weather patterns. By mapping and analyzing these data sources, machine learning algorithms can accurately predict the distribution of soil nutrients and other properties essential for precise agricultural practices. A previous study compared machine learning algorithms like SVM and Random Forest with deep learning algorithms CNN and LSTM for predicting crop yields. The most appropriate model is a significant challenge, but several studies have evaluated recommendation system models using deep machine learning techniques. Deep learning models attain accuracy above 90%, while many ML models achieve rates between 90% and 93%. Furthermore, the research seeks to propose specific crop suggestions grounded in soil nutrients for precision agriculture to enhance crop productivity.

Combination of deep learning and I-vector can significantly improve the performance of speaker recognition system, however, how to optimize the traditional feature parameters and how to model the speaker recognition system through deep learning are two most important research topics. This paper explores the system recognition performance from the types of input and neural network, and researches the optimal feature parameters and the most appropriate neural network structure of a speaker recognition system. Furthermore, the existing speaker recognition algorithms based on deep learning (Deep Neutral Network (DNN), Convolutional Neural Network (CNN)) have been analyzed and several improved models based on deep learning networks have been implemented and compared. Experiment shows that the network model after combination has a higher recognition rate in speaker recognition than the traditional system model.

Speaker recognition is an advanced method to identify a person from the biometric characteristics of speaking voice samples. Speaker recognition has become a vastly popular and useful research subject with countless essential applications in security, assistance, replication, authentication, automation, and verification. Many techniques are implemented using deep learning and neural network concepts and various datasets for speaker verification and identification. The primary goal of this work is to create improved robust techniques of speaker recognition to identify audio and enhance accuracy to human levels of comprehension. TIMIT and LibriSpeech datasets are used in this paper to develop an efficient automatic speaker recognition system. This work focuses on using MFCC to transform audio to spectrograms without losing the essential features of the audio file in question. We have used a closed set and an open set implementation procedure on these datasets. The closed set implementation uses a standard machine learning convention of utilizing the same datasets for training and testing, leading to higher accuracy. On the other hand, the open set implementation uses one dataset to train and another to test on each occasion. The accuracy, in this case, turned out to be relatively lower. On each dataset, CNN and LSTM deep learning techniques have been used to identify the sound, leading to the observation that implementing CNN resulted in a more significant accuracy.

The Internet of Things (IoT) has transformed many aspects of modern life, from healthcare and transportation to home automation and industrial control systems. However, the increasing number of connected devices has also led to an increase in security threats, particularly from botnets. To mitigate these threats, various machine learning (ML) and deep learning (DL) techniques have been proposed for IoT botnet attack detection. This systematic review aims to identify the most effective ML and DL techniques for detecting IoT botnets by delving into benchmark datasets, evaluation metrics, and data pre-processing techniques in detail. A comprehensive search was conducted in multiple databases for primary studies published between 2018 and 2023. Studies were included if they reported the use of ML or DL techniques for IoT botnet detection. After screening 1,567 records, 25 studies were included in the final review. The findings suggest that ML and DL techniques show promising results in detecting IoT botnet attacks, outperforming traditional signature-based methods. However, the effectiveness of the techniques varied depending on the dataset, features, and evaluation metrics used. Based on the synthesis of the findings, this review proposes a taxonomy for ML and DL techniques in IoT botnet attack detection and provides recommendations for future research in this area. This review illuminates the considerable potential of ML and DL approaches in bolstering the detection of IoT botnet attacks, thereby offering valuable insights to researchers involved in the domain of IoT security.

This article investigates the development and evaluation of a speaker identification system using deep learning techniques, with a focus on Convolutional Neural Networks (CNNs) and the audioMNIST dataset. The study reveals significant advancements in speaker identification, demonstrating substantial improvements over state-of-the-art models. Our system achieves high accuracy and reliability in distinguishing speakers, showcasing its potential applications in forensic science, security, and privacy protection. The paper thoroughly examines audio signal representation, preprocessing techniques, and feature extraction methods, highlighting how these components contribute to the system's effectiveness. By leveraging CNNs, the proposed system provides highly accurate speaker identification and exhibits robustness in various conditions, including noise and varying speech patterns. The findings underscore the system’s capability to enhance security measures and forensic research, paving the way for future optimizations and broader applications. This contribution expands the knowledge base in speaker identification technology, offering scalable and efficient solutions for real-world scenarios. Future research directions include refining the dataset, exploring advanced optimization techniques, and addressing ethical considerations to ensure the system's robustness and practical utility in diverse applications.