Data Augmentation Model for Audio Signal Extraction

The performance of machine learning (ML) models is closely tied to the quality, quantity, and diversity of the training datasets. Insufficient data or datasets lacking variability often led to overfitting, where models excel on training data but fail to generalize to unseen examples. Data augmentation, a technique that artificially expands datasets by applying transformations, has become an indispensable tool for improving ML model performance. This paper explores a range of data augmentation techniques, including traditional methods such as image flipping and rotation, advanced approaches like GAN-generated synthetic data, and hybrid strategies such as mixup and CutMix. Using an image classification task as a baseline, we demonstrate how these techniques improve model robustness, increase accuracy by 15–20%, and reduce overfitting by 20%. The paper also examines how data augmentation adapts to different data types, including text, images, and videos, and discusses the unique challenges and benefits associated with each. Future directions focus on automating augmentation pipelines to optimize their application across domains, ultimately making ML workflows more robust and scalable.

Most Facial Expression Recognition (FER) systems rely on machine learning approaches that require large databases for an effective training. As these are not easily available, a good solution is to augment the databases with appropriate data augmentation (DA) techniques, which are typically based on either geometric transformation or oversampling augmentations (e.g., generative adversarial networks (GANs)). However, it is not always easy to understand which DA technique may be more convenient for FER systems because most state-of-the-art experiments use different settings which makes the impact of DA techniques not comparable. To advance in this respect, in this paper, we evaluate and compare the impact of using well-established DA techniques on the emotion recognition accuracy of a FER system based on the well-known VGG16 convolutional neural network (CNN). In particular, we consider both geometric transformations and GAN to increase the amount of training images. We performed cross-database evaluations: training with the "augmented" KDEF database and testing with two different databases (CK+ and ExpW). The best results were obtained combining horizontal reflection, translation and GAN, bringing an accuracy increase of approximately 30%. This outperforms alternative approaches, except for the one technique that could however rely on a quite bigger database.

Improving the prediction of extreme wind speed events with generative data augmentation techniques

One of the common challenges in medical artificial intelligence (AI) applications using echocardiography is the lack of image data harmonization. This study aims to improve the prediction accuracy of left ventricular ejection fraction (LVEF) AI models by incorporating data augmentation (DA) techniques to address the variability in image data across different vendor machines. A database comprising 15,770 echocardiographic videos from 3154 patients across five different centers was utilized, with the data acquired using various vendor machines. We prepared datasets specific to GE healthcare (GE), philips (PH), and canon medical systems (CA) vendors, including 1911, 804, and 427 cohorts, respectively. A three-dimensional convolutional neural network (3D-CNN) was trained to predict LVEF, using videos consisting of 20 images per heartbeat as input, with training performed exclusively on data from GE machines (GE-based model). DA techniques, including gamma correction, scaling, median filtering, unsharp masking, translation, rotation, noise correction, and image conversion using a cycle generative adversarial network, were applied. A regression analysis using five different chamber views was performed on the GE test data. The accuracy of LVEF prediction using the GE-based model with DA—specifically gamma correction, scaling, and translation corrections—was excellent. The mean absolute error (root mean square error) in test cohorts was 4.33 (5.58) for GE, 4.42 (5.57) for PH, and 4.89 (6.57) for CA, which were comparable to the results of a model developed using data from all vendors, demonstrating the effectiveness of DA in harmonizing images. This study demonstrates that echocardiographic videos are transferable across vendors and that DA is highly effective in improving LVEF predictions from data acquired using different vendor machines.Supplementary InformationThe online version contains supplementary material available at 10.1038/s41598-025-21277-y.

Speech digit recognition research is growing decisively, and a bulk of digit recognition algorithms are used in European and a few Asian languages. Kui is a low-resourced tribal language locally used in several states of India. Despite its significance, there is not much research on Kui's speech. This research aims to present an in-depth analysis of novel Kui digit recognition using predefined machine learning (ML) techniques. For this purpose, we first gathered spoken numbers i.e. from 0 to 9 of eight different speakers containing a total of 200 words. Secondly, we choose the numbers: ଶୂନ (zero), ଏକ (one), ଦୁଇ (two), ତିନି(three), ସାରି(four), ପାସ (five), ସଅ (six), ସାତ (seven), ଆଟ (eight), ନଅ (nine). Meanwhile, we build nine different ML models to recognize Kui digits that take the Mel-frequency cepstral coefficients (MFCCs) method to extract the relevant features for model predictions. Finally, we compared the performance of ML models for both augmented and non-augmented Kui data. The result shows that the SVM+Augmentation method for Kui digit recognition combined obtained the highest accuracy of 83% than other methods. Moreover, the difficulties and potential prospects for Kui digit recognition are also highlighted in this work.

Machine learning (ML) models provide more choices to patients with diabetes mellitus (DM) to more properly manage blood glucose (BG) levels. However, because of numerous types of ML algorithms, choosing an appropriate model is vitally important. In a systematic review and network meta-analysis, this study aimed to comprehensively assess the performance of ML models in predicting BG levels. In addition, we assessed ML models used to detect and predict adverse BG (hypoglycemia) events by calculating pooled estimates of sensitivity and specificity. PubMed, Embase, Web of Science, and Institute of Electrical and Electronics Engineers Explore databases were systematically searched for studies on predicting BG levels and predicting or detecting adverse BG events using ML models, from inception to November 2022. Studies that assessed the performance of different ML models in predicting or detecting BG levels or adverse BG events of patients with DM were included. Studies with no derivation or performance metrics of ML models were excluded. The Quality Assessment of Diagnostic Accuracy Studies tool was applied to assess the quality of included studies. Primary outcomes were the relative ranking of ML models for predicting BG levels in different prediction horizons (PHs) and pooled estimates of the sensitivity and specificity of ML models in detecting or predicting adverse BG events. In total, 46 eligible studies were included for meta-analysis. Regarding ML models for predicting BG levels, the means of the absolute root mean square error (RMSE) in a PH of 15, 30, 45, and 60 minutes were 18.88 (SD 19.71), 21.40 (SD 12.56), 21.27 (SD 5.17), and 30.01 (SD 7.23) mg/dL, respectively. The neural network model (NNM) showed the highest relative performance in different PHs. Furthermore, the pooled estimates of the positive likelihood ratio and the negative likelihood ratio of ML models were 8.3 (95% CI 5.7-12.0) and 0.31 (95% CI 0.22-0.44), respectively, for predicting hypoglycemia and 2.4 (95% CI 1.6-3.7) and 0.37 (95% CI 0.29-0.46), respectively, for detecting hypoglycemia. Statistically significant high heterogeneity was detected in all subgroups, with different sources of heterogeneity. For predicting precise BG levels, the RMSE increases with a rise in the PH, and the NNM shows the highest relative performance among all the ML models. Meanwhile, current ML models have sufficient ability to predict adverse BG events, while their ability to detect adverse BG events needs to be enhanced. PROSPERO CRD42022375250; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=375250.

Eye-tracking technology enables communication for individuals with muscle control difficulties, making it a valuable assistive tool. Traditional systems rely on electrooculography (EOG) or infrared devices, which are accurate but costly and invasive. While vision-based systems offer a more accessible alternative, they have not been extensively explored for eye-writing recognition. Additionally, the natural instability of eye movements and variations in writing styles result in inconsistent signal lengths, which reduces recognition accuracy and limits the practical use of eye-writing systems. To address these challenges, we propose a novel vision-based eye-writing recognition approach that utilizes a webcam-captured dataset. A key contribution of our approach is the introduction of a Discrete Fourier Transform (DFT)-based length normalization method that standardizes the length of each eye-writing sample while preserving essential spectral characteristics. This ensures uniformity in input lengths and improves both efficiency and robustness. Moreover, we integrate a hybrid deep learning model that combines 1D Convolutional Neural Networks (CNN) and Temporal Convolutional Networks (TCN) to jointly capture spatial and temporal features of eye-writing. To further improve model robustness, we incorporate data augmentation and initial-point normalization techniques. The proposed system was evaluated using our new webcam-captured Arabic numbers dataset and two existing benchmark datasets, with leave-one-subject-out (LOSO) cross-validation. The model achieved accuracies of 97.68% on the new dataset, 94.48% on the Japanese Katakana dataset, and 98.70% on the EOG-captured Arabic numbers dataset—outperforming existing systems. This work provides an efficient eye-writing recognition system, featuring robust preprocessing techniques, a hybrid deep learning model, and a new webcam-captured dataset.

Mammography is the primary procedure for breast cancer screening, attempting to reduce breast cancer mortality risk with early detection. Deep learning methods have shown strong applicability to various medical images datasets. Due to paucity of available labeled medical images, accurate computer assisted diagnosis requires intensive data augmentation (DA) techniques, such as geometric/intensity transformations of original images. This data when used along with the training data helps to address the limited medical image dataset collected from various sources. Generative Adversarial Networks (GANs) is one of the DA techniques. GAN trained on images can generate new images that contain many authentic characteristics and look realistic to human observers. Therefore, this paper focuses on overcoming the problem of limited labeled dataset, using Deep Convolution GANs (DCGANs). To analyze the closeness between the original and synthetic images, a visualization tool ImageJ was used. In order to validate the proposed model, a visual Turing test was conducted with the help of medical experts.

Recent deep neural network models trained on smaller and less diverse datasets use data augmentation to alleviate limitations such as overfitting, reduced robustness, and lower generalization. Methods using 3D datasets are among the most common to use data augmentation techniques such as random point drop, scaling, translation, rotations, and jittering. However, these data augmentation techniques are fixed and are often applied to the entire object, ignoring the object’s local geometry. Different local neighborhoods on the object surface hold a different amount of geometric complexity. Applying the same data augmentation techniques at the object level is less effective in augmenting local neighborhoods with complex structures. This paper presents PatchAugment, a data augmentation framework to apply different augmentation techniques to the local neighborhoods. Our experimental studies on PointNet++ and DGCNN models demonstrate the effectiveness of PatchAugment on the task of 3D Point Cloud Classification. We evaluated our technique against these models using four benchmark datasets, ModelNet40 (synthetic), ModelNetlO (synthetic), SHREC’16 (synthetic) and ScanObjectNN (real-world).

Deep learning has revolutionized the performance of classification and object detection, but meanwhile demands sufficient labeled data for training. Given insufficient data, while many techniques have been developed to help combat overfitting, the challenge remains if one tries to train deep networks, especially in the ill-posed <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">extremely low data regimes</i> : only a small set of labeled data are available, and nothing – including unlabeled data – else. Such regimes arise from practical situations where not only data labeling but also data collection itself is expensive. We propose a deep adversarial data augmentation (DADA) technique to address the problem, in which we elaborately formulate data augmentation as a problem of training a class-conditional and supervised generative adversarial network (GAN). Specifically, a new discriminator loss is proposed to fit the goal of data augmentation, through which both real and augmented samples are enforced to contribute to and be consistent in finding the decision boundaries. Tailored training techniques are developed accordingly. To quantitatively validate its effectiveness, we first perform extensive simulations to show that DADA substantially outperforms both traditional data augmentation and a few GAN-based options. We then extend experiments to three real-world small labeled classification datasets where existing data augmentation and/or transfer learning strategies are either less effective or infeasible. We also demonstrate that DADA to can be extended to the detection task. We improve the pedestrian synthesis work by substitute for our discriminator and training scheme. Validation experiment shows that DADA can improve the detection mean average precision (mAP) compared with some traditional data augmentation techniques in object detection. Source code is available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/SchafferZhang/DADA</uri> .

Understanding the Performance of Machine Learning Models to Predict Credit Default: A Novel Approach for Supervisory Evaluation

The extensive utilization of drones has led to numerous scenarios that encompass both advantageous and perilous outcomes. By using deep learning techniques, this study aimed to reduce the dangerous effects of drone use through early detection of drones. The purpose of this study is the evaluation of deep learning approaches such as pre-trained YOLOv8 drone detection for security issues. This study focuses on the YOLOv8 model to achieve optimal performance in object detection tasks using a publicly available dataset collected by Mehdi Özel for a UAV competition that is sourced from GitHub. These images are labeled using Roboflow, and the model is trained on Google Colab. YOLOv8, known for its advanced architecture, was selected due to its suitability for real-time detection applications and its ability to process complex visual data. Hyperparameter tuning and data augmentation techniques were applied to maximize the performance of the model. Basic hyperparameters such as learning rate, batch size, and optimization settings were optimized through iterative experiments to provide the best performance. In addition to hyperparameter tuning, various data augmentation strategies were used to increase the robustness and generalization ability of the model. Techniques such as rotation, scaling, flipping, and color adjustments were applied to the dataset to simulate different conditions and variations. Among the augmentation techniques applied to the specific dataset in this study, rotation was found to deliver the highest performance. Blurring and cropping methods were observed to follow closely behind. The combination of optimized hyperparameters and strategic data augmentation allowed YOLOv8 to achieve high detection accuracy and reliable performance on the publicly available dataset. This method demonstrates the effectiveness of YOLOv8 in real-world scenarios, while also highlighting the importance of hyperparameter tuning and data augmentation in increasing model capabilities. To enhance model performance, dataset augmentation techniques including rotation and blurring are implemented. Following these steps, a significant precision value of 0.946, a notable recall value of 0.9605, and a considerable precision–recall curve value of 0.978 are achieved, surpassing many popular models such as Mask CNN, CNN, and YOLOv5.

A novel neural network-based alloy design strategy: Gated recurrent unit machine learning modeling integrated with orthogonal experiment design and data augmentation

EEG-based emotion identification from nerve conduction mechanisms: A gustatory-emotion coupling model combined with multiblock attention module

The emergent of machine learning (ML) and deep learning (DL) methods have created a substantial window of chance for their use in the industry. Given that both ML and DL algorithms are capable of identifying links between enormous amounts of data, one of the jobs for which these techniques have the most potential is visual inspection. These methods, nevertheless, call for a lot of photographs, which are not always possible to capture. Techniques for data augmentation are used as a remedy for this. Many datasets are created utilizing data augmentation approaches based on geometric transformations, starting from a very unbalanced dataset containing photos of various medical images. Many datasets are created utilizing data augmentation approaches based on geometric transformations, starting from a very unbalanced dataset containing photos of various medical images. The geometric transformation-based data augmentation segments the infected area and the classification process is proposed to highlight the severity of the disease. The proposed suggests an impartial and all-encompassing framework of evaluation for various information augmentation techniques. With this cutting-edge procedure, various augmented techniques are thoroughly and accurately assessed regarding data diversity and classification accurateness utilizing massive public datasets already available. In order to replicate the typical moderate size datasets used in deep learning, a regular-interval sampling strategy constructed on similarity ranking is described that can be used to choice samples from enormous open datasets and produce a subset that can accurately represent the original set. Then, using a variety of data augmentation methods, the augmented datasets are created from the small-sized datasets.