Enhanced Deep Learning Frameworks for Breast Cancer Detection: Addressing Data Imbalance, Adaptability, and Computational Efficiency

<p>Problem in imbalanced data is very common in classification or identification. The problem is raised when the number of instances of one class far exceeds the other. In the previous research, our DNA barcode-based Identification System of Tuna and Mackerel was developed in imbalanced dataset. The number of samples of Tuna and Mackerel were much more than those of other fish samples. Therefore, the accuracy of the classification model was probably still in bias. This research aimed at employing Synthetic Minority Oversampling Technique (SMOTE) to yield balanced dataset. We used kmers frequencies from DNA barcode sequences as features and Support Vector Machine (SVM) as classification method. In this research we used trinucleotide (3-mers) and tetranucleotide (4-mers). The training dataset was taken from Barcode of Life Database (BOLD). For evaluating the model, we compared the accuracy of model using SMOTE and without SMOTE in order to classify DNA barcode sequences which is taken from Department of Aquatic Product Technology, Bogor Agricultural University. The results showed that the accuracy of the model in the species level using SMOTE was 7% and 13% higher than those of non-SMOTE for trinucleotide (3-mers) and tetranucleotide (4-mers), respectively. It is expected that the use of SMOTE, as one of data balancing technique, could increase the accuracy of DNA barcode based fish classification system, particularly in the species level which is difficult to be identified.</p>

In the semiconductor manufacturing industry, Automatic Defect Classification (ADC) plays an important role in maintaining high wafer inspection quality and reducing yield loss. ADC performance has benefitted from using machine learning (ML) algorithms; however, performance is negatively affected by the data imbalance and limited amounts of training data. Synthetic Minority Oversampling Technique (SMOTE) is an oversampling technique to adjust the skewed class distribution of a dataset so that the bias of the majority class is reduced. This paper shows that applying SMOTE achieved higher accuracy and purity on two imbalanced datasets, consisting of scanning electron microscopy (SEM) images collected with ASML-HMI eP™ and eScan® series inspection tools. The ML models are also less sensitive to the selection of hyperparameters when SMOTE is applied. We also show that better classification results can be obtained with less training samples with SMOTE; we conducted an experiment where a ML model trained on only 25% of samples with SMOTE achieved a higher ADC accuracy and purity performance compared to the same ML model trained on all samples but without SMOTE. In another experiment using a highly imbalanced SEM dataset with very few counts of the defect-of- interest (DOI), the combination of SMOTE and random undersampling of the majority class improves the accuracy by up to 5x while maintaining the same level of purity.

The mutation of breast cells leads to breast cancer,a lump causing illnesses .A large amount of women who have the concern of cancer are suffering from mutation in their breast cells. Early diagnosis of breast cancer can significantly improve the survival rate of patients by allowing them to receive timely clinical treatment. Accurate classification from tumor data prevents patients from receiving unnecessary treatment. Therefore, correctly diagnosing breast cancer and classifying patients into malignant or benign groups is a hot topic. In this study, the Adaboost algorithm is used to sort breast cancer depending on whether it is benign or malignant by combining the one-hot coding approach and imbalance learning. The one-hot coding approach overcomes the bias caused by the LabelEncoder coding approach, and the synthetic minority over-sampling technique, which improves the classification performance of Adaboost by augmenting the categorization balanced data structure with more minority class samples, so that its diagnosis of breast cancer reaches 99% accuracy, which is better than other machine learning models, we propose this model can be used for the diagnosis of breast cancer, providing a more accurate and faster way to classify breast cancer.

The growing number of Internet of Things devices has led to an increased risk of complex and diverse cyberattacks. However, a significant challenge in this domain is the imbalanced class distribution in most Internet of Things datasets, cautilizing classification algorithms to be biased towards the majority class, hindering effective threat detection. This study addresses this issue by leveraging the Random Forest algorithm optimised by the Synthetic Minority Oversampling Technique. This research aims to develop an effective model for detecting cyberattacks in Internet of Things environments by resolving class imbalance issues inside of the CIC-IoT2023 dataset. The methodology involves several stages, comprising data preprocessing and applying Synthetic Minority Oversampling Technique for data balancing. The balanced dataset was then used to train a Random Forest model, by its performance evaluated utilizing accuracy, precision, recall, F1-score, and Cohen's Kappa metrics. The results demonstrate the model's effectiveness, achieving an accuracy of 99.01%, an F1-score of 98.96%, and a Cohen's Kappa of 98.92%. This marks a notable improvement in performance, particularly in detecting minority classes, compared to the model trained devoid of Synthetic Minority Oversampling Technique, that struggled to identify several less common attack types. The outcomes suggest that combining Random Forest by Synthetic Minority Oversampling Technique can significantly enhance the development of intrusion detection systems by improving detection accuracy for all 33 attack types and reducing the risks associated by undetected threats. In conclusion, this study advances Internet of Things cybersecurity by presenting an effective and efficient method for addressing data imbalance in attack detection. Future research should focus on evaluating the model's robustness utilizing more complex datasets and enhancing its performance for real-time deployment on resource-constrained Internet of Things Devices.

Imbalanced data is a significant challenge in sentiment analysis, as it often impacts the performance of machine learning models. This study applies the Naïve Bayes algorithm, enhanced with the Synthetic Minority Oversampling Technique (SMOTE), to address class imbalance in user reviews of the by.U application. Using the Knowledge Discovery in Databases (KDD) framework, the research involves data selection, preprocessing (text cleaning, normalization, stemming), transformation using TF-IDF, and train-test data splitting. SMOTE is applied to the training data to improve minority class representation, while Naïve Bayes performs sentiment classification. Model evaluation using cross-validation demonstrates that SMOTE increases accuracy from 84.42% to 85.83%. These results underscore the effectiveness of integrating SMOTE with Naïve Bayes in addressing imbalanced data, offering meaningful insights into user sentiment and aiding the development of improved features for the by.U application.

The performance of any classification algorithm is determined not only by the quality of the classifier itself, but also the quality of data to be used. Most data are imbalanced, meaning the different class instances have varying ratios which poses a challenge for classification performance. Synthetic Minority Oversampling Technique (SMOTE) algorithm is an oversampling technique that deals with data imbalance by generating synthetic data instances by linearly interpolating between the minority class instances. However, the SMOTE Algorithm has certain limitations as it has a potential to overfit the classification model. The proposed method utilizes a triangle centroid method for the synthesis of new minority class instances. Heron's formula will also be used for the proposed method to be able to determine the distribution density of the data instances, as well as use a triangular noise mitigation technique to reduce the propagation of noisy data instances. Results of simulation on publicly available medical datasets show that Heron-Centroid SMOTE improved SMOTE across all performance metrics and beating both ‘Imbalanced’ tests and SMOTE on most datasets, with mean F-score of 0.5792, and an average G-mean of 0.6398.

Bipolar Disorder (BD) is a serious mental health condition that is often difficult to diagnose correctly due to overlapping symptoms and imbalanced clinical data. Early and accurate diagnosis can help patients receive timely treatment and support. In this study, we developed a hybrid machine learning approach that integrates Gaussian Mixture Model (GMM), Synthetic Minority Over-sampling Technique (SMOTE), and an optimized XGBoost classifier to improve the detection of BD. First, GMM was applied to uncover hidden clusters of patients based on medical and psychometric features, generating informative cluster assignments as additional features. Next, SMOTE was used to address the imbalance between bipolar and non-bipolar cases by generating synthetic samples for the minority class. Finally, an optimized XGBoost model was trained on the enriched and balanced dataset, leveraging both original clinical features and GMM-derived cluster representations for improved predictive power. The GMM-SMOTE-XGBoost hybrid model achieved an accuracy of 93.27% on an independent test set. Comparative analysis against conventional classifiers such as Logistic Regression(LR), Decision Tree(DT) and Support Vector Machine(SVM), and shows that this hybrid approach consistently outperformed all baselines, particularly in sensitivity and overall diagnostic reliability. This work demonstrates the potential of combining unsupervised clustering, synthetic data balancing, and optimized gradient boosting to enhance psychiatric disorder classification. Such hybrid frameworks could serve as valuable clinical decision-support tools, improving diagnostic accuracy and robustness in mental health diagnostics

Mineral systems are composed of many interacting components that lead to complex, singular and rare properties of geo-data. In mineral prospectivity mapping (MPM), supervised machine learning algorithms, which have advantages in dealing with complex geo-data, usually involve uncertainty resulting from the discretization of continuous evidential maps into arbitrary classes as well as the large data imbalance caused by the rarity of deposit locations. Consequently, the predicted results may be biased. In this paper, a random forest (RF) algorithm based on the bagging technique is used to map the prospectivity of tungsten polymetallic deposits in the Nanling metallogenic belt. Data-driven logistic transformation is employed to obtain continuous evidential maps. Both discretized and continuous evidential maps are used to generate prospectivity models for comparison. To reduce the data imbalance, the under-sampling method and the synthetic minority over-sampling technique (SMOTE) are implemented to generate balanced datasets. The receiver operating characteristic (ROC) curve and improved prediction-area (P-A) plot are applied to evaluate the prospectivity models. The predictive results show that when using the RF algorithm in MPM, the application of continuous evidential maps can improve the performance of prospectivity models and reduce the uncertainty resulting from the discretization of evidential maps. The prospectivity model trained with a balanced SMOTE-generated dataset shows the best overall performance for improving the percentage of deposit locations that are correctly predicted and decreasing the percentage of non-deposit locations that are inaccurately identified as deposit locations to some extent. In addition, the improved P-A plot is superior to the ROC curve because the latter neglects the occupied area, which is critical for mineral exploration and may provide an overly optimistic performance with imbalanced data. However, further testing of the evaluation criteria and the SMOTE approach to reduce data imbalance is warranted to determine fully the universality in MPM from the perspective of data imbalance. Based on prospectivity models, four high-potential areas and five moderate-potential areas are delineated, which indicates good future prospecting for tungsten polymetallic deposits in this region.

Synthetic Minority Oversampling Technique (SMOTE) is a preferable method used to solve the imbalanced data classification issues. However, its efficiency for resolving the issues of minority sample classification still need to be improved. In order to balance its value and shortcome, we designed a perfected algorithm called “C-K-SMOTE’', which is a mixture clustering algorithm of the Canopy and K-means. For the final purpose of obtaining an approximately balanced data, first we use Canopy to achieve the approximate clustering, then use the K-means to obtain the accurate clustering, and after that we apply the SMOTE to increase the number of minority samples. The referential imbalanced data sets used in the article are selected from KEEL (Knowledge Extraction on Evolutionary Learning). By adopting random forest disaggregated model to carry experiments, SMOTE's efficiency of balancing the imbalanced databases is verified.

Diagnosing a parasitic disease is a very difficult job in clinical practice. In this study, we constructed a machine learning model for diagnosis prediction using patient information. First, we diagnosed whether a patient has a parasitic disease. Next, we predicted the proper diagnosis method among the six types of diagnostic terms (biopsy, endoscopy, microscopy, molecular, radiology, and serology) if the patient has a parasitic disease. To make the datasets, we extracted patient information from PubMed abstracts from 1956 to 2019. We then used two datasets: the prediction for parasite-infected patient dataset (N = 8748) and the prediction for diagnosis method dataset (N = 3780). We then compared four machine learning models: support vector machine, random forest, multi-layered perceptron, and gradient boosting. To solve the data imbalance problem, the synthetic minority over-sampling technique and TomekLinks were used. In the parasite-infected patient dataset, the random forest, random forest with synthetic minority over-sampling technique, gradient boosting, gradient boosting with synthetic minority over-sampling technique, and gradient boosting with TomekLinks demonstrated the best performances (AUC: 79%). In predicting the diagnosis method dataset, gradient boosting with synthetic minority over-sampling technique was the best model (AUC: 87%). For the class prediction, gradient boosting demonstrated the best performances in biopsy (AUC: 88%). In endoscopy (AUC: 94%), molecular (AUC: 90%), and radiology (AUC: 88%), gradient boosting with synthetic minority over-sampling technique demonstrated the best performance. Random forest demonstrated the best performances in microscopy (AUC: 82%) and serology (AUC: 85%). We calculated feature importance using gradient boosting; age was the highest feature importance. In conclusion, this study demonstrated that gradient boosting with synthetic minority over-sampling technique can predict a parasitic disease and serve as a promising diagnosis tool for binary classification and multi-classification schemes.

Oversampling ratio N and the minority class’ nearest neighboring number k are key hyperparameters of synthetic minority oversampling technique (SMOTE) to reconstruct the class distribution of dataset. No optimal default value exists there. Therefore, it is of necessity to discuss the influence of the output dataset on the classification performance when SMOTE adopts various hyperparameter combinations. In this paper, we propose a hyperparameter optimization algorithm for imbalanced data. By iterating to find reasonable N and k for SMOTE, so as to build a balanced and high-quality dataset. As a result, a model with outstanding performance and strong generalization ability is trained, thus effectively solving imbalanced classification. The proposed algorithm is based on the hybridization of simulated annealing mechanism (SA) and particle swarm optimization algorithm (PSO). In the optimization, Cohen’s Kappa is used to construct the fitness function, and AdaRBFNN, a new classifier, is integrated by multiple trained RBF neural networks based on AdaBoost algorithm. Kappa of each generation is calculated according to the classification results, so as to evaluate the quality of candidate solution. Experiments are conducted on seven groups of KEEL datasets. Results show that the proposed algorithm delivers excellent performance and can significantly improve the classification accuracy of the minority class.

Poverty data in official statistics data is important for development planning. The lower percentage of the poor recorded yearly indicates good development of a country. Moreover, there is always a problem when performing an inferential and classification analysis because of the imbalanced data, thereby leading to biases in the estimation results and prediction errors in the classification. One of the solutions to this problem is using Synthetic Minority Over-sampling Technique (SMOTE). Therefore, this study aims to evaluate the inference and classification quality using the binary logistic regression model without and with SMOTE. The data utilized was the poverty status of households in the rural and urban areas in East Java, Indonesia as contained in the 2019 National Socio-Economic Survey. Furthermore, the variables used are poverty status of the household, the age of the household head (HH), the ratio of household members who are employed, gender of the HH, number of household members, education level of HH, and occupation of the HH. It was concluded that the model with SMOTE approach was better at inference and classifying the results.

Background: Class imbalance is often discussed as a strenuous task in the realm of sentiment analysis. In an imbalanced classification, few minority class instances are unable to provide sufficient information, therefore direct learning from an unbalanced dataset can produce unsatisfactory results. This work aims to address the problem of class imbalance. Methods: At primary level this study uses a novel Synthetic Minority Oversampling Technique (SMOTE) for balancing the dataset and then proposes an ensemble model, named Ensemble Bagging Support Vector Machine (EBSVM) for opinion mining. To measure the performance of the particular approach, numerous analyses are conducted on both imbalanced and balanced datasets. Then the work compares the effectiveness of the suggested model with three base classifiers (Nave Bayes (NB), Decision Tree (DT), and Support Vector Machine (SVM)). The customer reviews for restaurants is chose as the dataset for this work. Accuracy, precision, recall and F-measure are used as metrics for evaluation. Findings: According to the results, the suggested EBSVM model excels all other individual classifiers with the imbalanced and SMOTE balanced dataset. The balanced EBSVM classifier improves the imbalanced EBSVM Classifier in terms of accuracy. Precision, recall and F-measure of the minority class in the imbalanced classifiers have been improved in balanced Classifiers. Novelty: The performance of opinion mining classifiers for imbalanced and balanced datasets is evaluated in this paper. The work examines not only general opinions, but also specific aspects such as food, service, ambiance, quality, and price. Comparing the suggested model with existing classification algorithms in the literature, it has found that it outperformed the other models. Keywords: Bagging; Accuracy; Ensemble; Precision; Recall; Fmeasure

Imbalance data is common in real-world applications like text categorization, face recognition for gender classification, medical diagnosis, fraud detection, oil-spills detection of satellite images. Most of the algorithms in machine learning are focusing on classification of majority class while ignoring or misclassifying minority sample. The minority samples are those that rarely occur but very important. It is commonly agreed that standard classifiers such as neural networks, support vector machines, and C4.5 are heavily biased in recognizing mostly the majority class since they are built to achieve overall accuracy to which the minority class contributes very little. In this study, we demonstrate how the synthetic minority over-sampling technique (SMOTE) can significantly improve the imbalance problem in gender classification from the data-level perspective. Hu’s moment of the face images was generated as the numerical descriptors with different imbalance ratio and classified using a supervised decision tree (J48) algorithm. The results show that prior to preprocessing the data with SMOTE, the minority group was severely misclassified as the majority group. Our claims are confirmed through the application of SMOTE in reducing the imbalance effects before inducing the decision tree.

An Experimental Assessment of Random Forest Classification Performance Improvisation with Sampling and Stage Wise Success Rate Calculation