A Hybrid Intelligent System for IP Traffic Classification

Land-cover classification using remote sensing imagery is an important part of environmental research because it provides baseline information for ecological vulnerability and risk assessment, disaster management, landscape conservation, local and regional planning, and so on. Rural-land-cover classification is challenging for both object-based image analysis methods and classifiers. The objective of this study is to improve the object-oriented classification accuracy of rural land cover by combining two models based on high spatial resolution imagery. We apply the C5.0 algorithm in R to combine support vector machines (SVMs) and random forest (RF) to create the model RS_C5.0. The effectiveness of the model combination is assessed by comparing the classification results with the state-of-the-art machine learning algorithm, namely extreme gradient boosting (XGBoost). The comparisons are done based on the classification results of both the study area and the case area. Results show that in the classification of the study area, RF performs slightly better than SVM, and XGBoost performs worse than RF but better than SVM. However, in the classification of the case area, SVM performs slightly better than RF and both SVM and RF perform better than XGBoost. Furthermore, RS_C5.0 obtains the highest overall accuracies and kappa coefficients in the classifications of both the study area and the case area. In terms of training time, XGBoost runs the slowest in the classifications of both the study area and the case area. SVM and RF as well as the combined model (RS_C5.0) run much faster than XGBoost classifier. To summarize, the combination of SVM and RF classifiers using C5.0 algorithm is found to be a fast and effective way to improve rural-land-cover classification.

Considering the form diversity of tree species composition in the Bagong Mountain National Forest Park of China, we mapped tree species utilizing Machine Learning Algorithms (support vector machines (SVM) and random forest (RF) classifiers) based on the OHS-2 hyperspectral satellite image by different datasets which combined spectral information and hyperspectral-derived vegetation indices (VIs) for improving tree species classification and explored the best performance of them. To verify the improvement, the results of physically-based spectral classifiers (spectral angle mapper (SAM) and maximum likelihood (ML) classifiers) were applied to compare with the results of machine learning algorithms. The results indicated an overall accuracy of 94.01%, 96.08%, 82.9% and 79.3% for SVM, RF, SAM and ML classifiers of the best performance using different datasets. Highest accuracies resulted from two machine learning algorithms classifiers; SVM and RF compared to SAM and ML classifiers. Although SVM outperformed RF when using all hyperspectral bands and VIs, the overall accuracy of the RF classifier is higher when compared to the SVM classifier using VIs combined selected features. Meanwhile, the RF classifier performed better than SVM after removing the redundancy of spectral data in training samples. Moreover, the machine learning algorithms successfully classified a small number of tree species (Cedrus deodara and Pterocarya stenoptera C. DC.) in the study area, but the physical spectroscopy-based method failed to classify these species. Such integration strategy improved the effectiveness of enhancing the accuracy of tree species classification and mapping their distribution on broad spatial and temporal scales using machine learning algorithms and hyperspectral imagery.

Aim: The aim of the work is to evaluate the accuracy and precision in predicting heart disease using Support Vector Machine (SVM), Random forest (RF), Logistic Regression (LR), Decision Tree (DT) Classification algorithms. Materials and Methods: Classification algorithm is appealed on a heart dataset which consists of 180 records. A framework for heart disease prediction in the medical sector comparing Random forest, Logistic Regression, Decision Tree and SVM classifiers has been proposed and developed. The sample size was calculated as 55 in each group using G power 80%. Sample size was calculated using clincalc analysis, with alpha and beta values 0.05 and 0.5, 95% confidence, pretest power 80% and enrolment ratio 1. Results: The Novel Random Forest Algorithm (92.13%), Support Vector Machine (62.51%), Logistic Regression (84.89%), Decision Tree (86.25%) classifiers produce respectively. SVM, RF exists a statistically significant difference between the two groups (p=0.001,p=.004;p<0.05).LR, RF exists a statistically insignificant difference between the two groups (p=.103, P=.080;p>0.05) both with confidence interval 95%. Hence Random forest is better than SVM, RF, DT classifiers. Conclusion: The results show that the performance of RF is better when compared with SVM, LR and DT in terms of both precision and accuracy.

Heart disease is a major cause of death worldwide. About 31% of global deaths occur due to this disease. According to the WHO report, approximately 17.9 million people worldwide die each year due to this disease. Early detection of heart disease can reduce the chance of the disease progressing to a more severe stage by providing appropriate treatment. Coronary angiography is the most precise method of detecting the disease; nevertheless, it is a painful and expensive procedure, and patients do not prefer it in the early stages. As a result, a non-invasive and reliable method that can be employed as a screening tool for disease diagnosis is required. Machine learning has influenced every element of human life in the modern era, and it has a huge impact in the health care sector also. Machine learning (ML) based decision support systems can be used to diagnose heart disease by evaluating the clinical parameters of a patient. Various ML techniques have been investigated in this paper, and a system has been designed for the diagnosis of heart disease, with an emphasis on coronary artery disease. Relevant features were selected using the Extra Tree feature selection method and classification was done by XGBoost (extreme gradient boosting), KNN (K-nearest neighbor), SVM (support vector machine), logistic regression (LR), decision tree (DT), random forest (RF) and neural network (NN) classifiers. A regularized NN model for heart disease diagnosis is also developed that has provided 84.0% accuracy and 85.0% accuracy for RF on the Kaggle dataset.

ObjectiveThe aim of this study was to develop and validate an ultrasound-based radiomics nomogram model by integrating the clinical risk factors and radiomics score (Rad-Score) to predict the Ki-67 status in patients with breast carcinoma.MethodsUltrasound images of 284 patients (196 high Ki-67 expression and 88 low Ki-67 expression) were retrospectively analyzed, of which 198 patients belonged to the training set and 86 patients to the test set. The region of interest of tumor was delineated, and the radiomics features were extracted. Radiomics features underwent dimensionality reduction analysis by using the independent sample t test and least absolute shrinkage and selection operator (LASSO) algorithm. The support vector machine (SVM), logistic regression (LR), decision tree (DT), random forest (RF), naive Bayes (NB) and XGBoost (XGB) machine learning classifiers were trained to establish prediction model based on the selected features. The classifier with the highest AUC value was selected to convert the output of the results into the Rad-Score and was regarded as Rad-Score model. In addition, the logistic regression method was used to integrate Rad-Score and clinical risk factors to generate the nomogram model. The leave group out cross-validation (LGOCV) method was performed 200 times to verify the reliability and stability of the nomogram model.ResultsSix classifier models were established based on the 15 non-zero coefficient features. Among them, the LR classifier achieved the best performance in the test set, with the area under the receiver operating characteristic curve (AUC) value of 0.786, and was obtained as the Rad-Score model, while the XGB performed the worst (AUC, 0.615). In multivariate analysis, independent risk factor for high Ki-67 status was age (odds ratio [OR] = 0.97, p = 0.04). The nomogram model based on the age and Rad-Score had a slightly higher AUC than that of Rad-Score model (AUC, 0.808 vs. 0.798) in the test set, but no statistical difference (p = 0.144, DeLong test). The LGOCV yielded a median AUC of 0.793 in the test set.ConclusionsThis study proposed a convenient, clinically useful ultrasound radiomics nomogram model that can be used for the preoperative individualized prediction of the Ki-67 status in patients with BC.

(1) Objective: To evaluate the performance of ultrasound-based radiomics in the preoperative prediction of human epidermal growth factor receptor 2-positive (HER2+) and HER2− breast carcinoma. (2) Methods: Ultrasound images from 309 patients (86 HER2+ cases and 223 HER2− cases) were retrospectively analyzed, of which 216 patients belonged to the training set and 93 patients assigned to the time-independent validation set. The region of interest of the tumors was delineated, and the radiomics features were extracted. Radiomics features underwent dimensionality reduction analyses using the intra-class correlation coefficient (ICC), Mann–Whitney U test, and the least absolute shrinkage and selection operator (LASSO) algorithm. The radiomics score (Rad-score) for each patient was calculated through a linear combination of the nonzero coefficient features. The support vector machine (SVM), K nearest neighbors (KNN), logistic regression (LR), decision tree (DT), random forest (RF), naive Bayes (NB) and XGBoost (XGB) machine learning classifiers were trained to establish prediction models based on the Rad-score. A clinical model based on significant clinical features was also established. In addition, the logistic regression method was used to integrate Rad-score and clinical features to generate the nomogram model. The leave-one-out cross validation (LOOCV) method was used to validate the reliability and stability of the model. (3) Results: Among the seven classifier models, the LR achieved the best performance in the validation set, with an area under the receiver operating characteristic curve (AUC) of 0.786, and was obtained as the Rad-score model, while the RF performed the worst. Tumor size showed a statistical difference between the HER2+ and HER2− groups (p = 0.028). The nomogram model had a slightly higher AUC than the Rad-score model (AUC, 0.788 vs. 0.786), but no statistical difference (Delong test, p = 0.919). The LOOCV method yielded a high median AUC of 0.790 in the validation set. (4) Conclusion: The Rad-score model performs best among the seven classifiers. The nomogram model based on Rad-score and tumor size has slightly better predictive performance than the Rad-score model, and it has the potential to be utilized as a routine modality for preoperatively determining HER2 status in BC patients non-invasively.

Low nuclear grade ductal carcinoma in situ (DCIS) patients can adopt proactive management strategies to avoid unnecessary surgical resection. Different personalized treatment modalities may be selected based on the expression status of molecular markers, which is also predictive of different outcomes and risks of recurrence. DCIS ultrasound findings are mostly non mass lesions, making it difficult to determine boundaries. Currently, studies have shown that models based on deep learning radiomics (DLR) have advantages in automatic recognition of tumor contours. Machine learning models based on clinical imaging features can explain the importance of imaging features. The available ultrasound data of 349 patients with pure DCIS confirmed by surgical pathology [54 low nuclear grade, 175 positive estrogen receptor (ER+), 163 positive progesterone receptor (PR+), and 81 positive human epidermal growth factor receptor 2 (HER2+)] were collected. Radiologists extracted ultrasonographic features of DCIS lesions based on the 5th Edition of Breast Imaging Reporting and Data System (BI-RADS). Patient age and BI-RADS characteristics were used to construct clinical machine learning (CML) models. The RadImageNet pretrained network was used for extracting radiomics features and as an input for DLR modeling. For training and validation datasets, 80% and 20% of the data, respectively, were used. Logistic regression (LR), support vector machine (SVM), random forest (RF), and eXtreme Gradient Boosting (XGBoost) algorithms were performed and compared for the final classification modeling. Each task used the area under the receiver operating characteristic curve (AUC) to evaluate the effectiveness of DLR and CML models. In the training dataset, low nuclear grade, ER+, PR+, and HER2+ DCIS lesions accounted for 19.20%, 65.12%, 61.21%, and 30.19%, respectively; the validation set, they consisted of 19.30%, 62.50%, 57.14%, and 30.91%, respectively. In the DLR models we developed, the best AUC values for identifying features were 0.633 for identifying low nuclear grade, completed by the XGBoost Classifier of ResNet50; 0.618 for identifying ER, completed by the RF Classifier of InceptionV3; 0.755 for identifying PR, completed by the XGBoost Classifier of InceptionV3; and 0.713 for identifying HER2, completed by the LR Classifier of ResNet50. The CML models had better performance than DLR in predicting low nuclear grade, ER+, PR+, and HER2+ DCIS lesions. The best AUC values by classification were as follows: for low nuclear grade by RF classification, AUC: 0.719; for ER+ by XGBoost classification, AUC: 0.761; for PR+ by XGBoost classification, AUC: 0.780; and for HER2+ by RF classification, AUC: 0.723. Based on small-scale datasets, our study showed that the DLR models developed using RadImageNet pretrained network and CML models may help predict low nuclear grade, ER+, PR+, and HER2+ DCIS lesions so that patients benefit from hierarchical and personalized treatment.

Ballistics (the linkage of bullets and cartridge cases to weapons) is a common type of evidence encountered in criminal cases around the world. The interest lies in determining whether two bullets were fired using the same firearm. This paper proposes an automated method to classify bullets from surface topography and Land Engraved Area (LEA) images of the fired pellets using machine and deep learning methods. The curvature of the surface topography was removed using loess fit and features were extracted using Empirical Mode Decomposition (EMD) followed by various entropy measures. The informative features were identified using minimum Redundancy Maximum Relevance (mRMR), finally the classification was performed using Support Vector Machines (SVM), Decision Tree (DT) and Random Forest (RF) classifiers. The results revealed a good predictive performance. In addition, the deep learning model DenseNet121 was used to classify the LEA images. DenseNet121 provided a higher predictive performance than SVM, DT and RF classifiers. Moreover, the Grad-CAM technique was used to visualise the discriminative regions in the LEA images. These results suggest that the proposed deep learning method can be used to expedite the linkage of projectiles to firearms and assist in ballistic examinations.In this work, the bullets that were compared were air pellets fired from both air rifles and a high velocity air pistol. Air guns were used to collect the data because they were more accessible than other firearms and could be used as a proxy, delivering comparable LEAs. The methods developed here can be used as a proof-of-concept and are easily expandable to bullet and cartridge case identification from any weapon.

Research efforts in the prediction of stroke and diabetes prioritize early detection in order to enhance patient outcomes. To achieve this, a variety of methodologies are integrated. Existing studies, on the other hand, are marred by imbalanced datasets, lack of diversity in their datasets, potential bias, and inadequate model comparisons; these flaws underscore the necessity for more comprehensive and inclusive research methodologies. This paper provides a thorough assessment of machine learning algorithms in the context of early detection and diagnosis of stroke and diabetes. The research employed widely used algorithms, including Logistic Regression, Decision Tree, Random Forest, K-Nearest Neighbors (KNN), and XGBoost Classifier, to examine medical data and derive significant findings. The XGBoost Classifier demonstrated superior performance, with an outstanding accuracy, precision, recall, and F1-score of 87.5%. The comparative examination of the algorithms indicated that the Decision Tree, Random Forest, and XGBoost classifiers consistently exhibited strong performance across all measures. The models demonstrated impressive discrimination capabilities, with the XGBoost Classifier and Random Forest reaching accuracy rates of roughly 87.5% and 86.5% respectively. The Decision Tree Classifier exhibited notable performance, with an accuracy rate of 83%. The overall accuracy of the models was evident in the F1-score, a metric that incorporates recall and precision, where the XGBoost model exhibited a marginal improvement of 2% over the Random Forest and Decision Tree models, and 4.25 percent over the last two. The aforementioned results underscore the effectiveness of the XGBoost Classifier, which will be employed as a predictive model in this study, alongside the Random Forest and Decision Tree models, for the accurate identification of stroke and diabetes. Furthermore, combining datasets improves model performance by utilizing relative features. This integrated dataset improves the model's efficiency and creates a resilient and comprehensive prediction model, improving healthcare outcomes. The findings of this research make a valuable contribution to the advancement of AI-driven diagnostic systems, hence enhancing the quality of healthcare decision-making.

Electrocardiogram is a diagnostic tool that makes a record of the muscular and electrical activities of the heart for showing that data as a trace on a piece of paper, which is then carefully studied and interpreted by a clinical assistant. Classification of ECG signals on performance factors like sensitivity, specificity and accuracy using machine learning techniques can provide substantial input to doctors for essential and effective treatment of the patient. Arrhythmia refers to the condition when the heart beats improperly. Irregular, fast or slow beating of heart comes under arrhythmia. It is caused due to improper working of electrical impulses of the heart. In this research work, various machine learning techniques were made use for the purpose of classification of normal and arrhythmic beats. The major objective of this work is automated classification of normal and irregular beats. Introduced approach deals with a good volume of standard ECG time-series data as inputs to various machine learning classifiers such as Naive Bayes, support vector machine, ada-boost, random forest, decision tree and k-nearest neighbor classifiers. MIT-BIH arrhythmia database has been made use for the purpose of examining the best classification performance, and one of the most popular datasets of the same database has been taken for training and testing purposes. This comprises of an exact 47 records of thirty minutes each and forty percent of the entire records were those of cardiac patients. Three major performance evaluation parameters have been examined by the researchers on distinct machine learning algorithms. They are accuracy, sensitivity and specificity. A confusion matrix has been made use for describing all these measurements as false positive [FP], false negative [FN], true positive [TP] and true negative [TN]. The efficiency and potential of different methods of arrhythmia detection are demonstrated, and numerous comparisons with various other conventional machine learning techniques are also made. The researchers calculated the sensitivity, specificity and accuracy and found the best result using decision tree classifier with 88.2% accuracy.

Optical image provides a unique spectral and textural opportunity to acquire data free of charge in cloud-free weather conditions. However, textural information from recent Sentinel-2A data has not been sufficiently recognized. Several researches have shown that texture features are essential for extracting crop information. This study presents a new scheme that integrates spectral bands and textural features for mapping maize fields and other land cover types (i.e., build-up, trees, others, and water) and evaluates the effectiveness of random forest (RF) and support vector machine (SVM) classifiers with different kernel functions based on Sentinel 2A (S-2A) data. The textural features were derived from multiple bands of S-2A image using a grey-level co-occurrence matrix (GLCM) algorithm. To normalize the analysis of these features, Random Forest feature selection was employed. The outcomes show that S-2A images are appropriate for mapping maize fields and other land covers when the image is accessible during the growing season. The SVM classifier with a radial basis function (RBF) kernel is superior to a polynomial (P), linear (L), and sigmoid (S) kernel functions, and the RF classifiers. For the SVM_RBF, the highest overall accuracy was obtained from the integration of spectral bands and textural features at scenario 2 SVM_RBF (87.40%), followed by the combination of spectral and textural features at scenario 2 SVM_P kernel (86.56%). However, scenario 5 SVM_P kernel (85.54%), scenario 4 SVM_P kernel function (85.30%), the spectral features alone, and the SVM_P kernel function, have the highest O/A (83.90%) than that of the SVM_RBF (83.66%). The inclusion of textural features contributed significantly in mapping the smallholder’s maize field in the study area. This demonstrated the value of S-2A in agricultural research.

Online games are hazardous to one's health and well-being. Addiction to video games has now become a concern to Bangladeshi youth. Our lives are negatively impacted by online gaming. We must keep an eye on our country's youth to ensure that they do not become addicted to any kind of internet gaming. We must refrain from playing games in order to avoid being hooked on them. Machine learning will be used to forecast the likelihood of becoming addicted to video games. We begin by reviewing relevant studies, journals, and internet publications, and then we speak with online gaming addictions. We discovered certain common elements that are linked to gaming addiction and Lemmen’s gaming addiction scale to measure the whether a person is addicted or not. Then, based on those criteria, such as age, gender, mental pressure, and so on, we collect data. We gather information from both addicts and nonaddicts. There are two possible outcomes: We processed all of the data once it was collected and developed a processed dataset. On our processed dataset, we used machine learning techniques. In different predictions and detection systems, machine learning, artificial intelligence and deep learning are applied. KNN (K-Nearest Neighbor), LR (Logistic Regression), Support Vector Machine (SVM), Gaussian Naive Bayes (GNB), Random Forest (RF), Adaptive Boosting (ADA Boosting), Decision Tree (DT), XGBOOST and Gradient Boosting (GB) classifier are some of the methods we utilize. Adaptive Boosting outperformed the other nine methods in our study. All the nine classifiers predict with high accuracy and among them, Adaptive Boosting (ADA Boosting) gives the maximum accuracy which is 93.00%.

Background: Mammography is commonly utilised for the detection of breast cancer, but it has some drawbacks like inaccurate findings. There is a good possibility of improvements in diagnostic accuracy by ML algorithms. Preventive healthcare requires early cervical cancer screening. Machine learning techniques are used in a variety of ways to analyse data on breast cancer. This study evaluated RF and SVM models for early identification of breast cancer. The results can potentially be improved by the use of comparative analysis. It is necessary to consider the significant contribution of screening programs of cancers. The results obtained in this paper can be utilized as a reference to enhance healthcare policy. Finally, a faster and more accurate detection of cancer can save lives. Method: This research presents computational machine learning (ML) experiments to improve the detection accuracy of breast cancer. It proposes two computational algorithms: RF and SVM to measure the precision of breast cancer prediction. The WDBC dataset is taken as input for analysis. It consists of 569 cases and 30 patient features. Typical data preparation methods include the division of training and testing datasets and normalising the data. The Python language is used to create a Random Forest (RF) classifier and a Support Vector Machine (SVM) algorithm. The model’s hyperparameters are done using grid search and cross-validation methods. The models are evaluated by performance indicators. Results: RF classifier attained an accuracy rate of 96%, which confirms its position as an essential tool for the early identification of diseases. The SVM classifier was able to obtain an overall accuracy of 95%, which also indicates significant potential for early detection techniques. Finally, the findings reveal RF and SVM are equally useful in the early diagnosis of breast cancer. Each approach has specific advantages and disadvantages.

Chapter 10 - Oil spill detection using optical remote sensing images and machine learning approaches (case study: Persian Gulf)

The goal of this research is to apply machine learning techniques to forecast a student’s probability of being accepted into a graduate program. Applicants’ GRE and TOEFL grades, university rankings, letters of recommendation, statements of purpose, cumulative grade point averages, and prior research experience are all included in the dataset utilized for this analysis. The goal is to calculate an applicant’s expected acceptance rate. This study uses a combination of Classifiers and regressors. Different prediction models are contrasted in this study: Random Forest Classifier (RFC), Decision Tree Classifier (DTC), K-Neighbors Classifier (KNC), Support Vector Classifier (SVC), Gradient Boosting Classifier (GBC), Logistic regression (LR), Support vector Regressor (SVR), Random Forest Regressor(RFR), Gradient Boosting Regressor(GBR) and Decision Tree Regressor(DTR). Using these characteristics, the models are trained and evaluated. Evaluation criteria such as accuracy, kappa value, AUC-ROC, and confusion matrix are used to find the models’ effectiveness. In order to determine which model performed the best, the assessment results are compared with one another. Based on study findings, the Gradient Boosting Classifier outperforms the other models tested by a significant margin (96 per cent). This model’s AUC-ROC of 0.97 indicates it does a decent job at separating the positive and negative categories.