Modified Bat Algorithm for Feature Selection with the Wisconsin Diagnosis Breast Cancer (WDBC) Dataset

Breast cancer has been one of the leading causes of death among women in the world. Early detection of this disease can save patient’s lives and reduce mortality. Due to the large number of features involved in the diagnosis of this disease, the breast cancer diagnosis process can be time consuming. To reduce cost and time and improving accuracy of breast cancer diagnosis, this paper propose a feature selection algorithm based on particle swarm optimization (PSO) combined with machine learning methods for selection the most effective features for breast cancer diagnosis among all features. In order to evaluate the efficiency of the proposed feature selection method, it was tested on three most common breast cancer datasets available in the University of California, Irvine (UCI) repository named: Coimbra dataset (CD), Wisconsin Diagnostic Breast Cancer dataset (WDBC) and Wisconsin Prognostic Breast Cancer dataset (WPBC). In the Coimbra dataset with all its 9 features and without PSO feature selection algorithm the highest obtained accuracy was 87% by Support Vector Machine method, while with PSO feature selection algorithm the accuracy reached to 91% and the number of features was reduced from 9 to 4. In the WDBC dataset with all its 30 features and without PSO feature selection algorithm the highest obtained accuracy was 99% by Random Forest method, while with PSO feature selection algorithm the accuracy reached to 100% and the number of features was reduced from 30 to 19. In the WPBC dataset with all its 33 features and without PSO feature selection algorithm the highest obtained accuracy was 94% by Support Vector Machine method, while with PSO feature selection algorithm the accuracy reached to 96% and the number of features was reduced from 33 to 17. The results of this paper indicated that the proposed feature selection algorithm based on PSO algorithm can improve the accuracy of breast cancer diagnosis. While it has selected fewer and more effective features than the total number of features in the original datasets.

This study aimed to forecast the daily reference evapotranspiration (ETo) using a gene-expression programming (GEP) algorithm with limited public weather forecast information over Gaoyou station, located in Jiangsu province, China. To calibrate and validate the gene-expression code, important meteorological data and weather forecast information were collected from the local meteorological station and public weather media, respectively. The GEP algebraic formulation was successfully constructed based only on daily minimum and maximum air temperature using the true FAO56 Penman-Monteith (PM) set as reference values. The performance of the models was then assessed using the correlation coefficient (R), root mean squared error (RMSE), root relative squared error (RRSE) and mean absolute error (MAE). The study demonstrated that GEP is able to calibrate ETo (all errors ≤0.990 mm/day, R = 0.832–0.866) and forecast the daily ETo with good accuracy (RMSE = 1.207 mm/day, MAE = 0.902 mm/day, RRSE = 0.629 mm/day, R = 0.777). The model accuracies slightly decreased over a 7-day forecast lead-time. These results suggest that the GEP algorithm can be considered as a deployable tool for ETo forecast to anticipate decision on short-term irrigation schedule in the study zone.

Breast Cancer (BC) is the second most common cancer in women after skin cancer and has become a major health issue. As a result, it is very important to diagnose BC correctly and categorizing the tumors into malignant or benign groups. We know that Machine Learning (ML) techniques have unique advantages and that is why they are widely used to analyze complex BC dataset and predict the disease. Wisconsin Diagnosis Breast Cancer (WDBC) dataset has been used to develop predictive models for BC by researchers in this field. The dataset has 573 instances and 32 features. In this paper, we have proposed a method for analyzing and predicting BC on the same dataset using Apache Spark. This big data framework is a very powerful tool for working on huge volume of data, such as healthcare data [4]. Principle Component Analysis (PCA) has been applied on the dataset for selecting the most important features. We have run experiments with top 6 and 10 features. The experiments are executed on Hadoop cluster, a cloud platform provided by the Electrical Engineering and Computer Science (EECS) department of University of Cincinnati. We have also made a comparison between the performance of different machine learning techniques: Decision Tree and Random Forest Classifier. We have set the performance of Decision Tree with top 10 features as a benchmark in our work. Random forest Classifier performs better than Decision Tree algorithm with top 6 as well as top 10 features. Random Forest achieves 97.52 % accuracy using top 10 features. Our results show that selecting the right features significantly improves accuracy in predicting BC.

In the present state of affairs, the motive behind every educational organization is to uplift the academic achievement of students. Educational data mining (EDM) is an upward field of research, and it is very helpful for academic institutions to predict the academic performance of the students. Educational datasets are the basis of various predictive models. Quality of these models can be improved by using feature selection (FS). To get the required benefits from the available data, there must be some tools for analysis and prediction. In lieu of the above, machine learning/data mining are most suitable. In educational data mining, for better accuracy of prediction models’ and quality of various educational datasets, feature selection (FS) plays a vital role. Feature selection (FS) algorithms abolish inappropriate information from the repositories of educational background so that performance of classifier in terms of accuracy could be increased and the same could be used for better decision. In lieu of the above, a best feature selection algorithm must be selected. In this paper, two filter selection approaches namely correlation feature selection (CFS) and wrapper-based feature selection have been used to demonstrate the importance of selection of a feature subset for a classification problem. The present paper aims to find the detailed investigation of filter feature selection algorithms along with the classification algorithms on a given dataset. We found result with numerous numbers of features from various Feature selection algorithms and classifiers which will help the researcher to discover the most excellent mixture of filter feature selection algorithms and its associated classifiers. The result indicates that SMO and J48 have the highest accuracy measures with the correlation feature selection algorithms, while Naïve Bayes has the highest accuracy measures with the wrapper subset feature selection algorithms for predicting high, medium and low grade for the students.

Breast cancer has proven to be a serious disease caused in women according to medical science. This study focuses on prediction of breast cancer in three different datasets, namely: Wisconsin breast cancer (WBC), Wisconsin Diagnosis Breast Cancer (WDBC) and Wisconsin Prognosis Breast Cancer (WPBC) datasets. The comparative study has been done between evolutionary algorithms and machine learning algorithms. Evolutionary algorithms include Particle Swam Optimization (CPSO) and Genetic Algorithm for Neural Network (GANN) whereas machine learning algorithms include KNN and C4.5 for predicting the breast cancer. The results are obtained after performing the experiment on different algorithms on the basis of their accuracy and standard deviation which may help people in medical science for better prediction of their disease and hence enabling appropriate treatment.

Energy-saving design is becoming a trending topic and top-priority over the past decades due to high energy costs, limited available resources and growing urban development. Buildings are alluded to as the major contributors of energy consumption and environmental emissions across the globe. This calls for the development of precise forecasting models of energy consumption and carbon emissions. Hence, this research paper harnesses the implementation of several contemporary metaheuristics to accurately project heating and cooling energy (HEN and CEN) in residential buildings. In this respect, black widow optimization, dandelion optimization, dingo optimization, sparrow search, and red-tailed hawk optimization are among the studied metaheuristics in this research study. The prediction accuracies of the developed models are assessed stepping on the measures of i) relative absolute error (RAE), ii) mean absolute error (MAE), iii) mean absolute percentage error (MAPE), iv) root mean squared error (RMSE) and v) Nash-Sutcliffe efficiency (NSE). It is shown that the developed red-tailed hawk optimization-based model succeeded in accomplishing the most precise results of HEN and CEN. In this context, it predicted HEN with RAE (0.201), MAE (1.838), MAPE (7.626%), RMSE (2.826), and NSE (0.921). Besides, it anticipated CEN with RAE (0.234), MAE (2.009), MAPE (7.519%), RMSE (3.246), and NSE (0.883). It can be argued that this research study could benefit architects and designers in creating more energy-efficient buildings at an early stage.

Emerging wireless sensor networking (WSN) and modern machine learning techniques have encouraged interest in the development of vehicle health monitoring (VHM) systems that ensure secure and reliable operation of the rail vehicle. The performance of rail vehicles running on railway tracks is governed by the dynamic behaviours of railway bogies especially in the cases of lateral instability and track irregularities. In order to ensure safety and reliability of railway in this chapter, a forecasting model has been developed to investigate vertical acceleration behaviour of railway wagons attached to a moving locomotive using modern machine learning techniques. Initially, an energy-efficient data acquisition model has been proposed for WSN applications using popular learning algorithms. Later, a prediction model has been developed to investigate both front and rear body vertical acceleration behaviour. Different types of models can be built using a uniform platform to evaluate their performances and estimate different attributes’ correlation coefficient (CC), root mean square error (RMSE), mean absolute error (MAE), root relative squared error (RRSE), relative absolute error (RAE) and computation complexity for each of the algorithm. Finally, spectral analysis of front and rear body vertical condition is produced from the predicted data using Fast Fourier Transform (FFT) and used to generate precautionary signals and system status which can be used by the locomotive driver for deciding upon necessary actions.

In this article, a comparison study of three artificial intelligence (AI) techniques for energy consumption estimation are presented. The models considered are: multilayer perceptron (MLP); radial basis function (RBF) and support vector machine (SVM). The energy consumption is modeled as a function of activity, structural and intensity changes. The models are applied to Canadian industrial manufacturing data from 1990 to 2000. Comparisons were based on Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), Relative Absolute Error (RAE), Root Relative Square Error (RRSE) as well as Simulation Time. The best results were obtained for the Multilayer Perceptron.

This paper presents development of an artificial intelligence (AI)‐based model, genetic expression programming (GEP) to predict long‐term streamflow using large‐scale climate drivers as predictors. GEP is chosen over artificial neural networks (ANNs) model, as ANN is a black‐box model, whereas GEP is able to explain the developed forecast models with mathematical expressions. As a case study, 12 streamflow measuring stations were selected from four different regions of New South Wales (NSW) in eastern Australia. A number of climate indices, Pacific Decadal Oscillation (PDO), Indian Ocean Dipole (IOD), El Nino Southern Oscillation (ENSO) and ENSO Modoki index (EMI), were selected as candidate predictors based on the findings of some preliminary studies. Higher predictabilities of the GEP‐based models are evident from the Pearson correlation (r) values ranging between 0.57 and 0.97, which are mostly about twice the values achieved by multiple linear regression (MLR) models in the preliminary study. Performances of the developed models were assessed using standard statistical measures such as root relative squared error (RRSE), relative absolute error (RAE), root mean square error (RMSE), mean absolute error (MAE), Nash–Sutcliffe efficiency (NSE) and Pearson correlation (r) values. The developed models are able to predict spring streamflow up to 5 months in advance with significantly high correlation values.

Food production in India is largely dependent on cereal crops including rice, wheat and various pulses. The sustainability and productivity of rice growing areas is dependent on suitable climatic conditions. Variability in seasonal climate conditions can have detrimental effect, with incidents of drought reducing production. Developing better techniques to predict crop productivity in different climatic conditions can assist farmer and other stakeholders in better decision making in terms of agronomy and crop choice. Machine learning techniques can be used to improve prediction of crop yield under different climatic scenarios. This paper presents the review on use of such machine learning technique for Indian rice cropping areas. This paper discusses the experimental results obtained by applying SMO classifier using the WEKA tool on the dataset of 27 districts of Maharashtra state, India. The dataset considered for the rice crop yield prediction was sourced from publicly available Indian Government records. The parameters considered for the study were precipitation, minimum temperature, average temperature, maximum temperature and reference crop evapotranspiration, area, production and yield for the Kharif season (June to November) for the years 1998 to 2002. For the present study the mean absolute error (MAE), root mean squared error (RMSE), relative absolute error (RAE) and root relative squared error (RRSE) were calculated. The experimental results showed that the performance of other techniques on the same dataset was much better compared to SMO.

Although breast cancer, with easy recurrence and high mortality, has become one of the leading causes of cancer death in women, early and accurate diagnosis of breast cancer can effectively increase the likelihood of a cure. Therefore, it is particularly important to improve the accuracy of early diagnosis of breast cancer. However, conventional early diagnosis relies on human experience and has a low accuracy rate. Therefore, many researchers have proposed various machine learning methods to improve the accuracy and efficiency of prediction. Most of the existing studies around breast cancer classification adopt a single algorithm to fit breast cancer data but ignore the applicability of different breast cancer data features to the model. In this paper, we adopt machine algorithms to strip the features of machine learning methods from the rest of the features and attempt to enhance the model effect by designing deep learning model structures to find the hidden patterns in the rest of the features. In addition, due to strict medical data privacy requirements and high collection difficulty and cost, the model designed in this paper will be trained on a small number of samples. As a result, we attempt to find a minimization model for a breast cancer classification algorithm that features both low cost and high efficiency. At the same time, the deep learning model is further designed to complement the original model when it is possible to introduce complex data indicators. Experimental values show that the design model in this paper performs best not only under limited data and limited indicators but also under limited data complex indicators, demonstrating the effectiveness of the approach of mixed comparison and feature selection of multiple classification algorithms. In summary, the fusion model designed and implemented in this paper performs well in the experiments, and the accuracy of the model test reaches 98.3%.

Data mining is a technique to extracts some meaningful information from large amount of data. Nowadays In healthcare sector data mining is come out important field from all the fields for providing accurate prediction of diseases and deeper study of medical data. Authors are using different data mining techniques to identification of various diseases such as stoke, diabetes, cancer, hypothyroid and heart disease etc. This paper discussed the literature study of various data mining techniques in section two. In this paper, we used two disease dataset breast cancer and diabetes dataset from the UCI machine learning repository. We classified the five classification algorithms on WEKA Explorer and WEKA Experimenter interface. WEKA tool is a good classification tool used in this paper. Naïve bayes, SMO, REP Tree, J48 and MLP algorithms are used to classify breast cancer and diabetes dataset on WEKA interface. The performances of these five algorithms have been analyzed on breast cancer and diabetes dataset using training data testing mode. After analyzing the performances of all algorithm, found that naïve bayes gives 72.70%accuracy on breast cancer dataset and SMO gives 76.80%accuracy on diabetes dataset.

Detecting cancer at an early stage is an important application, which reduces the risk of death for a cancerous patient. Data from tissues is generated using microarray DNA technology and these data contains genes/attributes of very large number and samples of relatively small number, making it tough to predict the classifier. Hence, several machine learning algorithms with more emphasis on feature selection were proposed to solve the problem of handling large number of genes/attributes. Most of the feature selection (FS) algorithms mentioned in the literature are Supervised learning algorithms. Authors proposed an Unsupervised feature selection algorithm, making it more independent of the class label. Simple Feature ranking algorithm using Single Value Decomposition (SVD)-Entropy is the first step in the proposed feature selection algorithm. SVD-Entropy based method selects attributes independent of the each other, hence reduces complexity involved in multiple association of attributes in large datasets. At second stage, Correlation among attributes is used to remove attributes/features that are highly correlated to each other. Once the features are selected, a logistic regression model for predicting the class label. The model predicts whether its a cancer or non-cancer causing tissue. The proposed algorithm proved to be an efficient approach in terms of accurately predicting the cancer causing tissues. Experiments were carried on three different datasets like Ovarian, Lung and Breast cancer. The accuracy scores achieved for these datasets are 100, 75 and 96.4 percent, respectively, proving the efficiency of the approach.

Breast cancer ranks among the most prevalent cancers in women globally, with its treatment efficacy heavily reliant on the early identification and diagnosis of the disease. The importance of early detection and diagnosis cannot be overstated in enhancing the survival prospects of those afflicted with breast cancer. With the increasing application of machine learning technology in the medical field, algorithm-based diagnostic tools provide new possibilities for early prediction of breast cancer. In this study, we introduced a novel feature selection approach, which leverages Shapley additive explanation (SHAP) values as the basis for Recursive Feature Elimination (RFE), utilizing a Random Forest (RF) algorithm within the RFE framework. To address the data imbalance challenge, we incorporated Borderline-SMOTE1. The efficacy of the proposed method was assessed using five machine learning models, K-Nearest Neighbor (KNN), Random Forest (RF), Logistic Regression (LR), Support Vector Machine (SVM), and Light Gradient Boosting Machine (LightGBM), applied to the Wisconsin Breast Cancer Diagnosis (WBCD) datasets. Optimizing hyperparameters of five models using the Particle Swarm Optimization (PSO) algorithm. In the datasets, 26 features were filtered using our recommended algorithm, the LightGBM-PSO model demonstrated an outstanding performance. The model demonstrated an impressive accuracy of 99.0% in differentiating between benign and malignant cases, boasting a specificity and precision of 100%, a recall rate of 97.40%, an F-measure of 98.68%, an AUC of 0.9870, and a 10-fold cross-validation accuracy of 0.9808. Subsequently, we developed a corresponding online tool (https://breast-cancer-prediction-tool-cgbjlhkns7yig6bmzvztmc.streamlit.app/) based on this model for predicting the risk of breast cancer. Feature selection using recommended algorithm and optimization of the LightGBM model through PSO can significantly enhance the accuracy of breast cancer prediction. This could potentially improve the prognosis for patients diagnosed with breast cancer.

Reservoir permeability is a crucial parameter for reservoir characterization and the estimation of current and future production from hydrocarbon reservoirs. Permeability can be conventionally estimated from traditional approaches such as core analysis and well-test data, which are time-consuming and expensive. Many scientists tried to estimate permeability from nuclear magnetic resonance (NMR) logs utilizing complex mathematical equations that may achieve imprecise approximation of the permeability values. Gradient boosting generates additive regression models by successively fitting a straightforward base learner to present pseudo-residuals using least squares at every iteration. The execution speed and accuracy of gradient boosting can be considerably enhanced by applying randomization process. Besides, the randomization process improves robustness against over fitting of the base learner. So, the novelty of the current study is the development of a Stochastic Gradient Boosting (SGB) regression model to predict the permeability of petroleum reservoirs based on well logs. Besides benchmark machine learning techniques are used to predict reservoir permeability from well logs. The correlation coefficient (R), relative absolute error (RAE), mean-absolute error (MAE), root mean-squared error (RMSE), and root relative squared error (RRSE) are utilized to check the overall fitting between measured permeability versus predicted ones. It is found that Stochastic Gradient Boosting model achieved overall better performance than the other models.