Diabetes Mellitus Prediction Using Ensemble Machine Learning Techniques

We often develop many applications based on datasets. In case of high dimensional dataset, we face some problems while building any data mining model. When there are too many attributes in the dataset, then there may be dependency between attributes. There may be some irrelevant attributes too. Because of the influence of the dependent and irrelevant attributes, we get less accuracy in the data mining process. To overcome this problem, we need to reduce the dimensions of the dataset. In this work, we experimentally tested influence of dimension reduction on classification problems. For this purpose, we used four different datasets. We used backward elimination method to reduce the dimension of the dataset down to seven dimensions. We have experimented with Multi-layer Perceptron, Naive Bayes, Decision Tree, Random Forest, K-Nearest Neighbor, and Support Vector Machine classification methods. We used 10-fold validation to train and test our dataset. Experimental results show that when the dimension is reduced, then the accuracy is improved for some classification algorithms like Multi-layer Perceptron, Naive Bayes, and Random Forest. Our general finding is that if we exclude the less significant and irrelevant attributes, then the classification model gives better accuracy than it does without dimension reduction.

Nowadays, the Structural Building Health Damage Monitoring System (SBHDMS) is a crucial technology for predicting the civil building structures' health. SBHDMS contains abnormal changes in the buildings in terms of damage levels. Natural Disasters like Earthquakes, Floods, and cyclones affect the unusual changes in the buildings. If the building undergoes any natural disaster, the sensors capture the vibration data or change the buildings' structure. Due to the vibration data, these unusual changes can be analyzed. Here sensors or Machine Learning based Building Damage Prediction (MLBDP) are used for capturing and collecting the vibration data. This paper proposes a Novel Rough Set based Artificial Neural Network with Support Vector Machine (RAS) metaheuristic method. RAS method is used to predict the damaged building's vibration data levels captured by the sensors. For the feature reduction subset, we use one of the essential pre-processing method called the Rough set theory (RST) strategy. RAS has two contributions. The first one is the Support Vector Machine (SVM) classification method used for identifying the structures of the buildings. The artificial Neural Network (ANN) method used to predict the buildings' damage levels is the second contribution. The proposed method (RAS) is accurately predicting the conditions of the construction building structure and predicting the damage levels, without human intervention. Comparing the results states that the proposed method accuracy is better than SVM's classification methods, ANN. The prediction analysis depicts that the RAS method can effectively detect the damage levels.

EMU(Electric Multiple Units) maintenance platform is one of the key equipments of the motor Train base and EMU application, provides convenient for EMU daily maintenance and inspection, maintenance and repair. In the process design of the equipment, hydraulic crossover and other methods are adopted to meet the needs of the maintenance personnel on different types of EMUs. Therefore, the tipping boards are set up on the actual platform and protection network to ensure the safety of the workers' reaching the top. The EMUs usually use a four line storehouse, and the number of tipping plates is hundreds of them. Most of them are reversing / receiving by cylinder driving, and a large number of flip plates are distributed in the workshop. Besides, the state of the retractable boards and the faults have important influence on the operation. Therefore, it is very important to monitor the state of the flip plate. At present, it is more dependent on the monitoring and controlling system of the mechanical stroke switch in China. Due to the state of the hardware and the stability of the system, the method has the risk of omission and false alarm in some cases. Meanwhile, the switch signal can not directly display the real-time state of the tipping board. Therefore, the present invention provides a high-definition network camera image processing board state detection system based on double plate state real-time monitoring and detection, enhance the safety of EMU maintenance platform. The real-time image acquisition, calculating the specified texture information area gray co-occurrence matrix, generating feature vector descriptor, using support vector machine (SVM) classification method for feature vector classification, training classifier, and use the classifier to recognize the flap, and locate the flap position. And SVM is a novel method of machine learning evolving from statistics. SVM presents many own advantages in solving machine learning problems such as small samples, nonlinearity and high dimension. In this paper, the image texture SVM classification method construct feature vectors through the extraction of image gray level co-occurrence matrix texture information.The metioned texture imformation include gray-level co-occurrence matrix energy, contrast and entropy. And the gray level co-occurrence matrix reflects the image direction, adjacent interval and the change in value of integrated information.The results show that the image texture SVM classification method can effectively combine the method of template matching for the identification of condition detection of overhaul platform.

Analysis of Devanur and Manamedu Ophiolite Complexes in SGT, India: A detailed examination employing remote sensing techniques and Laboratory Spectral Signature investigations

Abstract. This study exploited the multispectral Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) and Landsat 8 Operational Land Imager (OLI) data in order to map lithological units and structural map in the south High Atlas of Marrakech. The method of analysis was used by principal component analysis (PCA), band ratios (BR), Minimum noise fraction (MNF) transformation. We performed a Support Vector Machine (SVM) classification method to allow the joint use of geomorphic features, textures and multispectral data of the Advanced Space-borne Thermal Emission and Reflection radiometer (ASTER) satellite. SVM based on ground truth in addition to the results of PCA and BR show an excellent correlation with the existing geological map of the study area. Consequently, the methodology proposed demonstrates a high potential of ASTER and Landsat 8 OLI data in lithological units discrimination. The application of the SVM methods on ASTER and Landsat satellite data show that these can be used as a powerful tool to explore and improve lithological mapping in mountainous semi-arid, the overall classification accuracy of Landsat8 OLI data is 97.28% and the Kappa Coefficient is 0.97. The overall classification accuracy of ASTER using nine bands (VNIR-SWIR) is 74.88% and the Kappa Coefficient is 0.71.

Insurance Administration Organization, which can be used by all people. However, this organization has received various criticisms from the public through social media, namely Twitter. This study aims to analyze public sentiment about the Indonesian Social Insurance Administration Organization on Twitter. The method used in this research is the Naive Bayes Classifier (NBC) method and uses the Support Vector Machine (SVM) method as a comparison. The amount of data used was 12,990 tweets with a data collection period from September 14, 2019 - February 18, 2020. The study compared the two classifier models built, namely the classifier model with two sentiment classes and four sentiment classes. The accuracy results show that the SVM method has a better accuracy value than the NBC method. SVM has an accuracy value of 63.60% and 82.77% for the two sentiment classes in the four sentiment classifier model. The tweet classification results show that the public's conversation about the Indonesian Social Insurance Administration Organization on Twitter has a negative polarity value tendency.

Kernel Principal Component Analysis (KPCA) is a widely used technique in the dimension reduction, de-noising and discovering nonlinear intrinsic dimensions of data set. In this paper we describe a reweighing kernel-based classification method for improving recognition problem. Firstly, we map the training samples to the feature space by non-linear transformation, and then perform principal component analysis(PCA) using the selected kernel function in the feature space, and get the linear representation of testing samples in the feature space. Secondly, by using the idea of reweighting, we select the similarity between testing sample and each training sample as the weight of reweighting, then take the final weight as the criteria of classification. The experimental results demonstrate that our method is more accurate than Support Vector Machine (SVM) classification method and Linear Discriminant Analysis (LDA) classification. In addition, the number of training samples that our method need is much smaller than some other methods.

Background/Objectives: Recent studies emphasized on using ensemble models over single ones to solve credit scoring problems. The objective of this study is to build a heterogeneous ensemble classifier model with an improved classification accuracy. Methods: This study focuses on developing a heterogeneous ensemble classifier using Logistic Regression, K-nearest neighbor, Decision tree, Random Forest, Naïve Base and Support vector machine as base classifiers and Random Forest, Logistic Regression and Support vector machine as meta-classifiers. The proposed model is built using these six base classifiers for ensemble aggregation. A feature selection algorithm based on the random forest technique is used for selecting the best features. A stacking and voting method are used for building ensemble model. Findings: The ensemble classifier gives superior predictive performance than single classifiers SVM, DT, RF, NB, KNN and LR with an accuracy of 91.56% for Australian dataset and 84.35% for German dataset. Novelty: The proposed model uses stacking and majority voting method for ensemble classification. Initially, stacking is applied to the base classifiers. This is done in two levels. First the training dataset is split into 10 folds for cross validation. The output of each classifier is taken, and the dataset is updated with the meta-features. In the second level, three meta-classifiers (MC), namely LR, SVM and RF are used. Majority voting is applied to the output of these meta-classifiers for the prediction. Keywords: Credit scoring; ensemble model; SVM; DT; RF; NB; KNN; LR

Plastic waste has become one of Indonesia’s most urgent environmental concerns, as the country is still among the biggest contributors to global plastic pollution. Although many digital-based solutions have been introduced to resolve this issue, adoption in daily practice remains relatively low. This study examines public sentiment towards a plastic waste management application disguised as the ‘ $\mathbf{P}$ ‘ Application by conducting sentiment analysis on $\mathbf{7 2 6}$ user reviews, collected through data mining from digital distribution platforms for Android-based applications. Sentiment analysis was conducted using the Support Vector Machine (SVM) and Random Forest (RF) classification methods, and SMOTE was then used to address data imbalance. In addition, TF-IDF (Term Frequency-Inverse Document Frequency) with division ratio of 70:30 also assisted in the word representation process, Confusion Matrix and AUC-ROC (Area Under the Receiver Operating Characteristic Curve) were also used to evaluate the performance and explain the contribution of each classification model. The results showed that, after applying SMOTE, Random Forest achieved $86 \%$ accuracy and a 0.93 F1-score, slightly higher than SVM ($84 \%, 0.92$), indicating stable and consistent classification performance. Sentiment analysis showed that most users gave positive feedback to the ‘ P ‘ Application, reflecting strong public support for the application’s role in facilitating recycling and environmentally friendly actions.

This paper investigates whether the combination of airborne hyperspectral imagery (Aisa EAGLE II) and image classification methods (MLC, SVM) using feature extraction can discriminate among species and clones of energy trees. The trees examined have similar morphological traits due to limitation of detection. The image classification was applied on a spectrally selected and transformed (PCA, MNF) dataset. A binary tree SVM classifier was developed in accordance with the principle of SVM, based on the Jeffries-Matusita (JM) separability measure of selected classes. The adaptive binary tree SVM on MNF-transformed dataset provided more accurate results than applied MLC and multiclass SVM methods. The primary outcome of this study was a comparison of support vector machines (SVM) classification methods to evaluate species or clones of energy plants. In this paper, an adaptive binary tree SVM classifier (ABTSVM) is proposed to increase the accuracy of subspecies level.

This paper presents a video shot boundary detection system based on support vector machine (SVM) classification method. A hardware fully-parallel digital Support Vector Machine (SVM) classifier is used to detect the shot boundary in a continuous video stream. The throughput is increased by employing a pipelined architecture in the feature extraction stage. Hardware SVM can detect both cut and gradual transition in the video stream. Random pseudo-sampling techniques are employed to solve the class imbalance problem in SVM training. The internal wordlength is optimized for performance and hardware complexity. The threshold method in the postprocessing stage merges small subshots to reduce false alarms. The complete system is demonstrated on Xilinx Virtex IV XC4VSX35 FPGA platform to achieve 256 frames per second.

A cooperative blind spectrum detection with the Doolittle decomposition and support vector machine (SVM) classification is proposed to improve the performance and reduce the complexity and latency of spectrum detection in hybrid Geostationary Earth Orbit and Low Earth Orbit (GEO-LEO) satellite constellation networks. First, a principal component analysis (PCA) algorithm is adopted to process perceive signals. Second, the maximum-to-minimum eigenvalue ratio of a covariance matrix is utilized to construct statistics with self-learning ability by using the Doolittle decomposition. Third, primary user and noise signals are labeled with “+1” and “$-$1” as training labels, respectively. Finally, a high-performance PCA-SVM classification is generated by training the labels and the corresponding statistics. Innovations mainly include the Doolittle decomposition of the covariance matrix in the SVM and the PCA to preprocess the perceived signals. Simulation results show that the detection probability of the proposed scheme outperforms the energy detection and the SVM algorithm by 55 and 15% at a signal-to-noise ratio (SNR) of $-$15 dB, respectively. The average error probability of the proposed scheme is 20% lower than that of the SVM at an SNR of $-$20 dB. Therefore, in hybrid GEO-LEO satellite constellation networks, the cooperative blind spectrum detection with the Doolittle decomposition and SVM classification can detect the spectrum with low complexity and high performance effectively.

Based on hierarchical clustering and re-sampling,this paper presented a Support Vector Machine(SVM) classification method for large-scale data,which combined supervised learning with unsupervised learning.The proposed method first used k-means cluster analytical technology to partition dataset into several subsets.Then,the method clustered class by class for each subset and selected samples in each clustering center neighborhood to form candidate training datasets.Last,the method applied SVM to train and model for candidate training datasets.The experimental results show that the proposed method can substantially reduce SVM learning cost.Meanwhile,the proposed method has better classification accuracy than random re-sampling method,and can attain about the same classification accuracy of the non-sampling method.

A detection method of typical toxic mixed red tide algae in Qinhuangdao based on three-dimensional fluorescence spectroscopy

Accurate and efficient disease diagnosis plays a crucial role in healthcare. This study proposes a novel approach to enhance disease diagnosis performance by combining bagging and Teaching-Learning-Based Optimization (TLBO). The objective is to develop an optimized ensemble model that leverages the strengths of multiple base classifiers to improve diagnostic accuracy. The proposed methodology involves several key steps. TLBO optimization process is employed to dynamically select the most informative instances (bags) from the training data. The optimization process iteratively refines the bags by considering the fitness of each ensemble model constructed using different base classifiers. The soundness of an ensemble model is evaluated based on its accuracy in predicting the target variable. To further enhance the performance of the base classifiers, hyperparameter tuning using grid search is incorporated into the model training process. This ensures that each base classifier is optimized with the best set of hyperparameters, leading to more accurate predictions. The optimized bags are then used to train the base classifiers, which include Decision Tree (DT), K-Nearest Neighbors (KNN), Support Vector Machines (SVM), and Gaussian Naive Bayes (GNB). The base classifiers are combined into ensemble models using a Voting Classifier, allowing them to complement each other’s strengths and improve overall prediction performance. The results indicate that the TLBO-optimized ensemble models outperform individual base classifiers and traditional ensemble methods. The diversity among classifiers plays a crucial role in influencing the performance of ensemble models, especially in the context of disease diagnosis. Evaluating dissimilarity measures between classifiers becomes a key strategy in disease diagnosis. The dynamically selected bags contribute to improved accuracy, as they contain the most relevant instances for disease diagnosis and also explore computation time and diversity proposed ensemble approach on disease datasets.