A Hybrid Swarm and Gravitation-based feature selection algorithm for handwritten Indic script classification problem

Daily physical activity monitoring and recognition have become a big health caring challenge in modern times. Fast recognition of physical activity from wearable sensors dataset with acceptable accuracy has got great research attention. In this paper, we have presented an optimization framework with feature selection techniques. The Bayesian Optimization algorithm has been employed to optimize hyper-parameters of Support Vector Machine(SVM), Random Forest (RF), Extreme Gradient Boosting(XGBoost). Two feature selection algorithms like Fast Correlation Based Filter (FCBF) and Maximum Redundancy Maximum Relevance(mRMR) feature selection have been applied to reduce the size of the extracted feature vector. Classification performances of the two feature selection techniques are compared in terms of accuracy and F1 score. For reduced feature vector the highest acceptable accuracy and F1 score of 95.4% and 94.76% respectively have been achieved by optimized XGBoost classifier with mRMR feature selection. In addition to this, it is shown that reduced computation time with considerable classification performance can be achieved by an efficient feature selection algorithm which is useful for designing a simplified system.

New hybrid data mining model for credit scoring based on feature selection algorithm and ensemble classifiers

India is a multilingual country with 22 official languages and more than 1600 languages in existence. Kannada is one of the official languages and widely used in the state of Karnataka whose population is over 65 million. Kannada is one of the south Indian languages and it stands in the 33rd position among the list of widely spoken languages across the world. However, the survey reveals that much more effort is required to develop a complete Optical Character Recognition (OCR) system. In this direction the present research work throws light on the development of suitable methodology to achieve the goal of developing an OCR. It is noted that the overall accuracy of the OCR system largely depends on the accuracy of the segmentation phase. So it is desirable to have a robust and efficient segmentation method. In this paper, a method has been proposed for proper segmentation of the text to improve the performance of OCR at the later stages. In the proposed method, the segmentation has been done using horizontal projection profile and windowing. The result obtained is passed to the recognition module. The Histogram of Oriented Gradient (HoG) is used for the recognition in combination with the support vector machine (SVM). The result is taken as the feedback and fed to the segmentation module to improve the accuracy. The experimentation is delivered promising results.

With the growth of Internet, there has been a tremendous increases in the number of attacks and therefore Intrusion Detection Systems (IDS’s) has become a main stream of information security. The purpose of IDS is to help the computer systems to deal with attacks. This anomaly detection system creates a database of normal behaviour and deviations from the normal behaviour to trigger during the occurrence of intrusions. Based on the source of data, IDS is classified into Host based IDS and Network based IDS. In network based IDS, the individual packets flowing through the network are analyzed where as in host based IDS the activities on the single computer or host are analyzed. The feature selection used in IDS helps to reduce the classification time. In this paper, the IDS for detecting the attacks effectively has been proposed and implemented. For this purpose, a new feature selection algorithm called Optimal Feature Selection algorithm based on Information Gain Ratio has been proposed and implemented. This feature selection algorithm selects optimal number of features from KDD Cup dataset. In addition, two classification techniques namely Support Vector Machine and Rule Based Classification have been used for effective classification of the data set. This system is very efficient in detecting DoS attacks and effectively reduces the false alarm rate. The proposed feature selection and classification algorithms enhance the performance of the IDS in detecting the attacks.

<span>Handwriting recognition is a growing field of study in computer vision, artificial intelligence and pattern recognition technology aimed to recognizing texts and handwritings of hefty amount of produced official documents and paper works by institutes or governments. Using computer to distinguish and make these documents accessible and approachable is the goal of these efforts. Moreover, recognition of text has accomplished practically a major progress in many domains such as security sector and e-government structure and more. A system for recognition text’s handwriting was presented here relied on edge histogram descriptor (EHD), histogram of orientated gradients (HOG) features extraction and support vector machine (SVM) as a classifier is proposed in this paper. HOG and EHD give an optimal features of the Arabic hand-written text by extracting the directional properties of the text. Besides that, SVM is a most common machine learning classifier that obtaining an essential classification results within various kernel functions. The experimental evaluation is carried out for Arabic handwritten images from IESK-ArDB database using HOG, EHD features and proposed work provides 85% recognition rate.</span>

Ear diseases are characterized by various symptoms, including balance disturbances, delayed speech development in children, headaches, fever, and hearing loss. To prevent further complications, these conditions must be diagnosed and treated promptly. The traditional diagnostic method has been an otoscope examination by otolaryngologists. However, the accuracy of this approach is contingent upon the clinician's expertise and the quality of the equipment used, which can render it susceptible to misdiagnosis. Incorrect diagnoses may result in the administration of antibiotics unnecessarily, disease progression, and other adverse consequences. This study aims to evaluate the efficacy of computationally efficient machine learning models in classifying ear disease images. To enhance classification accuracy, a Histogram of Oriented Gradients (HOG) was employed for feature extraction and optimization algorithms were utilized for feature selection. The Whale Optimization Algorithm (WOA) effectively selected informative features for the k-Nearest Neighbors (kNN) model, achieving a classification accuracy of 92.6%. Furthermore, the Support Vector Machine (SVM) model achieved an accuracy of 92% using a feature map comprising features selected by a range of optimization algorithms. The experimental findings emphasize the potential of strategic feature selection in enhancing the performance of classical machine learning models for ear disease classification. By employing computationally efficient techniques such as HOG and optimization algorithms, these models can attain classification accuracies that are on par with those of more resource-intensive deep learning approaches. Such developments facilitate the creation of accessible and efficient diagnostic tools, particularly beneficial in resource-constrained clinical settings. The findings of this study provide a basis for further research to enhance the diagnostic precision of machine learning-based techniques in medical imaging.

In the present state of affairs, the motive behind every educational organization is to uplift the academic achievement of students. Educational data mining (EDM) is an upward field of research, and it is very helpful for academic institutions to predict the academic performance of the students. Educational datasets are the basis of various predictive models. Quality of these models can be improved by using feature selection (FS). To get the required benefits from the available data, there must be some tools for analysis and prediction. In lieu of the above, machine learning/data mining are most suitable. In educational data mining, for better accuracy of prediction models’ and quality of various educational datasets, feature selection (FS) plays a vital role. Feature selection (FS) algorithms abolish inappropriate information from the repositories of educational background so that performance of classifier in terms of accuracy could be increased and the same could be used for better decision. In lieu of the above, a best feature selection algorithm must be selected. In this paper, two filter selection approaches namely correlation feature selection (CFS) and wrapper-based feature selection have been used to demonstrate the importance of selection of a feature subset for a classification problem. The present paper aims to find the detailed investigation of filter feature selection algorithms along with the classification algorithms on a given dataset. We found result with numerous numbers of features from various Feature selection algorithms and classifiers which will help the researcher to discover the most excellent mixture of filter feature selection algorithms and its associated classifiers. The result indicates that SMO and J48 have the highest accuracy measures with the correlation feature selection algorithms, while Naïve Bayes has the highest accuracy measures with the wrapper subset feature selection algorithms for predicting high, medium and low grade for the students.

<p>Classification aims to identify a class label of an instance according to the information from its characteristics or features. Unfortunately, many classification problems have a large feature set containing irrelevant and redundant features, which reduce the classification performance. In order to address the above problem, feature selection is proposed to select a small subset of relevant features. There are three main types of feature selection methods, i.e. wrapper, embedded and filter approaches. Wrappers use a classification algorithm to evaluate candidate feature subsets. In embedded approaches, the selection process is embedded in the training process of a classification algorithm. Different from the other two approaches, filters do not involve any classification algorithm during the selection process. Feature selection is an important process but it is not an easy task due to its large search space and complex feature interactions. Because of the potential global search ability, Evolutionary Computation (EC), especially Particle Swarm Optimization (PSO), has been widely and successfully applied to feature selection. However, there is potential to improve the effectiveness and efficiency of EC-based feature selection. The overall goal of this thesis is to investigate and improve the capability of EC for feature selection to select small feature subsets while maintaining or even improving the classification performance compared to using all features. Different aspects of feature selection are considered in this thesis such as the number of objectives (single-objective/multi-objective), the fitness function (filter/wrapper), and the searching mechanism. This thesis introduces a new fitness function based on mutual information which is calculated by an estimation approach instead of the traditional counting approach. Results show that the estimation approach works well on both continuous and discrete data. More importantly, mutual information calculated by the estimation approach can capture feature interactions better than the traditional counting approach. This thesis develops a novel binary PSO algorithm, which is the first work to redefine some core concepts of PSO such as velocity and momentum to suit the characteristics of binary search spaces. Experimental results show that the proposed binary PSO algorithm evolve better solutions than other binary EC algorithms when the search spaces are large and complex. Specifically, on feature selection, the proposed binary PSO algorithm can select smaller feature subsets with similar or better classification accuracies, especially when there are a large number of features. This thesis proposes surrogate models for wrapper-based feature selection. The surrogate models use surrogate training sets which are subsets of informative instances selected from the training set. Experimental results show that the proposed surrogate models assist PSO to reduce the computational cost while maintaining or even improving the classification performance compared to using only the original training set. The thesis develops the first wrapper-based multi-objective feature selection algorithm using MOEA/D. A new decomposition strategy using multiple reference points for MOEA/D is designed, which can deal with different characteristics of multi-objective feature selection such as highly discontinuous Pareto fronts and complex relationships between objectives. The experimental results show that the proposed algorithm can evolve more diverse non-dominated sets than other multi-objective algorithms. This thesis introduces the first PSO-based feature selection algorithm for transfer learning. In the proposed algorithm, the fitness function uses classification performance to reduce the differences between domains while maintaining the discriminative ability on the target domain. The experimental results show that the proposed algorithm can select feature subsets which achieve better classification performance than four state-of-the-art feature-based transfer learning algorithms.</p>

In this study, we present the performance of Support Vector Machine (SVM), Convolution Neural Network (CNN), and Artificial Neural Network (ANN) with Bag of Words (BoW), Histogram of Oriented Gradients (HOG), and Image Pixels (IP) for face recognition. SVM, CNN, and ANN are machine learning approaches and has been used for pattern recognition, especially in face recognition technology. BoW, HOG, and IP are being used for image feature extraction. The testing has been conducted from publicly available AT&T face database. Every individual subject consists of 10 images with different facial expression, different illumination and the dimensions of the images is unified as 92-by-112 pixels with PGM formats. SVM achieved recognition accuracy of 97.00%, 96.00%, and 98.00% with subsequently BoW, HOG, and IP. CNN achieved recognition accuracy of 94.00%, 99.00%, and 99.50% with subsequently BoW, HOG, and IP. ANN achieved recognition accuracy of 96.00%, 99.00%, and 99.50% with subsequently BoW, HOG, and IP. The experimental results show that the IP with ANN approach clearly outperformed the others approaches.

A hybrid ensemble-filter wrapper feature selection approach for medical data classification

Existing studies have attempted to determine the tool chipping condition using the indirect method of data capture and intelligent analysis techniques considering machine parameters, and tool conditions using signal processing techniques. Due to the obstructive nature of the machining operation, however, it is daunting to use signal capturing to intelligently capture the condition of the tool as well as that of the workpiece. This study aimed to apply some advanced signal processing techniques to the vibration signals captured experimentally during machining operation for the decision making and analysis of tool and workpiece conditions. Vibration signals were captured during turning operations while using four (4) classes of tools, based on their flank wear. The signals were first pre-processed and decomposed using the Empirical Mode Decomposition (EMD) method. The Hilbert–Huang transform (HHT) was applied to the resulting IMFs obtained to compute the feature vectors used to classify the condition of the tool and workpiece. A total of 12 features, consisting of instantaneous properties such as instantaneous energy, instantaneous frequencies, and amplitudes, were obtained for data training and classification of tool conditions. To optimize the classification process, feature selection was performed using a genetic algorithm (GA) to reduce the number of features from 12 to 4 for data training and classification. The feature vectors were first trained for tool classification with a neural network scaled conjugate gradient (SCG) algorithm. The result showed that the model classification error was 0.102. Two other machine learning models, support vector machine (SVM) and K-Nearest Neighbors (KNN), were also implemented for classifying the tool conditions, from the feature vector, to determine the model that most accurately predicted the condition of the tool. To avoid bias and reduce misclassification errors, the k-fold cross-validation technique was applied with ‘k’ taken as 5 and 10. The computed feature vectors were used as inputs to train the machine learning model using both SVM and KNN models to classify the tool and workpiece condition during machining. The error loss of each model was evaluated and plotted to review the performance. The average overall error loss of 0.5031 was observed for the SVM model with 5-fold cross-validation, whereas the error loss of 0.0318 was observed for the KNN model with 5-fold cross-validation. The average overall error loss of 0.5009 was observed for the SVM model with 10-fold cross-validation when trained using the features selected by a genetic algorithm (GA), while the average overall error loss of 0.0343 was observed for the KNN model. The optimal performance of the SVM model was obtained when all features were used for the training, whereas the KNN model performed better when feature selection was implemented. The error losses of the models were evaluated to be less in KNN models, compared to SVM and SCG. The obtained results also showed that the developed KNN models performed 10 times better than the SVM model in predicting the tool condition from the captured vibration signal during the machining process.

Methods for text segmentation from scene images

We present an offline signature verification system based on a signature's local histogram features. Test signature is divided into zones using both the Cartesian and log polar coordinate systems and histogram of oriented gradients (HOG) is calculated for each zone. Verification is considered as a two-class classification problem and for this purpose, a user independent Support Vector Machine (SVM) model is trained using both genuine and skilled forgery signatures of a completely different set of people than those in the test set. For each feature type, a single SVM model which learns the differences of query and reference signatures' feature vectors, is trained. The fusion of all classifiers, using skilled forgeries as negative test examples, achieves a 24.30% equal error rate in the GPDS-160 signature database, with 5 references.

Histogram of oriented gradient (HOG) feature has been widely used in vehicle detection. In this paper, a modified version of HOG is proposed by introducing compass gradient into the HOG calculation. Three different versions of the modified HOG features are used as an input for linear and nonlinear support vector machine (SVM). The modified HOG variants proved to have better classification performance than that of the standard HOG. The classification results of modified HOG and nonlinear SVM are compared to the classification results of YOLO object detector. Finally, a vehicle detection system based on the best performing classifiers is introduced.

Communication is the ultimate of man’s search for conveying his ideas, emotions, and concepts. Dance is one of the media of communication through which dancers share notion of feelings, with the spectators through gestures, i.e., mudra. Gesture recognition propagates a concept without verbal speech or listening, and in dance recognition, the notion is transferred through various dance poses and actions. This activity in a way really paves way to enhance Indian Sign Language. This study focuses to solve the mudra resemblance in Bharatanatyam through a new system developed with image processing and classification technique using histogram of oriented gradient (HOG) feature extraction techniques and support vector machine (SVM) classifier. SVM classifies the features of HOG into mudras as text labels. Popular feature vectors such as scale-invariant feature transform (SIFT), speed up robust feature (SURF), and local binary pattern (LBP) are hardened against HOG for accuracy and speediness, and this innovative proposed concept is useful for online dance learners.