Enhancing Sundanese News Articles Classification: A Comparative Study of Models and Feature Extraction Techniques

Text classification is the automated technique used to classify text into a predefined category that is more related to text. Most studies and researches have focused on classification texts written in English rather than Arabic because of the Arabic nature and difficulty of its structures. The difficult nature of Arabic makes it more complex and difficult to deal with because of its many rules and characteristics that are unique to it, but it has become necessary to deal with this language because of its widespread use on the internet. Feature representation and extraction, especially for text, have attracted considerable attention in recent years. The main object of this process is to convert text into a numerical representation. All approaches and systems depend on the frequency of words within text, but these approaches are few. This paper presents a new feature extraction method aimed at furthering natural language processing applications in any language, especially Arabic. It is based on transforming a vector of representation in the time domain into the frequency domain. Fourier feature extraction is a powerful and versatile technique. The primary goal of this approach is to extract salient features from raw text, and then a filter is used to remove noise from the extracted features. Its scalability and efficiency make it suitable to be used on large datasets, making it a widely adopted feature extraction technique. For classification, we used logistic regression, which is a powerful tool for classifying text data and offers significant advantages such as speed and accuracy. We used three world datasets (CNN, OSAC, and SANAD), and the results showed a good performance. The proposed method outperformed recent approaches, in which accuracy reached 98%.

As a basic task in NLP (Natural Language Processing), feature extraction directly determines the quality of text clustering and text classification. However, the commonly used TF-IDF (Term Frequency & Inverse Document Frequency) and LDA (Latent Dirichlet Allocation) text feature extraction methods have shortcomings in not considering the text’s context and blindness to the topic of the corpus. This study builds a feature extraction algorithm and application scenarios in the field of failure diagnosis. A text-driven failure diagnosis model is designed to classify and automatically judge which failure mode the failure described in the text belongs to once a failure-description text is entered. To verify the effectiveness of the proposed feature extraction algorithm and failure diagnosis model, a long-term accumulated failure description text of an aircraft maintenance and support system was used as a subject to conduct an empirical study. The final experimental results also show that the proposed feature extraction method can effectively improve the effect of clustering, and the proposed failure diagnosis model achieves high accuracies and low false alarm rates.

This paper examines the performance of different machine and deep learning algorithms in classifying colon histological images using different feature extraction methods. The relationship between the feature extraction methods and the selected machine learning methods to improve the classification accuracy is analyzed. Widely used methods like local binary patterns, histograms of oriented gradients, Gabor filter and Dobeshi wavelets are investigated for feature extraction from colon histological images. The features extracted by histogram of oriented gradients and Gabor filter methods were used as a single joint feature vector. And popular machine learning methods such as Support vector machine, Decision trees, Random forest, k-nearest neighbors and Naive Bayesian method were used to classify the selected images. The paper also investigates ensemble methods using gradient bousting and voting classifier as examples. The authors also focus on the study of convolutional neural networks as they are one of the main deep learning methods at the moment. The classification methods selected for analysis are compared in terms of classification accuracy and time taken for training and recognition. All pre-defined and adjustable parameters of both feature extraction methods and classification methods were personally selected by the authors as a result of experimental studies, which were conducted using a software tool created in the Python programming language on a set of LC25000 histological images. The software created is easily customizable and can be used in the future to investigate classification methods on other datasets.

This paper presents a novel geometrical scale and rotation independent feature extraction (FE) technique for multi-lingual character recognition (CR). The performance of any CR techniques mainly depends on the robustness of the proposed FE methods. Currently, there are very few scale and rotation independent FE techniques present in the literature which successfully extract the robust features from characters with noise such as distortion and breaks in the characters. Many FE methods from the literature failed to distinguish the characters which look similar in their appearance. So, in this paper, we have proposed a novel scale and rotation independent geometrical shape FE technique which successfully recognized distorted, broken, and similarly looking characters. Aside from the proposed FE technique, we've used crossing count (CC) features. Finally, we have combined the proposed features with CC features to make as Feature Vector (FV) of the character to be recognized. The proposed CR technique is evaluated using publicly available media-lab license plate (LP), ISI_Bengali, and Chars74K benchmark data sets and achieved encouraging results. To further assess the performance of the proposed FE method, we've used a proprietary data set containing nearly 168000 multi-lingual characters from English, Devanagari, and Marathi scripts and achieved encouraging results. We have observed better classification rates for the proposed FE method using publicly available benchmark data sets as compared to few of the CR FE methods from the literature.

Feature extraction techniques are applied to obtain features that will be useful in classifying and recognizing images. Feature extraction techniques are very helpful in various image processing applications. Many studies show the effectiveness of feature extraction before classification. There is also research showing that a feature extraction method may be good for certain classification approaches but may also be preferable. The impact of the sample and its size can also determine the results of the application of feature extraction techniques in the classification process. In this study, the author aims to prove the effectiveness of the application of the HOG feature extraction technique on the classification with the SVM method on flower images. The experiment was carried out on two groups of images, where the first group was image classes with relatively uniform colors and shapes, both in shape and color. and the second group is image classes with relatively different colors and shapes in the same class. The results showed that image datasets with relatively uniform colors and shapes do not require the application of any feature extraction to produce high accuracy. For classification by performing feature extraction in this study it gives different results for the two interest groups.

Day by day the number of text documents in digital form is increasing. Text classification is used to organize these text documents. However, text classification has the problem of high dimensionality of feature space. This high dimensionality of feature space is solved by feature selection and feature extraction methods and improves the performance of text categorization. The feature selection and feature extraction techniques remove the irrelevant features from the text documents and reduce the dimensionality of feature space. This paper presents the various feature selection and feature extraction methods. This paper also discusses various classifiers to classify the documents.

Text classification which is an integral part of text mining has caught much attention in various industries and fields recently. The ability is in assigning text documents to one or more pre-defined categories based on content similarity. While most of application of text classification focuses on document level, question classification works at much granular level such as sentence and phrase. There have been numerous studies on question classification in accordance to Bloom taxonomy in assessments to measure cognitive level of learners in higher learning institutions. But it has not been effective yet to resolve overlapping issue of Bloom taxonomy verb keywords being assigned to more than one category of Bloom taxonomy. The presence of this poses a problem in respect of classifying a particular question into a right category of Bloom taxonomy. And feature extraction plays an important role in improving the accuracy of classifier such as Support Vector Machine in question classification. Much of the past related research work focus on feature extraction methods such as bag of word (BOW) and syntactic analysis to classify questions and to address the issue, an improvement in feature extraction is needed. In view of this, this study proposes an integrated approach in feature extraction involving semantic aspect in classifying questions in accordance to Bloom taxonomy. Support Vector Machine classifier is used as it is well known for its high accuracy in text classification. With all this in place, an improved accuracy in classifying questions in accordance to Bloom taxonomy can be expected.

One of the most common causes of death worldwide is skin cancer and its incidence is increasing. To achieve optimal treatment and improve clinical outcomes for patients, precision skin cancer detection and classification approaches are required, which can be achieved through the application of feature extraction and machine learning algorithms. The development of such algorithms to identify important patterns from skin cancer image datasets enables early detection and more accurate classification and more effective treatment. Although previous studies have tried to detect skin cancer using feature extraction techniques such as HFF, HOG, and GLCM, some weaknesses still need to be improved. This research aims to combine various feature extraction methods such as Gray Level Co-occurrence Matrix, Histogram Oriented Gradients, and Local Binary Patterns and machine learning algorithms such as Support Vector Machine, Random Forest, and Gaussian Naïve Bayes in the classification process between Melanoma and Nevus skin cancers. In this research, the number of datasets used is 17,397 derived from the ISIC Dataset. The results showed that the Histogram Oriented Gradients method with Support Vector Machine algorithm achieved the highest accuracy of 92%. The combination of Gray Level Co-occurrence Matrix and Local Binary Patterns with Random Forest algorithm also achieved an accuracy of 92%, the combination of Gray Level Co-occurrence Matrix, Histogram Oriented Gradients, and Local Binary Patterns with Random Forest algorithm also resulted in an accuracy of 92%. These findings suggest that the combination of various feature extraction methods and machine learning algorithms can improve accuracy in skin cancer classification, which in turn can contribute to early detection and more effective treatment.

The manifold growth of malware in recent years has resulted in extensive research being conducted in the domain of malware analysis and detection, and theories from a wide variety of scientific knowledge domains have been applied to solve this problem. The algorithms from the machine learning paradigm have been particularly explored, and many feature extraction methods have been proposed in the literature for representing malware as feature vectors to be used in machine learning algorithms. In this paper we present a comparison of several feature extraction techniques by first applying them on system call logs of real malware, and then evaluating them using a random forest classifier. In our experiment the HMM-based feature extraction method outperformed the other methods by obtaining an F-measure of 0.87. We also explored the possibility of using ensembles of feature extraction methods, and discovered that combination of HMM-based features with bigram frequency features improved the F-measure by 1.7%.

The classification and recognition technology of underwater acoustic signal were always an important research content in the field of underwater acoustic signal processing. Currently, wavelet transform, Hilbert-Huang transform, and Mel frequency cepstral coefficients are used as a method of underwater acoustic signal feature extraction. In this paper, a method for feature extraction and identification of underwater noise data based on CNN and ELM is proposed. An automatic feature extraction method of underwater acoustic signals is proposed using depth convolution network. An underwater target recognition classifier is based on extreme learning machine. Although convolution neural networks can execute both feature extraction and classification, their function mainly relies on a full connection layer, which is trained by gradient descent-based; the generalization ability is limited and suboptimal, so an extreme learning machine (ELM) was used in classification stage. Firstly, CNN learns deep and robust features, followed by the removing of the fully connected layers. Then ELM fed with the CNN features is used as the classifier to conduct an excellent classification. Experiments on the actual data set of civil ships obtained 93.04% recognition rate; compared to the traditional Mel frequency cepstral coefficients and Hilbert-Huang feature, recognition rate greatly improved.

Analytics of machine learning-based algorithms for text classification

Objective: Visual descriptor methods like Local Binary Pattern (LBP) capture anatomical structures in captured images along with their disparities, which can be exploited by suitable methods for the diagnosis of medical anomalies. In our study, we have proposed a Local Mean Gradient Pattern (LMGP), based partly on LBP, a feature extraction algorithm for the classification of Computed Tomography (CT) images of the brain into normal, ischemic, or hemorrhage categories. Methods: The AISD and Kaggle datasets containing patients' brain CT scan images (acute ischemic stroke, hemorrhage, and normal cases) were taken. Initially, adaptive histogram equalization (AHE) techniques were applied as preprocessing operations to enhance the quality of the CT images. Furthermore, features were extracted from the preprocessed data using several feature extraction techniques, including our proposed LMGP feature descriptor. The features were then scaled using the standard scaling technique. Subsequently, preprocessed images were fed into different classifiers to build models for classifying brain CT scan images. Results: The effectiveness of our methodology LMGP was determined using different metrics, such as recall, precision, F1 score, logarithmic loss, accuracy (ACC), and area under the curve (ROC). Conclusively, LMGP performed best when the RBF-SVM classifier was used for the classification and gave an accuracy of 94% and 96% in the case of five-fold and ten-fold cross-validation, respectively. Conclusion: LMGP offers a distinctive and robust method of feature extraction from CT scan images by combining local information along with gradient change in pixels of the image. The efficacy of our proposed methodology (LMGP) was evaluated by using distinct classifiers, and the results were compared with eight different feature extraction methods. Overall, LMGP effectively outperformed all other feature descriptor methods in this study.

International audience

The objective of this article is to create an algorithm of the sequence of artificial signals that can be used to compare and create methods for processing one- and two-dimensional signals. It will then be implemented to compare feature extraction methods that rely on discrete wavelet transforms. The discrete wavelet transform is superior to other signal processing techniques in several ways. Developing a feature set is a crucial step in using the discrete wavelet transform. Mean value and standard deviation are suggested as feature extraction techniques in this study. The mean value is the only option selected for the first feature extraction method; the mean value and standard deviation are selected for the second feature extraction method. To build any number of artificial signal sequences from a single, several conditions are taken into account, for example, their symmetry, they are supposed to be located at the same distance from each other, that is, with an equal step. Symmetrical signal sequences constructed in this way differ from common wellknown signal sequences, such as Fourier series, in that they converge to a given signal in equal steps.

This paper presents main paradigms of research for feature extraction methods to further augment the state of art in speaker recognition (SR) which has been recognized extensively in person identification for security and protection applications. Speaker recognition system (SRS) has become a widely researched topic for the last many decades. The basic concept of feature extraction methods is derived from the biological model of human auditory/vocal tract system. This work provides a classification-oriented review of feature extraction methods for SR over the last 55 years that are proven to be successful and have become the new stone to further research. Broadly, the review work is dichotomized into feature extraction methods with and without noise compensation techniques. Feature extraction methods without noise compensation techniques are divided into following categories: On the basis of high/low level of feature extraction; type of transform; speech production/auditory system; type of feature extraction technique; time variability; speech processing techniques. Further, feature extraction methods with noise compensation techniques are classified into noise-screened features, feature normalization methods, feature compensation methods. This classification-oriented review would endow the clear vision of readers to choose among different techniques and will be helpful in future research in this field.