Applying embedding models and advanced RAG techniques for Korean text classification

Supervised machine learning studies are gaining more significant recently because of the availability of the increasing number of the electronic documents from different resources. Text classification can be defined that the task was automatically categorized a group documents into one or more predefined classes according to their subjects. Thereby, the major objective of text classification is to enable users for extracting information from textual resource and deals with process such as retrieval, classification, and machine learning techniques together in order to classify different pattern. In text classification technique, term weighting methods design suitable weights to the specific terms to enhance the text classification performance. This paper surveys of text classification, process of different term weighing methods and comparison between different classification techniques.

How to Improve Text Summarization and Classification by Mutual Cooperation on an Integrated Framework

Prediction of cause of death from forensic autopsy reports using text classification techniques: A comparative study

A massive of text that is generated every minute is increasing dramatically. Therefore, it is more and more important to find an effective model to automatic classify the amount of text. Topic models is the most powerful techniques in text classification. There are many research results in the field of topic model have been published in scholarly journals. The Latent Dirichlet Allocation (LDA) is one of the most popular topic models in text classification. Researchers have proposed many topic evolution models based on LDA to solve some specific problems in applications of text classification. And some joint models which based on topic models combined other algorithms have been studied to enhance the performance of text classification. In this paper, we investigated three categories topic models for text classification and briefly introduced their advantages and disadvantages in the applications of text mining. Also, we introduce the generated process of documents and illustrate the graphical model for each topic models.

Metaheuristic algorithms, inspired by natural phenomena and human-based strategies, offer versatile approaches to navigate diverse search spaces and adapt to dynamic environments. These algorithms, including evolutionary algorithms, swarm intelligence, bio-inspired methods, human-based approaches, and plant-inspired techniques, have found applications across diverse domains such as engineering, finance, healthcare, logistics, and telecommunications. In the text classification domain, metaheuristic techniques have emerged as powerful tools to enhance the accuracy, efficiency, and robustness of classification systems. By optimizing feature subsets, fine-tuning model parameters, and addressing challenges such as feature selection, dimensionality reduction, class imbalance, and noisy data, metaheuristic algorithms provide flexible solutions that adapt to various text datasets and tasks. This review paper comprehensively explores recent advancements in metaheuristic applications in text classification across six categories. From evolutionary-based methods to swarm-based approaches, bio-inspired techniques to physics/chemistry-based strategies, human-based methods to plant-based algorithms, researchers have leveraged diverse metaheuristic techniques to push the boundaries of text classification. Through a systematic analysis of recent research studies, this review provides insights into the strengths, limitations, and future directions of metaheuristic optimization in the context of text classification.

The rapid growth of unstructured textual data in various domains has necessitated the development of sophisticated techniques for multi-label text classification. Traditional methods often struggle with handling the complexity and interdependence of multiple labels, leading to suboptimal performance. This paper presents an advanced approach that integrates the Beta Ant Colony Optimization (BACO) algorithm with deep learning techniques for multi-label text classification. The BACO algorithm effectively explores the feature space and selects relevant features by leveraging pheromone trails, while the deep learning model captures intricate patterns and relationships within the textual data. The integration of these two methodologies aims to enhance the efficiency and accuracy of multi-label classification tasks, particularly in domains where label dependency is prominent. Empirical evaluations on benchmark datasets demonstrate that the proposed hybrid approach outperforms existing state-of-the-art techniques in terms of precision, recall, F1-score, and computational efficiency. The findings suggest that combining heuristic optimization algorithms with deep learning can significantly improve multi-label text classification performance, providing a robust solution for real-world applications.

The Kampus Merdeka program, launched by the Indonesian Ministry of Education, Culture, Research, and Technology in 2020, aims to enhance students' skills through hands-on work experience. Considering the rising significance of social media, particularly Twitter, in gauging public opinion, this research focuses on analyzing the sentiment towards the Kampus Merdeka program. The primary objective is to classify the sentiments expressed in tweets related to the program and compare two feature extraction techniques—TF-IDF and FastText—to identify the best approach for transforming text data into numerical vectors. The sentiment classification model was built using the Support Vector Machine (SVM) algorithm, a machine learning technique known for its accuracy in text classification. A total of 16,730 tweets were collected and analyzed, yielding an accuracy of 73% for FastText and 72% for TF-IDF. Results show that FastText is more effective in capturing semantic relationships, leading to higher accuracy in sentiment classification. Findings indicate that the public sentiment towards the Kampus Merdeka program is predominantly positive (60.7%), with negative and neutral sentiments at 33.5% and 5.8%, respectively. The success of the FastText method underscores the importance of advanced feature extraction techniques in text classification. The novelty of this research lies in its use of FastText for educational policy evaluation, providing a new perspective on using sentiment analysis to assess public perception of educational programs.

Stack Overflow is a popular community-based Qaamp;A website that caters to technical needs of software developers. As of February 2015 -- Stack Overflow has more than 3.9M registered users, 8.8M questions, and 41M comments. Stack Overflow provides explicit and detailed guidelines on how to post questions but, some questions are very poor in quality. Such questions are deleted by the experienced community members and moderators. Deleted questions increase maintenance cost and have an adverse impact on the user experience. Therefore, predicting deleted questions is an important task. In this study, we propose a two stage hybrid approach -- DelPredictor -- which combines text processing and classification techniques to predict deleted questions. In the first stage, DelPredictor converts text in the title, body, and tag fields of questions into numerical textual features via text processing and classification techniques. In the second stage, it extracts meta features that can be categorized into: profile, community, content, and syntactic features. Next, it learns and combines two independent classifiers built on the textual and meta features. We evaluate DelPredictor on 5 years (2008 -- 2013) of deleted questions from Stack Overflow. Our experimental results show that DelPredictor improves the F1-scores over baseline prediction, a prior approach [12] and a text-based approach by 29.50%, 9.34%, and 28.11%, respectively.

Impact of feature selection techniques in Text Classification: An Experimental study

Support Vector Machines (SVM), one of the new techniques for text classification, have been widely used in many application areas. SVM try to find an optimal hyperplane within the input space so as to correctly classify the binary classification problem. We present a novel heuristic text classification approach based on genetic algorithm (GA) and SVM. Simulation results demonstrate that GA and SVM are integrated effectively, and have good classification accuracy.

In natural language processing, the selection of the token is a very important step. The original text should segment into some granularity, then subsequent processing and analysis work can be carried out. The influence of select different segmentation granularity on the Korean text classification task is discussed. Due to the Korean language composition characteristics, combined with the linguistic knowledge the text was divided into six different levels: phoneme, syllable, subword, word, space writing without suffix, and space writing. Then build text semantic expressions in the vector space model. According to the different granularity performance in five classic classifiers and six deep learning models, Korean text feature representations were analyzed and compared in six different granularities. The Korean scientific literature was classified, and the results show that the spacing without suffix level performs best in seven classifiers, and the highest classification accuracy rate reaches 91.94%.

Big multimedia data is heterogeneous in essence, that is, the data may be a mixture of video, audio, text, and images. This is due to the prevalence of novel applications in recent years, such as social media, video sharing, and location based services (LBS), etc. In many multimedia applications, for example, video/image tagging and multimedia recommendation, text classification techniques have been used extensively to facilitate multimedia data processing. In this paper, we give a comprehensive review on feature selection techniques for text classification. We begin by introducing some popular representation schemes for documents, and similarity measures used in text classification. Then, we review the most popular text classifiers, including Nearest Neighbor (NN) method, Naive Bayes (NB), Support Vector Machine (SVM), Decision Tree (DT), and Neural Networks. Next, we survey four feature selection models, namely the filter, wrapper, embedded and hybrid, discussing pros and cons of the state-of-the-art feature selection approaches. Finally, we conclude the paper and give a brief introduction to some interesting feature selection work that does not belong to the four models.

Text classification plays an essential role in the medical domain by organizing and categorizing vast amounts of textual data through machine learning (ML) and deep learning (DL). The adoption of Artificial Intelligence (AI) technologies in healthcare has raised concerns about the interpretability of AI models, often perceived as "black boxes." Explainable AI (XAI) techniques aim to mitigate this issue by elucidating AI model decision-making process. In this paper, we present a scoping review exploring the application of different XAI techniques in medical text classification, identifying two main types: model-specific and model-agnostic methods. Despite some positive feedback from developers, formal evaluations with medical end users of these techniques remain limited. The review highlights the necessity for further research in XAI to enhance trust and transparency in AI-driven decision-making processes in healthcare.

Text classification is one of the important applications of Natural Language Processing (NLP) in which text is classified into pre-defined categories or classes. Several state-of-the-arts have already been conducted on text classification in different Indian languages, however, limited researches on text classification performed in Odia. Moreover, the news headlines classification is a text classification technique which is performed in our study mainly focusing on Odia language. The Convolutional Neural Network (CNN) based Deep Learning technique is used to classify the Odia news headlines dataset available at Kaggle repository. The dataset consisting of approx. 15,200 Odia news headlines is split into training and testing sets of 80:20 ratio and is categorized into different classes, such as sports, business, and entertainment by using CNN. The efficacy and efficiency of the proposed CNN-based Odia news headlines classification is evaluated in contrary to other existing machine learning and deep learning models, such as Neural Networks, LSTM (Long Short-Term Memory), and Bi-LSTM (Bidirectional Long Short-Term Memory) with respect to different performance metrics like precision, accuracy, recall, F1-score, training time, and AUC-ROC (Area Under the Receiver Operating Characteristic Curve). The simulation results revealed that the proposed CNN model outperformed with respect to other models.

Text classification is a process of classifying textual contents to a set of predefined classes and categories. As enormous numbers of documents and contextual contents are introduced every day on the Internet, it becomes essential to use text classification techniques for different purposes such as enhancing search retrieval and recommendation systems. A lot of work has been done to study different aspects of English text classification techniques. However, little attention has been devoted to study Arabic text classification due to the difficulty of processing Arabic language. Consequently, in this paper, we propose an enhanced Arabic topic-discovery architecture (EATA) that can use ontology to provide an effective Arabic topic classification mechanism. We have introduced a semantic enhancement model to improve Arabic text classification and the topic discovery technique by utilizing the rich semantic information in Arabic ontology. We rely in this study on the vector space model (term frequency-inverse document frequency (TF-IDF)) as well as the cosine similarity approach to classify new Arabic textual documents.