Fake news detection in Dravidian languages using transfer learning with adaptive finetuning

The recent advancements made in World Wide Web and social networking have eased the spread of fake news among people at a faster rate. At most of the times, the intention of fake news is to misinform the people and make manipulated societal insights. The spread of low-quality news in social networking sites has a negative influence upon people as well as the society. In order to overcome the ever-increasing dissemination of fake news, automated detection models are developed using Artificial Intelligence (AI) and Machine Learning (ML) methods. The latest advancements in Deep Learning (DL) models and complex Natural Language Processing (NLP) tasks make the former, a significant solution to achieve Fake News Detection (FND). In this background, the current study focuses on design and development of Natural Language Processing with Sea Turtle Foraging Optimization-based Deep Learning Technique for Fake News Detection and Classification (STODL-FNDC) model. The aim of the proposed STODL-FNDC model is to discriminate fake news from legitimate news in an effectual manner. In the proposed STODL-FNDC model, the input data primarily undergoes pre-processing and Glove-based word embedding. Besides, STODL-FNDC model employs Deep Belief Network (DBN) approach for detection as well as classification of fake news. Finally, STO algorithm is utilized after adjusting the hyperparameters involved in DBN model, in an optimal manner. The novelty of the study lies in the design of STO algorithm with DBN model for FND. In order to improve the detection performance of STODL-FNDC technique, a series of simulations was carried out on benchmark datasets. The experimental outcomes established the better performance of STODL-FNDC approach over other methods with a maximum accuracy of 95.50%.

The availability and expansion of social media has made it difficult to distinguish between fake and real news. Information falsification has exponentially increased as a result of how simple it is to spread information through sharing. Social media dependability is also under jeopardy due to the extensive dissemination of false information. Therefore, it has become a research problem to automatically validate information, specifically source, content, and publisher, to identify it as true or false. Despite its limitations, machine learning (ML) has been crucial in the categorization of information. Previous studies suggested three-step methods for categorising false information on social media. In the first step of the process, the data set is subjected to a number of pre-processing processes in order to transform unstructured data sets into structured data sets. The unknowable properties of fake news and the features are extracted by the Lexicon Model in the second stage. In the third stage of this research project, a feature selection method by WOA (Whale Optimization Algorithm) for weight value to tune the classification part. Finally, a Hybrid Classification model that is hybrid with a fuzzy based Convolutional Neural Network and kernel based support vector machine is constructed in order to identify the data pertaining to bogus news. However using single classifier for fake news detection produces the insufficient accuracy. To overcome this issue in this work introduced an improved model for fake news classification. To turn unstructured data sets into structured data sets, a variety of pre-processing operations are used on the data set in the initial phase of the procedure. The unknowable properties of fake news and the features are extracted by the Lexicon Model in the second stage. In the third stage of this research project, a feature selection method by COA (Coati Optimization Algorithm) for weight value to tune the classification part. Finally, an ensemble of RNN (Recurrent Neural Networks), VGG-16 and ResNet50.A classification model was developed to recognise bogus news information. Evaluate each fake news analysis' performance in terms of accuracy, precision, recall, and F1 score. The suggested model, out of all the methodologies taken into consideration in this study, provides the highest outcomes, according to experimental findings

Fake news detection within online social media using supervised artificial intelligence algorithms

Nowadays, the dissemination of news information has become more rapid, liberal, and open to the public. People can find what they want to know more and more easily from a variety of sources, including traditional news outlets and new social media platforms. However, at a time when our lives are glutted with all kinds of news, we cannot help but doubt the veracity and legitimacy of these news sources; meanwhile, we also need to guard against the possible impact of various forms of fake news. To combat the spread of misinformation, more and more researchers have turned to natural language processing (NLP) approaches for effective fake news detection. However, in the face of increasingly serious fake news events, existing detection methods still need to be continuously improved. This study proposes a modified proof-of-concept model named NER-SA, which integrates natural language processing (NLP) and named entity recognition (NER) to conduct the in-domain and cross-domain analysis of fake news detection with the existing three datasets simultaneously. The named entities associated with any particular news event exist in a finite and available evidence pool. Therefore, entities must be mentioned and recognized in this entity bank in any authentic news articles. A piece of fake news inevitably includes only some entitlements in the entity bank. The false information is deliberately fabricated with fictitious, imaginary, and even unreasonable sentences and content. As a result, there must be differences in statements, writing logic, and style between legitimate news and fake news, meaning that it is possible to successfully detect fake news. We developed a mathematical model and used the simulated annealing algorithm to find the optimal legitimate area. Comparing the detection performance of the NER-SA model with current state-of-the-art models proposed in other studies, we found that the NER-SA model indeed has superior performance in detecting fake news. For in-domain analysis, the accuracy increased by an average of 8.94% on the LIAR dataset and 19.36% on the fake or real news dataset, while the F1-score increased by an average of 24.04% on the LIAR dataset and 19.36% on the fake or real news dataset. In cross-domain analysis, the accuracy and F1-score for the NER-SA model increased by an average of 28.51% and 24.54%, respectively, across six domains in the FakeNews AMT dataset. The findings and implications of this study are further discussed with regard to their significance for improving accuracy, understanding context, and addressing adversarial attacks. The development of stylometric detection based on NLP approaches using NER techniques can improve the effectiveness and applicability of fake news detection.

Filtering, vetting, and verifying digital information is an area of core interest in information science. Online fake news is a specific type of digital misinformation that poses serious threats to democratic institutions, misguides the public, and can lead to radicalization and violence. Hence, fake news detection is an important problem for information science research. While there have been multiple attempts to identify fake news, most of such efforts have focused on a single modality (e.g., only text‐based or only visual features). However, news articles are increasingly framed as multimodal news stories, and hence, in this work, we propose a multimodal approach combining text and visual analysis of online news stories to automatically detect fake news. Drawing on key theories of information processing and presentation, we identify multiple text and visual features that are associated with fake or credible news articles. We then perform a predictive analysis to detect features most strongly associated with fake news. Next, we combine these features in predictive models using multiple machine‐learning techniques. The experimental results indicate that a multimodal approach outperforms single‐modality approaches, allowing for better fake news detection.

Fake news detection in low-resource languages: A novel hybrid summarization approach

Due to the widespread use of social media, people are exposed to fake news and misinformation. Spreading fake news has adverse effects on both the general public and governments. This issue motivated researchers to utilize advanced natural language processing concepts to detect such misinformation in social media. Despite the recent research studies that only focused on semantic features extracted by deep contextualized text representation models, we aim to show that content-based feature engineering can enhance the semantic models in a complex task like fake news detection. These features can provide valuable information from different aspects of input texts and assist our neural classifier in detecting fake and real news more accurately than using semantic features. To substantiate the effectiveness of feature engineering besides semantic features, we proposed a deep neural architecture in which three parallel convolutional neural network (CNN) layers extract semantic features from contextual representation vectors. Then, semantic and content-based features are fed to a fully connected layer. We evaluated our model on an English dataset about the COVID-19 pandemic and a domain-independent Persian fake news dataset (TAJ). Our experiments on the English COVID-19 dataset show 4.16% and 4.02% improvement in accuracy and f1-score, respectively, compared to the baseline model, which does not benefit from the content-based features. We also achieved 2.01% and 0.69% improvement in accuracy and f1-score, respectively, compared to the state-of-the-art results reported by Shifath et al. (A transformer based approach for fighting covid-19 fake news, arXiv preprint arXiv:2101.12027, 2021). Our model outperformed the baseline on the TAJ dataset by improving accuracy and f1-score metrics by 1.89% and 1.74%, respectively. The model also shows 2.13% and 1.6% improvement in accuracy and f1-score, respectively, compared to the state-of-the-art model proposed by Samadi et al. (ACM Trans Asian Low-Resour Lang Inf Process, https://doi.org/10.1145/3472620, 2021).

Ushering in the contemporary ‘fake news’ crisis, Craig Silverman of Buzzfeed News reported that it outperformed mainstream news on Facebook in the three months prior to the 2016 US presidential elections. Here the report’s methods and findings are revisited for 2020. Examining Facebook user engagement of election-related stories, and applying Silverman’s classification of fake news, it was found that the problem has worsened, implying that the measures undertaken to date have not remedied the issue. If, however, one were to classify ‘fake news’ in a stricter fashion, as Facebook as well as certain media organizations do with the notion of ‘false news’, the scale of the problem shrinks. A smaller scale problem could imply a greater role for fact-checkers (rather than deferring to mass-scale content moderation), while a larger one could lead to the further politicisation of source adjudication, where labelling particular sources broadly as ‘fake’, ‘problematic’ and/or ‘junk’ results in backlash.

Along with the advancement of the world wide web, the rise and far reaching appropriation of the social site initiative have distorted the manner in which news is shaped and distributed. News has gotten quicker, less expensive and effectively available among web based life. This modify has joined a few hindrances also. Specifically, flabbergasting content, for example, fake news made by online networking clients, is getting progressively perilous. The fake news issue, in spite of being presented just because as of late, has become a significant examination theme because of the high substance of online networking. Writing fake remarks and news via web-based networking media is simple for clients. The primary test is to decide the distinction among genuine and fake news. We developed a method for the fake news classification on twitter. Web- based GUI is developed for the fake news classification system to categorize the tweets as fake or genuine. We develop a machine learning program to identify fake news by comparing tweets with genuine sources. Naive bayes and passive aggressive machine learning algorithms are estimated with TF-IDF feature extraction method.

People lie, actions Don't! Modeling infodemic proliferation predictors among social media users

Recently, fake news has been widely spread through the Internet due to the increased use of social media for communication. Fake news has become a significant concern due to its harmful impact on individual attitudes and the community’s behavior. Researchers and social media service providers have commonly utilized artificial intelligence techniques in the recent few years to rein in fake news propagation. However, fake news detection is challenging due to the use of political language and the high linguistic similarities between real and fake news. In addition, most news sentences are short, therefore finding valuable representative features that machine learning classifiers can use to distinguish between fake and authentic news is difficult because both false and legitimate news have comparable language traits. Existing fake news solutions suffer from low detection performance due to improper representation and model design. This study aims at improving the detection accuracy by proposing a deep ensemble fake news detection model using the sequential deep learning technique. The proposed model was constructed in three phases. In the first phase, features were extracted from news contents, preprocessed using natural language processing techniques, enriched using n-gram, and represented using the term frequency–inverse term frequency technique. In the second phase, an ensemble model based on deep learning was constructed as follows. Multiple binary classifiers were trained using sequential deep learning networks to extract the representative hidden features that could accurately classify news types. In the third phase, a multi-class classifier was constructed based on multilayer perceptron (MLP) and trained using the features extracted from the aggregated outputs of the deep learning-based binary classifiers for final classification. The two popular and well-known datasets (LIAR and ISOT) were used with different classifiers to benchmark the proposed model. Compared with the state-of-the-art models, which use deep contextualized representation with convolutional neural network (CNN), the proposed model shows significant improvements (2.41%) in the overall performance in terms of the F1score for the LIAR dataset, which is more challenging than other datasets. Meanwhile, the proposed model achieves 100% accuracy with ISOT. The study demonstrates that traditional features extracted from news content with proper model design outperform the existing models that were constructed based on text embedding techniques.

Fake news have attracted attention of general public because of the influence they can exert on important activities of society, such as elections. Efforts have been made to detect them, but usually they rely on human labour fact-checking, what can be costly and time consuming. Computational approaches have typically relied on supervised learning models, in which a model is trained based on fake and true news samples. Such approach allows a large amount of news to be classified in a short time, but it demands datasets labelled with positive and negative instances. Our work proposes to detect fake news by training a model with only fake samples in the training dataset, through One-Class Classification (OCC). We compare a novel algorithm, called DCDistanceOCC, to others published in literature, and got similar, or even better, results. The case study is the Brazilian politics scenario starting at the 2018 general elections on Twitter and WhatsApp. These two platforms were a fertile ground to fake news proliferation. We also evaluated the models over another available dataset from literature. To the best of our knowledge, this is the first paper to identify fake news using an OCC approach and also the first one to provide Portuguese-based WhatsApp and Twitter datasets with fake news.

In perceptual decision-making, it is well-known that low confidence in a decision promotes information seeking, which increases subsequent decision accuracy. It is unclear, however, whether these mechanisms generalize to more complex domains such as fake news detection. Here, we tested whether confidence also drives information seeking in the context of fake news, whether seeking information improves fake news detection and sharing intentions, and whether we find confidence-driven confirmation biases. In an online study, 314 US citizens indicated whether news headlines were true or fake and could request additional information before finalizing their decision. First, in line with findings from perceptual decision-making, confidence was the main driver of information seeking for both fake and true news. Yet critically, whereas confidence lawfully scaled with decision accuracy for true news items, we found a U-shaped relationship for fake news items: decision accuracy was lowest for intermediate confidence, indicating that for fake headlines confidence is not a reliable signal of headline veracity. Second, while information seeking increased decision accuracy for true news items, for fake news items decision accuracy remained at chance level even after information seeking. Sharing intentions for fake news remained equally unaffected by information seeking, and mostly increased for belief-congruent true items. Finally, we found a confidence-driven confirmation bias for beliefs, but not for sharing intentions. Together, our results clarify that while confidence-driven information seeking adaptively increases decision accuracy for true news items, it is entirely ineffective in the context of fake news.

Nowadays, with the advancement of technology, the use of news sources has also undergone a great evolution. News sources have constantly evolved from past to present, ranging from magazines to radios, from newspapers to televisions. The fact that it has become so easy to access news has caused society to pay more attention to fake news. Fake news has the ability to influence society through news sources such as social media, which can reach wider audiences with the development of technology. The difficulties of users in accessing accurate and reliable sources in this information flow that shapes their daily lives increases the potential for the spread of fake news, and it becomes increasingly difficult to distinguish between real and fake news. In this study, classification models for fake news detection were designed using machine learning algorithms. The dataset, which includes fake and real news examples, contains 42,000 examples. Each class, including fake and real samples, contains 22,000 sample data. In order to increase data quality, accuracy and usability, preprocessing methods were applied to the data set. The removal of numbers, stop words, and html tags was done in the pre-processing step to remove unnecessary information from the text. Models were created for fake news detection with singular and ensemble classification algorithms. Performance evaluation of the models was performed using 5-fold cross-validation. In the performance comparisons of the models, values such as accuracy, sensitivity, specificity, tp rate and fp rate were calculated. The highest performance results were observed in the random forest classification algorithm with an accuracy rate of 76%.

Over the past few years, Large Language Models of Code (Code LLMs) have started to have a significant impact on programming practice. Code LLMs are also emerging as building blocks for research in programming languages and software engineering. However, the quality of code produced by a Code LLM varies significantly by programming language. Code LLMs produce impressive results on high-resource programming languages that are well represented in their training data (e.g., Java, Python, or JavaScript), but struggle with low-resource languages that have limited training data available (e.g., OCaml, Racket, and several others). This paper presents an effective approach for boosting the performance of Code LLMs on low-resource languages using semi-synthetic data. Our approach, called M ulti PL-T, generates high-quality datasets for low-resource languages, which can then be used to fine-tune any pretrained Code LLM. M ulti PL-T translates training data from high-resource languages into training data for low-resource languages in the following way. 1) We use a Code LLM to synthesize unit tests for commented code from a high-resource source language, filtering out faulty tests and code with low test coverage. 2) We use a Code LLM to translate the code from the high-resource source language to a target low-resource language. This gives us a corpus of candidate training data in the target language, but many of these translations are wrong. 3) We use a lightweight compiler to compile the test cases generated in (1) from the source language to the target language, which allows us to filter our obviously wrong translations. The result is a training corpus in the target low-resource language where all items have been validated with test cases. We apply this approach to generate tens of thousands of new, validated training items for five low-resource languages: Julia, Lua, OCaml, R, and Racket, using Python as the source high-resource language. Furthermore, we use an open Code LLM (StarCoderBase) with open training data (The Stack), which allows us to decontaminate benchmarks, train models without violating licenses, and run experiments that could not otherwise be done. Using datasets generated with M ulti PL-T, we present fine-tuned versions of StarCoderBase and Code Llama for Julia, Lua, OCaml, R, and Racket that outperform other fine-tunes of these base models on the natural language to code task. We also present Racket fine-tunes for two very recent models, DeepSeek Coder and StarCoder2, to show that M ulti PL-T continues to outperform other fine-tuning approaches for low-resource languages. The M ulti PL-T approach is easy to apply to new languages, and is significantly more efficient and effective than alternatives such as training longer.