• Home
  • Search
  • Deep Learning-Based Language Identification in English-Hindi-Bengali Code-Mixed Social Media Corpora
  • Cite Icon26
  • https://doi.org/10.1515/jisys-2017-0440Copy DOI Icon

Deep Learning-Based Language Identification in English-Hindi-Bengali Code-Mixed Social Media Corpora

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Abstract This article addresses language identification at the word level in Indian social media corpora taken from Facebook, Twitter and WhatsApp posts that exhibit code-mixing between English-Hindi, English-Bengali, as well as a blend of both language pairs. Code-mixing is a fusion of multiple languages previously mainly associated with spoken language, but which social media users also deploy when communicating in ways that tend to be rather casual. The coarse nature of code-mixed social media text makes language identification challenging. Here, the performance of deep learning on this task is compared to feature-based learning, with two Recursive Neural Network techniques, Long Short Term Memory (LSTM) and bidirectional LSTM, being contrasted to a Conditional Random Fields (CRF) classifier. The results show the deep learners outscoring the CRF, with the bidirectional LSTM demonstrating the best language identification performance.

Similar Papers
  • Research Article
  • Citations28

Sequence labeling to detect stuttering events in read speech

  • Dec 04, 2019
  • Computer Speech & Language
  • Sadeen Alharbi +4
  • Front Matter
  • Citations53

Navigating Social Media in #Ophthalmology

  • May 20, 2019
  • Ophthalmology
  • Edmund Tsui +1
  • Research Article
  • Citations6

Attention-Based BiLSTM for Negation Handling in Sentimen Analysis

  • Oct 31, 2020
  • IJCCS (Indonesian Journal of Computing and Cybernetics Systems)
  • Riszki Wijayatun Pratiwi +2
  • PDF
  • Research Article
  • Citations10

The Research of Air Combat Intention Identification Method Based on BiLSTM + Attention

  • Jun 12, 2023
  • Electronics
  • Bin Tan +3
  • PDF
  • Research Article
  • Citations173

Forecasting Cryptocurrency Prices Using LSTM, GRU, and Bi-Directional LSTM: A Deep Learning Approach

  • Feb 18, 2023
  • Fractal and Fractional
  • Phumudzo Lloyd Seabe +2
  • Conference Article

Predictive Irrigation Management Using Long Short-Term Memory Networks and IoT Data in Agriculture

  • May 23, 2025
  • Erupaka Nitya +5
  • Conference Article

Hybrid Deep Learning and Transformer-Based Approaches for Sentiment and Emotion Analysis in the Sri Lankan Cake Industry

  • Dec 16, 2025
  • Udan Diwyanjalee +1
  • Research Article
  • Citations13

Comparative Analysis of LSTM and BiLSTM in Image Detection Processing

  • Mar 29, 2024
  • Journal of Wireless Mobile Networks, Ubiquitous Computing, and Dependable Applications
  • Dr Bob Subhan Riza +2
  • Research Article
  • Citations4

Gender Classification Based on Electrocardiogram Signals Using Long Short Term Memory and Bidirectional Long Short Term Memory

  • Jul 16, 2023
  • Jurnal Ilmiah Teknik Elektro Komputer dan Informatika
  • Kevin Yudhaprawira Halim +4
  • Research Article

Comparative Analysis of LSTM and Bi-LSTM Models for Earthquake Occurrence Prediction in Tokai-Japan Region

  • Dec 30, 2024
  • International Journal of Electrical, Computer, and Biomedical Engineering
  • Azhari Haris Al Hamdi +2
  • Research Article
  • Citations4

Integrated modelling of automobile maintenance expert system based on knowledge graph

  • Jul 01, 2021
  • Journal of Physics: Conference Series
  • Gen Liu +4
  • Conference Article
  • Citations7

Production prediction modeling of industrial processes based on Bi-LSTM

  • Jun 01, 2019
  • Yongming Han +5
  • Research Article
  • Citations5395

Framewise phoneme classification with bidirectional LSTM and other neural network architectures

  • Jul 01, 2005
  • Neural Networks
  • Alex Graves +1
  • Research Article
  • Citations30

Online leakage current classification using convolutional neural network long short-term memory for high voltage insulators on web-based service

  • Mar 01, 2023
  • Electric Power Systems Research
  • Phuong Nguyen Thanh +1
  • Research Article

Forecasting United States Dollar to Tanzania Shillings Exchange Rate Using Comparable LSTM and BiLSTM Deep Learning Models

  • Mar 01, 2025
  • East African Scholars Journal of Engineering and Computer Sciences
  • Isakwisa Gaddy Tende
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.