• Home
  • Search
  • Multi-Task Text Classification using Graph Convolutional Networks for Large-Scale Low Resource Language
  • Open Access IconOpen Access
  • Cite Icon15
  • https://doi.org/10.1109/ijcnn55064.2022.9892105Copy DOI Icon

Multi-Task Text Classification using Graph Convolutional Networks for Large-Scale Low Resource Language

  • Jul 18, 2022
  • Mounika Marreddy +4 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Graph Convolutional Networks (GCN) have achieved state-of-art results on single text classification tasks like sentiment analysis, emotion detection, etc. However, the performance is achieved by testing and reporting on resource-rich languages like English. Applying GCN for multi-task text classification is an unexplored area. Moreover, training a GCN or adopting an English GCN for Indian languages is often limited by data availability, rich morphological variation, syntax, and semantic differences. In this paper, we study the use of GCN for the Telugu language in single and multi-task settings for four natural language processing (NLP) tasks, viz. sentiment analysis (SA), emotion identification (EI), hate-speech (HS), and sarcasm detection (SAR). In order to evaluate the performance of GCN with one of the Indian languages, Telugu, we analyze the GCN based models with extensive experiments on four downstream tasks. In addition, we created an annotated Telugu dataset, TEL-NLP, for the four NLP tasks. Further, we propose a supervised graph reconstruction method, Multi-Task Text GCN (MT- Text GCN) on the Telugu that leverages to simultaneously (i) learn the low-dimensional word and sentence graph embeddings from word-sentence graph reconstruction using graph autoencoder (GAE) and (ii) perform multi-task text classification using these latent sentence graph embeddings. We argue that our proposed MT- Text GCN achieves significant improvements on TEL-NLP over existing Telugu pretrained word embeddings [1], multilingual pretrained Transformer models: mBERT [2], and XLM-R [3]. On TEL-NLP, we achieve a high Fl-score for four NLP tasks: SA (0.84), EI (0.55), HS (0.83) and SAR (0.66). Finally, we show our model's quantitative and qualitative analysis on the four NLP tasks in Telugu. We open-source our TEL-NLP dataset, pretrained models, and code <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> https://github.com/scsmuhio/MTGCN_Resources.

Similar Papers
  • Research Article
  • Citations23

Am I a Resource-Poor Language? Data Sets, Embeddings, Models and Analysis for four different NLP Tasks in Telugu Language

  • Nov 25, 2022
  • ACM Transactions on Asian and Low-Resource Language Information Processing
  • Mounika Marreddy +4
  • Conference Article
  • Citations3

Word Embedding for Bengali Language using Domain-related Corpus

  • Apr 26, 2023
  • Ashutosh Bandyopadhyay +1
  • Research Article
  • Citations9

Word Embeddings for Natural Language Processing

  • Jan 01, 2016
  • Infoscience (Ecole Polytechnique Fédérale de Lausanne)
  • Rémi Lebret
  • Conference Article
  • Citations86

Assessing the Generalizability of Code2vec Token Embeddings

  • Nov 01, 2019
  • Hong Jin Kang +2
  • Conference Article
  • Citations4

Sentiment and Context-refined Word Embeddings for Sentiment Analysis

  • Oct 17, 2021
  • Ayca Deniz +2
  • PDF
  • Research Article
  • Citations83

Paradigm Shift in Natural Language Processing

  • May 28, 2022
  • Machine Intelligence Research
  • Tian-Xiang Sun +3
  • Conference Article
  • Citations14

HauWE: Hausa Words Embedding for Natural Language Processing

  • Oct 01, 2019
  • Idris Abdulmumin +1
  • Conference Article
  • Citations91

GREEK-BERT: The Greeks visiting Sesame Street

  • Sep 02, 2020
  • John Koutsikakis +3
  • Book Chapter
  • Citations31

Harnessing Online News for Sarcasm Detection in Hindi Tweets

  • Jan 01, 2017
  • Santosh Kumar Bharti +2
  • Conference Article
  • Citations3

An empirical comparison of distance/similarity measures for Natural Language Processing

  • Oct 15, 2019
  • Dimmy Magalhães +2
  • Research Article
  • Citations10

Resolving ambiguity in natural language for enhancement of aspect-based sentiment analysis of hotel reviews

  • Jan 13, 2025
  • PeerJ Computer Science
  • Asma Nadeem +7
  • Conference Article
  • Citations2

Distributed Representation of Words in Vector Space for Kannada Language

  • Dec 01, 2018
  • Pandurang S Kambali +2
  • Research Article

Financial text embeddings for the Russian language: a global vectors-based approach

  • Feb 01, 2025
  • IAES International Journal of Artificial Intelligence (IJ-AI)
  • Kostyantyn A Malyshenko +1
  • PDF
  • Research Article
  • Citations16

Learned Text Representation for Amharic Information Retrieval and Natural Language Processing

  • Mar 20, 2023
  • Information
  • Tilahun Yeshambel +2
  • Research Article
  • Citations31

Joint evaluation of preprocessing tasks with classifiers for sentiment analysis in Brazilian Portuguese language

  • Feb 03, 2021
  • Multimedia Tools and Applications
  • Douglas Nunes De Oliveira +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.