• Home
  • Search
  • COMPARATIVE ANALYSIS OF BACK-TRANSLATION MODELS FOR NORMALIZATION MOBILE APP USER REVIEWS
  • https://doi.org/10.15282/ijsecs.11.2.2025.10.0142Copy DOI Icon

COMPARATIVE ANALYSIS OF BACK-TRANSLATION MODELS FOR NORMALIZATION MOBILE APP USER REVIEWS

  • Abstract
  • Literature Map
  • Similar Papers
Abstract

The increase of mobile apps has led to an exponential growth of user-generated reviews, which are often noisy, informal, and linguistically diverse, thereby posing significant challenges for automated analysis in requirements engineering. This study evaluates whether back-translation (BT) can normalize informal reviews while preserving meaning, and which model (Google Translate vs Facebook M2M100_418M) offers better semantic preservation, grammatical quality, and lexical alignment. We collected 323 Google Play reviews (667 sentences) from three Malaysian government apps. Texts were cleaned, expanded for colloquial forms, and then BT was applied using Malay as an intermediate language. Evaluation used four metrics which are semantic similarity (Sentence-BERT), grammar error count (LanguageTool), BLEU (NLTK), and perplexity (GPT-2). Models differences were tested with paired t-tests and Wilcoxon signed- rank tests, while paired scatterplots showed distributional patterns. Google was significantly better on semantic similarity (t(322)=5.38, p<.001), grammar errors (t(322)=3.66, p<.001), and BLEU (t(322)=2.99, p=.003); effect sizes were small to moderate. Perplexity differences were not significant, indicating comparable sentence-level fluency. Visualizations confirmed Google’s steadier performance with fewer extreme outliers. BT is a practical normalization step for noisy reviews. For the English–Malay pipeline studied here, Google provides more reliable semantic preservation and grammatical quality, while both systems are similar in fluency. However, the generalizability of these results are constrained by the relatively modest sample size (323 reviews, 667 sentences), and future work should validate results on large datasets and explore hybrid strategies combining strengths of both models.

Similar Papers
  • Research Article

The Translational Force of Words: The Journey of “Come” and “Go” into Arabic

  • Mar 28, 2024
  • World Journal of English Language
  • Abdullah Saleh Aziz Mohammad +1
  • Research Article
  • Citations38

Prospective Evaluation of Psychosocial Impact after One Year of Orthodontic Treatment Using PIDAQ Adapted for Indian Population.

  • Jan 01, 2017
  • JOURNAL OF CLINICAL AND DIAGNOSTIC RESEARCH
  • Kanika Garg
  • Research Article
  • Citations2

Abstract LB-200: Integrating dynamic 18F-FDG PET-CT, tumor metabolomics and functional genomics to understand metformin's pharmacodynamic effects in breast cancer: results of a phase 0 clinical trial

  • Jul 15, 2016
  • Cancer Research
  • Simon Lord +12
  • Conference Article
  • Citations95

A certified type-preserving compiler from lambda calculus to assembly language

  • Jun 10, 2007
  • Adam Chlipala
  • Research Article

POST-EDITING MACHINE TRANSLATION OF ENGLISH-INDONESIAN BY EFL STUDENTS: A STUDY ON GRAMMATICAL COHESION IN ABSTRACT TRANSLATION

  • Dec 11, 2024
  • Celtic : A Journal of Culture, English Language Teaching, Literature and Linguistics
  • Atsani Wulansari +2
  • Book Chapter
  • Citations4

EXTREME

  • Jan 01, 2013
  • Ella Roubtsova
  • Research Article
  • Citations2

Large language models for precision oncology: Clinical decision support through expert-guided learning.

  • Jun 01, 2024
  • Journal of Clinical Oncology
  • Jacqueline Lammert +14
  • Conference Article

Node Context Selection in Transformer-Based Graph Representation Learning Models

  • Dec 17, 2022
  • Tianze Wang +2
  • Research Article
  • Citations933

Semi-Supervised Hashing for Large-Scale Search

  • Dec 01, 2012
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Jun Wang +2
  • Research Article

An Analysis of Strategies and Problems in English E-mail Writing of Employees Working on a Thai Commercial Bank in Bangkok, Thailand

  • Jun 30, 2025
  • Rajamangala University of Technology Tawan-ok Social Science Journal
  • Thammawat Chamnan-Asawakul +3
  • Research Article
  • Citations2

Intercultural Crisis Communication: Translation, Interpreting and Languages in Local Crises, Federico M. Federici and Christophe Declercqxii+2682020Bloomsbury AcademicLondon and New York9781350097056

  • Jun 10, 2022
  • System
  • Lisheng Liu
  • Video Transcripts

From Bag-of-Words to Pre-trained Neural Language Models: Improving Automatic Classification of App Reviews for Requirements Engineering

  • Oct 15, 2020
  • Underline Science Inc.
  • Adailton Araujo +5
  • Research Article
  • Citations17

Measuring the Semantic Distance between Languages from a Statistical Analysis of Bilingual Dictionaries*

  • Feb 01, 2008
  • Journal of Quantitative Linguistics
  • Martin C Cooper
  • Book Chapter
  • Citations2

Semantic Similarities in Natural Language Requirements

  • Dec 09, 2019
  • Henning Femmer +2
  • Research Article
  • Citations2

SCALABLE INFORMATION RETRIEVAL SYSTEM IN SEMANTIC WEB BY QUERY EXPANSION AND ONTOLOGICAL BASED LSA RANKING SIMILARITY MEASUREMENT

  • Jan 01, 2020
  • International Journal of Advanced Intelligence Paradigms
  • Uma Devi M +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.