• Home
  • Search
  • Towards Vietnamese Question and Answer Generation: An Empirical Study
  • Cite Icon3
  • https://doi.org/10.1145/3675781Copy DOI Icon

Towards Vietnamese Question and Answer Generation: An Empirical Study

  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Question-answer generation (QAG) is a challenging task that generates both questions and answers from a given input paragraph context. The QAG task has recently achieved promising results thanks to the appearance of large pre-trained language models, yet, QAG models are mainly implemented in common languages, e.g., English. There still remains a gap in domain and language adaptation of these QAG models to low-resource languages such as Vietnamese. To address the gap, this article presents a large-scale and systematic study of QAG in Vietnamese. To do that, we first implement several QAG models by using the common fine-tuning techniques based on powerful pre-trained language models. We next introduce a set of instructions designed for the QAG task. These instructions are used to fine-tuned the pre-trained language and large language models. Extensive experimental results of both automatic and human evaluation on five benchmark machine reading comprehension datasets show two important points. First, the instruction-tuning method has the potential to enhance the performance of QAG models. Second, large language models trained in English need more data for fine-tuning to work well on the downstream QAG tasks of low-resource languages. We also provide a prototype system to demonstrate how our QAG models actually work. The code for fine-tuning QAG models and instructions are also made available.

Similar Papers
  • Book Chapter
  • Citations14

Towards an Enhanced Understanding of Bias in Pre-trained Neural Language Models: A Survey with Special Emphasis on Affective Bias

  • Jan 01, 2022
  • Anoop K +3
  • Research Article
  • Citations8

A self-supervised language model selection strategy for biomedical question answering

  • Sep 16, 2023
  • Journal of Biomedical Informatics
  • Negar Arabzadeh +1
  • PDF
  • Preprint Article

Knowledge Enhancement of Small-Scale Models in Medical Question Answering (Preprint)

  • Nov 03, 2024
  • Xinbai Li +3
  • Video Transcripts

Robust Transfer Learning with Pretrained Language Models through Adapters

  • Aug 01, 2021
  • Underline Science Inc.
  • Wenjuan Han +2
  • Research Article
  • Citations1

Using a large language model to provide individualized feedback for pre-service physics teachers’ written reflections

  • Nov 21, 2025
  • Disciplinary and Interdisciplinary Science Education Research
  • Stefan Sorge +2
  • Book Chapter
  • Citations78

Towards Human-Like Educational Question Generation with Large Language Models

  • Jan 01, 2022
  • Zichao Wang +3
  • Research Article
  • Citations5

Understanding latent affective bias in large pre-trained neural language models

  • Mar 05, 2024
  • Natural Language Processing Journal
  • Anoop Kadan +4
  • Research Article
  • Citations16

Unlocking language barriers: Assessing pre-trained large language models across multilingual tasks and unveiling the black box with Explainable Artificial Intelligence

  • Jun 01, 2025
  • Engineering Applications of Artificial Intelligence
  • Muhamet Kastrati +5
  • Conference Article
  • Citations5

Leveraging Large Language Models for Improving Keyphrase Generation for Contextual Targeting

  • Oct 21, 2024
  • Xiao Bai +3
  • PDF
  • Research Article
  • Citations14

Unlocking the Secrets Behind Advanced Artificial Intelligence Language Models in Deidentifying Chinese-English Mixed Clinical Text: Development and Validation Study

  • Jan 25, 2024
  • Journal of Medical Internet Research
  • You-Qian Lee +6
  • Supplementary Content

Regex-augmented Domain Transfer Topic Classification based on a Pre-trained Language Model: An application in Financial Domain

  • May 22, 2023
  • arXiv (Cornell University)
  • Vanessa Liao +3
  • Conference Article

CrossLM: A Data-Free Collaborative Fine-Tuning Framework for Large and Small Language Models

  • Jun 23, 2025
  • Yongheng Deng +5
  • Research Article

Extraction of distant recurrence sites for breast cancer patients from free-text clinical notes using large language models.

  • Mar 01, 2026
  • Journal of biomedical informatics
  • Madhu Babu Sikha +6
  • Research Article

QUESTION-ANSWER SYSTEM ON MEDICAL DOMAIN WITH LLMS USING VARIOUS FINE-TUNING METHODS

  • May 31, 2025
  • International Journal of Advanced Research
  • Misha Patel +2
  • Research Article
  • Citations2

Exploring Large Language Models for Detecting Online Vaccine Reactions.

  • Sep 24, 2024
  • Studies in health technology and informatics
  • Sedigh Khademi +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.