• Home
  • Search
  • BERT+vnKG: Using Deep Learning and Knowledge Graph to Improve Vietnamese Question Answering System
  • Cite Icon13
  • https://doi.org/10.14569/ijacsa.2020.0110761Copy DOI Icon

BERT+vnKG: Using Deep Learning and Knowledge Graph to Improve Vietnamese Question Answering System

  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

A question answering (QA) system based on natural language processing and deep learning is a prominent area and is being researched widely. The Long Short-Term Memory (LSTM) model that is a variety of Recurrent Neural Network (RNN) used to be popular in machine translation, and question answering system. However, that model still has certainly limited capabilities, so a new model named Bidirectional Encoder Representation from Transformer (BERT) emerged to solve these restrictions. BERT has more advanced features than LSTM and shows state-of-the-art results in many tasks, especially in multilingual question answering system over the past few years. Nevertheless, we tried applying multilingual BERT model for a Vietnamese QA system and found that BERT model still has certainly limitation in term of time and precision to return a Vietnamese answer. The purpose of this study is to propose a method that solved above restriction of multilingual BERT and applied for question answering system about tourism in Vietnam. Our method combined BERT and knowledge graph to enhance accurately and find quickly for an answer. We experimented our crafted QA data about Vietnam tourism on three models such as LSTM, BERT fine-tuned multilingual for QA (BERT for QA), and BERT+vnKG. As a result, our model outperformed two previous models in terms of accuracy and time. This research can also be applied to other fields such as finance, e-commerce, and so on.

Loading PDF

Similar Papers
  • Research Article
  • Citations3

Improving the BERT model for long text sequences in question answering domain

  • Mar 01, 2024
  • International Journal of Advances in Applied Sciences
  • Vijayan Ramaraj +3
  • Research Article
  • Citations26

Reading comprehension based question answering system in Bangla language with transformer-based learning

  • Oct 01, 2022
  • Heliyon
  • Tanjim Taharat Aurpa +4
  • Research Article
  • Citations11

Building a deep learning-based QA system from a CQA dataset

  • Jun 15, 2023
  • Decision Support Systems
  • Sol Jin +4
  • PDF
  • Research Article
  • Citations18

Bidirectional encoders to state-of-the-art: a review of BERT and its transformative impact on natural language processing

  • Mar 02, 2024
  • Информатика. Экономика. Управление - Informatics. Economics. Management
  • Rajesh Gupta
  • Research Article
  • Citations1

Phishing website detection using novel integration of BERT and XLNet with deep learning sequential models

  • Nov 01, 2024
  • Indonesian Journal of Electrical Engineering and Computer Science
  • Kongara Srinivasa Rao +5
  • Book Chapter
  • Citations25

Investigating Query Expansion and Coreference Resolution in Question Answering on BERT

  • Jan 01, 2020
  • Natural Language Processing and Information Systems
  • Santanu Bhattacharjee +3
  • Conference Article
  • Citations15

Vietnamese Question Answering System f rom Multilingual BERT Models to Monolingual BERT Model

  • Dec 04, 2020
  • Nguyen Thi Mai Trang +1
  • Research Article

Comparative Analysis of Deep Learning Approaches for Twitter Text Classification

  • Oct 21, 2022
  • INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT
  • Lukesh Kadu
  • Conference Article
  • Citations3

Bilingual Question Answering System Using Bidirectional Encoder Representations from Transformers and Best Matching Method

  • Oct 20, 2021
  • Dini Adni Navastara +2
  • PDF
  • Research Article
  • Citations39

Automatic detection of actionable radiology reports using bidirectional encoder representations from transformers

  • Sep 11, 2021
  • BMC Medical Informatics and Decision Making
  • Yuta Nakamura +8
  • Research Article

A bio- medical Question Answering system for the Malayalam language using word embedding and Bidirectional Encoder Representation from Transformers.

  • Jan 01, 2022
  • International Journal of Security and Privacy in Pervasive Computing
  • Research Article
  • Citations38

Modified Bidirectional Encoder Representations From Transformers Extractive Summarization Model for Hospital Information Systems Based on Character-Level Tokens (AlphaBERT): Development and Performance Evaluation

  • Apr 29, 2020
  • JMIR Medical Informatics
  • Yen-Pin Chen +4
  • Research Article
  • Citations170

BERT applications in natural language processing: a review

  • Mar 15, 2025
  • Artificial Intelligence Review
  • Nadia Mushtaq Gardazi +5
  • Discussion
  • Citations142

Classifying social determinants of health from unstructured electronic health records using deep learning-based natural language processing

  • Jan 07, 2022
  • Journal of Biomedical Informatics
  • Sifei Han +9
  • Research Article
  • Citations179

Comparing deep learning architectures for sentiment analysis on drug reviews.

  • Aug 17, 2020
  • Journal of Biomedical Informatics
  • Cristóbal Colón-Ruiz +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.