- Research Article
22
- 10.1162/coli_a_00420
Natural Language Processing and Computational Linguistics
- Dec 07, 2021
- Computational Linguistics
- Junichi Tsujii
Natural Language Processing and Computational Linguistics
Current question answering (QA) systems usually contain named entity recognizer (NER) as a core component. NER is an important and difficult task in computational linguistics. It plays an important role in natural language processing application such as Question Answering, Machine Translation, and Information Retrieval etc. NER includes the identification and classification of certain proper nouns (like location, organization, person, data, money and others) in a text. The purpose of our study is to recognize and extract the exact Japanese sight seeing domain named entities. It is a basic step for the following processing: question analysis and keyword extraction information retrieval. As well as, through doing the named entity recognition, we consider that it can mine exact information from text document to respond to user. This paper describes how to do the Japanese sightseeing named entity recognition due to we are constructing a Japanese sightseeing question answering system. We adopt the hybrid method which combined with machine learning and rule-base method. In the experiment of Japanese sightseeing domain named entity recognition we have got excellent precision and recalling rates. It shows that our method is effective and can be used in a practical question answering system.
Natural Language Processing and Computational Linguistics
Natural Language Processing and Computational Linguistics
Core techniques of question answering systems over knowledge bases: a survey
The Semantic Web contains an enormous amount of information in the form of knowledge bases (KB). To make this information available, many question answering (QA) systems over KBs were created in the last years. Building a QA system over KBs is difficult because there are many different challenges to be solved. In order to address these challenges, QA systems generally combine techniques from natural language processing, information retrieval, machine learning and Semantic Web. The aim of this survey is to give an overview of the techniques used in current QA systems over KBs. We present the techniques used by the QA systems which were evaluated on a popular series of benchmarks: Question Answering over Linked Data. Techniques that solve the same task are first grouped together and then described. The advantages and disadvantages are discussed for each technique. This allows a direct comparison of similar techniques. Additionally, we point to techniques that are used over WebQuestions and SimpleQuestions, which are two other popular benchmarks for QA systems.
Read moreNamed Entity Recognition over Dialog Dataset Using Pre-trained Transformers
Need of natural language processing (NLP) applications and advancement in deep learning (DL) techniques have increased the need of large amount of human readable data leading to interesting research area named entity recognition (NER), which is a sub-task of natural language processing. NER identifies and tags different real-life entities in their pre-defined categories. Pre-defined categories include person, locations, times, organizations, events, etc., depending upon dataset in hand. For different natural language processing applications such as information retrieval (IR), question answering system (QAS), text summarization (TS), and machine translation (MT), NER forms a base work. Performance of earlier NER techniques is good but requires human intervention for forming domain-specific features or rules. Performance of NER system is further improved by application of emerging deep learning models, and also use of NER in dialog system is less explored area. So, in this paper, our aim is to mention different techniques which can be applied to do NER task and fine-tune the prê-trained transformers to work on in-car dialog dataset for NER task and evaluate the performance of system.
Read moreResearch on Named Entity Recognition for Information Extraction
In natural language processing, named entity recognition, as a basic task used in natural language processing, aims at identifying entities with specific meaning in the text, mainly including personal names, place names, institutional names, proper nouns, etc. Named entity recognition technology is an indispensable part of many natural language processing methods, such as information extraction, information retrieval, machine translation and question answering systems. This paper first briefly introduces the developing process of named entity recognition, and describes the basic concept, objectives and difficulties of named entity recognition. Then, it summarizes the methods of named entity recognition from based on rules and dictionary method, based on statistical method, to the deep learning method and migration of learning, and looks forward to the future development of named entity recognition.
Read moreQuestion answering systems for health professionals at the point of care-a systematic review.
Question answering (QA) systems have the potential to improve the quality of clinical care by providing health professionals with the latest and most relevant evidence. However, QA systems have not been widely adopted. This systematic review aims to characterize current medical QA systems, assess their suitability for healthcare, and identify areas of improvement. We searched PubMed, IEEE Xplore, ACM Digital Library, ACL Anthology, and forward and backward citations on February 7, 2023. We included peer-reviewed journal and conference papers describing the design and evaluation of biomedical QA systems. Two reviewers screened titles, abstracts, and full-text articles. We conducted a narrative synthesis and risk of bias assessment for each study. We assessed the utility of biomedical QA systems. We included 79 studies and identified themes, including question realism, answer reliability, answer utility, clinical specialism, systems, usability, and evaluation methods. Clinicians' questions used to train and evaluate QA systems were restricted to certain sources, types and complexity levels. No system communicated confidence levels in the answers or sources. Many studies suffered from high risks of bias and applicability concerns. Only 8 studies completely satisfied any criterion for clinical utility, and only 7 reported user evaluations. Most systems were built with limited input from clinicians. While machine learning methods have led to increased accuracy, most studies imperfectly reflected real-world healthcare information needs. Key research priorities include developing more realistic healthcare QA datasets and considering the reliability of answer sources, rather than merely focusing on accuracy.
Read moreAnswering Gene Ontology terms to proteomics questions by supervised macro reading in Medline
Motivation and Objectives Biomedical professionals have at their disposal a huge amount of literature. But when they have a precise question, they often have to deal with too many documents to efficiently find the appropriate answers in a reasonable time. Faced to this literature overload, the need for automatic assistance has been largely pointed out, and PubMed is argued to be only the beginning on how scientists use the biomedical literature (Hunter and Cohen, 2006). Ontology-based search engines began to introduce semantics in search results. These systems still display documents, but the user visualizes clusters of PubMed results according to concepts which were extracted from the abstracts. GoPubMed (Doms and Schroeder, 2005) and EBIMed (Rebholz-Schuhmann et al, 2007) are popular examples of such ontology-based search engines in the biomedical domain. Question Answering (QA) systems are argued to be the next generation of semantic search engines (Wren, 2011). QA systems no more display documents but directly concepts which were extracted from the search results; these concepts are supposed to answer the user’s question formulated in natural language. EAGLi (Gobeill et al, 2009), our locally developed system, is an example of such QA search engines. Thus, both ontology-based and QA search engines, share the crucial task of efficiently extracting concepts from the result set, i.e. a set of documents. This task is sometimes called macro reading, in contrast with micro reading – or classification, categorization – which is a traditional Natural Language Processing task that aims at extracting concepts from a single document (Mitchell et al, 2009). This paper focuses on macro reading of MEDLINE abstracts. Several experiments have been reported to find the best way to extract ontology terms out of a single MEDLINE abstract, i.e. micro reading. In particular, (Trieschnigg et al, 2009) compared the performances of six classification systems for reproducing the manual Medical Subject Headings (MeSH) annotation of a MEDLINE abstract. The evaluated systems included two morphosyntactic classifiers (sometimes also called thesaurus-based), which aim at literally finding ontology terms in the abstract by alignment of words, and a machine learning (or supervised) classifier, which aims at inferring the annotation from a knowledge base containing already annotated abstracts. The authors concluded that the machine learning approach outperformed the morphosyntactic ones. But the macro reading task is fundamentally different, as we look for the best way to extract then combine ontology terms from a set of MEDLINE abstracts. The issue investigated in this paper is: to what extent the differences observed between two classifiers for a micro reading task are observed for a macro reading one? In particular, the redundancy hypothesis claims that the redundancy in large textual collections such as the Web or MEDLINE tends to smoothe performance differences across classifiers (Lin, 2007). To address this question, we compared a morphosyntactic and a machine learning classifiers for both tasks, focusing on the extraction of Gene Ontology (GO) terms, a controlled vocabulary for the characterization of proteins functions. The micro reading task consisted in extracting GO terms from a single MEDLINE abstract, as in the Trieschnigg et al’s work; the macro reading task consisted in extracting GO terms from a set of MEDLINE abstracts in order to answer to proteomics questions asked to the EAGLi QA system.
Read moreBERT+vnKG: Using Deep Learning and Knowledge Graph to Improve Vietnamese Question Answering System
A question answering (QA) system based on natural language processing and deep learning is a prominent area and is being researched widely. The Long Short-Term Memory (LSTM) model that is a variety of Recurrent Neural Network (RNN) used to be popular in machine translation, and question answering system. However, that model still has certainly limited capabilities, so a new model named Bidirectional Encoder Representation from Transformer (BERT) emerged to solve these restrictions. BERT has more advanced features than LSTM and shows state-of-the-art results in many tasks, especially in multilingual question answering system over the past few years. Nevertheless, we tried applying multilingual BERT model for a Vietnamese QA system and found that BERT model still has certainly limitation in term of time and precision to return a Vietnamese answer. The purpose of this study is to propose a method that solved above restriction of multilingual BERT and applied for question answering system about tourism in Vietnam. Our method combined BERT and knowledge graph to enhance accurately and find quickly for an answer. We experimented our crafted QA data about Vietnam tourism on three models such as LSTM, BERT fine-tuned multilingual for QA (BERT for QA), and BERT+vnKG. As a result, our model outperformed two previous models in terms of accuracy and time. This research can also be applied to other fields such as finance, e-commerce, and so on.
Read moreTowards OpenDomain CrossLanguage Question Answering
We present MATQAM (Multilingual Answer Triggering Question Answering Machine) a multilingual answer triggering open-domain QA system, focusing on answering questions whose answers might be in free texts in multiple languages within Wikipedia.Obtaining relevant information from the Web has become more challenging, since online communities and social media tend to confine people to bounded trends and ways of thinking. Due to the large amount of data available, getting the relevant information has become a more challenging task. Unlike in standard Information Retrieval (IR), Question Answering (QA) systems aim at retrieving the relevant answer(s) to a question expressed in natural language, instead of returning a list of documents. On the one hand, information is dispersed in different languages and needs to be gathered to get more knowledge. On the other hand, extracting answers from multilingual documents is a complicated task because natural languages follow diverse linguistic syntaxes and rules, especially for Semitic languages, such as Arabic. This project tackles open-domain QA using Wikipedia as source of knowledge by building a multilingual —Arabic, French, English— QA system. In order to obtain a collection of Wikipedia articles as well as questions in multiple languages, we extended an existing English dataset: WikiQA (Yang et al., 2015). We used the WikiTailor toolkit (Barrón-Cedeño et al., 2015) to build a comparable corpus form Wikipedia articles and to extract the corresponding articles in Arabic, French, and English. We used neural machine translation to generate the questions in the three languages as well. Our QA system consists of the three following modules. (i) Question processing consists of transforming a natural language question into a query and determining the expected type of the answer in order to define the retrieval mechanism for the extraction function. (ii) The document retrieval module consists of retrieving the most relevant documents from the search engines —in multiple languages— given the produced query. The purpose of this module is to identify the documents that may contain an answer to the question. It requires cross-language representations as well as machine translation technology to do that, as the question could be asked in Arabic, French or English and the answer could be in either of these languages. (iii) The answer identification module ranks specific text fragments that are plausible answers to the question. It first ranks the candidate text fragments in the different languages and, if they are found, they are combined into one consolidated answer. This is a variation of the cross-language QA scenario enabling answer triggering, where no concrete answer has to be provided, if it does not exist. In order to build our QA system, we extend an existing framework (Rücklé and Gurevych, 2017) integrating neural networks for answer selection. References Alberto Barrón-Cedeño, Cristina España Bonet, Josu Boldoba Trapote, and Luís Márquez Villodre. A Factory of Comparable Corpora from Wikipedia. In Proceedings of the Eighth Workshop on Building and Using Comparable Corpora, pages 3–13, Beijing, China, 2015. Association for Computational Linguistics. Andreas Rücklé and Iryna Gurevych. End-to-End Non-Factoid Question Answering with an Interactive Visualization of Neural Attention Weights. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics-System Demonstrations (ACL 2017), pages 19–24, Vancouver, Canada, August 2017. Association for Computational Linguistics. doi:10.18653/v1/P17-4004. URL http://aclweb.org/anthology/P17-4004. Yi Yang, Wen-tau Yih, and Christopher Meek. WikiQA: A Challenge Dataset for Open-Domain Question Answering. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 2013–2018, Lisbon, Portugal, 2015.
Read moreTowards an efficient Malayalam Named Entity Recognizer Analysis on the Challenges
Towards an efficient Malayalam Named Entity Recognizer Analysis on the Challenges
Combining semantic information in question answering systems
Combining semantic information in question answering systems
The first step towards named entity recognition in mising language
Named Entity Recognition (NER) is used to classify each word of a document into predefined named entity classes and is important for Natural Language Processing (NLP) tasks such as information retrieval, question answering system, machine translation etc. Mising is a Tibeto-Burman language spoken by over 500,000 Mising people who inhabit in Assam. Mising is a resource-constrained language. The corpus for the language was developed by the authors with 50K words as there is hardly any document in the web written in the language. The authors had used 12 tag sets and Support Vector Machine (SVM) classifier for NER in Mising language. As the Mising language uses the Roman script and the named entities are always starts with capital letter in Mising language unlike other Indian languages makes it easier to extract and classify the NER. The authors used 5-fold cross validation test for the SVM based NER system with average Precision, recall and F-Score of 85.14%, 90.58% and 87.77% respectively. As this was the first NER system for the language, the authors did not find other systems to compare with.
Read moreNamed Entity Recognition using Support Vector Machine: A Language Independent Approach
<p>Named Entity Recognition (NER) aims to classify each word of a document into predefined target named entity classes and is now-a-days considered to be fundamental for many Natural Language Processing (NLP) tasks such as information retrieval, machine translation, information extraction, question answering systems and others. This paper reports about the development of a NER system for Bengali and Hindi using Support Vector Machine (SVM). Though this state of the art machine learning technique has been widely applied to NER in several well-studied languages, the use of this technique to Indian languages (ILs) is very new. The system makes use of the different contextual information of the words along with the variety of features that are helpful in predicting the four different named (NE) classes, such as Person name, Location name, Organization name and Miscellaneous name. We have used the annotated corpora of 122,467 tokens of Bengali and 502,974 tokens of Hindi tagged with the twelve different NE classes 1, defined as part of the IJCNLP-08 NER Shared Task for South and South East Asian Languages (SSEAL) 2. In addition, we have manually annotated 150K wordforms of the Bengali news corpus, developed from the web-archive of a leading Bengali newspaper. We have also developed an unsupervised algorithm in order to generate the lexical context patterns from a part of the unlabeled Bengali news corpus. Lexical patterns have been used as the features of SVM in order to improve the system performance. The NER system has been tested with the gold standard test sets of 35K, and 60K tokens for Bengali, and Hindi, respectively. Evaluation results have demonstrated the recall, precision, and f-score values of 88.61%, 80.12%, and 84.15%, respectively, for Bengali and 80.23%, 74.34%, and 77.17%, respectively, for Hindi. Results show the improvement in the f-score by 5.13% with the use of context patterns. Statistical analysis, ANOVA is also performed to compare the performance of the proposed NER system with that of the existing HMM based system for both the languages.</p>
Read moreA Study on Machine Learning Approaches for Named Entity Recognition
Natural Language Processing (NLP) is one of the sub-parts of Artificial Intelligence which normally focuses on empowering computers to understand and operate on human languages and to get computers closer towards understanding a language as a human does. Named Entity Recognition (NER) is core of NLP systems. NER is a process of automatic identification of named entities in a given text or document. Named entities are real world objects or in general named entities are proper nouns like name of person, location, date and time expression etc. The recognition and extraction of real named entity is very important for solving difficulties in many research areas like Question Answering and Summarization Systems, Information Extraction, Machine Learning, Semantic Web Search and Bio-informatics, Video Annotation and many more. In this paper the major focus is given on comprehending different types of NER and approaches applied for NER especially different machine learning models used for identification of Named Entities.
Read moreLioness Adapted GWO-Based Deep Belief Network Enabled with Multiple Features for a Novel Question Answering System
Recently, the researches on Question Answering (QA) systems attract progressive attention with the enlargement of data and the advances on machine learning. Selection of answers from QA system is a significant task for enhancing the automatic QA systems. However, the major complexity relies in the designing of contextual factors and semantic matching. Motivation: Question Answering is a specialized form of Information Retrieval which seeks knowledge. We are not only interested in getting the relevant pages but we are interested in getting specific answer to queries. Question Answering is in itself intersection of Natural Language Processing, Information Retrieval, Machine Learning, Knowledge Representation, Logic and Inference and Semantic Search. Contribution: Feature extraction plays a major role for accurate classification, where the learned features get extracted for enhancing the capability of sequence learning. Optimized Deep Belief network model is adopted for the precise question answering system, which could handle both objective and subjective questions. A new hybrid optimization algorithm known as Lioness Adapted GWO (LA-GWO) algorithm is introduced, which mainly concentrates on high reliability and convergence rate. This paper intends to formulate a novel QA system, and the process starts with word embedding. From the embedded results, some of the features get extracted, and subsequently, the classification is carried out using the hybrid optimization enabled Deep Belief Network (DBN). Specifically, the hidden neurons in DBN will be optimally tuned using a new Lioness Adapted GWO (LA-GWO) algorithm, which is the hybridization of both Lion Algorithm (LA) and Grey Wolf optimization (GWO) models. Finally, the performance of proposed work is compared over other conventional methods with respect to accuracy, sensitivity, specificity, and precision, respectively.
Read moreThe role of Natural Language Processing with Machine Learning
Natural Language Processing (NLP) has undergone transformative advancements with the integration of Machine Learning (ML) techniques, fundamentally enhancing how machines understand and generate human language. This paper explores the synergy between NLP and ML, emphasizing the role of ML algorithms in improving NLP applications. We discuss key ML methodologies, including supervised and unsupervised learning, as well as deep learning models such as Recurrent Neural Networks (RNNs), Long Short-Term Memory (LSTM) networks, and Transformer-based architectures like BERT and GPT. These innovations have significantly advanced applications including text classification, sentiment analysis, named entity recognition, machine translation, question answering systems, chatbots, and more. We also address challenges and emerging trends in the field, providing a comprehensive overview of how ML-driven NLP solutions are shaping the future of technology. This paper aims to offer insights into the impact of ML on NLP and its implications for developing more sophisticated and efficient language-processing systems.
Read more