User Stories and Natural Language Processing: A Systematic Literature Review

User story management is a critical aspect of agile software development, as it involves understanding and prioritizing the needs of stakeholders, and translating them into actionable tasks for development teams. Furthermore, the identification of new activities within products is crucial for enhancing software quality assurance, and user story management is a crucial component of agile software development and software testing. Reusing manually written test steps would be a waste of time and effort for the testers because requirements in agile software development are continually changing and eventually becoming out-dated. Therefore, developers need to implement the necessary functions and write test steps for user stories to determine the desired behaviour or desired result of the program. In an agile world, the user story is the link between the customer and the development team, as well as the main pillar on which the development team relies to understand the product requirements. Therefore, developers need to implement the necessary functions and write test steps for user stories to determine the desired behaviour or desired result of the program. Since agile testing can detect defects early in the software life cycle and deliver a high-quality product, we propose our approach to generating test cases using natural language processing to analyse the user story. Therefore, Neural Language Processing (NLP) techniques help the development team to obtain clear data and achieve customer satisfaction.

User stories are commonly used to capture user needs in agile methods due to their ease of learning and understanding. Yet, the simple structure of user stories prevents us from capturing relations among them. Such relations help the developers to better understand and structure the backlog items derived from the user stories. One solution to this problem is to build goal models that provide explicit relations among goals but require time and effort to build. This paper presents a pipeline to automatically generate a goal model from a set of user stories by applying natural language processing (NLP) techniques and our initial heuristics to build realistic goal models. We first parse and identify the dependencies in the user stories, and store the results in a graph database to maintain the relations among the roles, actions, and objects mentioned in the set of user stories. By applying NLP techniques and several heuristics, we generate goal models that resemble human-built models. Automatically generating models significantly decreases the time spent on this tedious task. Our research agenda includes calculating the similarity between the automatically generated models and the expert-built models. Our overarching research goals are to provide i. an NLP-powered framework that generates goal models from a set of user stories, ii. several heuristics to generate goal models that resemble human-built models, and iii. a repository that includes sets of user stories, with corresponding human-built and automatically generated goal models.

1 IntroductionOrganizations focus on automate their processes in order to improve efficiency, reduce costs, and/or reduce human beings' errors in an easy and rapid manner. Business process management (BPM) methods provide a solution to this issue. In this context, information systems like CRM, ERP, SCM, etc. have known an increasing demand. The main problem consists of the length of the business process specifications. If new regulations appear, these specifications must be adapted. Manually extraction of visual models is time consuming. During time, a series of solutions were proposed. The literature shows a crowd of approaches that extracts data models [1], [2], [3], and process models [4], [5] from Natural Language (NL) text. This paper aims to analyze the Natural Language Processing (NLP) techniques and tools used in order to provide different types of visual representations.On the last few years, approaches based on NLP have been developed in order to automate process conversion from NL text. NLP plays an important role in NL text analysis as NLP tries to understand speech and text as humans beings would do. Colloquialism, abbreviations or typos make this task a challenging one. NLP has the origins in 1950s when Alan Turing proposed the Turing test [6], by introducing the imitation game. Since then, the literature shows a plethora of NLP tools [7], [8], [9], [10] using several machine learning techniques, our focus being on those applied on data models and process models discovery from NL text, starting with the first language parser [11] to the actual ones like NLTk [7], [8], ANTLR1, etc.Linguistic analysis is closely tied to NLP. Liddy [12] highlights 7 levels of linguistic analysis: a) Phonetic or Phonological level: how words are pronounced, b) Morphological level: prefixes, suffixes and roots analysis, c) Lexical level: word level analysis including lexical meaning and Part-Of-Speech (POS) analysis, d) Syntactic level: grammatical analysis of words in a sentence, e) Semantic level: determining the possible meanings of sentences, f) Discourse level: interpreting structure and meaning for texts larger than a sentence, g) Pragmatic level: understanding the purpose of a language.Some of the problems approached by NLP are: POS tagging, parsing, Named Entity Recognition (NER), chunking, Semantic Role Labeling (SRL). Anaphora resolution [13] refers to the interpretation of the link between the anaphor and its antecedents.The remainder of the paper is organized as follows: Section 2 briefly outlines the NLP domain, describing the levels of linguistic analysis and the main NLP approaches of analyzing NL requirements. Section 3 focuses on data and process models extraction from NL text. This section makes an introduction to Object Oriented Analysis and Business Process Modeling and analyses the existing tools that discover data and process models from text. Subsequently, Section 4 summarizes the results of this work and the conclusions are drawn in Section 5.2NLPA detailed review on NLP is given in [14] and in [15]. Jones [14] divides the history of NLP into four phases: the first starts at the beginning of the 1940s and lasts to the late 1960s, the second begins from the end of 60s and lasts to the end of 70s, the third is represented by late 80s, where the fourth phase starts in the late of 90s. Next, we will detail each phase as they were defined in [14] and [15]. First phase treated machine translation issues, while the second focused on artificial intelligence. The third phase can be called grammatico-logical phase, which is followed by the lexical phase. A fifth phase is proposed in [16] where formal theories and statistical data are combined. Since this study was published first in 1994 and then it was re-organized in 2001 we can add the sixth phase: from 2000 until present where NLP techniques are combined in order to contribute to visual models extraction.Software requirements are usually written in NL which is asymmetric and irregular [17]. …

The inspection of documents written in natural language with computers has become feasible thanks to the advances in Natural Language Processing (NLP) techniques. However, certain applications require a deeper semantic analysis of the text to produce good results. In this article, we present an exploratory study of semantic-aware NLP techniques for discovering latent concerns in use case specifications. For this purpose, we propose two NLP techniques, namely: semantic clustering and semantically-enriched rules. After evaluating these two techniques and comparing them with a technique developed by other researchers, results have showed that semantic NLP techniques hold great potential for detecting candidate concerns. Particularly, if these techniques are properly configured, they can help to reduce the efforts of requirement analysts and promote better quality in software development.

The growing usage of Agile methodology in software development projects among industry professionals (software engineers, system analysts, requirement engineers, etc.) and academia (software engineering students) leads to the need for the implementation of UML diagram for requirements modelling. Use case diagram, an example of UML diagram, is a very powerful tool to model the requirements specified by the users while also helping the development teams understand the functionalities and interactions between users and the system. However, there is a lack of a system or tool that can perform the operation to visualise the use case diagram directly from user stories because generating this diagram manually requires a deep understanding of the requirements and effective communications with stakeholders and it consume lots of time while previous studies which relate to this study are unable to fulfil the relationship elements of use case diagram. This study will introduce a method to visualise the use case diagram from structured textual user stories by utilising Natural Language Processing (NLP) and application of logical rules which will be done in four stages, namely Requirement Gathering, Natural Language Processing, Application of Logical Rules and UML Diagram Generation. A tool named Stanford CoreNLP will be used to perform four techniques of NLP: tokenisation, stemming and lemmatisation, POS tagging and dependency parsing to process the textual user stories, followed by applying the logical rules before generating the use case diagram. This study will propose a method to solve the gap, which is the problem with the generation of relationship elements, while contribute a semi-automated approach to generate a use case diagram from user stories.

Aspirin-exacerbated respiratory disease (AERD) is an acquired inflammatory condition characterized by the presence of asthma, chronic rhinosinusitis with nasal polyposis, and respiratory hypersensitivity reactions on ingestion of aspirin or other nonsteroidal anti-inflammatory drugs (NSAIDs). Despite AERD having a classic constellation of symptoms, the diagnosis is often overlooked, with an average of greater than 10 years between the onset of symptoms and diagnosis of AERD. Without a diagnosis, individuals will lack opportunities to receive effective treatments, such as aspirin desensitization or biologic medications. Our aim was to develop a combined algorithm that integrates both natural language processing (NLP) and machine learning (ML) techniques to identify patients with AERD from an electronic health record (EHR). A rule-based decision tree algorithm incorporating NLP-based features was developed using clinical documents from the EHR at Mayo Clinic. From clinical notes, using NLP techniques, 7 features were extracted that included the following: AERD, asthma, NSAID allergy, nasal polyps, chronic sinusitis, elevated urine leukotriene E4 level, and documented no-NSAID allergy. MedTagger was used to extract these 7 features from the unstructured clinical text given a set of keywords and patterns based on the chart review of 2 allergy and immunology experts for AERD. The status of each extracted feature was quantified by assigning the frequency of its occurrence in clinical documents per subject. We optimized the decision tree classifier's hyperparameters cutoff threshold on the training set to determine the representative feature combination to discriminate AERD. We then evaluated the resulting model on the test set. The AERD algorithm, which combines NLP and ML techniques, achieved an area under the receiver operating characteristic curve score, sensitivity, and specificity of 0.86 (95% CI 0.78-0.94), 80.00 (95% CI 70.82-87.33), and 88.00 (95% CI 79.98-93.64) for the test set, respectively. We developed a promising AERD algorithm that needs further refinement to improve AERD diagnosis. Continued development of NLP and ML technologies has the potential to reduce diagnostic delays for AERD and improve the health of our patients.

The AI voice assistant mobile application was developed to aid drivers in operating their mobile phones while driving without touching their phones. The literature review examines multiple innovative artificial technologies involved in applications with voice assistants in natural language processing (NLP) techniques. The methodology used involved a qualitative approach, and the design science paradigm was used for the development of the voice assistant for smartphones with NLP techniques. NLP techniques that were applied in the development of the AI voice assistant are smart synthesis, data flow sequence, core and interface accessing, part of speech tagging, named entity recognition, conference resolution, and porter stemming. Some of the operations that are achieved by the application include arithmetic calculations based on voice commands and returning the computer result via voice, searching the internet based on user voice input, and providing a response via voice assistance.

In the past few years there has been a growing interest in the employment of verbal productions as digital biomarkers, namely objective, quantifiable behavioural data that can be collected and measured by means of digital devices, allowing for a low-cost pathology detection, classification and monitoring. Numerous research papers have been published on the automatic detection of subtle verbal alteration, starting from written texts, raw speech recordings and transcripts, and such linguistic analysis has been singled out as a cost-effective method for diagnosing dementia and other medical conditions common among elderly patients (e.g., cognitive dysfunctions associated with metabolic disorders, dysarthria). To provide a critical appraisal and synthesis of evidence concerning the application of natural language processing (NLP) techniques for clinical purposes in the geriatric population. In particular, we discuss the state of the art on studying language in healthy and pathological ageing, focusing on the latest research efforts to build non-intrusive language-based tools for the early identification of cognitive frailty due to dementia. We also discuss some challenges and open problems raised by this approach. We performed a scoping review to examine emerging evidence about this novel domain. Potentially relevant studies published up to November 2021 were identified from the databases of MEDLINE, Cochrane and Web of Science. We also browsed the proceedings of leading international conferences (e.g., ACL, COLING, Interspeech, LREC) from 2017 to 2021, and checked the reference lists of relevant studies and reviews. The paper provides an introductory, but complete, overview of the application of NLP techniques for studying language disruption due to dementia. We also suggest that this technique can be fruitfully applied to other medical conditions (e.g., cognitive dysfunctions associated with dysarthria, cerebrovascular disease and mood disorders). Despite several critical points need to be addressed by the scientific community, a growing body of empirical evidence shows that NLP techniques can represent a promising tool for studying language changes in pathological aging, with a high potential to lead a significant shift in clinical practice. What is already known on this subject Speech and languages abilities change due to non-pathological neurocognitive ageing and neurodegenerative processes. These subtle verbal modifications can be measured through NLP techniques and used as biomarkers for screening/diagnostic purposes in the geriatric population (i.e., digital linguistic biomarkers-DLBs). What this paper adds to existing knowledge The review shows that DLBs can represent a promising clinical tool, with a high potential to spark a major shift to dementia assessment in the elderly. Some challenges and open problems are also discussed. What are the potential or actual clinical implications of this work? This methodological review represents a starting point for clinicians approaching the DLB research field for studying language in healthy and pathological ageing. It summarizes the state of the art and future research directions of this novel approach.

Social media, a buzz term in the modern world, refers to various online platforms like social networks, forums, blogs and blog comments, microblogs, wikis, media sharing platforms, social bookmarks through which communication between individuals, communities, or groups takes place. People over social media do not only share their ideas and opinions, but it has become an important source through which businesses promote their products. Analyzing huge data generated over social media is useful in various tasks like analyzing customer trends, forecast sales, understanding opinions of people on different hot topics, views of customers about services/products, and many more. Different natural language processing (NLP) techniques are used for crawling and processing social media data to get useful insights out of this. In this chapter, the focus is on various NLP techniques used to process the social media data. Challenges faced by NLP techniques to process social media data are also put forward in this chapter.

Executable files still remain popular to compromise the endpoint computers. These executable files are often obfuscated to avoid anti-virus programs. To examine all suspicious files from the Internet, dynamic analysis requires too much time. Therefore, a fast filtering method is required. With the recent development of natural language processing (NLP) techniques, printable strings became more effective to detect malware. The combination of the printable strings and NLP techniques can be used as a filtering method. In this paper, we apply NLP techniques to malware detection. This paper reveals that printable strings with NLP techniques are effective for detecting malware in a practical environment. Our dataset consists of more than 500,000 samples obtained from multiple sources. Our experimental results demonstrate that our method is effective to not only subspecies of the existing malware, but also new malware. Our method is effective against packed malware and anti-debugging techniques.

This Chapter discusses the application of Natural Language Processing (NLP) in the legal domain for entity identification and the generation of hierarchy-based applications. NLP techniques, such as Named Entity Recognition (NER) and information extraction, are utilized to analyse legal documents, extract key information, and understand contextual relationships. The integration of NLP facilitates tasks such as legal document summarization, contract analysis, automated document generation, and legal research, thereby enhancing the efficiency and accuracy of legal processes. The creation of hierarchical structures within documents, language translation, sentiment analysis, and compliance monitoring further contribute to the comprehensive utilization of NLP in the legal field. The abstract highlights the transformative impact of NLP in streamlining legal workflows, improving information retrieval, and ensuring compliance with evolving legal standards. Most judicial systems in the world, centered around the Supreme Court as the highest-level court, grapples with a substantial caseload, receiving over 7,500 cases annually but hearing fewer than 150. The Supreme Court's unique role in interpreting the constitutionality of laws and establishing precedents underscores its significant influence. Challenges arise from the overwhelming caseload, leading to increased use of plea bargains and potential concerns about justice. To address these issues, a proposed research initiative suggests employing machine learning and natural language processing to accelerate Supreme Court decisions, aiming to uncover pivotal aspects that greatly influence the outcomes, and enhance our comprehension on India legal system's functioning and constraints. This chapter presents a methodology for sentiment-based summarization of legal documents using Natural Language Processing (NLP) techniques. The process involves pre-processing the text, conducting sentiment analysis to label sentences as positive, negative, or neutral, and then summarizing the document while incorporating the identified sentiments. Special attention is paid to legal-specific considerations such as terminology and context.

Urban planners routinely engage with extensive textual materials, such as zoning codes, comprehensive plans, and public comments. The large volume of textual data being generated in cities offers new opportunities to use emerging computational technologies to process and analyze textual data. In this research, we compare how natural language processing (NLP) techniques and large language models (LLMs) compare to human qualitative coding techniques to identify public sentiment and topics contained in public comments about the Minneapolis 2040 upzoning. We use a custom rubric developed in collaboration with urban planners to assess outputs across these different methods, scoring outputs on factors such as accuracy, convergence, creativity, efficiency, and interpretability. Additionally, we conduct interviews with practicing urban planners to understand their perceptions of integrating these computational techniques into their existing workflows. We find that using NLP techniques are helpful in providing urban planners with an aerial view of their data, but require additional human interpretation. In contrast, using LLMs markedly improves efficiency, interpretability, and descriptiveness over traditional NLP techniques, but requires human validation to address concerns related to social biases and equity. We further find that urban planners are open to using new text processing technologies, but have reservations about entirely outsourcing decision-making to AI tools, viewing AI technologies more as “co-pilots” rather than autonomous agents. Our findings underscore the importance of integrating human judgment into using computational tools to develop a more informed, equitable, and reflective practice in an era of expanding urban data and computational technologies.

With the trend of globalization and digitalization, many transnational companies are continuously collecting and storing unstructured text data in different languages. To exploit the business value of such high-volume multilingual text data, cross-lingual information extraction utilizes machine translation and other natural language processing (NLP) techniques to analyze this data. However, results of these analysis heavily depend on the order in which the tasks are performed as well as the used machine translation and NLP approaches or trained models. In this paper, we defined and evaluated a series of cross-lingual text processing pipelines for English and Chinese language. We therefore combine multiple commercial machine translation services with different automatic keyphrase extraction and named entity recognition techniques and evaluate their performance with regards to the order of execution. Hence, we evaluate the combination of machine translation systems and natural language processing techniques with two processing sequences in our experiment. One is to translate the document before extracting keyphrase and named entities. The other is to translate the processing results. The experiment outcomes indicate that translating documents is a better choice than the other way around in both tasks. However, there exists a substantial disparity between the performance of the cross-lingual text processing pipelines and the corresponding monolingual references.

The role of natural language processing (NLP) techniques, such as parsing and semantic analysis, is described within current language tutoring systems. Significant trends are distinguished in the exploitation of these techniques, design issues and tradeoffs are examined, and current and potential contributions of NLP technology are discussed with respect to instructional theory and educational practice. Limitations and problems are addressed in using NLP tools for teaching, and approaches to assessment are considered.

Fast-paced and ever-growing advances in Signal Processing and Machine Learning (ML) models have initiated works on autonomous medical monitoring/screening tasks to assess patients' cognitive state. In conventional cognitive assessment systems, a physician evaluates the mental abilities of the brain by rating the patient's numerical, verbal, and logical responses. Development of an autonomous cognitive assessment system that replaces the physician is a critically challenging task. As a first step towards achieving this objective, in this paper an Automated Virtual Cognitive Assessment (AVCA) framework is proposed that integrates Natural Language Processing (NLP) and hand gesture recognition techniques. The proposed AVCA framework provides individual scores in the seven major cognitive domains, i.e., orientation, attention, language, contractual ability, memory, calculation, and reasoning. More specifically, audio and video signals are fed to the framework in a real-time fashion, where semantic and synthetic analysis are performed using NLP techniques and Deep Neural Network (DNN) models. The AVCA's real-time video processing engines interpret patients' video signals to monitor their hand gestures and enable easier interaction. Initial simulation results corroborate effectiveness of the proposed AVCA framework.