A combination approach for enhancing automated traceability (NIER track)

The Web has become a large repository of documents (or pages) written in many different languages. In this context, traditional information retrieval (IR) techniques cannot be used whenever the user query and the documents being retrieved are in different languages. To address this problem, new cross‐language information retrieval (CLIR) techniques have been proposed. In this work, we describe a method for cross‐language retrieval of medical information. This method combines query terms and related medical concepts obtained automatically through a categorization procedure. The medical concepts are used to create a linguistic abstraction that allows retrieval of information in a language‐independent way, minimizing linguistic problems such as polysemy. To evaluate our method, we carried out experiments using the OHSUMED test collection, whose documents are written in English, with queries expressed in Portuguese, Spanish, and French. The results indicate that our cross‐language retrieval method is as effective as a standard vector space model algorithm operating on queries and documents in the same language. Further, our results are better than previous results in the literature.

Information retrieval (IR) approaches have proven useful in recovering traceability links between free-text documentation and source code. IR-based traceability recovery approaches produce ranked lists of traceability links between pieces of documentation and source code. These traceability links are then pruned using various strategies and, finally, validated by human experts. In this paper we propose two contributions to improve the precision and recall of traceability links and, thus, reduces the required human experts' manual validation effort. First, we propose a novel approach, Trust race, inspired by Web trust models to improve the precision and recall of traceability links: Trust race uses intractability recovery approach to obtain a set of traceability links, which rankings are then re-evaluated using a set of other traceability recovery approaches. Second, we propose a novel traceability recovery approach, His trace, to identify traceability links between requirements and source code through CVS/SVN change logs using a Vector Space Model (VSM). We combine a traditional recovery traceability approach with His trace to build Trust race in which we use Histraceas one expert adding knowledge to the traceability links extracttedfrom CVS/SVN change logs. We apply Trustrace on two case studies to compare its traceability links with those recovered using only the VSM-based approach, in terms of precision and recall. We show that Trustrace improves with statistical significance the precision of the traceability links while also improving recall but without statistical significance.

Trace links between requirements and code are beneficial for many software engineering tasks such as maintenance, program comprehension, and re-engineering. If trace links are created and used continuously during a project, they need to have high precision and recall to be useful. However, manual trace link creation is cumbersome and existing automatic trace link creation methods are typically only applied retrospectively and to structured requirements. Therefore, they focus on recall and accept manual effort to cope with low precision. Such manual effort is not acceptable continuously. Furthermore, the maintenance of existing links along with changing artefacts in a project is neglected in most automatic trace link creation approaches. Therefore, we developed and evaluated an interaction log-based trace link creation approach IL to continuously provide correct trace links during a project. IL links unstructured requirements specified in an issue tracker and source code managed in a version control system. In the latest version, ILCom, our approach uses the interactions of developers with files in an integrated development environment and issue identifiers provided in commit messages to create trace links continuously after each commit. In this paper, we present ILCom, its most recent evaluation study, and a systematic literature review (SLR) about trace link maintenance (TM). We also present a TM process for ILCom based on two approaches from our SLR. In the evaluation study, we show that precision of ILCom created links is above 90% and recall almost at 80%. In the SLR, we discuss 16 approaches. Our approach is the first trace link creation approach with very good precision and recall and integrated trace maintenance.

Information retrieval (IR) is widely used in automatically requirements traceability recovery. Corresponding approaches are built based on textual similarity, that is, the higher the similarity, the higher possibility of artifacts related. A common work of many IR-based techniques is to remove false positive links in the candidate links to achieve higher accuracy. In fact, traceability links can be recovered by different kinds of information, not only the textual information. In our study, we propose to recover more traceability links by exploring both textual features and structural information. Specifically, we use combined IR techniques to process the textual information of the software artifacts, and extract the structural information from the source code, establishing corresponding code relationship graphs. We then incorporate such structural information into the traceability recovery analysis by using graph embedding. The results show that combined IR techniques and using graph embedding technology to process structural information can improve the recovery traceability.

The Web enables to have access to silo-ed information describing news articles, often offering a multitude of viewpoints that, once combined, can provide a broader picture of the story being reported on the news. In this paper, we propose an approach that automatically extracts representative features of a news item, namely named entities, from textual content attached to a video item (subtitles) and from a set of documents from the Web collected using entity expansion techniques. Approaches relying on entity expansion generally try to collect and process the important facts behinds a particular news item, but they are often too dependent on frequency-based functions and information retrieval techniques thus neglecting the multi-dimensional relationships that are established among the entities. We propose a concentric-based approach that enables to represent the context of a news item, by harmonizing into a single model the representative entities, which can be extracted using information retrieval and natural language processing techniques (Core), and other entities that get prominent according to different dimensions such as informativeness, semantic connectivity, or popularity (Crust). We compare our approach with a baseline by analyzing the compactness of the generated summary on an existing gold standard available on the Web. Results of the experiments show that our approach converges faster to the ideal compact news snapshot with an improvement of 36.9% over the baseline.

Context and motivation: Traceability is used to follow and understand the relationships between various software engineering artifacts such as requirements and source code. Comprehensive traceability of software engineering artifacts is important to ensure that a software can be further developed or maintained. Traceability links are often created manually by using commit ids or retrospectively by using information retrieval (IR). Question/Problem: However, creating traceability links manually is costly and it is error-prone in retrospect. As part of our ongoing research on feature management where traceability is also of interest, we use a lightweight tagging approach to relate artifacts. We want to investigate how such a tag-based approach compares to approaches using commit ids, interaction logs (IL), and IR for creating traceability links. Principal ideas/results: We conducted a case study in which students applied the tag-based, the IL-based, and the commit-based approach. We transformed the tags to traceability links and compared them with the commit-based and IL-based approach as well as with IR-based approaches, using a gold standard. We applied different improvements. Contribution: This is the first study comparing four completely different traceability approaches in one project. The combination of IL and commit ids shows the best precision and recall but is intrusive. The other approaches differ less in precision and recall and both need improvement for practical application. We discuss the benefits and drawbacks of the different approaches and state implications for research and practice.

This chapter provides a perspective on a problem-based learning (PBL) approach to teaching information retrieval (IR) theory, techniques, and practice at under- and postgraduate levels. The educational philosophy of PBL is outlined, and its pertinence to addressing the challenges of teaching IR in terms of both the diverse nature of the subject and also of the students is discussed. It is argued that teaching IR as a solution to a problem (access to information) and as a problem (how can we organize information in IR systems so it can be accessed) provides an engaging and challenging way to teach it to a range of students. It also draws connections between IR theory and techniques and relates IR to other disciplines through showing how similar problems are faced in other subjects. Some specific examples of teaching exercises based on PBL are provided with a discussion and reflection on their effectiveness. Finally assessment and feedback from students are discussed.

Companies often develop and maintain a collection of product variants that share some common features but also support different, customer-specific features. To reengineering such legacy product variants for systematic reuse, one must identify features and their implementing code units (e.g. functions, files) in different product variants. Information retrieval (IR) techniques may be applied for that purpose. In this paper, we discuss problems that hinder direct application of IR techniques to a collection of product variants. To counter these problems, we present an approach to support effective feature location in product variants. The novelty of our approach is that we exploit commonalities and differences of product variants by software differencing and FCA techniques so that IR technique can achieve satisfactory results for feature location in product variants. We have implemented our approach and conducted evaluation with a collection of nine Linux kernel product variants. Our evaluation shows that our approach always significantly outperforms a direct application of IR technique in the subject product variants.

A key part of software evolution and maintenance is the continuous integration from collaborative efforts, often resulting in complex traceability challenges between software artifacts: features and modules remain scattered in the source code, and traceability links become harder to recover. In this paper, we perform a systematic mapping study dealing with recent research recovering these links through information retrieval, with a particular focus on natural language processing (NLP).Our search strategy gathered a total of 96 papers in focus of our study, covering a period from 2013 to 2021. We conducted trend analysis on NLP techniques and tools involved, and traceability efforts (applying NLP) across the software development life cycle (SDLC). Based on our study, we have identified the following key issues, barriers, and setbacks: syntax convention, configuration, translation, explainability, properties representation, tacit knowledge dependency, scalability, and data availability.Based on these, we consolidated the following open challenges: representation similarity across artifacts, the effectiveness of NLP for traceability, and achieving scalable, adaptive, and explainable models. To address these challenges, we recommend a holistic framework for NLP solutions to achieve effective traceability and efforts in achieving interoperability and explainability in NLP models for traceability.

Being such a vast resource of information, World Wide Web has become irreplaceable but the outburst of information available over the internet has made web search a time consuming and a very complex process. Now days if someone need to retrieve any information using internet they come across huge number of web pages because of large amount of data on web. It becomes difficult task to find information so in order to retrieve meaningful and intelligent information we have many information retrieval (IR) techniques. To gather the significant information from such a vast available resource Information Retrieval (IR); a method of retrieving such information resources which are relevant to an information need is applied. This paper would review few of these methods for intelligent information retrieval systems on web based on the Ontology information retrieval techniques.

Visual information retrieval (VIR) is an active and vibrant research area, which attempts at providing means for organizing, indexing, annotating, and retrieving visual information (images and videos) form large, unstructured repositories. The goal of VIR is to retrieve the highest number of relevant matches to a given query (often expressed as an example image and/or a series of keywords). In its early years (1995-2000) the research efforts were dominated by content-based approaches contributed primarily by the image and video processing community. During the past decade, it was widely recognized that the challenges imposed by the semantic gap (the lack of coincidence between an image's visual contents and its semantic interpretation) required a clever use of textual metadata (in addition to information extracted from the image's pixel contents) to make image and video retrieval solutions efficient and effective. The need to bridge (or at least narrow) the semantic gap has been one of the driving forces behind current VIR research. Additionally, other related research problems and market opportunities have started to emerge, offering a broad range of exciting problems for computer scientists and engineers to work on. In this tutorial, we present an overview of visual information retrieval (VIR) concepts, techniques, algorithms, and applications. Several topics are supported by examples written in Java, using Lucene (an open-source Java-based indexing and search implementation) and LIRE (Lucene Image REtrieval), an open-source Java-based library for content-based image retrieval (CBIR) written by Mathias Lux.After motivating the topic, we briefly review the fundamentals of information retrieval, present the most relevant and effective visual descriptors currently used in VIR, the most common indexing approaches for visual descriptors, the most prominent machine learning techniques used in connection with contemporary VIR solutions, as well as the challenges associated with building real-world, large scale VIR solutions, including a brief overview of publicly available datasets used in worldwide challenges, contests, and benchmarks. Throughout the tutorial, we integrate examples using LIRE, whose main features and design principles are also discussed. Finally, we conclude the tutorial with suggestions for deepening the knowledge in the topic, including a brief discussion of the most relevant advances, open challenges, and promising opportunities in VIR and related areas.The tutorial is primarily targeted at experienced Information Retrieval researchers and practitioners interested in extending their knowledge of document-based IR to equivalent concepts, techniques, and challenges in VIR. The acquired knowledge should allow participants to derive insightful conclusions and promising avenues for further investigation.

Software requirements traceability links have been widely recognized as an essential means for effective system evolution when requirements change. However, creating and maintaining traceability links is not an easy task in practice, especially when faced time pressure. Therefore, an automatic and accurate traceability link recovery approach is needed. Existing methods usually recover the traceability links through information retrieval models [1], which calculate text similarity among software artifacts. Although the text-similarity plays an essential role in correlating software artifacts, we argue that the context of software artifacts also renders important clues for establishing the traceability links among software artifacts. For example, for each software use case, its includes/extends use cases can be seen as its context information, contributing to comprehensively profiling the use case. The collection of software artifacts can be modeled as a graph structure through a variety of explicit relationships. Description-Embodied Knowledge Representation Learning (DKRL) [2] is a widely accepted method, which can effectively capture the structural information of explicit relationship and description information of entities. By effectively and precisely embedding such a graph, the context information can be meaningfully represented, contributing to the identification of requirements traceability links. In this paper, we propose a Traceability Link Recovery-Knowledge Representation Learning (TLR-KRL) to recover requirements traceability links between use cases and code based on DKRL. This work has been accepted in The 32nd International Conference on Software Engineering& Knowledge Engineering. TLR-KRL can comprehensively characterize software artifacts by embedding both text information and structural relationships, an overview of which is shown in Fig. 1. Specifically, we follow a systematic process to extend the DKRL model, improving its negative sampling method and thus minimizing false-negative samples generated by the original DKRL model. In such a way, we are able to obtain more precise embedding of software artifacts. Such meaningful embeddings are then used to train traceability link classifiers by using supervised machine learning algorithms. All traceability link candidates obtained from the classifier will be further screened by using triple classification in order to retrieve more correct traceability links. To verify the effectiveness of our method, we have carried out experiments on four datasets, including eTour, EAnci, Clinic, and ITrust. The evaluation results on each of the datasets have all shown that our approach can outperform existing work.

Recovering traceability is an important software goal in the reverse engineering process. Conventional methods based on the information retrieval model have recovered traceability links for supporting software engineers. In such methods, the call relations in the source code directly impact the accuracy of traceability links in large projects, e.g. enterprise projects. This paper uses a source code parser to create a syntax tree as a preprocessing step for information retrieval to recover traceability links between source code and documents. The effectiveness of our proposal is confirmed by a comparison with real product data obtained from an enterprise project.

To quickly locate the source code that maps to a specific change described in change history, establishing traceability links between release notes and source code is a necessary task. Current works on the traceability link recovery can be used to find out source code changes which are of higher textual similarities with the release note. However, these approaches rely on consistency of the text used in artifacts at various abstraction levels, and the completeness of text descriptions. In this paper, we propose to leverage source code change information for improving the accuracy of release note to source code traceability recovery tasks. In order to reduce the complexity of link recovery, our approach first performs change impact analysis to cluster the source code changes for the same purpose as a virtual class. After that, our approach employs a natural language generation algorithm to generate readable summary sentence for each virtual class. The traceability links are built between release notes and clusters of program entities by computing the linguistic similarity of sentences. We conduct case studies on 26 releases of 3 popular softwares to evaluate the approach, and the results indicate that our proposed method can improve the accuracy of traceability link recovery compared to other IR-based techniques.

Due to the increasing daily of users documentation in the global communications network, the management, and control of its information in it have been challenged. How to extract useful knowledge in an Internet heterogeneous environment is essential. Information retrieval techniques can retrieve user information needs in a large amount of data. Search engines are the first selection of users to find information. In this search, Web crawler plays a key role in search engines. A web crawler is a script that routinely scans the web. In this paper, a information retrieval method will be presented using a combination of vector space modeling and language statistical model to improve the retrieve of related documents. The proposed approach is based on the structural similarity of the document corpus. Measuring the similarity of the input term is based on the shortest path between each term and the next term. In this method, the number of nodes, edges and links is calculated. Finally, the similarity using the path feature and cosine similarity is measured. Available documents the proposed method by the crawler of the web is compiled from various Wikipedia pages. The results of the conceptual retrieved of documents show that 84% accuracy, 88% recall and average precision of 56% have improved compared to other methods.