Novelty and topicality in interactive information retrieval

Traditional information retrieval algorithms ignore user needs and are unable to obtain user gaze coordinates and gaze times, resulting in low retrieval accuracy. The author proposes a new interactive information retrieval algorithm for this purpose. Divide eye tracking technology evaluation indicators, visually process eye movement information, obtain user gaze coordinates and gaze time, and calculate the influence coefficients of each gaze area and each point in the area. Weighted visual words are accumulated to get a visual word list with the weight of the associated area, and visual word list and Rocchio algorithm are combined to build a hidden Relevance feedback retrieval model in semantic space to judge information retrieval preferences. Intelligent robot is introduced, and Jensen Shannon divergence is used to calculate the Kullback–Leibler divergence distance between the probability distributions of document sets, calculate the similarity matching, and complete the interactive information retrieval. The simulation results prove that, due to the introduction of intelligent robot strategy in this method, the amount of irrelevant retrieval information is reduced by matching user needs and retrieval results. Therefore, the amount of messages generated by information retrieval is significantly lower than that of the two literature methods, without adding additional network load. The network system is in a stable operation state, and users can quickly grasp their own required information, and the retrieval speed is also improved to a certain extent. It is proved that the proposed algorithm has high retrieval accuracy, can effectively reduce network load and achieve high-quality human-computer interactive information retrieval.

Information retrieval has taken an important turn when the researchers started using user behavior to improve their ranking algorithms. With the advent of user behavior in information retrieval, the interactive information retrieval is beginning to make its mark. In this paper, we discuss how user behavior is being used in information retrieval. We survey various strategies used for incorporating user behavior into information retrieval. The key fact is that taking absolute feedback about whether the retrieved documents are relevant or not is very difficult, and if we can take the implicit feedback from the user in the form of user behavior, we can arrive at a better learning function for the algorithm. We, in this paper, would like to provide a case study of various approaches in using user behavior for information retrieval.

This paper presents an iterative and interactive information retrieval (IR) system for Web search using formal concept analysis (FCA). FCA provides a natural way to organise objects according to their properties and it has been used in recent work to organise search engine results. The navigation over the lattice helps the user to explore a structured and synthetic result. Such a lattice contains concepts that are relevant and others that are not relevant regarding a given IR task. In this way, lattices are introduced in an interactive and iterative system. The user expresses his negative or positive agreement with some concept of the lattice in respect of his objective of IR. These user choices are converted into operations over the lattice. The lattice is dynamically updated for a better fit to the request.

Since Information Retrieval (IR) is an interactive process in general, it is important to study Interactive Information Retrieval (IIR), where we would attempt to model and optimize an entire interactive retrieval process (rather than a single query) with consideration of many different ways a user can potentially interact with a search engine. This tutorial systematically reviews the progress of research in IIR with an emphasis on the most recent progress in the development of models, algorithms, and evaluation strategies for IIR. It starts with a broad overview of research in IIR and then gives an introduction to formal models for IIR using a cooperative game framework and covering decision-theoretic models such as the Interface Card Model and Probability Ranking Principle for IIR. Next, it provides a review of some representative specific techniques and algorithms for IIR, such as various forms of feedback techniques and diversification of search results, followed by a discussion of how an IIR system should be evaluated and multiple strategies proposed recently for evaluating IIR using user simulation. The tutorial ends with a brief discussion of the major open challenges in IIR and some of the most promising future research directions.

It is our great pleasure to welcome you to New Brunswick, New Jersey and the third ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2018). CHIIR, as you may know, has roots in two previously successful communities: The Information Interaction in Context (IIiX) conference and the Human Computer Information Retrieval (HCIR) symposium, which ran from 2006 and 2007 respectively. These meetings were focused on issues that involved Human Information Behavior (HIB), Interactive Information Retrieval (IIR) and Human-Computer Interaction (HCI). Those roots, as well as decades of research and development on information seeking and other forms of information interaction, human-centered design, and information retrieval are the backbone of CHIIR. At the same time, this vibrant new community has picked up more scholars and themes as it continues to attract new students and professionals, as well as emerging research topics that are evident in this year's program. In fact, CHIIR is one of the few forums that explicitly supports presentation of bold new ideas through its Perspective Papers category. In addition, we have picked up Demos as a new category for presentations this year. All of these wonderful things could not be possible without a large number of people making significant contributions. We are quite fortunate to have Katriina Byström, Falk Scholer, and Jeff Huang as our Program Chairs this year. These three brave souls took upon a tremendous effort of working with dozens of submissions, reviewers, and meta-reviewers and constructing a high-quality program while coordinating from three different continents. Soo Young Rieh and Preben Hansen, on the other hand dealt with higher than expected load for short papers and still managed to get them reviewed and assessed on time. Even our Doctoral Consortium (DC) this year ended up being quite challenging as we received twice as many submissions as before, but our fine DC chairs Jaceck Gwizdka and Vivek Singh found world-class mentors for these doctoral students. Thanks to our Workshops and Tutorials Chair Xiaojun Yuan, we have a fantastic lineup of tutorials on the first day and workshops on the last day. When the whole program was ready for the conference, it was our Proceedings Chair Roberto Gonzalez-Ibanez who managed to put together these proceedings that you are holding in your hands, or more likely viewing in the ACM Digital Library! We are thankful for having an energetic and resourceful local arrangement committee with Michael Cole as the Treasurer, Fernando Diaz as the Sponsorship Chair, Kaitlin Costello as the Local Organizing Chair, and Sunyoung Kim and Matt Mitsui as the Student Volunteers Chairs. And it was our Publicity Chair Anita Crescenzi, who helped us with not only the outreach efforts, but also with the registration system. Finally, none of these would have happened without the authors and reviewers from more than 30 countries whose contributions are reflected in every aspect of this conference. So, thank you all!

Over the last decade, architecture has witnessed a growing popularity for new computational tools such as parametric design environments (PDEs). Given their rapid evolution and development, expertise tends to become increasingly transient, and architects find themselves in a situation where they must constantly re-learn their tools. At the same time, access to information has become increasingly widespread. Self-learners can thus rely on information retrieval systems to address knowledge gaps. However, the inherent tool complexity has given rise to a new kind of knowledge. On the basis of the different types described by Anderson and Krathwohl, the authors have previously shown that conceptual knowledge is essential for teaching parametric design. In contrast, research on interactive information retrieval (IIR) has highlighted that procedural knowledge is preferred in create tasks like design. Consequently, it can be argued that in a self-learning situation, architects might not be adopting best practice in relation to knowledge retrieval, especially when considering the visual scripting nature of certain PDEs. The purpose of this paper is to observe cognitive patterns in knowledge search activities while designing in parametric environments and validate the integration of CLT and IIR for further research. We highlight the types of knowledge and sources architecture graduate students, novices in PDEs, search for during design over multiple sessions and why. The paper reports on three design tasks completed during a computational course that emphasized student's autonomy. A qualitative analysis of interviews reveals epistemic actions to fall prey to procedural information, which is in line with both IIR and CLT research. This research is part of a PhD project studying the impact of knowledge retrieval on architectural design when using PDEs. Eventually, it could raise awareness in education, research, and practice regarding information retrieval in architectural design.

Recent studies in information retrieval have shown that gender biases have found their way into representational and algorithmic aspects of computational models. In this paper, we focus specifically on gender biases in information retrieval gold standard datasets, often referred to as relevance judgements. While not explored in the past, we submit that it is important to understand and measure the extent to which gender biases may be presented in information retrieval relevance judgements primarily because relevance judgements are not only the primary source for evaluating IR techniques but are also widely used for training end-to-end neural ranking methods. As such, the presence of bias in relevance judgements would immediately find its way into how retrieval methods operate in practice. Based on a fine-tuned BERT model, we show how queries can be labelled for gender at scale based on which we label MS MARCO queries. We then show how different psychological characteristics are exhibited within documents associated with gendered queries within the relevance judgement datasets. Our observations show that stereotypical biases are prevalent in relevance judgement documents.

A general-purpose, interactive computerized information retrieval system specially suitable for the retrieval of bibliographic information from a small scale database. (DB) containing up to 15000 records is described. The user defines fields in terms of tags through the data definition processor which provides flexibility for the record structure. Another processor creates the DB from an off-line input file containing the tag(s) followed by the data for the field(s) supplied by the user. Retrieval of information is carried out by the query processor in an interactive manner. It provides options to (i) select a descriptor (the postings are displayed; (ii) combine 2 sets at a time; (iii) display the different sets chosen; and iv) print the chosen set(s) with full record details or specified tag fields only. The package is developed on an Usha-Alpha 1042 system using Alpha BASIC language under AMOS operating system.

From highly relevant to not relevant: examining different regions of relevance

Analyzing and modeling user behavior in the Information Retrieval (IR) process is important for IR research. In this paper, we propose a new research schema in IR research. In this schema, we first investigate humans' cognitive process when completing a specific IR task and build cognitive models for that task. The findings in the investigation and the proposed cognitive models are then utilized to improve machines' performance in the IR task. Through this research schema, we revisit three IR tasks. In the first study, we carefully analyze users' clicking behavior in mobile search and propose a mobile click model to extract relevance feedback from the mobile search logs. In the second study, we conduct an eye-tracking study to investigate how human assessors read a document during relevance judgment task and adopt the findings in building a novel retrieval model that can better approximate humans' relevance judgment. In the last study, we conduct another eye-tracking study to investigate humans' reading behavior when completing the reading comprehension task. We build a prediction model for user attention and leverage the predicted attention signals to improve the machine reading comprehension model. By successfully adopting this research schema to three different IR tasks, we demonstrate its effectiveness and generalizability.

This review examines a sample of interactive information retrieval (IR) systems within the framework of a design challenge set forth by John Bennett in 1971. Bennett directed his challenge to a group of information scientists who attended The User Interface for Interactive Search of Bibliographic Data Bases Workshop. During the workshop, participants exchanged their insights and experiences on various aspects of user interface requirements for interactive IR systems and discussed system design features that could result in the design of more effective user interfaces for information retrieval. The main goals of this review are to characterize interactive IR design trends over time, examine the extent to which IR systems have responded to Bennett's design challenge, and to suggest potential future research directions and challenges.

We show that users have different reading behavior when evaluating the interestingness of articles, calling for different parameter configurations for information retrieval algorithms for different users. Better recommendation results can be made if parameters for common information retrieval algorithms, such as the Rocchio algorithm, are learned dynamically instead of being statically fixed a priori. By dynamically learning good parameter configurations, Rocchio can adapt to differences in user behavior among users. We show that by adaptively learning online the parameters of a simple retrieval algorithm, similar recommendation performance can be achieved as more complex algorithms or algorithms that require extensive fine-tuning. Also we have also shon that online parameter learning can yield 10% better results than best performing filter from the TREC11 adaptive filter task.

Graph theory and the fields of natural language processing and information retrieval are well-studied disciplines. Traditionally, these areas have been perceived as distinct, with different algorithms, different applications and different potential end-users. However, recent research has shown that these disciplines are intimately connected, with a large variety of natural language processing and information retrieval applications finding efficient solutions within graph-theoretical frameworks. This book extensively covers the use of graph-based algorithms for natural language processing and information retrieval. It brings together topics as diverse as lexical semantics, text summarization, text mining, ontology construction, text classification and information retrieval, which are connected by the common underlying theme of the use of graph-theoretical methods for text and information processing tasks. Readers will come away with a firm understanding of the major methods and applications in natural language processing and information retrieval that rely on graph-based representations and algorithms.

Test collection is used to evaluate the information retrieval systems in laboratory-based evaluation experimentation. In a classic setting, generating relevance judgments involves human assessors and is a costly and time consuming task. Researchers and practitioners are still being challenged in performing reliable and low-cost evaluation of retrieval systems. Crowdsourcing as a novel method of data acquisition is broadly used in many research fields. It has been proven that crowdsourcing is an inexpensive and quick solution as well as a reliable alternative for creating relevance judgments. One of the crowdsourcing applications in IR is to judge relevancy of query document pair. In order to have a successful crowdsourcing experiment, the relevance judgment tasks should be designed precisely to emphasize quality control. This paper is intended to explore different factors that have an influence on the accuracy of relevance judgments accomplished by workers and how to intensify the reliability of judgments in crowdsourcing experiment.

In this paper we present a method for reformulating the Recommender Systems problem in an Information Retrieval one. In our tests we have a dataset of users who give ratings for some movies; we hide some values from the dataset, and we try to predict them again using its remaining portion (the so-called "leave-n-out approach"). In order to use an Information Retrieval algorithm, we reformulate this Recommender Systems problem in this way: a user corresponds to a document, a movie corresponds to a term, the active user (whose rating we want to predict) plays the role of the query, and the ratings are used as weigths, in place of the weighting schema of the original IR algorithm. The output is the ranking list of the documents ("users") relevant for the query ("active user"). We use the ratings of these users, weighted according to the rank, to predict the rating of the active user. We carry out the comparison by means of a typical metric, namely the accuracy of the predictions returned by the algorithm, and we compare this to the real ratings from users. In our first tests, we use two different Information Retrieval algorithms: LSPR, a recently proposed model based on Discrete Fourier Transform, and a simple vector space model.