Information Retrieval System Based on Query Translation Approach for Cross-Languages

In Cross-Language Information Retrieval (CLIR) process, the translation effects have a direct impact o n the accuracy of follow-up retrieval results. In diction ary-based approach, we are dealing with the words t hat have more than one meaning which can decrease the retrieval performance if the query translation retur n an incorrect translations. These issues need to be ove rcome using efficient technique. In this study we p roposed a Cross-Language Information Retrieval (CLIR) method based on domain ontology using Quran concepts for disambiguating translation of the query and to improve the dictionary-based query translation. For experimentation, we use Quran ontology written in E nglish and Malay languages as a bilingual parallelcorpora and Quran concepts as a resource for cross- language query translation along with dictionary-ba sed translation. For evaluation, we measure the perform ance of three IR systems. IR 1 is natural language query IR, IR 2 is natural language query CLIR based on dictionary (as a Baseline) and IR 3 is the retrieval of this research proposed method using Mean Average Precision (MAP) and average precision at 11 points of recall. The experimental result shows that our prop osed method brings significant improvement in retri eval accuracy for English document collections, but defi cient for Malay document collections. The proposed CLIR method can obtain query expansion effect and improve retrieval performance in certain language.

Searching information retrieval systems is a highly interactive, iterative process that cannot be understood simply by comparing the output of a search session (the “search product”) to a query stated in advance. In this article, we examine evaluation goals and methods for studying information retrieval behavior, drawing examples from our own research and that of others. We limit our review to research that employs online monitoring, also known as transaction log analysis. Online monitoring is one of few methods that can capture detailed data on the search process at a reasonable cost; these data can be used to build quantitative models or to support qualitative interpretations of quantitative results. Monitoring is a data collection technique rather than a research design, and can be employed in experimental or field studies, whether alone or combined with other data collection methods. Based on the research questions of interest, the researcher must determine what variables to collect from each data source, which to treat as independent variables to manipulate, and which to treat as dependent variables to observe effects. Studies of searching behavior often treat search task and searcher characteristics as independent variables and may manipulate other independent variables specific to the research questions addressed. Search outcomes, time, and search paths frequently are treated as dependent variables. We discuss each of these sets of variables, illustrating them with sample results from the literature and from our own research. Our examples are drawn from the Science Library Catalog project, a 7-year study of children's searching behavior on an experimental retrieval system. We close with a brief discussion of the implications of these results for the design of information retrieval systems. © 1996 John Wiley & Sons, Inc.

Cross language information retrieval (CLIR) is a retrieval process in which the user fires queries in one language to retrieve information from another (different) language. The diversity of information and language barriers are the serious issues for communication and cultural exchange across the world. To solve such barriers, Cross language information retrieval system, are nowadays in strong demand. CLIR is a subset of Information Retrieval (IR) system. Information Retrieval deals with finding useful information from a large collection of unstructured, structured and semi-structured data to a user query where the query is a set of keywords. Information Retrieval can be classified into different classes such as Monolingual information retrieval, Bi-Lingual Information Retrieval, Multilingual information retrieval and Cross language information retrieval. This paper focuses on the various IR variants and techniques used in CLIR system. Further, based on available literature, a number of challenges and issues in CLIR have been identified and discussed. It gives an overview of the advantages, limitations, tools available in CLIR research. It also describes new application areas of CLIR such as medical, multimedia, question answering system etc. The need for exploring and building more specialized information system that enable speakers of an Odia language to discover valuable information beyond linguistic and cultural barriers. This study is aimed at building an experimental CLIR system between one of the under-resourced language (i.e. Odia) and one of the most commonly used online language (i.e. English) in future.

Cross lingual Information Retrieval (CLIR) refers to the information retrieval activities in which the query and/or documents may appear in different languages. Dictionary-based query translation has been a common method in CLIR systems. In these methods we face with the problem of translation ambiguity in which a single word in one language has more than one translation in the other language. In this paper we propose a hybrid approach to retrieve English documents relevant to Persian queries. In this approach we exploit a combination of phrase reorganization, pattern based phrase translation and query expansion before and after translation to improve the dictionary-based query translation. We also propose an improved probabilistic algorithm to choose the best translation of words and phrases. Finally, the documents will be ranked according to statistical language model with some translation steps. Our experimental results show that each of the mentioned methods can bring significant improvement over simple dictionary approaches.

Purpose – People often engage in different information-seeking strategies (ISSs) within a single information-seeking episode. A critical concern for the design of information retrieval (IR) systems is how to provide support for these different behaviors in a manner which searchers can easily understand, navigate and use, as they move from one ISS to another. The purpose of this paper is to describe a dialogue structure that was implemented in an experimental IR system, in order to address this concern. Design/methodology/approach – The authors conducted a user-centered experiment to evaluate the IR systems. Participants were asked to search for information on two different task types, with four different topics per task, in both the experimental system and a baseline system emulating state-of-the-art IR systems. The authors report here the results related explicitly to the use of the experimental system's dialogue structure. Findings – For one of the task types, most participants followed the search steps as predicted in the dialogue structures, and those who did so completed the task in fewer moves. For the other task type, predicted order of moves was often not followed, but participants again used fewer moves when following the predicted order. Results demonstrate that the dialogue structures the authors designed indeed support effective human information behavior patterns in a variety of ways, and that searchers can effectively use a system which changes to support different ISSs. Originality/value – This study shows that it is both possible and beneficial, to design an IR system which can support multiple ISSs, and that such a system can be understood and used successfully.

We present a method for automatic query expansion for cross-lingual information retrieval in the medical domain. The method employs machine translation of source-language queries into a document language and linear regression to predict the retrieval performance for each translated query when expanded with a candidate term. Candidate terms (in the document language) come from multiple sources: query translation hypotheses obtained from the machine translation system, Wikipedia articles and PubMed abstracts. Query expansion is applied only when the model predicts a score for a candidate term that exceeds a tuned threshold which allows to expand queries with strongly related terms only. Our experiments are conducted using the CLEF eHealth 2013–2015 test collection and show significant improvements in both cross-lingual and monolingual settings.

These research studies compare two methods for ontology creation and their corresponding tools. The main objective of this work is the building of a graphical editor for ontology construction, based on software usability criteria. This comparison shows which methods used in previous tools will remains in the new editor, and what new tools can be developed for enhancing the ontology management made using the old one. The use of graphics and diagrams helps in the discovery of new knowledge, from information received from various sources, being the Internet or databases. This new type of editor improves the visualization of relations between the terms of ontologies and thereby improves the efficiency of its construction for commercial application systems. In addition, this form of information representation, based on these diagrams, will allow information systems based on ontologies to identify - automatically -concepts, hidden elements, the flow time between the events of cause and consequences and the meaning of relations between the captured information. The Ontojuris project has the purpose given above, and it is described on this paper. The project consists of a multilingual information system for legal information retrieval associated with an ontology editor, called Knowledge Engineering Suite. The system accepts queries in one language, and allows information retrieval based on similarity of documents, written in one of several languages. The multilingual ontology editor works with the concept of Universal Words (UW's). The UWs are universal representations of things and objects, and it is developed inside the UNL Project (being UNL an acronym for Universal Networking Language) and allows the query expansion in a multilingual way. Query expansion can improve searching process, required by user, by including additional terms which have similar meaning to the original query. In this study, we proposed a new expansion method which is based on domain ontology and UWs, to achieve better performance for a multilingual information retrieval. So, the Ontojuris project aims to facilitate access to information on legislation in the area of Intellectual Property Law, Consumer Rights and Electronic Law in the consortium formed by researches in Brazil, Chile, Spain and Argentina.

Cross language information retrieval (CLIR) deals with the use of queries in one language to access documents in another. A popular CLIR approach is to translate the query into the language of the documents being retrieved. The simplest yet most effective method for query translation is bilingual dictionary approach. However, direct translation using bilingual dictionary prune two problems: proper names and compound words translations. In this study, a series of experiments were conducted to test and evaluate the effectiveness of the Malay-English CLIR using proper names and compound words translation. We believe by using concept-based indexing and translations, makes proper names and compound words translation possible. The best retrieval performance was obtained from the combination of query translation approach-select all translations listed in the dictionary, the alternative weighting scheme and proper names identification and translation.

Query translation (QT) serves as a critical factor in successful cross-lingual information retrieval (CLIR). Due to the lack of parallel query samples, neural-based QT models are usually optimized with synthetic data which are derived from large-scale monolingual queries. Nevertheless, such kind of pseudo corpus is mostly produced by a general-domain translation model, making it be insufficient to guide the learning of QT model. In this paper, we extend the data augmentation with a domain transfer procedure, thus to revise synthetic candidates to search-aware examples. Specifically, the domain transfer model is built upon advanced Transformer, in which layer coordination and mixed attention are exploited to speed up the refining process and leverage parameters from a pre-trained cross-lingual language model. In order to examine the effectiveness of the proposed method, we collected French-to-English and Spanish-to-English QT test sets, each of which consists of 10,000 parallel query pairs with careful manual-checking. Qualitative and quantitative analyses reveal that our model significantly outperforms strong baselines and the related domain transfer methods on both translation quality and retrieval accuracy.

Recent availability of commercial online machine translation (MT) systems makes it possible for layman Web users to utilize the MT capability for cross-language information retrieval (CLIR). To study the effectiveness of using MT for query translation, we conducted a set of experiments using Google Translate, an online MT system provided by Google, for translating queries in CLIR. The experiments show that MT is an excellent tool for the query translation task, and with the help of relevance feedback, it can achieve significant improvement over the monolingual baseline. The MT based query translation not only works for long queries, but is also effective for the short Web queries.

We present a thorough comparison of two principal approaches to Cross-Lingual Information Retrieval: document translation (DT) and query translation (QT). Our experiments are conducted using the cross-lingual test collection produced within the CLEF eHealth information retrieval tasks in 2013–2015 containing English documents and queries in several European languages. We exploit the Statistical Machine Translation (SMT) and Neural Machine Translation (NMT) paradigms and train several domain-specific and task-specific machine translation systems to translate the non-English queries into English (for the QT approach) and the English documents to all the query languages (for the DT approach). The results show that the quality of QT by SMT is sufficient enough to outperform the retrieval results of the DT approach for all the languages. NMT then further boosts translation quality and retrieval quality for both QT and DT for most languages, but still, QT provides generally better retrieval results than DT.

Information retrieval (IR) systems aim to select relevant material from large collections of information in response to user queries. The approaches used to accomplish this have been the focus of much research and development over the past 50 years, and have led to the algorithms underlying many commercial and Web-based search engines today. This entry describes the common components that go into the design of IR systems (from text processing to inverted file indexes). The major classes (or models) of retrieval algorithms (Boolean, vector, and probabilistic) are described along with formal definitions of the basic form of these algorithms and some of the variations in common use in IR research. In addition, the entry examines query expansion techniques, and in particular relevance feedback, and how they are used in IR systems

this paper provides an in-depth survey of challenges in the design of intelligent information retrieval systems, pointing out some similarities and differences in the core data mining and web based search operations. The procedures for evaluation of search engine performance and implicit feedback of the user with respect to a search result are studied with references to the different algorithms. We have proposed a novel neural satisfaction based feedback vector in contrast to the existing activity pattern based feedback as a future research direction in Intelligent IR. We addressed the select research work in the area of soft information retrieval using fuzzy sets, artificial neural networks, genetic algorithms and probabilistic information retrieval. As an instance of information retrieval, web mining is a set of operations to retrieve relevant documents from preprocessed, crawled and indexed web, and it can be categorized into more specialized tasks of web content mining, web structure mining and web usage mining. We have given a survey of the important reviews on topic of web mining and its associated tasks. On the basis of Identified challenges in information retrieval in general, and web mining in particular, we have concentrated on applicability of soft computing techniques and their hybrids in web mining, the performance related issues of select solutions, future of web mining and the next generation user's expectations from a search engine.

Traditional information retrieval algorithms ignore user needs and are unable to obtain user gaze coordinates and gaze times, resulting in low retrieval accuracy. The author proposes a new interactive information retrieval algorithm for this purpose. Divide eye tracking technology evaluation indicators, visually process eye movement information, obtain user gaze coordinates and gaze time, and calculate the influence coefficients of each gaze area and each point in the area. Weighted visual words are accumulated to get a visual word list with the weight of the associated area, and visual word list and Rocchio algorithm are combined to build a hidden Relevance feedback retrieval model in semantic space to judge information retrieval preferences. Intelligent robot is introduced, and Jensen Shannon divergence is used to calculate the Kullback–Leibler divergence distance between the probability distributions of document sets, calculate the similarity matching, and complete the interactive information retrieval. The simulation results prove that, due to the introduction of intelligent robot strategy in this method, the amount of irrelevant retrieval information is reduced by matching user needs and retrieval results. Therefore, the amount of messages generated by information retrieval is significantly lower than that of the two literature methods, without adding additional network load. The network system is in a stable operation state, and users can quickly grasp their own required information, and the retrieval speed is also improved to a certain extent. It is proved that the proposed algorithm has high retrieval accuracy, can effectively reduce network load and achieve high-quality human-computer interactive information retrieval.

The Web has become a large repository of documents (or pages) written in many different languages. In this context, traditional information retrieval (IR) techniques cannot be used whenever the user query and the documents being retrieved are in different languages. To address this problem, new cross‐language information retrieval (CLIR) techniques have been proposed. In this work, we describe a method for cross‐language retrieval of medical information. This method combines query terms and related medical concepts obtained automatically through a categorization procedure. The medical concepts are used to create a linguistic abstraction that allows retrieval of information in a language‐independent way, minimizing linguistic problems such as polysemy. To evaluate our method, we carried out experiments using the OHSUMED test collection, whose documents are written in English, with queries expressed in Portuguese, Spanish, and French. The results indicate that our cross‐language retrieval method is as effective as a standard vector space model algorithm operating on queries and documents in the same language. Further, our results are better than previous results in the literature.