- Research Article
- 10.1287/isre.1120.0459
About Our Authors
- Dec 01, 2012
- Information Systems Research
About Our Authors
Question Answering Systems (QAS) are receiving increasing attention from information systems researchers, particularly those in the information retrieval and natural language processing communities. Evaluation of an information system’s success and user satisfaction are important issues in information systems research, especially for emerging online service systems on the Internet. Although many QAS have been implemented, little work has been done on the development of an evaluation model for them. The purpose of this study is to develop an evaluation model for question answering systems from user’s perspective. We have established the theoretical foundation and conceptualization of the constructs for user satisfaction with question answering systems. We have developed a general instrument capable of reliably and accurately measuring user satisfaction in the context of question answering systems. The proposed evaluation model provides a framework for the design of question answering systems from the user’s perspective to enhance user satisfaction and acceptance of QAS.
About Our Authors
About Our Authors
User-centered evaluation of question answering systems
With the rapid growth of the Internet and database technologies in recent years, question answering systems (QAS) have emerged as important applications. As most evaluation models focus on system-centered evaluation, user-centered evaluation has attracted little attention. Although many QAS have been implemented, little work has been done on the development of a user-centered evaluation for QAS. User-centered evaluation is used to understand a userpsilas needs and identify important dimensions and factors in the development of an information system in order to improve its acceptance. The purpose of this study is to develop a user-centered evaluation model for QAS from the userpsilas perspective. The proposed user-centered evaluation model provides a framework for the design of question answering systems from the userpsilas perspective to enhance user satisfaction and acceptance of QAS.
Read moreA Composite Natural Language Processing and Information Retrieval Approach to Question Answering Using a Structured Knowledge Base
With the inception of the World Wide Web, the amount of data present on the Internet is tremendous. This makes the task of navigating through this enormous amount of data quite difficult for the user. As users struggle to navigate through this wealth of information, the need for the development of an automated system that can extract the required information becomes urgent. This paper presents a Question Answering system to ease the process of information retrieval. Question Answering systems have been around for quite some time and are a sub-field of information retrieval and natural language processing. The task of any Question Answering system is to seek an answer to a free form factual question. The difficulty of pinpointing and verifying the precise answer makes question answering more challenging than simple information retrieval done by search engines. The research objective of this paper is to develop a novel approach to Question Answering based on a composition of conventional approaches of Information Retrieval (IR) and Natural Language processing (NLP). The focus is on using a structured and annotated knowledge base instead of an unstructured one. The knowledge base used here is DBpedia and the final system is evaluated on the Text REtrieval Conference (TREC) 2004 questions dataset.
Read moreEditorial: There Are Promises to Keep and Miles to Go Before I Leave…
Editorial: There Are Promises to Keep and Miles to Go Before I Leave…
The measurement of user satisfaction with question answering systems
The measurement of user satisfaction with question answering systems
Core techniques of question answering systems over knowledge bases: a survey
The Semantic Web contains an enormous amount of information in the form of knowledge bases (KB). To make this information available, many question answering (QA) systems over KBs were created in the last years. Building a QA system over KBs is difficult because there are many different challenges to be solved. In order to address these challenges, QA systems generally combine techniques from natural language processing, information retrieval, machine learning and Semantic Web. The aim of this survey is to give an overview of the techniques used in current QA systems over KBs. We present the techniques used by the QA systems which were evaluated on a popular series of benchmarks: Question Answering over Linked Data. Techniques that solve the same task are first grouped together and then described. The advantages and disadvantages are discussed for each technique. This allows a direct comparison of similar techniques. Additionally, we point to techniques that are used over WebQuestions and SimpleQuestions, which are two other popular benchmarks for QA systems.
Read moreDesign of Question Answering System with Automated Question Generation
One of the most difficult problems in developing question-answering (QA) system is that it is so hard to generate natural language questions and to find an answer to a query question. In order to avoid a number of difficulties of developing QA systems, we propose a new style of question-answering system architecture that actively uses sentences within a document as a source of question/answer. Basically, our proposed QA system gives user a set of candidate query question for user information needs, and the candidate questions are automatically generated from significant sentences that are expected to contain meaningful facts or events. The QA system builds a complete database of (question, answer) pairs after analyzing a whole collection of documents. For this, we need to perform the following steps: sentence split, named-entity recognition, question generation, question filtering, question/ answer indexing. The important things in the process are question generation and question filtering. For the first thing, we can generate questions that ask the entities extracted from a given sentence. The question filtering is to isolate significant sentences that have meaningful information that users want.
Read moreAbout Our Authors
About Our Authors
Question Answering Systems: A Systematic Literature Review
Question answering systems (QAS) are developed to answer questions presented in natural language by extracting the answer. The development of QAS is aimed at making the Web more suited to human use by eliminating the need to sift through a lot of search results manually to determine the correct answer to a question. Accordingly, the aim of this study was to provide an overview of the current state of QAS research. It also aimed at highlighting the key limitations and gaps in the existing body of knowledge relating to QAS. Furthermore, it intended to identify the most effective methods utilized in the design of QAS. The systematic review of literature research method was selected as the most appropriate methodology for studying the research topic. This method differs from the conventional literature review as it is more comprehensive and objective. Based on the findings, QAS is a highly active area of research, with scholars taking diverse approaches in the development of their systems. Some of the limitations observed in these studies encompass the focused nature of current QAS, weaknesses associated with models that are used as building blocks for QAS, the need for standard datasets and question formats hence limiting the applicability of the QAS in practical settings, and the failure of researchers to examine their QAS solutions comprehensively. The most effective methods for designing QAS include focusing on syntax and context, utilizing word encoding and knowledge systems, leveraging deep learning, and using elements such as machine learning and artificial intelligence. Going forward, modular designs ought to be encouraged to foster collaboration in the creation of QAS.
Read moreAbout Our Authors
Ram Bala (“ Competitive Behavior-Based Price Discrimination for Software Upgrades ”) is an assistant professor of operations management at the Indian School of Business in Hyderabad, India. He holds a Ph.D. in management science from the UCLA Anderson School of Management. His main research areas are product line design, promotional effort allocation, global product development, and pricing and contracting strategies for services. His research cuts across disciplinary lines, particularly operations management, marketing, and information systems. Roger Calantone (“ How Peripheral Developers Contribute to Open-Source Software Development ”) is the Eli Broad Chaired University Professor of Business at Michigan State University. He received his Ph.D. from the University of Massachusetts. He has served on over 125 dissertation committees and has coauthored numerous articles in academic journals in the areas of innovation, systems and product development, and decision support systems for innovation processes and routines. Jamie Callan (“ The Halo Effect in Multicomponent Ratings and Its Implications for Recommender Systems: The Case of Yahoo! Movies ”) is a professor of computer science at Carnegie Mellon's Language Technologies Institute and School of Information Systems and Management. His research and teaching focus on text-based information retrieval, primarily search engine architectures, federated search of groups of search engines, adaptive information filtering, text mining, and information retrieval for educational applications. Paul Chwelos (“ Information Technology and Intangible Output: The Impact of IT Investment on Innovation Productivity ”) was an assistant professor of Management Information Systems at the Sauder School of Business at the University of British Columbia. He received his B.S. from the University of Victoria and a Ph.D. in management information systems from the University of British Columbia. He was an expert in information technology innovation, IT hedonic price indexes, and online commerce. His research has been published in Information Systems Research and the Economics of Innovation and New Technology. Iain Cockburn (“ Information Technology and Intangible Output: The Impact of IT Investment on Innovation Productivity ”) is a professor of strategy and innovation in the Boston University School of Management and is a research associate of National Bureau of Economic Research. He received his Ph.D. from Harvard University. His research interests include intellectual property, management of innovation, and the economics of the life sciences sector. Faiz Currim (“ Modeling Spatial and Temporal Set-Based Constraints During Conceptual Database Design ”) is with the department of Management Information Systems at the University of Arizona. Prior to working at Arizona, he was on the faculty at University of Iowa. His research interests include applications in database design and management, conceptual data modeling, data privacy and security, and XML Schema management. Wenjing Duan (“ Research Note: To Continue or Not to Continue Sharing? An Empirical Analysis of User Decision in Peer-to-Peer Sharing Networks ”) is an assistant professor of information systems at the George Washington University. She received her Ph.D. in information systems from the University of Texas at Austin. Her research interests glide the intersections between information systems, economics, and marketing. She has published in MIS Quarterly, Communications of ACM, the Journal of Retailing, and Decision Support Systems; she is also the recipient of the NET Institute Research Grant and serves as the associate editor of Decision Support Systems. George Duncan (“ The Halo Effect in Multicomponent Ratings and Its Implications for Recommender Systems: The Case of Yahoo! Movies ”) is a professor of statistics, emeritus in the Heinz College at Carnegie Mellon University. His research centers on information technology and social accountability. He chaired the panel on confidentiality and data access of the National Academy of Sciences, resulting in the book Private Lives and Public Policies: Confidentiality and Accessibility of Government Statistics. He is a fellow of the American Statistical Association, an elected member of the International Statistical Institute, and a fellow of the American Association for the Advancement of Science. David Fitoussi (“ IT Outsourcing Contracts and Performance Measurement ”) is an assistant professor at the Paul Merage School of Business, University of California, Irvine, and a faculty research associate at the Center for Research on IT and Organizations. He holds a Ph.D in management from the MIT Sloan School of Management. Lucio Fuentelsaz (“ Switching Costs, Network Effects, and Competition in the European Mobile Telecommunications Industry ”) is a professor of strategic management at the University of Zaragoza. His primary research interest focuses on understanding competitive strategy decisions and their consequences on firm performance. In recent years, he has studied topics such as firm competitive dynamics, diffusion of innovations, and mergers and acquisitions. He is currently editor of Cuadernos de Economía y Dirección de la Empresa. His research has been published in leading academic journals such as the Strategic Management Journal, Research Policy, and the Journal of Economics and Management Strategy. Nelson Granados (“ Online and Offline Demand and Price Elasticities: Evidence from the Air Travel Industry ”) is an assistant professor of information systems at the Graziadio School of Business and Management, Pepperdine University. He holds a Ph.D. in information and decision sciences, an M.S. and a Ph.D. minor in applied economics, and an MBA from the University of Minnesota. His research on information transparency was awarded Best IS Publication of the Year by senior scholars of the IS discipline and Best Publication of the Year by the Journal of the Association for Information Systems. Bin Gu (“ Research Note: The Impact of External Word-of-Mouth Sources on Retailer Sales of High-Involvement Products ”) is an assistant professor of information management at the McCombs School of Business, University of Texas at Austin. He received a Ph.D. and an M.A. in operations and information management from the Wharton School of Business, University of Pennsylvania. His research interests are in user-generated contents, online social networks, virtual communities, e-commerce, and IT business value. He is a recipient of 2008 Information Systems Research Best Published Paper Award. Alok Gupta (“ Online and Offline Demand and Price Elasticities: Evidence from the Air Travel Industry ”) holds the Curtis L. Carlson Schoolwide Chair in Information Management at the Carlson School of Management, University of Minnesota. He received his Ph.D. in management science and information systems from the University of Texas at Austin. He has published over 40 articles in the top management science, operations research, economics, and IS journals, and he received the prestigious National Science Foundation CAREER Award in 2001 for his research on online auctions. He serves on the editorial boards of Management Science, Information Systems Research, the Journal of Management Information Systems, and Decision Support Systems. Vijay Gurbaxani (“ IT Outsourcing Contracts and Performance Measurement ”) is the Taco Bell Endowed Professor and director of the Center for Research on IT and Organizations at the Paul Merage School of Business, University of California, Irvine. He received a master's degree in mathematics and computer science from the Indian Institute of Technology, Bombay, and a Ph.D. in business administration from the University of Rochester. His research has appeared in Information Systems Research, Management Science, MIS Quarterly, and Communications of the ACM. Yun Huang (“ Research Note: To Continue or Not to Continue Sharing? An Empirical Analysis of User Decision in Peer-to-Peer Sharing Networks ”) is a research associate in the Department of Industrial Engineering and Management Sciences at Northwestern University. He received his Ph.D. in management science and information systems from the University of Texas at Austin. His research focuses on social network analysis, individual behavior in e-commerce applications, and recommender systems. His work has appeared in the Communications of the ACM, New Media & Society, ACM Transactions on Internet Technology, and ACM/IEEE proceedings. Sora Kang (“ Research Note: A Multilevel Analysis of the Effect of Group Appropriation on Collaborative Technologies Use and Performance ”) is currently an assistant professor for the Division of Digital Business, Hoseo University. She has a Ph.D. from the Ewha Womans University in management information systems. Her research interests include adoption and performance of IT, organizational politics and knowledge management, and organizational impact of information technology. Her papers have appeared in the Journal of Computer Information Systems, the International Journal of Business Studies, Information: An International Interdisciplinary Journal, and the Business Management Review. Karthik N. Kannan (“ Effects of Information Revelation Policies Under Cost Uncertainty ”) is an assistant professor of management at Purdue University's Krannert School of Management. He earned his Ph.D. in information systems, M. Phil. in public policy and management, and M.S. in electrical and computer engineering, all from Carnegie Mellon University. His current research focuses on markets and pricing of information goods/servic
Read moreAbout Our Authors
About Our Authors
Betwixt and Between? Bringing Information Systems and Accounting Systems Research Together
I n 2008, the Research and Publications Committee of the Information Systems Section of the American Accounting Association decided to sponsor a special issue of the Journal of Information Systems (JIS) entitled ‘‘Reviews of Information Systems Research.’’ The objective of the special issue is to ‘‘publish papers that review a stream of research in information systems (IS) broadly defined.’’ The Committee intended that submissions would review and integrate the IS (information systems) and AIS (accounting information systems) literatures and suggest future research directions in both disciplines. The special issue followed a previous valiant and groundbreaking effort in IS/AIS research integration for the IS section by Professors Vicky Arnold and Steve Sutton (Arnold and Sutton 2002). As editor of this special issue, I took a somewhat different approach to the task than is normal. First, rather than a regular call for papers, I requested researchers to submit extended abstracts. The objectives of this approach were to ensure that the scope of the proposed article was concomitant with the objective of the special issue and to identify any potential overlaps in subject matter. In this process, I was able to negotiate the amalgamation of several writing teams. I also ensured that where there was commonality in subject matter, the writing teams were introduced to each other and worked to manage the writing process. Second, I had clear views on how the papers should be structured. As an author of one of the chapters in the earlier monograph for the IS section, I was impressed with the systematic approach Dr. Arnold took to ensuring a common approach in the structure of the contributions and the discipline exercised in ensuring that the goals of the monograph were achieved. It is simpler to achieve a common approach in a monograph than it is in separate papers in JIS. My ambition was, then, to strongly suggest directions to authors but not to mandate a single approach. As a consumer of many literature reviews, I realize how easy it is to maroon readers in a Sargasso Sea, not knowing how to navigate their way. Readers need clear navigational markers and a sense of direction. Third, I saw the review process as a mutual exercise among writing teams, reviewers, and myself as editor. Given the scope of this exercise, I deliberately took a more active editorial role than is normal. These objectives probably added somewhat to the time taken for publication but did, I believe, improve the quality of the papers.
Read moreAbout Our Authors
About Our Authors
Context aware restricted tourism domain question answering system
The advancement in the world of internet has made information retrieval an easy task. Search engines provide users the information they need but not in specific form, instead floods the user with lots of documents/web pages that contain the information required by user. User waste their time to scan all documents in order to retrieve the needed information. Question Answering System reduces this drawback by automating the whole process. In this paper a tourism domain Question Answering System is proposed that contains the information about the tourist places of five different cities of Rajasthan. The system follows the principles of information retrieval and natural language processing. The proposed system is experimented with the set of 300 questions and it is observed that the system showed 70% precision and 80% accuracy rate. Lastly, proposed QAS (Question Answering System) is compared with other three existing Question Answering systems: AnswerBus [29], START [4], and NaLURI [28].
Read morePower dynamics in organisations and the role of information systems
Power dynamics in organisations and the role of information systems