Utilizing, producing, and contributing design knowledge in DSR projects

Evaluation of design artefacts and design theories is a key activity in Design Science Research (DSR), as it provides feedback for further development and (if done correctly) assures the rigour of the research. However, the extant DSR literature provides insufficient guidance on evaluation to enable Design Science Researchers to effectively design and incorporate evaluation activities into a DSR project that can achieve DSR goals and objectives. To address this research gap, this research paper develops, explicates, and provides evidence for the utility of a Framework for Evaluation in Design Science (FEDS) together with a process to guide design science researchers in developing a strategy for evaluating the artefacts they develop within a DSR project. A FEDS strategy considers why, when, how, and what to evaluate. FEDS includes a two-dimensional characterisation of DSR evaluation episodes (particular evaluations), with one dimension being the functional purpose of the evaluation (formative or summative) and the other dimension being the paradigm of the evaluation (artificial or naturalistic). The FEDS evaluation design process is comprised of four steps: (1) explicate the goals of the evaluation, (2) choose the evaluation strategy or strategies, (3) determine the properties to evaluate, and (4) design the individual evaluation episode(s). The paper illustrates the framework with two examples and provides evidence of its utility via a naturalistic, summative evaluation through its use on an actual DSR project.

Not much is known about how design knowledge is re-used in Design Science Research (DSR). The concepts of generalization and transfer as different types of knowledge-building and re-use are discussed in other disciplines and in Information System Research in general, but less so in DSR. Offermann et al. [1] proposed three ranges of design theories and seven strategies for how to create and generalize design knowledge. In this paper, we classify all DESRIST 2006 - 2010 publications according to design range and research strategy. By doing so, we empirically ground the merely theoretically established research strategies, and are able to discover three additional strategy types. The literature analysis shows that the specification of design range and strategy in abstracts is often incomplete or misleading. Based on the analysis we recommend template abstracts for design science publications which guide researchers on how to include all relevant information about design knowledge they (re-)used.

Aim/Purpose: To discuss the Design Science Research approach by comparing some of its canons with observed practices in projects in which it is applied, in order to understand and structure it better. Background: Recent criticisms of the application of the Design Science Research (DSR) approach have pointed out the need to make it more approachable and less confusing to overcome deficiencies such as the unrealistic evaluation. Methodology: We identified and analyzed 92 articles that presented artifacts developed from DSR projects and another 60 articles with preceding or subsequent actions associated with these 92 projects. We applied the content analysis technique to these 152 articles, enabling the preparation of network diagrams and an analysis of the longitudinal evolution of these projects in terms of activities performed and the types of artifacts involved. Contribution: The content analysis of these 152 articles enabled the preparation of network diagrams and an analysis of the longitudinal evolution of these projects in terms of the activities and types of artifacts involved. Evidence was found of a precedence hierarchy among different types of artifacts, as well as nine new opportunities for entry points for the continuity of DSR studies. Only 14% of the DSR artifacts underwent an evaluation by typical end users, characterizing a tenth type of entry point. Regarding the evaluation process, four aspects were identified, which demonstrated that 86% of DSR artifact evaluations are unrealistic. Findings: We identified and defined a set of attributes that allows a better characterization and structuring of the artifact evaluation process. Analyzing the field data, we inferred a precedence hierarchy for different artifacts types, as well as nine new opportunities for entry points for the continuity of DSR studies. Recommendation for Researchers: The four attributes identified for analyzing evaluation processes serve as guidelines for practitioners and researchers to achieve a realistic evaluation of artifacts. Future Research: The nine new entry points identified serve as an inspiration for researchers to give continuity to DSR projects.

Design science research (DSR) aims to deliver innovative solutions for real-world problems. DSR produces Information Systems (IS) artifacts and design knowledge describing means-end relationships between problem and solution spaces. A key success factor of any DSR research endeavor is an appropriate understanding and description of the underlying problem space. However, existing DSR literature lacks a solid conceptualization of the problem space in DSR. This paper addresses this gap and suggests a conceptualization of the problem space in DSR that builds on the four key concepts of stakeholders, needs, goals, and requirements. We showcase the application of our conceptualization in two published DSR projects. Our work contributes methodologically to the field of DSR as it helps DSR scholars to explore and describe the problem space in terms of a set of key concepts and their relationships.

Aim/Purpose: [This Proceedings paper was revised and published in the 2018 issue of the journal Issues in Informing Science and Information Technology, Volume 15] The proposed Personal Knowledge Management (PKM) for Empowerment (PKM4E) Framework expands on the notions of the Ignorance Map and Matrix for further supporting the educational concept of a PKM system-in-progress. Background: The accelerating information abundance is depleting the very attention our cognitive capabilities are able to master, one key cause of individual and collective opportunity divides. Support is urgently needed to benefit Knowledge Workers independent of space (developed/developing countries), time (study or career phase), discipline (natural or social science), or role (student, professional, leader). Methodology: The Design Science Research (DSR) project introducing the novel PKM System (PKMS) aims to support a scenario of a ‘Decentralizing KM Revolution’ giving more power and autonomy to individuals and self-organized groups. Contribution: The portrayal of potential better solutions cannot be accommodated by one-dimensional linear text alone but necessitates the utilization of visuals, charts, and blueprints for the concept as well as the use of colors, icons, and catchy acronyms to successfully inform a diverse portfolio of audiences and potential beneficiaries. Findings: see Recommendation for Researchers Recommendations for Practitioners: The PKM4E learning cycles and workflows apply ‘cumulative synthesis’, a concept which convincingly couples the activities of researchers and entrepreneurs, and assists users to advance their capability endowments via applied learning. Recommendation for Researchers: In substituting document-centric with meme-based knowledge bases, the PKMS approach merges distinctive voluntarily shared knowledge objects/assets of diverse disciplines into a single unified digital knowledge repository and provides the means for advancing current metrics and reputation systems. Impact on Society: The PKMS features provide the means to tackle the widening opportunity divides by affording knowledge workers with continuous life-long support from trainee, student, novice, or mentee towards professional, expert, mentor, or leader. Future Research: After completing the test phase of the PKMS prototype, its transformation into a viable PKM system and cloud-based server based on a rapid development platform and a noSQL-database is estimated to take 12 months.

Adopting Artificial Intelligence in a Decision Support System – Learnings from Comment Moderation Systems

As an open complex adaptive knowledge system, Web2.0 uses some applications like Blog, Wiki, Tag, SNS, RSS as its kernel, and puts many complex new theories and technologies, for example, Six degrees separation, Synergetics, Long tail, XML, Ajax into the background. So that knowledge production, communication and utilization have realized in self-organization and ordering through users' widely particip- ating under the restriction of simple rulers by the patterns of multiple, multiple, personalization and decentralization. The above make users become the adaptive agent of knowledge architecture (KA) in the Web2.0, revert KA to its original state of human-oriented and gives users abundant experiences, and made KA present the new characteristics of hierarchy, multiple and complexity. Therefore, the traditional KA theory can't explain and serve the new character, so that it is necessary to reveal the basic principles and evolution mechanism of the personal KA, Website KA and social KA in Web2.0 by introducing some complex theory and methods such as self-organization theory, emergence theory, and loop feedback theory from a new perspective.

Design Science Research (DSR) is a paradigm that centres on the development and evaluation of artefacts. While central, a proper scientific evaluation can significantly increase the work required to complete a DSR project. The high costs, workload, and delays caused by evaluations have been shown to lead to poor or absent evaluations. These findings present two paradoxes: (1) evaluation is considered essential, yet it is commonly done poorly or not at all; (2) DSR promises to improve research relevance through timely artefact development and reliability through scientific evaluation, yet poor and lengthy evaluations cause DSR to often fail to deliver on its promise. To address these paradoxes, this paper presents MEDS (Methods for Evaluation in Design Science), a four-step evaluation method that includes three component methods new to the evaluation guidance literature: MuSCoW (Must, Should, Could, Won’t), the DSR Evaluation Selection Framework, and Short-Scoping of evaluation methods. MEDS aims to address the above paradoxes and guide DSR researchers, especially novices, to achieve a programme of effective and resource-efficient DSR evaluations as an on-going component of existing DSR methodologies. By carefully planning, orchestrating, and scoping evaluation activities, MEDS delivers a rigorous evaluation programme without overwhelming researchers with a massive evaluation burden.

Several papers have addressed the theory foundation of DSR. While researchers usually emphasize that the existence of such a knowledge base (KB) is essential for high quality design science research (DSR), opinions depart what kind of knowledge comprises such a knowledge base and which qualitative requirements apply regarding the knowledge leveraged. Some researchers demand that DSR is based on descriptive formal theories, while other scholars extend the width of the knowledge base also to unverified empirical evidence, conceptual knowledge and prescriptive knowledge. In order to provide some guidance for practical DSR, we apply literature review methodology on recent DSR articles to determine the common practice regarding the use and development of knowledge bases in previous projects. Based on this investigation, we discuss current issues, derive implications for future research and suggest measures to strengthen the role of the knowledge base in DSR.

In Education, we develop artifacts: classes, didactic resources and educational practices. It is possible to interrelate the development of an artifact with the production of theoretical knowledge, and Design Science Research (DSR) is the approach we present on this article, used to do scientific research connected to the development of artifacts. Through this approach, the goal is to design a different reality, modified by artifacts designed to solve problems in given contexts, with the scientific knowledge being the result of the investigation of the use of the artifact in a given situation. DSR is an approach that is still under discussion; in this article, we show how our research group has been appropriating DSR. In particular, we present the DSR Model in which we synthesized the main lessons learned by our group. In order to exemplify the use of the DSR Model, we present the research on Smart Musical Mats. We consider that the DSR Model has been helping make our group’s researches more rigorous in theoretical, epistemological and methodological terms and, thus, more relevant in scientific terms. We present this model because we consider it to be a useful instrument to support other researchers that want to consider and use DSR.

Industrial business associations improving the internationalisation of SMEs with digital platforms: A design science research approach

Aim/Purpose: Due to the rapid development of digital technology, create knowledge to support the development of education for lifelong learning. Background: There is a lack of normative and prescriptive support that can guide the development of education concerning lifelong learning. Methodology: Design science research, interviews, grounded theory and root-cause analysis. Contribution: Contribution to practice: A master program in Information Systems that supports lifelong learning. Contribution to theory: Advancements on design knowledge that can guide the development of education programs concerning rapid advancements in digital technology. Findings: Five design principles: consider rapid development of digital technology, balance time-consuming bureaucratic procedures with companies’ demands for speedy access to modern courses, simplify procedures for students applying with work experience qualifications, implement plans for competence development of teachers, and base courses on rigour and relevance. Recommendations for Practitioners: Companies could enter the whole education program or select interesting courses or course modules. Recommendation for Researchers: The design principles should be considered when research on guidance concerning lifelong learning for adult learners is conducted. Impact on Society: Lifelong learning enhances social inclusion, active citizenship and personal development, as well as competitiveness and employability. Future Research: Further validation of the design principles in order to create knowledge that can support the development of education for lifelong learning.

Design science research application in medical radiation science education: A case study on the evaluation of a developed artifact

Opening up design science: The challenge of designing for reuse and joint development

We suggest that a new type of information system appears to be increasing in importance, that of consumer information systems. Compared with traditional information systems development approaches, where the focus is on improving the efficiency and effectiveness of organizational processes, design for consumer information systems focuses more on the enjoyment, pleasure and purchases of the consumer. We argue that the shift in focus from users to consumers in consumer information systems calls for a significant re-appraisal of our current information systems development methods. Hence, this paper proposes a new research agenda for IS researchers focusing on the development of consumer information systems. We plan to pursue this agenda by primarily using design science research, supplemented by other research methods as needed. The expected contributions include new insights into effective management processes for service design, a better understanding of issues of integration of information systems development practices used to develop consumer information systems, and the development of methods for requirements discovery for service innovation. These three components aim to contribute to a holistic evaluation of consumer information systems.