Standardized Sampling for Systematic Literature Reviews (STAMP Method): Ensuring Reproducibility and Replicability

Unobtrusiveness has been highlighted as an important design principle in Human-Computer Interaction (HCI). However, the understanding of unobtrusiveness in the literature varies. Researchers often claim unobtrusiveness for their interaction method based on their understanding of what unobtrusiveness means. This lack of a shared definition hinders effective communication in research and impedes comparability between approaches. In this article, we approach the question “What is unobtrusive interaction?” with a systematic and extensive literature review of 335 papers and an online survey with experts. We found that not a single definition of unobtrusiveness is universally agreed upon. Instead, we identify five working definitions from the literature and experts’ responses. We summarize the properties of unobtrusive interaction into a design framework with five dimensions and classify the reviewed papers with regard to these dimensions. The article aims to provide researchers with a more unified context to compare their work and identify opportunities for future research.

PurposeThe purpose of this paper is to contribute to understanding social entrepreneurship via a systematic literature review (SLR) of the construct’s varied definitions to assess the means by and the context in which the phenomenon is studied.Design/methodology/approachThe SLR follows a deliberative, replicable, methodical and transparent process, including a quality assessment tool of definitional sources. SLR results are organized around Gartner’s (1985) framework of new value creation, thus additionally analysing the dimensionality with which social entrepreneurship has been studied. Finally, a qualitative analysis of the definitions reviews commonalities of themes within definitions to assess trends.FindingsSignificant research has been dedicated to defining social entrepreneurship. However, many efforts do not explore the full dimensionality of the concept, as findings reveal that no definition explored the four dimensions of entrepreneurship posited by Gartner (1985). Further, a time-series review of definitions demonstrates limited advancement in definitional development. Geographic location of definition authors and key word analysis challenge previous research on the activation of social entrepreneurship in literature.Research limitations/implicationsAlthough the SLR was conducted in a controlled manner, this study is time-bound and only reviews English-language publications. While results are analysed using a recognized framework (i.e. Gartner, 1985), other conceptual models are available. Although two researchers independently categorized and analysed definitions, assessment of quality was limited. The results offer an insight into how the conceptualization of social entrepreneurship may be advanced as well as the important role of practitioners in the development of the construct’s theory and practice.Practical implicationsThe detailed appraisal of definitions may guide practitioners as they strive to define their own organizational efforts. The multi-dimensional conversation of social entrepreneurship in this study enables the leaders of different organizational types to ensure their social entrepreneurship activities consider all dimensions (i.e. environment, individual, organization and process). The SLR allows the practitioner to further engage in deep discussion on the future of the field by cataloguing their influence on the multi-dimensionality of the social entrepreneurship construct. Organizational leaders may also use the findings to generate more discussion around what is missing from the definitions (i.e. empathy, responsibility, resourcefulness and transparency).Originality/valueThe findings synthesize social entrepreneurship definitions across multi-disciplinary fields and contexts and within a multi-dimensional framework utilizing an infrequently used literature review method within social sciences.

In this paper, we present the development of the Altered States Database (ASDB), an open-science project based on a systematic literature review. The ASDB contains psychometric questionnaire data on subjective experiences of altered states of consciousness (ASC) induced by pharmacological and non-pharmacological methods. The systematic review follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Scientific journal articles were identified through PubMed and Web of Science. We included studies that examined ASC using the following validated questionnaires: Altered States of Consciousness Rating Scale (APZ, 5D-ASC, 11-ASC), Phenomenology of Consciousness Inventory (PCI), Hallucinogen Rating Scale (HRS), or Mystical Experience Questionnaire (MEQ30). The systematic review resulted in the inclusion of a total of 165 journal articles, whereof questionnaire data was extracted and is now available on the Open Science Framework (OSF) website (https://osf.io/8mbru) and on the ASDB website (http://alteredstatesdb.org), where questionnaire data can be easily retrieved and visualized. This data allows the calculation of comparable psychometric values of ASC experiences and of dose-response relationships of substances inducing ASC.

What is known about personal reputation? A systematic literature review

PurposeThis study evaluates the effects of non-invasive home telemonitoring methods of managing congestive heart failure (CHF) patients with particular focus on complexity of intervention, patient characteristics, patient severity, and key enabling technologies (KETs) adopted. Our goal was to capture all possible aspects of previously documented outcomes and provide updated and clearer evidence on mixed effects on common themes.MethodsRandomized controlled trials (RCTs) published between 1 January 2012 and 6 June 2019, focusing on home telemonitoring of patients with only CHF or CHF coexisting with other chronic disease(s), were retrieved from online resources (PubMed, Embase, MEDLINE(R), Your journals@Ovid, Elsevier, and ClinicalTrials.gov). The snowball sampling method and forward citation tracking on Google Scholar were also adopted to identify additional relevant studies. Retrieved studies were in a language known by the authors (i.e., English, Spanish or Italian). Quality assessment of individual studies for shortcomings in design, management, evaluation, and reporting was done using the Cochrane risk of bias (RoB) tool. Variables of interest were synthesized as differences in relative risk (RR), or as weighted mean differences (WMD). Outcomes were assigned as primary or secondary based on a principal judgement of clinical importance, and secondarily on highest recurrent counts in included studies.ResultsIn all, 28 RCTs involving 10,258 patients were included in the qualitative synthesis, out of which 24 were used for the quantitative synthesis. These studies focused on non-invasive telemonitoring practices for home monitoring of CHF patients, through the deployment of different kinds of electronic/mobile devices, with most having wireless communication capabilities. Moreover, studies focusing on implantable monitoring devices in terms of inputs, data and patient performance were also included. Brain natriuretic peptide (BNP) ((WMD = -27.75; 95% CI (-53.36, -2.14); p-value = 0.034), rehospitalization/hospitalization for heart failure (RR = 0.88; 95% CI (0.79, 0.98); p-value = 0.015), cardiovascular death/heart failure hospitalization (RR = 0.70; 95% CI (0.51, 0.97); p-value = 0.03), and six minute walk test (6MWT) (WMD = 25.61; 95% CI (9.22, 41.99); p-value = 0.002) significantly improved in the telemonitoring group, while the number of visits to a nurse (WMD = 1.42; 95% CI (0.33, 2.52); p-value = 0.011) increased considerably compared to usual care.ConclusionAlthough there were limitations to the evidence provided in this review such as wide variations in certain variables (e.g., sample populations, RoB assessment, telemonitoring tools, follow-up periods), issues with allocation concealment and blinding of participants and personnel, and paucity of data for synthesizing particular outcomes of interest, overall, telemonitoring seems to offer much better results in the treatment of CHF patients compared to usual care.Registration and protocolThis systematic review and meta-analysis has been retrospectively registered in the Open Science Framework (OSF) repository with https://doi.org/10.17605/OSF.IO/NDXCP. All data related to this study, including the electronic supplementary data, can be found at this link: osf.io/57q3h.

Context: Systematic literature reviews have become common in software engineering in the last decade, but challenges remain.Goal: Given the challenges, the objective is to describe improvement areas in writing primary studies, and hence provide a good basis for researchers aiming at synthesizing research evidence in a specific area.Method: The results presented are based on a literature review with respect to synthesis of research results in software engineering with a particular focus on empirical software engineering. The literature review is complemented and exemplified with experiences from conducting systematic literature reviews and working with research methodologies in empirical software engineering.Results: The paper presents three areas where improvements are needed to become more successful in synthesizing empirical evidence. These three areas are: terminology, paper content and reviewing.Conclusion: It is concluded that it must be possible to improve the primary studies, but it requires that researchers start having synthesis in mind when writing their research papers.

The Open Data initiative Altered States Database (ASDB) collects psychometric questionnaire data on the subjective experiences of pharmacologically and non-pharmacologically induced altered states of consciousness. The ASDB is updated annually and can be utilized by both researchers and non-scientists to access information or conduct further analyses. The current update adds data published in the year 2024, sourced from a systematic literature review following the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines. A total of 470 items were screened, resulting in 28 included journal articles, of which twelve report on the 11-Altered States of Consciousness Rating Scale (11-ASC), eleven on the 5D-ASC, ten on the Mystical Experience Questionnaire (MEQ30), three on the Hallucinogen Rating Scale (HRS), and one on the Phenomenology of Consciousness Inventory (PCI). In total, the ASDB now encompasses data from 28 pharmacological and 18 nonpharmacological consciousness modifying techniques (CMT) (plus control substances/techniques), incorporating 225 journal articles and 978 single datasets from 25.131 participants across datasets. The ASDB can be accessed on https://asdb.info and on Open Science Framework (OSF; https://osf.io/8mbru).

Time-restricted eating (TRE) is a novel dietary intervention shown to facilitate weight loss and improve metabolic health. However, like any dietary intervention, long-term success largely depends on individual adherence, which can be influenced by whether the intervention impacts the individual's health-related quality of life (HR-QoL). Despite the growing body of research investigating TRE as a dietary approach and its potential impact on HR-QoL in adults, to date there has been no systematic review to summarize these findings. To examine the impact of TRE on HR-QoL in adults. All randomized controlled trials, pre-post and pilot/feasibility studies were searched in PubMed, EMBASE via Ovid, CINAHL, Cochrane Library, and PsycINFO via Ovid until March 20, 2023. Two researchers were involved in the screening and paper selection process. A single researcher extracted all relevant data from eligible studies. Overall, 10 studies were eligible for inclusion in this systematic review. Four studies reported improvements in overall HR-QoL scores among participants with type 2 diabetes, middle-aged women with obesity, generally healthy adults, and generally healthy adult employees. Three studies reported significant and nonsignificant improvements in some domains of HR-QoL assessment tools among overweight, sedentary older adults, overweight or obese adults, and 24-hour shift workers. No studies reported that TRE adversely affected HR-QoL. Improvements in HR-QoL appeared to occur primarily at 12 weeks/3 months. There was no clear relationship between HR-QoL scores and TRE protocol, additional study outcomes, participant health status, age, or adherence. Although further research is required to elucidate the impact of TRE on HR-QoL, the findings reveal that no studies show that TRE adversely affects HR-QoL. Open Science Framework (OSF) (The Impact of Time-Restricted Eating on Health-Related Quality of Life: A Systematic Review; https://doi.org/10.17605/OSF.IO/9NK45).

Multigrade classrooms represent a widely extended educational modality in rural contexts and territories with low demographic density. This organizational model, in which a single teacher serves students from different levels in the same space, poses particular challenges but also significant pedagogical opportunities. In this systemic literature review, a total of 40 international studies were analyzed according to the PRISMA guidelines, published between 2019 and 2024 in databases such as Scopus and ERIC. The objective of this analysis is to identify the main organizational and methodological approaches, as well as the strengths and weaknesses, associated with teaching in multigrade contexts. This systematic review has been prospectively registered in the Open Science Framework (OSF) under registration number: 64rsu. A qualitative thematic analysis was employed to organize the results into five categories: organizational models, pedagogical practices, teacher training, impact on learning, and school-community links. The findings underscore the efficacy of this model in promoting educational inclusion, cooperative learning, and curricular contextualization. Nevertheless, they also underscore the necessity for specific teacher training and support policies. This review offers a comparative and critical perspective that has the potential to inform the development of more effective pedagogical and training strategies in a range of educational settings.

Inter‐organizational collaboration is a well‐established subject in the nonprofit research literature, with hundreds of journal articles, scholarly texts, and academic conference proceedings published since 2000. Consequently, a handful of prominent review articles have helped synthesize this literature, including Gazley and Gou's award‐winning article in this journal. However, their study only reviewed articles up to 2015, affording an opportunity for subsequent review work to expand our understanding of nonprofit collaboration. We take the caveats and qualifications of Gazley and Gou's review as points of departure for our work. Specifically, we identify communication scholarship on nonprofit collaboration as a notable line of nonprofit collaboration research that to date has largely been overlooked by nonprofit scholars but now has reached a level of critical mass and impact. We aim to accomplish four goals in this review article: (1) familiarize nonprofit scholars with the distinct aspects of communication scholarship, (2) provide the most comprehensive review to date of communication nonprofit collaboration research, (3) address some of the limitations of Gazley and Guo's review and advance their work by demonstrating how communication scholarship responds to some of the things called for in their article—specifically their calls for more research on collaboration processes, design, and practitioner guidance, and (4) explain what communication scholarship contributes to our understanding of nonprofit collaboration, thereby substantiating our claim of good news—that we know even more about nonprofit collaboration to inform our current and future endeavors in research and practice.

This systematic literature review (SLR) delves deep into the body of knowledge in Architectural Education where Vedic principles have been used in the context of popular learning theories. The purpose here is to elicit information about the theories of learning and identify the most prominent theories so that the nature of research undertaken so far can be classified based on the contribution of the theories, research focus, and research type. Further, after screening the literature, data extraction and synthesis is carried out leading to the identification of research gaps. Additionally, the factors that emerge through the selected literature have been grouped with their associated variables to provide a future direction for researchers to develop a framework for seamlessly integrating Vedic Architecture (VA) principles and practices into the architectural curriculum. The research methodology utilized in this study adopts an SLR approach characterized by deductive reasoning based on evidence. This deliberate choice aims to ensure a transparent and logical process, minimizing bias through extensive literature searches. The objective is to reach well-founded decisions, procedures, and conclusions that address the specific research questions posed. This review identified that there were four prominent theories used in the context of Architectural education using VA. Experiential Learning Theory (ELT) leads with 31% of the total 97 papers followed by Constructivist Learning Theory (CLT) (26%), Cultural-Historical Activity Theory (CAT) (24%), and Transformative Learning Theory (TLT) with 19 papers (19%). In research focus based classification, model development-based papers (55.7%) dominated the literature. In the classification of research type there were a higher number of papers on empirical research (36.1%). Six key research gaps have been identified that future researchers can attempt to address or fill. Finally, six major factors have been derived from the papers reviewed in this SLR, which could form the foundation for the development of a VA-based educational model. The SLR will assist practitioners and researchers in determining the key factors which need to be considered while developing a holistic model of VA based curriculum in architectural education. The limitation could be the focus laid on only four theories which dominated the contemporary research literature ignoring the other theories. The research is an original contribution to the knowledge base considering the literature from the past 25 years, the period during which the research in VA in architectural education has been active globally. The value addition is in terms of the identification of the underpinning theories to be considered in the development of a holistic model.

Performative Microforests: Investigating the potential benefits of integrating spatial vegetation environments into buildings, in regards to the performance of buildings, their occupants + local ecosystems

Purpose Street view analytics (SVA) is an emerging field focusing on the systematic analysis of street-level imagery to understand urban environments, which has rapidly advanced with the advent of vision language models (VLMs). Despite the significant advancements, a critical review of the applications of VLMs for SVA is lacking. This paper aims to fill this gap by providing a comprehensive literature review on VLM-enabled SVA. Design/methodology/approach This study adopts a Preferred Reporting Items for Systematic Reviews and Meta-Analyses-guided systematic literature review. After keyword retrieval, literature collection, thematic screening and a five-domain quality assessment (data representativeness, ground truth validity, model design and/or analytic rigor, validation and/or generalization and reporting and/or reproducibility), 69 VLM-enabled SVA studies (2020–2025) were selected. Five reviewers independently extracted and synthesized evidence, and inter-rater reliability was quantified to verify consistency. Findings The systematic analysis underscores the transformative potential of VLMs in SVA, emphasizing their multimodal data handling and open-domain knowledge integration. However, key challenges, while rooted in broader SVA limitations, manifest distinctly in VLM contexts: temporal dynamics, contextual reliance, annotation inconsistencies, computational demands and process transparency. Handling remains task-dependent, with future research focusing on city- and year-held-out temporal evaluation, robustness to street-level variability, retrieval-augmented generation for consistency, hybrid edge-cloud models and chain-of-thought prompting. Originality/value This study contributes to the field by synthesizing the latest development of VLMs for SVA, identifying avenues for future research and ultimately proposing an integrated workflow for enhancing VLMs' applications in SVA tasks.

Public participation has been growing in both theory and practice of urban planning, including heritage planning. The reasoning is to facilitate the involvement of a broader group of stakeholders, beyond experts. More specifically, for heritage planning, participation could enable consensus-building on defining the significance of heritage, namely attributes (the resources that should be listed as heritage), and values (the reasons that attributes are important). However, there is not yet a holistic understanding of the influencing factors behind consensus-building in the participatory planning processes for cultural heritage. To evaluate existing research from this angle, a systematic literature review was conducted on peer-reviewed articles using the Scopus database. As most of the studies focuse on urban planning, this research examines the factors influencing consensus-building in the participatory planning process applied to urban and heritage planning and reflects on the applicability of these factors in heritage planning. The main factors were identified inductively and grouped into two categories: 1) public participation: actors, methods, and levels of public participation, and 2) consensus: approaches, and conflicts. The relations between these factors and their frequencies are investigated using statistical analysis methods, namely frequency analysis, independent-samples t-test, and Spearman correlation. The literature confirms that urban planning has applied more diverse methods and tools for public participation compared to studies in the field of heritage planning, and could inspire heritage planning. Conflict is recognized as an intertwined concept with consensus which is considered either as a challenge or as a necessity for an inclusive decision-making. By proposing a framework integrating these factors and sub-factors and illustrating their relationships, this research could also be useful for decision-makers and practitioners to better tailor the public participation process and means to implement it, considering the relevant factors involved.

In research, augmentative and alternative communication (AAC) interventions have primarily focused on teaching children to make requests; however, AAC intervention should not stop there. There is a dearth of AAC intervention research targeting other communicative functions, despite there being a significant need to enhance children’s communication competence in a variety of social and educational contexts. The purpose of this study was to examine the initial efficacy and feasibility of an AAC narrative intervention on the picture-supported retelling skills of three children with autism, aged 6–9 years old. This multiple baseline across participants design study was preregistered at Open Science Framework (https://doi.org/10.17605/OSF.IO/29SFP). We measured the effect of the intervention on children’s inclusion and complexity of story grammar elements and the variety of symbols used to retell untrained stories during a baseline condition, just before each intervention session, immediately following each intervention session, and three weeks after the last intervention session. Parents completed a feasibility questionnaire and documented their children’s generalized use of AAC. The AAC narrative intervention improved children’s AAC retells, with ascending trends in the intervention condition and scores elevated above baseline after 3 weeks. Parents reported that they perceived the intervention to be appropriate, effective, enjoyable, and planned to use it themselves after the study. Generalized use of AAC outside of intervention sessions was documented for all three participants.