Are quality improvement collaboratives effective? A systematic review

Up to 50% of antibiotic usage in hospitals is inappropriate. In hospitals infections caused by antibiotic-resistant bacteria are associated with higher mortality, morbidity and prolonged hospital stay compared with infections caused by antibiotic-susceptible bacteria. Clostridium difficile associated diarrhoea (CDAD) is a hospital acquired infection that is caused by antibiotic prescribing. To estimate the effectiveness of professional interventions that alone, or in combination, are effective in promoting prudent antibiotic prescribing to hospital inpatients, to evaluate the impact of these interventions on reducing the incidence of antimicrobial resistant pathogens or CDAD and their impact on clinical outcome. We searched the Cochrane Effective Practice and Organisation of Care (EPOC) specialized register, Cochrane Central Register of Controlled Trials, MEDLINE, EMBASE from 1980 to November 2003. Additional studies were obtained from the bibliographies of retrieved articles We included all randomised and controlled clinical trials (RCT/CCT), controlled before and after studies (CBA) and interrupted time series (ITS) studies of antibiotic prescribing to hospital inpatients. Interventions included any professional or structural interventions as defined by EPOC. Two reviewers extracted data and assessed quality. Sixty six studies were included and 51 (77%) showed a significant improvement in at least one outcome. Six interventions only aimed to increase treatment, 57 interventions aimed to decrease treatment and three interventions aimed to both increase and decrease treatment. The intervention target was the decision to prescribe antibiotics (one study), timing of first dose (six studies), the regimen (drug, dosing interval etc, 61 studies) or the duration of treatment (10 studies); 12 studies had more than one target. Of the six interventions that aimed to increase treatment, five reported a significant improvement in drug outcomes and one a significant improvement in clinical outcome. Of the 60 interventions that aimed to decrease treatment 47 reported drug outcomes of which 38 (81%) significantly improved, 16 reported microbiological outcomes of which 12 (75%) significantly improved and nine reported clinical outcomes of which two (22%) significantly deteriorated and 3 (33%) significantly improved. Five studies aimed to reduce CDAD. Three showed a significant reduction in CDAD. Due to differences in study design and duration of follow up it was only possible to perform meta-regression on a few studies. The results show that interventions to improve antibiotic prescribing to hospital inpatients are successful, and can reduce antimicrobial resistance or hospital acquired infections.

Introduction: Clinical decision support (CDS) has been implemented in many clinical settings in order to improve decision-making. Their potential to improve diagnostic accuracy and reduce unnecessary testing is well documented; however, their effectiveness in impacting physician practice in real world implementations has been limited by poor physician adherence. The objective of this systematic review and meta-regression was to establish the effectiveness of CDS tools on adherence and identify which characteristics of CDS tools increase physician use of and adherence. Methods: A systematic review and meta-analysis was conducted. MEDLINE, EMBASE, PsychINFO, the Cochrane Central Register of Controlled Trials and Cochrane Database of Systematic Reviews were searched from inception to June 2017. Included studies examined CDS in a hospital setting, reported on physician adherence to or use of CDS, utilized a comparative study design, and reported primary data. All tool type was classified based on the Cochrane Effective Practice and Organization of Care (EPOC) classifications. Studies were stratified based on study design (RCT vs. observational). Meta-regression was completed to assess the different effect of characteristics of the tool (e.g. whether the tool was mandatory or voluntary, EPOC classifications). Results: A total of 3,359 candidate articles were identified. Seventy-two met inclusion criteria, of which 46 reported outcomes appropriate for meta-regression (5 RCTs and 41 observational studies). Overall, a trend of increased CDS use was found (pooled RCT OR: 1.36 [95% CI: 0.97-1.89]; pooled observational OR: 2.12 [95% CI: 1.75-2.56]).When type of tool is considered, clinical practice guidelines were superior compared to other interventions (p=.150). Reminders (p=.473) and educational interventions (p=.489) were less successful than other interventions. Multi-modal tools were not more successful that single interventions (p=.810). Lastly, voluntary tools may be supperior to than mandatory tools (p=.148). None of these results are statistically significant. Conclusion: CDS tools accompanied by a planned intervention increases physician utilization and adherence to the tool. Meta-regression found that clinical practice guidelines had the biggest impact on physician adherence although not statistically significant. Further research is required to understand the most effective intervention to maximize physician utilization of CDS tools.

Alzheimer’s disease (AD) and dementia are preventable and highly prevalent diseases, as is systemic arterial hypertension. Thus, it is speculated that angiotensin receptor blockers (ARBs) may be neuroprotective against AD.Objective:The aim of this study was to evaluate if the use of ARBs confers a neuroprotective effect on AD, through a systematic review.Methods:Studies published on Embase, LILACS, SciELO, and PubMed were evaluated. The selection of the studies included those that evaluated the use of antihypertensive drugs in individuals with a previous diagnosis of mild cognitive impairment. The data were extracted with the Cochrane Effective Practice and Organization of Care (EPOC) form. The risk of bias was evaluated by the EPOC “Risk of bias tool.”Results:A total of 12 articles were identified, and 3 articles were selected. Two of them analyzed the use of ARB/ACEI versus other antihypertensives and the development of dementia.Conclusion:There is a tendency for ARBs to be superior to other antihypertensives in preventing dementia.

BackgroundMifepristone is a selective progesterone receptor modulator with decades of data demonstrating its potential as a highly effective emergency as well as non-emergency contraceptive. Despite considerable evidence pointing to the...

BackgroundThere is a significant treatment gap in provision of effective treatment for people with mental disorders globally. In some Low and Middle Income Countries (LMICs) this gap is 90% or more in terms of untreated cases. Clinical practice guidelines (CPGs) are one tool to improve health care provision. The aim of this review is to examine studies of the effectiveness of evidence-based CPG implementation across physical and mental health care, to inform mental healthcare provision in low and middle income countries (LMICs), and to identify transferable lessons from other non-communicable diseases to mental health.MethodsA systematic literature review employing narrative synthesis and utilising the tools developed by the Cochrane Effective Practice and Organisation of Care (EPOC) group was conducted. Experimental studies of CPG implementation relating to non-communicable diseases, including mental disorders, in LMICs were retrieved and synthesised.ResultsFew (six) studies were identified. Four cluster randomised controlled trials (RCTs) related to the introduction of CPGs for non-communicable diseases in physical health; one cluster-RCT included CPGs for both a non-communicable disease in physical health and mental health, and one uncontrolled before and after study described the introduction of a CPG for mental health. All of the included studies adopted multi-faceted CPG implementation strategies and used education as part of this strategy. Components of the multi-faceted strategies were sometimes poorly described. Results of the studies included generally show statistically significant improvement on some, but not all, outcomes.ConclusionEvidence for the effectiveness of interventions to improve uptake of, and compliance with, evidence-based CPGs in LMICs for mental disorders and for other non-communicable diseases is at present limited. The sparse literature does, however, suggest that multifaceted CPG implementation strategies that involve an educational component may be an effective way of improving guideline adherence and therefore of improving clinical outcomes. Further work is needed to examine cost-effectiveness of CPG implementation strategies in LMICs and to draw conclusions on the transferability of implementation experience in physical health care to mental health practice settings. Strategies to ensure that CPGs are developed with clear guidance for implementation, and with explicit, methods to evaluate them should be a priority for mental health researchers and for international agencies.

Cochrane Central Register of Controlled Trials (CENTRAL), the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register, Medline, Ovid; Embase, CINAHL, EBSCO, Science Citation Index and Social Sciences Citation Index, ISIWeb of Science Randomised trials of audit and feedback that reported objectively measured health professional practice or patient outcomes. Data were abstracted by two independent review authors using a data extraction form. The following factors were examined as possible explanations for the variation in the effectiveness of interventions across comparisons; format of feedback, source of feedback, frequency of feedback, instructions for improvement, direction of change required, baseline performance, profession of recipient and risk of bias within the trial itself. Risk of bias was assessed using EPOC criteria. The degree of confidence in the estimate of effect across studies was assessed using the GRADE approach. All outcomes were expressed as compliance with desired practice and both professional and patient outcomes were assessed, though separately. One hundred and forty studies were included. Using 70 of these 108 comparisons were made. After excluding studies at high risk of bias there were 82 comparisons from 49 studies with dichotomous outcomes, and the weighted median adjusted RD was 4.3% (interquartile range (IQR) 0.5% to 16%). For studies with continuous outcomes the weighted median adjusted percentage change relative to control was 1.3% (IQR = 1.3%to 28.9%). For patient outcomes the weighted median RD was 0.4% (IQR -1.3% to 1.6%) in studies reporting dichotomous outcomes, and the weighted median percentage change was 17% (IQR 1.5% to 17%) for studies with continuous outcomes. Multivariable meta-regression indicated that feedback may be more effective when baseline performance is low, the source is a supervisor or colleague, it is provided more than once, it is delivered in both verbal and written formats and when it includes both explicit targets and an action plan. Audit and feedback generally lead to small but potentially important improvements in professional practice.

Introduction: People living with type 2 diabetes undertake a range of tasks to manage their condition, collectively referred to as self-management. Interventions designed to support self-management vary in their content, and efficacy. This systematic review will analyse self-management interventions for type 2 diabetes drawing on theoretical models of patient workload and capacity. Methods and analysis: Five electronic databases (Medline, Embase, CENTRAL, CINAHL and PsycINFO) will be searched from inception to 27th April 2021, supplemented by citation searching and hand-searching of reference lists. Two reviewers will independently review titles, abstracts and full texts. Inclusion criteria include Population: Adults with type 2 diabetes mellitus; Intervention: Randomised controlled trials of self-management support interventions; Comparison: Usual care; Outcomes: HbA1c (primary outcome) health-related quality of life (QOL), medication adherence, self-efficacy, treatment burden, healthcare utilization (e.g. number of appointment, hospital admissions), complications of type 2 diabetes (e.g. nephropathy, retinopathy, neuropathy, macrovascular disease) and mortality; Setting: Community. Study quality will be assessed using the Effective Practice and Organisation of Care (EPOC) risk of bias tool. Interventions will be classified according to the EPOC taxonomy and the PRISMS self-management taxonomy and grouped into similar interventions for analysis. Clinical and methodological heterogeneity will be assessed within subgroups, and random effects meta-analyses performed if appropriate. Otherwise, a narrative synthesis will be performed. Interventions will be graded on their likely impact on patient workload and support for patient capacity. The impact of these theoretical constructs on study outcomes will be explored using meta-regression. Conclusion This review will provide a broad overview of self-management interventions, analysed within the cumulative complexity model theoretical framework. Analyses will explore how the workload associated with self-management, and support for patient capacity, impact on outcomes of self-management interventions. Registration number: PROSPERO CRD42021236980.

ObjectivesLow value imaging provides little or no benefit to the patient, may cause harm, and waste resources. To reduce low value imaging, we need to know how to change clinical...

To summarize the effectiveness of implementation strategies for ICU execution of recommendations from the 2013 Pain, Agitation/Sedation, Delirium (PAD) or 2018 PAD, Immobility, Sleep Disruption (PADIS) guidelines. PubMed, CINAHL, Scopus, and Web of Science were searched from January 2012 to August 2023. The protocol was registered with PROSPERO (CRD42020175268). Articles were included if: 1) design was randomized or cohort, 2) adult population evaluated, 3) employed recommendations from greater than or equal to two PAD/PADIS domains, and 4) evaluated greater than or equal to 1 of the following outcome(s): short-term mortality, delirium occurrence, mechanical ventilation (MV) duration, or ICU length of stay (LOS). Two authors independently reviewed articles for eligibility, number of PAD/PADIS domains, quality according to National Heart, Lung, and Blood Institute assessment tools, implementation strategy use (including Assess, prevent, and manage pain; Both SAT and SBT; Choice of analgesia and sedation; Delirium: assess, prevent, and manage; Early mobility and exercise; Family engagement and empowerment [ABCDEF] bundle) by Cochrane Effective Practice and Organization of Care (EPOC) category, and clinical outcomes. Certainty of evidence was assessed using Grading of Recommendations Assessment, Development, and Evaluation. Among the 25 of 243 (10.3%) full-text articles included ( n = 23,215 patients), risk of bias was high in 13 (52%). Most studies were cohort ( n = 22, 88%). A median of 5 (interquartile range [IQR] 4-7) EPOC strategies were used to implement recommendations from two (IQR 2-3) PAD/PADIS domains. Cohort and randomized studies were pooled separately. In the cohort studies, use of EPOC strategies was not associated with a change in mortality (risk ratio [RR] 1.01; 95% CI, 0.9-1.12), or delirium (RR 0.92; 95% CI, 0.82-1.03), but was associated with a reduction in MV duration (weighted mean difference [WMD] -0.84 d; 95% CI, -1.25 to -0.43) and ICU LOS (WMD -0.77 d; 95% CI, -1.51 to 0.04). For randomized studies, EPOC strategy use was associated with reduced mortality and MV duration but not delirium or ICU LOS. Using multiple implementation strategies to adopt PAD/PADIS guideline recommendations may reduce mortality, duration of MV, and ICU LOS. Further prospective, controlled studies are needed to identify the most effective strategies to implement PAD/PADIS recommendations.

Educating prescribers is a strategy to reduce prescription errors in hospitals. The present systematic review gives an overview of original research papers on the education of prescribers and reporting outcomes on (potential) patient harm. A search of the databases Embase and Medline, using the Ovid interface, was performed. Research on the effect of physician education in order to prevent medication-related problems in inpatients, and on reporting original data and outcomes on prescribing errors and/or (potential) patient harm, was included. The assessment of methodological quality and risk of bias was performed using the Methodological Index for Non-Randomized studies (MINORS) checklist and the suggested risk of bias criteria for Effective Practice and Organization of Care (EPOC) reviews. Eight studies investigated an intervention on education alone, and in seven studies education was the main part of a multifaceted intervention. All studies were small and had short follow-up periods. The educational programmes varied and were given to physicians of different specialties and levels of experience. Most studies reported intermediate process parameters as the outcome. The risk of performance and reporting bias were high. All included studies suffered from poor methodology. The majority, especially studies in which education was part of a multifaceted intervention, reported effectiveness on intermediate outcome markers as prescription errors and potential adverse drug events. However, we found no firm evidence that educating prescribers in the hospital leads to a decrease in patient harm. Further work is needed to develop educational programmes, accompanied by more high-quality research with outcomes on the improvement of patient care.

Low- to moderate-certainty evidence suggests that, compared to usual care, medication reconciliation, CPOE/CDSS, barcoding, feedback and dispensing systems in surgical wards may reduce medication errors and ADEs. However, the results are imprecise for some outcomes related to medication reconciliation and CPOE/CDSS. The evidence for other interventions is very uncertain. Powered and methodologically sound studies are needed to address the identified evidence gaps. Innovative, synergistic strategies -including those that involve patients- should also be evaluated.

Methods Articles in the Cochrane Database of Systematic Reviews, Effective Practice and Organization of Care (EPOC) that included at least one of the 47 Cochrane Review implementation strategies were retrieved yielding 1158 articles in 337 journals. We selected publications from the 3 journals with the largest number of articles: British Medical Journal (BMJ), Journal of the American Medical Association (JAMA), and Medical Care. We developed an “Implementation Strategy Fidelity Score” based on definitions adapted from Dusenbury (2003) [1]. Adherence (documenting implementation strategies and extent to which they took place), dose (proportion of people receiving each strategy) and participant responsiveness (extent to which individuals were involved in the development or evaluation of strategies or their receptivity to them) were scored on a 3-point scale: 0=no detail, 1=some detail, and 2=great detail.

Poor or inequitable access to oral health care is commonly reported in high-, middle- and low-income countries. Although the severity of these problems varies, a lack of supply of dentists and their uneven distribution are important factors. Delegating care to dental auxiliaries could ease this problem, extend services to where they are unavailable and liberate time for dentists to do more complex work. Before such an approach can be advocated, it is important to know the relative effectiveness of dental auxiliaries and dentists. To assess the effectiveness, costs and cost effectiveness of dental auxiliaries in providing care traditionally provided by dentists. We searched the following electronic databases from their inception dates up to November 2013: the Cochrane Effective Practice and Organisation of Care (EPOC) Group's Specialised Register; Cochrane Oral Health Group's Specialised Register; the Cochrane Central Register of Controlled Trials (Issue 11, 2013); MEDLINE; EMBASE; CINAHL; Cochrane Database of Systematic Reviews; Database of Abstracts of Reviews of Effectiveness; five other databases and two trial registries. We also undertook a grey literature search and searched the reference list of included studies and contacted authors of relevant papers. We included randomised controlled trials (RCTs), non-randomised controlled clinical trials (NRCTs), interrupted time series (ITSs) and controlled before and after studies (CBAs) evaluating the effectiveness of dental auxiliaries compared with dentists in undertaking clinical tasks traditionally performed by a dentist. Three review authors independently applied eligibility criteria, extracted data and assessed the risk of bias of each included study and two review authors assessed the quality of the evidence from the included studies, according to The Cochrane Collaboration's procedures. Since meta-analysis was not possible, we gave a narrative description of the results. We identified five studies (one cluster RCT, three RCTs and one NRCT), evaluating the effectiveness of dental auxiliaries compared with dentists in providing dental care traditionally provided by dentists, eligible for inclusion in this review. The included studies, which involved 13 dental auxiliaries, six dentists, and more than 1156 participants, evaluated two clinical tasks/techniques: placement of preventive resin fissure sealants and the atraumatic restorative technique (ART). Two studies were conducted in the US, and one each in Canada, Gambia and Singapore.Of the four studies evaluating effectiveness in placing preventive resin fissure sealants, three found no evidence of a difference in retention rates of those placed by dental auxiliaries and dentists over a range of follow-up periods (six to 24 months). One study found that fissure sealants placed by a dental auxiliary had lower retention rates than one placed by a dentist after 48 months (9.0% with auxiliary versus 29.1% with dentist). The same study reported that the net reduction after 48 months in the number teeth exhibiting caries (dental decay) was lower for teeth treated by the dental auxiliary than the dentist (3 with auxiliary versus 60 with dentist, P value < 0.001).One study showed no evidence of a difference in dental decay after treatment with fissure sealants between groups. The one study comparing the effectiveness of dental auxiliaries and dentists in performing ART reported no difference in survival rates of the restorations (fillings) after 12 months.All studies were at high risk of bias and the overall quality of the evidence was very low, as assessed using the GRADE approach. In addition, four of the included studies were more than 20 years old; the materials used and the techniques assessed were out of date. We found no eligible studies comparing the effectiveness of dental auxiliaries and dentists in the diagnosis of oral diseases and conditions, in delivering oral health education and other aspects of health promotion, or studies assessing participants' perspectives including the acceptability of care received. None of the included studies reported adverse effects. In addition, we found no studies comparing the costs and cost-effectiveness of dental auxiliaries and dentists, their impact on access and equity of access to care that met the pre-specified inclusion criteria. We only identified five studies for inclusion in this review, all of which were at high risk of bias and four were published more than 20 years ago, highlighting the paucity of high-quality evaluations of the relative effectiveness, cost-effectiveness and safety of dental auxiliaries compared with dentists in performing clinical tasks. No firm conclusions could be drawn from the present review about the relative effectiveness of dental auxiliaries and dentists.

Despite evidence supporting the effectiveness of diabetic retinopathy screening (DRS) in reducing the risk of sight loss, attendance for screening is consistently below recommended levels. The primary objective of the review was to assess the effectiveness of quality improvement (QI) interventions that seek to increase attendance for DRS in people with type 1 and type 2 diabetes.Secondary objectives were:To use validated taxonomies of QI intervention strategies and behaviour change techniques (BCTs) to code the description of interventions in the included studies and determine whether interventions that include particular QI strategies or component BCTs are more effective in increasing screening attendance;To explore heterogeneity in effect size within and between studies to identify potential explanatory factors for variability in effect size;To explore differential effects in subgroups to provide information on how equity of screening attendance could be improved;To critically appraise and summarise current evidence on the resource use, costs and cost effectiveness. We searched the Cochrane Library, MEDLINE, Embase, PsycINFO, Web of Science, ProQuest Family Health, OpenGrey, the ISRCTN, ClinicalTrials.gov, and the WHO ICTRP to identify randomised controlled trials (RCTs) that were designed to improve attendance for DRS or were evaluating general quality improvement (QI) strategies for diabetes care and reported the effect of the intervention on DRS attendance. We searched the resources on 13 February 2017. We did not use any date or language restrictions in the searches. We included RCTs that compared any QI intervention to usual care or a more intensive (stepped) intervention versus a less intensive intervention. We coded the QI strategy using a modification of the taxonomy developed by Cochrane Effective Practice and Organisation of Care (EPOC) and BCTs using the BCT Taxonomy version 1 (BCTTv1). We used Place of residence, Race/ethnicity/culture/language, Occupation, Gender/sex, Religion, Education, Socioeconomic status, and Social capital (PROGRESS) elements to describe the characteristics of participants in the included studies that could have an impact on equity of access to health services.Two review authors independently extracted data. One review author entered the data into Review Manager 5 and a second review author checked them. Two review authors independently assessed risks of bias in the included studies and extracted data. We rated certainty of evidence using GRADE. We included 66 RCTs conducted predominantly (62%) in the USA. Overall we judged the trials to be at low or unclear risk of bias. QI strategies were multifaceted and targeted patients, healthcare professionals or healthcare systems. Fifty-six studies (329,164 participants) compared intervention versus usual care (median duration of follow-up 12 months). Overall, DRS attendance increased by 12% (risk difference (RD) 0.12, 95% confidence interval (CI) 0.10 to 0.14; low-certainty evidence) compared with usual care, with substantial heterogeneity in effect size. Both DRS-targeted (RD 0.17, 95% CI 0.11 to 0.22) and general QI interventions (RD 0.12, 95% CI 0.09 to 0.15) were effective, particularly where baseline DRS attendance was low. All BCT combinations were associated with significant improvements, particularly in those with poor attendance. We found higher effect estimates in subgroup analyses for the BCTs 'goal setting (outcome)' (RD 0.26, 95% CI 0.16 to 0.36) and 'feedback on outcomes of behaviour' (RD 0.22, 95% CI 0.15 to 0.29) in interventions targeting patients, and 'restructuring the social environment' (RD 0.19, 95% CI 0.12 to 0.26) and 'credible source' (RD 0.16, 95% CI 0.08 to 0.24) in interventions targeting healthcare professionals.Ten studies (23,715 participants) compared a more intensive (stepped) intervention versus a less intensive intervention. In these studies DRS attendance increased by 5% (RD 0.05, 95% CI 0.02 to 0.09; moderate-certainty evidence).Fourteen studies reporting any QI intervention compared to usual care included economic outcomes. However, only five of these were full economic evaluations. Overall, we found that there is insufficient evidence to draw robust conclusions about the relative cost effectiveness of the interventions compared to each other or against usual care.With the exception of gender and ethnicity, the characteristics of participants were poorly described in terms of PROGRESS elements. Seventeen studies (25.8%) were conducted in disadvantaged populations. No studies were carried out in low- or middle-income countries. The results of this review provide evidence that QI interventions targeting patients, healthcare professionals or the healthcare system are associated with meaningful improvements in DRS attendance compared to usual care. There was no statistically significant difference between interventions specifically aimed at DRS and those which were part of a general QI strategy for improving diabetes care. This is a significant finding, due to the additional benefits of general QI interventions in terms of improving glycaemic control, vascular risk management and screening for other microvascular complications. It is likely that further (but smaller) improvements in DRS attendance can also be achieved by increasing the intensity of a particular QI component or adding further components.

BackgroundThe pressing need for better antimicrobial stewardship (AMS) is invariably reliant on educational interventions in some form.ObjectivesTo evaluate the effectiveness of post-qualification educational interventions for AMS behaviour change among health professionals.MethodsSeven databases were searched for articles published between 2013 and 2024 for post-qualification educational interventions aimed at health professionals to improve AMS. Randomised controlled trials (RCTs) and quasi-experimental designs such as non-randomised trials, controlled and non-controlled before and after studies, and qualitative studies were considered eligible. The quality of studies was assessed using Cochrane Effective Practice and Organization of Care (EPOC) criteria for RCTs and interrupted time series designs, and the Mixed Methods Appraisal Tool (MMAT) for all other studies. Data were extracted, analysed for effectiveness, and synthesised narratively. Registration: PROSPERO international prospective register of systematic reviews (PROSPERO 2023 CRD42023447115).ResultsForty-six studies were included in the review, with six meeting the EPOC criteria. The remaining forty were assessed using the MMAT. The overall risk of bias for the six studies meeting the EPOC criteria was low, but risk of bias was high for studies assessed using the MMAT. Overall, there was some evidence that formal education alone was effective in this context, but only limited evidence about what type of educational intervention, for which profession, is most effective.ConclusionsOur review provided an in-depth examination of post-qualification AMS interventions. We found studies were heterogeneous and quality of evidence relatively poor. High quality studies focused on establishing key components of effective educational interventions are required.