MEF Associates

ABSTRACTThis article explores the application of open science practices, focusing on the challenges, barriers, and lessons learned from preregistering outcomes and analytic protocols in impact evaluation. Using the Health Profession Opportunity Grants (HPOG) Program Impact Study as a case study, we illustrate the balance between pre‐specifying research plans and maintaining flexibility to adapt to unexpected findings. We discuss how preregistration can enhance transparency, credibility, and the overall quality of evidence, as well as practical considerations for future evaluations. Our insights aim to guide evaluators in applying open science principles to improve the rigor and integrity of impact evaluations.

Treatment as usual has historically been used as control arms for randomized controlled trials (RCTs), but utilizing wellness interventions as active comparison conditions can advance the evidence base of such interventions while increasing access to health promotion content. We use the results from the CONNECT 2 RCT's wellness intervention control arm as a case example of active comparison conditions that can control for dosage or attentional effects in future research. We summarized existing studies on wellness control HIV RCT interventions, introduced CONNECT 2, and discussed recruitment, randomization, and the intervention. Overall, Wellness Promotion participants were more likely to engage in physical activity, eat healthier, and do more vigorous exercise when compared with HIV Risk Reduction. CONNECT 2 Wellness intervention results solidify why wellness interventions can play an important role in treatment guidelines. Developing and implementing this model can be a more ethical, equitable, and holistic approach among underserved communities.

The intergenerational influence of adverse childhood experiences on individual outcomes demonstrates a need for research that considers both personal and environmental contributors to risk. As such, the current study explored how maternal cumulative risks influence the relationship between maternal Adverse Childhood Experiences (ACEs) and their children’s behavioral dysregulation among families involved with the child welfare system ( N = 314). The importance of child age is also considered. The sample was stratified by age groups of children (1.5–5 years and 6–18 years), and the relationship between maternal ACEs, cumulative risk, and child behavior was assessed using OLS regressions. For younger children, maternal ACEs were only associated with externalizing behaviors when not controlling for cumulative risk, but cumulative risks were independently and significantly associated with both internalizing and externalizing behaviors. For older children, ACEs were independently associated with both types of behavior, but controlling for cumulative risk attenuated the strength of this relationship. Cumulative risks were also independently associated with older children’s internalizing and externalizing behaviors. Findings suggest the need to consider both individual and environmental risks for parents and children involved in the child welfare system, and the developmental timing and stability of that risk, in order to adequately support parent-child relationships as well as caregiving environments.