- Research Article
- 10.1097/sih.0000000000000918
Simulation Operations Needs Assessment Tool: Development and Validation for Simulation Operations Personnel.
- Jan 26, 2026
- Simulation in healthcare : journal of the Society for Simulation in Healthcare
- Jarrod W Young + 4 more +4
Simulation operations specialists (SOSs) play a critical yet ill-defined role in healthcare simulation. Despite their critical involvement in operations, orientation, and support of simulation-based education, no validated needs assessment tool existed to guide professional development. This study aimed to design and validate the Simulation Operations Needs Assessment Tool (SONAT) to identify knowledge and skills gaps, guide onboarding, and inform SOS professional development. The SONAT was developed using best practice, community, and peer-reviewed documents, including the Certified Healthcare Simulation Operations Specialist Blueprint, SimGHOSTS Capability Framework, and the Healthcare Simulation Standards of Best Practice. Messick's Unified Validity Theory guided the validation process using Lawshe's method to assess survey items. Following expert feedback and item revision, the tool was disseminated for psychometric analysis. Internal consistency was assessed using Cronbach's alpha for each section of the tool. Content validity indices (CVIs) for the final SONAT exceeded the .70 acceptability threshold (CVI = .738). A sample of 256 SOSs completed the SONAT. Internal consistency was strong across 4 domains (α = .730-.912). Respondents reported high proficiency in manikin-based and task trainer simulation but less in emerging modalities (eg, Augmented Reality/Virtual Reality). Awareness of professional standards was strong, although gaps were noted in knowledge of ethics and leadership opportunities, particularly among noncertified individuals. SONAT collects valid and reliable data when assessing SOS developmental needs across diverse roles and backgrounds. It has the potential to standardize orientation, support tailored professional development, and strengthen skillsets of the evolving SOS profession.
Read more