Implementing structured team debriefing using a Black Box in the operating room: surveying team satisfaction

IntroductionComprehensive data capture systems such as the Operating Room Black Box (OR Black Box) are becoming more widely implemented to access quality data in the complex environment of the OR....

MP68-19 USE OF THE OR BLACK BOX® TO EVALUATE OPERATING ROOM ECONOMIC EFFICIENCY

OR black box and surgical control tower: Recording and streaming data and analytics to improve surgical care.

Device-related interruptions in the operating room (OR) may create stress among health care providers and delays. Although non-technical skills (NTS) of the OR teams, such as situational awareness and communication, are expected to influence device-related interruptions, empirical data on this relationship are limited. We performed a prospective cohort study of 144 consecutive elective laparoscopic operations during 13months. A data capture system called the OR Black Box® was used to characterize device-related interruptions, NTS, and distractions. Device-related interruptions were classified according to a priori established categories. Positive and negative NTS instances were identified according to validated measurement tools specific for nurses and surgeons. We assessed the relationship between NTS and device-related interruptions after adjusting for potential confounders. A total of 86 device-related interruptions occurred in 48 of 144 operations (33%). They were most frequently classified as device failure (54%) followed by improper assembly (19%) and disconnection (14%). Medians of 1 [interquartile range (IQR) 0-3] and 1 (IQR 0-2) negative NTS instance per operation were demonstrated by nurses and surgeons, respectively. Medians of 28 (IQR 15-38) and 40 (IQR 28-118) positive NTS instances per operation were demonstrated by nurses and surgeons. In a multivariable analysis, a higher frequency of negative NTS instances demonstrated by nurses was associated with device-related interruptions after risk adjustment (Odds Ratio 1.33, p = 0.02). In elective laparoscopic operations, an increased likelihood of device-related interruptions in the OR was associated with more frequent negative NTS demonstrations by nursing teams.

To characterize intraoperative errors, events, and distractions, and measure technical skills of surgeons in minimally invasive surgery practice. Adverse events in the operating room (OR) are common contributors of morbidity and mortality in surgical patients. Adverse events often occur due to deviations in performance and environmental factors. Although comprehensive intraoperative data analysis and transparent disclosure have been advocated to better understand how to improve surgical safety, they have rarely been done. We conducted a prospective cohort study in 132 consecutive patients undergoing elective laparoscopic general surgery at an academic hospital during the first year after the definite implementation of a multiport data capture system called the OR Black Box to identify intraoperative errors, events, and distractions. Expert analysts characterized intraoperative distractions, errors, and events, and measured trainee involvement as main operator. Technical skills were compared, crude and risk-adjusted, among the attending surgeon and trainees. Auditory distractions occurred a median of 138 times per case [interquartile range (IQR) 96-190]. At least 1 cognitive distraction appeared in 84 cases (64%). Medians of 20 errors (IQR 14-36) and 8 events (IQR 4-12) were identified per case. Both errors and events occurred often in dissection and reconstruction phases of operation. Technical skills of residents were lower than those of the attending surgeon (P = 0.015). During elective laparoscopic operations, frequent intraoperative errors and events, variation in surgeons' technical skills, and a high amount of environmental distractions were identified using the OR Black Box.

Introduction of the Operating Room Black Box in Gynecology: Development of a Procedural Framework for Total Laparoscopic Hysterectomy

Communication failures between multidisciplinary teams can impact efficiency, performance, and morale. Academic operating rooms (ORs) often have surgical, anesthesia, and nursing teams, each teaching multiple trainees. Incorrectly identifying name and "rank" (postgraduate year [PGY]) of resident trainees can disrupt performance evaluations and team morale and even potentially impair delivery of quality care when miscommunication errors proliferate. Our OR-based survey asked 50 participants (18 surgeons, 14 anesthesiologists, and 18 nursing members), to recall basic identification data including provider names and PGY levels from their recent collaborating OR teams. Participants also weighed in on the importance of using accurate "names and ranks" for all OR participants. Each service reliably knew their own team members' names and rank. However, surgery and anesthesia teams displayed decreased knowledge about their lower level trainees, whereas nursing teams performed best, identifying all level nurses present. Deficits occurred whenever participants tried recalling basic identifying data about contributors from any other collaborating team. Typically, misidentified participants were lower level PGY residents working on other teams' services. All survey respondents desired improving systems to better remember "names and ranks" identifications among OR participants, citing both safety and team morale benefits. Many fail to know the names and ranks of contributors among members of different OR teams. Even our most reliable nursing team was inconsistent at identification information from collaborating practitioners. Despite universally acknowledged benefits, participants rarely learned basic background identification data beyond their own team. Those surveyed all desired improving identifications with suggestions including sterile name and rank tags and proper notification of entry and exit from the OR. Because successful collaborations require appropriate level task delegations, participants believed knowing a resident's name and rank is important not only for team bonding but also for safety. Academia furthermore demands fair performance evaluations, and displaying them clearly improves recall. Refining our own identified gaps in OR communications may demonstrate improved teamwork and safer task delegations and perhaps even stimulate other performance benefits for academic ORs.

Distractions in the operating room (OR) can create stress among surgeons and lead to higher chances of errors and adverse events. The objective is to determine intraoperative factors that are associated with surgeons' perception of distraction. We conducted a prospective cohort study in 265 consecutive patients undergoing elective laparoscopic general surgery during the 2years after the implementation of a data capture system called the OR Black Box to identify intraoperative sources of distraction. At the end of each operation, human-factor surveys were administered to assess whether surgeons felt distracted. Using a multivariable logistic model, we determined which intraoperative sources of distraction were associated with the surgeons feeling distracted in the OR. The attending surgeon reported feeling distracted in 120 of 265 operations (45%). Auditory sources of distraction, such as the OR door opening occurred at a median of 41 times per case (interquartile range (IQR), 32-54). Cognitive distractions such as teaching (142 cases (54%)), device malfunction (91 (34%)), irrelevant conversations (72 (27%)), management of the next case (41 (15%)), and time pressure (22 (8%)) occurred in a significant number of operations. In a multivariable analysis, presence of irrelevant conversations (odds ratio 2.14, 95% confidence interval (CI) 1.16-3.94, p = 0.015) and patient history of previous abdominal surgery (odds ratio 2.2, 95% CI 1.18-4.1, p = 0.013) were independently associated with increased likelihood of the surgeons feeling distracted. Irrelevant conversation in the OR is a modifiable factor that was independently associated with surgeon's perception of distraction.

Utilizing Black Box Technology to Identify and Describe Intraoperative Delays, Distractions and Threats in the Gynecology OR: A Pilot Study

IntroductionAccording to the Institute of Medicine (IOM), medical errors account for nearly 98,000 deaths in the United States each year. Given that almost half of all adverse events in hospitalized...

We report for the first time the use of the Operating Room Black Box (ORBB) to track checklist compliance, engagement, and quality. Implementation of operative checklists is associated with improved outcomes. Compliance is difficult to monitor. Most studies report either no assessment of checklist compliance or deployed in-person short-term assessment. The ORBB a novel artificially intelligence-driven data analytic platform affords the opportunity to assess checklist compliance without disrupting surgical workflow. This was a retrospective review of prospectively collected ORBB data. Operative cases included elective surgery at a quaternary referral center. Cases were analyzed as prepolicy change (first 9 months) or as a postpolicy change (last 9 months). Measures of checklist compliance, engagement, and quality were assessed. There were 3879 cases that were performed and monitored for checklist compliance between August 15, 2020, and February 20, 2022. The overall scores for compliance, engagement, and quality were 81%, 84%, and 67% respectively. When broken down by phase, the scores for time-out were compliance 100%, engagement 98%, and quality 61%. Scores for the debrief phase were 81% for compliance, 98% for engagement, and 66% for quality. After a hospital policy change, the debrief scores improved significantly (85%; P <0.001 for compliance, 88%; P <0.001 for engagement and 71%; P <0.001 for quality). ORBB provides the unprecedented ability to assess not only compliance with surgical safety checklists but also engagement and quality. Utilization of this technology allows the assessment of compliance in near real time and to accurately address safety threats that may arise from noncompliance.

BackgroundPatient safety depends on effective teamwork. The similarity of team members’ mental models - or their shared understanding–regarding clinical tasks is likely to influence the effectiveness of teamwork. Mental models have not been measured in the complex, high-acuity environment of the operating room (OR), where professionals of different backgrounds must work together to achieve the best surgical outcome for each patient. Therefore, we aimed to explore the similarity of mental models of task sequence and of responsibility for task within multidisciplinary OR teams.MethodsWe developed a computer-based card sorting tool (Momento) to capture the information on mental models in 20 six-person surgical teams, each comprised of three subteams (anaesthesia, surgery, and nursing) for two simulated laparotomies. Team members sorted 20 cards depicting key tasks according to when in the procedure each task should be performed, and which subteam was primarily responsible for each task. Within each OR team and subteam, we conducted pairwise comparisons of scores to arrive at mean similarity scores for each task.ResultsMean similarity score for task sequence was 87 % (range 57–97 %). Mean score for responsibility for task was 70 % (range = 38–100 %), but for half of the tasks was only 51 % (range = 38–69 %). Participants believed their own subteam was primarily responsible for approximately half the tasks in each procedure.ConclusionsWe found differences in the mental models of some OR team members about responsibility for and order of certain tasks in an emergency laparotomy. Momento is a tool that could help elucidate and better align the mental models of OR team members about surgical procedures and thereby improve teamwork and outcomes for patients.Electronic supplementary materialThe online version of this article (doi:10.1186/s12909-016-0752-8) contains supplementary material, which is available to authorized users.

ABSTRACTMaintaining job satisfaction across the team in the operating room (OR) is essential for reducing staff turnover, stress, burnout, medical errors and increasing patient satisfaction. This literature review explores factors impacting on job satisfaction for OR team members, with a specific focus on nurses, anaesthetists and surgeons. A literature search from January 1997 to November 2017 was conducted using databases CINHAL, psychINFO, Medline and ABI/inform. Surgeon, anaesthetist, OR nurse and OR team job satisfaction studies were included. The search yielded 48 studies. Dominant contributing factors for all three disciplines included: work conditions, support and acknowledgement from management, and fulfilment from the clinical role. Career prospects, research opportunities, autonomy, utilising the full extent of one’s skills, team dynamics/communication, pressure from management, and social support systems were also identified as significant for specific disciplines within the team. This review highlights the importance of addressing factors relating to job satisfaction from an ‘OR team’ perspective and considering the inter-relationship between roles. Further research into ‘team satisfaction’ in the OR, its measurement and its relationship with retention and productivity would be of benefit.

Despite advances in medical technology, intraoperative adverse events (IAE) continue to occur in hospital’s complex systems. Current approaches to understanding and mitigating IAEs rely on retrospective data analyses to recognize the series of events leading to an IAE. This paper discusses current challenges and highlights the potential of the Operating Room Blackbox (ORBB) system use to enhance patient safety.

Fire in Labor and Delivery: Simulation Case Scenario