|
|
||||||||
J Thorac Cardiovasc Surg 2008;136:1422-1428
© 2008 The American Association for Thoracic Surgery
Congenital Heart Disease |
a Department of Anesthesia, Utrecht Medical Center, Utrecht, The Netherlands, and the Department of Anesthesia, College of Medicine and Public Health, University of South Florida, Tampa, Fla
b Department of Medicine, The University of Chicago, Chicago, Ill
c Department of Anesthesiology, University of Miami, Miami, Fla
d Department of Biostatistics, University of Miami, Miami, Fla
e Department of Cardiac Surgery, Children's Hospital of New Jersey, Newark, NJ
f Department of Cardiac Surgery, Children's Hospital Boston and Harvard Medical School, Boston, Mass
Received for publication January 1, 2008; revisions received February 26, 2008; accepted for publication March 23, 2008. * Address for reprints: Emile A. Bacha, MD, Cardiac Surgery, Children's Hospital Boston, Harvard Medical School, 300 Longwood Ave, Boston, MA 02115. (Email: emile.bacha{at}cardio.chboston.org).
| Abstract |
|---|
|
|
|---|
Methods: Prospective observations of pediatric cardiac surgical procedures were conducted. Patient complexity scores were calculated and outcomes recorded. The process of care was divided into epochs. Events were extracted and coded into compensated or uncompensated major and minor adverse events. Linear regression and analysis of variance were used to analyze the relationships between epochs, complexity, adverse events, and outcome. Patient-specific and procedure-specific variables were tested in a forward stepwise logistic regression as predictors of cases with 1 or more major adverse events.
Results: One hundred two patients undergoing pediatric cardiac surgery were observed. An average of 1.2 (range 0–6) major adverse events occurred per case. The most common type of major adverse event was cardiovascular, and most occurred during the surgery/postbypass epoch. Cognitive compensation was the most common compensation mechanism for major adverse events. An average of 15.3 minor adverse events occurred per case. Minor adverse events occurred frequently during the surgery/bypass epoch and related to communication and coordination failures. Higher case complexity, longer surgery duration, and higher number of major adverse events per patient correlated with death compared with other outcome groups (P < .01). Case complexity (P < .01) and surgery duration (P < .05) were both significant predictors of major adverse events.
Conclusions: Pediatric cardiac surgery is an ideal model to study the coordinated efforts of team members in a complex organizational structure. Adverse events occurred routinely during pediatric cardiac surgery and were mostly compensated. Case complexity was a significant predictor of major adverse events. The number of major adverse events per patient correlated with clinical outcomes.
| Introduction |
|---|
|
|
|---|
The primary aim of this study was to explore the impact of intraoperative human factors and adverse events on surgical performance and patient outcomes in PCS. A secondary aim was to look at adverse events compensation mechanisms.
| Methods |
|---|
|
|
|---|
|
The outcome scores were coded at discharge by a previously published 1 to 4 scale as follows: (1) uncomplicated hospital stay, (2) intubation more than 72 hours with mild morbidity, (3) prolonged intubation and major morbidity, and (4) death.16
Mortality was defined as any in-patient mortality or as outpatient mortality within 30 days of surgery.17
Clinical variables collected for each patient included age, weight, gestational age, sex, admission date, date of surgery, discharge date, length of stay, status at discharge and 30 days postoperatively, preoperative status such as need for intubation, inotropes, urgency of repair, operating room times, postoperative ventilation time, extubation date, and need for mechanical support. Clinical case complexity was measured by the comprehensive Aristotle risk assessment scoring system.14
The scoring tool stratifies on the basis of the potential for morbidity, mortality, and the anticipated technical difficulty of a given procedure.
Patients younger than 18 years were chosen randomly, but an effort was made to focus on neonates and patients with complex conditions. The surgeon wore a video head-camera so that observers could also follow the surgical steps. The observers created a handwritten observational tool to document the surgical flow. The field notes were transcribed by an independent party and later analyzed by the research team. Adverse events were defined as "unintended incidents in care that may result in adverse outcomes or may require additional care efforts to prevent adverse outcomes."18
The events were extracted and coded according to immediate patient outcomes. Adverse events were classified as major or minor events (major event—may have serious consequences; minor events—not expected to cause serious consequences or break in surgical flow).16
Events were then further classified as compensated or uncompensated (compensation—appropriate action taken to offset the effect of adverse event).
Events were further categorized into each appropriate epoch and subdivided into the following clinical naturalistic categories: (1) blood products; (2) lines and line placement; (3) instruments (4) monitoring; (5) sterility and hygiene; (6) cardiopulmonary bypass (CPB); (7) bleeding; (8) ventilation; (9) technical/surgical issues; (10) communication; (11) medications (12) transport; (13) cognitive; (14) cardiovascular; and (15) transesophageal echocardiogram.
The following types of compensation were differentiated: (1) cognitive; (2) luck; (3) system (4) surgical–technical; and (5) monitoring. "Luck" was defined as a compensation occurring solely because the compensatory action happened to occur at the right time but without any explicit clinician reasoning. "System" was defined as the policies and procedures already in place. The videotapes were reviewed when necessary to corroborate observational data. The data were later analyzed independently by a pediatric cardiac surgeon and a cardiac anesthesiologist. Patients were followed up prospectively throughout their hospital course by the observers. All data were documented in an Excel database.
Statistical Analysis
The data were analyzed for both descriptive and analytic statistics. We focused on identifying the relationships between the number of events, types of events, length of the epochs, timing of events with case complexity, and outcomes.
2 Analyses, analysis of variance, and linear regression models were used to analyze relationships between length of the epochs, number of events per case, case complexity, and outcomes. Confidence intervals were measured when possible.
| Results |
|---|
|
|
|---|
Major Events (Table 1)
A median of 1.1 major events (range 0–6) occurred per case. The majority of events (43%) occurred during the postbypass epoch, including cardiovascular adverse events (56%) and bleeding adverse events (62%) (Figure 1). The most common type of event was related to the cardiovascular system (20%), followed by an airway or pulmonary event (14%) (Figure 2
). Cognitive compensation was the most common type of compensation (35%) (Figure 3
). Two major events were uncompensated: a carotid laceration resulting from attempts at internal jugular line placement and that left no lasting harm, and a malignant ventricular tachyarrhythmia that was unresponsive to conservative measures and eventually required emergency extracorporeal membrane oxygenator support. The analysis of variance demonstrated that significantly higher case complexity, longer surgery time, and higher number of major events per case were correlated with a death outcome (P < .05).
|
|
|
Correlations
The length of the surgical procedure ("surgery epoch") (mean 301 minutes; SD 101 minutes) correlated with case complexity (r = 0.83; P < .05), whereas neither the "anesthesia induction" time (mean = 74 minutes; SD = 24 minutes) nor the "postoperative" (mean = 25 minutes; SD = 11 minutes) epochs correlated with case complexity by analysis of variance.
Case complexity, longer surgery time, and higher number of major events per case correlated with outcome 4 (death) (P < .05). The number of major events per case correlated with patient outcomes (P < .05) and case complexity (P < .01).
The duration of surgery and the number of major events per case increased with case complexity. Case complexity was not significantly different between patients with type 2 or 3 outcomes (Table 2 ). Excluding non-CPB cases or using hospital mortality instead of 30-day mortality did not change the statistical results or their significance. There were no significant differences between different outcome groups in the number of minor events per case.
|
| Discussion |
|---|
|
|
|---|
Over the past few years, a plethora of solutions have been proposed to address the deficiencies in health care delivery. However, very few of these solutions have been evidence-based. Subsequently, there has been little impact on reducing patient harm, and a dearth of knowledge regarding the true incidence of adverse events exists.19
Several recent studies have demonstrated that the majority of hospital adverse events are related to an invasive or surgical procedure and occur predominantly during the intraoperative phase of the procedure.20
Extensive inquests into preventable deaths after PCS, such as the Manitoba Inquiry21
and the Bristol Royal Infirmary Inquiry,22
have revealed the influential impact of human factors and system issues on PCS outcomes. A landmark study by de Leval and colleagues16
investigated the role of human factors on surgical outcomes in PCS patients, specifically using the arterial switch operation as an example of complex, high-risk surgery. The identification of, and successful recovery from, major and minor adverse events was observed. The total numbers of minor and major events per case were both strong predictors of the probability of death and near miss. They found that, although proper compensation greatly reduced the risk of death, minor events go largely unnoticed by the operating room team and are therefore left uncompensated.16
A subsequent analysis of the same data suggested that minor events impede the operating room team's ability to compensate for future major events.9
These findings, and the findings of Catchpole and associates,1
are entirely consistent with the present study, which is also heavily weighted toward complex cardiac repairs (as evidenced by a median Aristotle comprehensive score of 12.6).14,17
Given the complexity of the repairs selected by the study, it is not surprising that the majority of major adverse events (41/92 [44%]) belonged to the cardiovascular system (cardiovascular, bleeding, surgical–technical, CPB). Many of the major events were related to organizational accidents, which followed closely Reason, Carthey, and de Leval's model23
of latent elements in a microsystem predisposing teams to have major adverse events.
The epoch most laden with adverse events was by far the surgery/postbypass epoch, during which 45% of all major adverse events occurred. This vulnerable and unstable period begins with the aortic crossclamp release and is followed by weaning and separation from CPB. This can be seen as analogous to aviation's most event-laden periods, take-off and landing (also called the "glass cockpit," that is, all communications not related to takeoff and landing restricted below 10,000 feet).24
These results are also strikingly similar to a comparable study performed in adult cardiac surgery patients in which the majority of major adverse events occurred either during CPB or during the postbypass phase.25
These studies reinforce our understanding that this epoch is the most distraction-sensitive and human error–prone period in the intraoperative cardiac surgical process. Not surprisingly, the majority of instrument and device difficulties also occurred during the CPB period.
In contradistinction to the observational studies on the arterial switch operation, which found a high correlation between number of minor events and outcomes,16,26
we did not find a similar effect. This is most likely due to the fact that we were not studying one specific operation performed at many different hospitals, but rather a variety of complex repairs in one hospital. The fact that a subsequent study of a mixture of cases by the same group in London yielded only a weak relationship between minor events and outcome further supports the generalizability of our findings.1
In the present study, most minor events occurred during the surgery/bypass epoch, followed closely by the presurgery/anesthesia induction epoch. The most common type of minor events was communication failures (29%), 36% of which occurred during the CPB period and 26% during the anesthesia induction. The predominance of communication failures mirrors the findings of the Joint Comission on Accreditation of Healthcare Organizations (JCAHO) national sentinel event reporting program27
and also the findings of two other recent studies.2,4
This suggests an area in need of improvement, with greater attention paid to the nuances of communication modes during induction and CPB times.
Interestingly, we found that minor events were independent of case complexity and occurred in all cases. This is a unique and troubling finding. Minor events seemed to arise from a different dynamic that occurred in all cases, irrespective of case complexity, case duration, or seniority of team. The large number of minor events seems to indicate an environment awash with distractions, interruptions, and miscommunications. This again bears a striking resemblance to the adult cardiac surgery study reported by Wong and colleagues.25
The data suggest opportunities for clinical redesign of care as well as opportunities for team training. Focused team communication training, for example, has been shown to improve the subjective and objective reliability of communication exchanges.28
The compensation mechanisms differed for major and minor adverse events. For major adverse events, cognitive and surgical–technical compensation, rather than primary prevention or system measures, were the prevalent team practices (70% of all compensation). While surgical–technical compensation is inherent to any surgical procedure, the prevalence of cognitive compensation (41%) implies that human factors play an important role in PCS outcomes. The system compensation mechanism was triggered in only 10% of cases, and "luck" was the main compensatory mechanism in 13%. A system that relies heavily on cognitive prevention or on "luck" is inherently unreliable and dependent on external forces, such as surgeon fatigue, personal issues, and other extraneous factors. Interestingly, minor events compensatory mechanisms were mostly geared toward system compensation (45% of cases), suggesting that the systems that have been put in place as barriers against adverse events are not resilient enough to catch major adverse events.29
The number of major adverse events per case correlated significantly with hospital survival despite the fact that virtually all major events were compensated (or deemed to be acutely compensated by the study group). This would suggest that the compensatory mechanisms may not have been sufficient in preventing death, since ideally, perfect compensation would imply complete long-term recovery from an adverse event. Furthermore, compensation was most often reactionary in nature and not preventive or proactive, suggesting a definite role for improvement in clinical processes toward prevention.
Limitations of this Study
We recognize several limitations to the study. There are limitations to both human factors research and statistical analysis of performance assessment. The capture of observational data is by necessity subjective and observer-dependent and can suffer from interrater reliability as well as a sampling bias.3,15
Undoubtedly, many events, and especially those occurring behind the anesthetic curtain, might have been missed. However, identification of major adverse events remained stable throughout the course of the study, suggesting that the observers were able to pick up most if not all major adverse events (Figure 4
). We calibrated our observer carefully, including using two observers early in the study to observe the same case, and found remarkably similar findings. On the other hand, the capture of minor events did go up as the study progressed, suggesting that the observers became increasingly familiar with the myriad of potential event enablers and were able to discern more adequately routine from nonroutine events. Observers were overseen by participating clinical personnel, possibly creating an inherent bias. The adverse event domains and compensation typology were developed on the basis of extensive clinical experience and in-depth knowledge of the cognitive psychology of human error and responses. It will benefit from further validation. The domains overlap, reflecting the complexity of the PCS environment. For example, a cognitive element is nearly always present even if the adverse event is strictly technical or monitoring related. In every case, we have tried to choose the most appropriate main compensation mechanism, which, although always determined by consensus, remains subjective by definition.
|
| Footnotes |
|---|
Supported by the Children's Heart Foundation.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
M. Nathan, J. M. Karamichalis, H. Liu, P. del Nido, F. Pigula, R. Thiagarajan, and E. A. Bacha Intraoperative adverse events can be compensated by technical performance in neonates and infants after cardiac surgery: A prospective study J. Thorac. Cardiovasc. Surg., November 1, 2011; 142(5): 1098 - 1107.e5. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Caplan and D. F. Vener Databases and Outcomes in Congenital Cardiac Anesthesia World Journal for Pediatric and Congenital Heart Surgery, October 1, 2011; 2(4): 586 - 592. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Morgan, S. Pickering, K. Catchpole, E. Robertson, M. Hadi, and P. McCulloch Observing and Categorising Process Deviations in Orthopaedic Surgery Reviews of Human Factors and Ergonomics, September 1, 2011; 55(1): 685 - 689. [Abstract] [PDF] |
||||
![]() |
J. M. Schraagen, T. Schouten, M. Smit, F. Haas, D. van der Beek, J. van de Ven, and P. Barach A prospective study of paediatric cardiac surgical microsystems: assessing the relationships between non-routine events, teamwork and patient outcomes BMJ Qual. Saf., July 1, 2011; 20(7): 599 - 603. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. A. Martinez, D. A. Thompson, N. A. Errett, G. R. Kim, L. Bauer, L. H. Lubomski, A. P. Gurses, J. A. Marsteller, B. Mohit, C. A. Goeschel, et al. Review Article: High Stakes and High Risk: A Focused Qualitative Review of Hazards During Cardiac Surgery Anesth. Analg., May 1, 2011; 112(5): 1061 - 1074. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. H. Culig, R. F. Kunkle, D. C. Frndak, N. Grunden, T. D. Maher Jr, and G. J. Magovern Jr Improving Patient Care in Cardiac Surgery Using Toyota Production System Based Methodology Ann. Thorac. Surg., February 1, 2011; 91(2): 394 - 399. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. M. Schraagen, T. Schouten, M. Smit, F. Haas, D. van der Beek, J. van de Ven, and P. Barach Assessing and improving teamwork in cardiac surgery. BMJ Qual. Saf., December 1, 2010; 19(6): 1 - 6. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. J. Lilford, P. J. Chilton, K. Hemming, A. J. Girling, C. A. Taylor, and P. Barach Evaluating policy and service interventions: framework to guide selection and interpretation of study end points BMJ, August 27, 2010; 341(aug27_1): c4413 - c4413. [Full Text] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |