|
|
||||||||
J Thorac Cardiovasc Surg 2006;131:154-162
© 2006 The American Association for Thoracic Surgery
Evolving Technology |
a Department of Cardiac Surgery, University Hospital Gasthuisberg, Leuven, Belgium
b Division of Cardiac Surgery, The Johns Hopkins Hospital, Baltimore, Md
c Department of Anesthesia, University Hospital Gasthuisberg, Leuven, Belgium.
Received for publication June 24, 2005; accepted for publication August 29, 2005. * Address for reprints: Prof Dr Paul Sergeant, Cardiac Surgery Department, Gasthuisberg University Hospital, Herestreet, B 3000, Leuven, Belgium (Email: paul.sergeant{at}uz.kuleuven.ac.be).
| Abstract |
|---|
|
|
|---|
METHODS: Fifty teams of 1.3 ± 0.5 surgeons and 1.1 ± 1.9 anesthetists visited 2.2 ± 0.7 days. Variables describe the pre-visit cardiac activity and OPCAB attitude, complexity score (10 frequently cited complexity criteria), application, and conversion rate. The multimodal approach to knowledge transfer included interactive discussions (commitment; resistances; levers and process of change; methods; outcome; resource optimization), active participation in 3.8 ± 1.3 unselected cases (anchor-stitch, enucleation techniques), low-fidelity bench model (shunt placement, anastomotic technique), and CD-ROM. Exit end points included OPCAB attitude and complexity score. Late end points (3 months) included OPCAB attitude, complexity score, and application rate.
RESULTS: OPCAB was considered, upon exit, beneficial for all patients by 90% of the teams (versus 29 % pre-visit), but by only 62 % of the teams at 3 months. The complexity score downgraded at exit from 3.6 ± 2 (pre-visit) to 1.2 ± 1 (P <.001) but increased again at 3 months to 1.6 ± 1 (P =.001 versus pre-visit and P =.001 versus exit). The 3-month OPCAB rate of the surgeons was 49% ± 32% versus 23% ± 28% pre-visit (P <.0001). This was influenced by the pre-visit OPCAB rate and education, as well as by the post-visit changes in complexity scores and attitude. The conversion rate toward cardiopulmonary bypass improved from 3.5% ± 5% (pre-visit) to 1.3% ± 3% (3 months, P =.006).
CONCLUSIONS: The multimodal OPCAB re-training resulted in a substantial increase of the application, concomitant with a decrease in conversion. The positive impact on attitude and complexity score, at exit, was somewhat reduced in the following clinical confrontation.
| Introduction |
|---|
|
|
|---|
The Katholieke Universiteit of Leuven reengineered toward OPCAB in all patients and for all surgeons in October 1999.
9,10
Since that date, it provided OPCAB training and retraining, as well, for residents as for experienced surgeons in different formats, based on well-studied and defined educational backgrounds. Between January 2000 and January 2004, 294 multimodal individualized trainings, given to 379 different surgeons and anesthetists, preceded this study. It is the intention of this study to investigate the performance of this format and provide a model and guidance for similar educational venues on the application of this or other new technologies.
| Materials and Methods |
|---|
|
|
|---|
The initial data form (Appendix 1) was completed on the team's arrival at the hospital, prior to any interaction. This included their OPCAB benefit attitude and their OPCAB complexity score. The OPCAB benefit attitude identified the spectrum of patients (low-risk, high-risk, all patients) they believed receive the most benefit from OPCAB. The OPCAB complexity score identifies 10 anatomic and physiologic conditions commonly considered complexity variables for OPCAB. These included redo operation, the presence of left main disease, severe left ventricular hypertrophy, low ejection fraction, intramural or intraseptal coronary vessels, posterolateral wall coronary vessels, sequential arterial grafts, recent infarct (within 7 days), and an unstable ST segment. The total number of positive responses was calculated as "complexity score." After the visit, the Exit Questionnaire (see Appendix 2) was completed. The 3-Month Follow-Up Questionnaire (Appendix 3) gave insight into the late performance after the training.
Educational Basis
The Leuven CMEST (Continuing Medical Education of Surgical Technologies) has been based, over the years preceding the current analytic project, on the science of knowledge management and technology implementation. Three core elements formed its basis: the taxonomy of learning objectives, the theory of adult learning, and the dynamic theory of organizational knowledge creation.
The taxonomy of learning objectives
11
identifies knowledge, skills, and attitude. Knowledge is gained by the digestion of information and its transformation through the process of learning. Skills require the development of psychomotor competencies, a process based on regular practice, expertise motivation, and ongoing training. Attitude refers to how knowledge and skills are combined in the care of patients, including clinical judgment, decision making, and the values of professional behavior.
The theory of adult learning
12
integrates cognitive and individualized elements. Cognitive elements
13
focus on internal mental processes, solving real problems. Therefore, perception, reasoning, and understanding are valued more than memory. CMEST was individualized
14
because of the different stages of experience preceding the training, the different expectations, and the individual learning styles.
The dynamic theory of organizational knowledge
15
explains the process from knowledge creation by the individual to its integration within the organization. Codified knowledge
16
refers to knowledge that is transmittable in formal, symbolic language, whereas tacit knowledge is hard to articulate, acquired through experience or participation, often context specific. The interaction between surgery and anesthesia is a typical example of tacit knowledge. Tacit and codified knowledge exist along a spectrum and are not mutually exclusive. The transfer of these different natures of knowledge can be through socialization (tacit-tacit), through combination (codified-codified), through externalization using metaphors and analogies (tacit-codified), or through traditional learning methods (codified-tacit).
Knowledge Transfer Process
The knowledge transfer process, consistent over the study interval, was structured in a mind map. The faculty consisted of one surgeon and, alternating, one of three senior anesthetists. After completion of the entry form, well-defined learning objectives were discussed in the first hours of the first day and before surgery. The learning objectives started with a SWOT analysis (strengths, weaknesses, opportunities, threats) of CABG, the need for, the process, and the management of change. This was followed by a discussion of the reengineering: multidisciplinary interaction, monitoring, anesthetic management and conditioning, surgical technique subdivided in teachable components, and finally the actual implementation for all patients and all surgeons. This discussion was guided by slide presentations, animations, and video sequences. Subsequently, the first day, the surgeons scrubbed in and the anesthetists participated in two unselected OPCAB cases, performing well-defined teaching objectives: multidisciplinary interaction, anesthetic management, deep stitch placement, cardiac enucleation, and manipulation. The sequential approach of the retraining is best demonstrated by the enucleation technique. It is first described verbally, then in animation, followed by video, by expert cognitive modeling on the human in the operating theater, and finally repeated (over the different patients) nonexpert modeling by the visiting surgeon corrected by the expert. The different OPCAB procedures were linked by interactive discussions between expert and scholars about procedural variability and organizational aspects of perfusion and nursing. Virtual training was simultaneously addressed by having team members practice shunt insertion and anastomotic techniques in low-fidelity training models.
Day 2 starts again with expert-scholar interaction about the cognitive and motor skills issues of day 1, as well as economic aspects, real-time quality control monitoring systems, outcome analysis, and finally early and late outcome data of our own population. The acquired OPCAB knowledge was reinforced with two additional unselected cases. The CME ended with a wrap-up discussing the organizational and psychologic issues the team would encounter at return in their units. The exit report was completed and a CD-ROM with the complete slide presentation and OPCAB bibliography provided to assist in institutional education.
Team Variability
Fifty teams of surgeons, anesthetists, and nurses from 16 countries were retrained during 2 days (Table 1). The teams came at their own initiative through word of mouth. The originating institutions were mostly academic (68%). The originating units had an average cardiac surgery practice of 1000 cases (range: 175-3375), with 7.0 ± 4.6 staff surgeons and 1.9 ± 2.6 licensed surgeons without staff position. Information about their early post-CABG morbidity and mortality (Appendix 1) seemed unavailable or incomplete in 76% of the teams, even after repeated requests post hoc. The visiting teams worked together several days a week and some had participated in different formats of OPCAB retraining, preceding the current one. Complex enucleation methods, using sling techniques in combination with apical suction and anastomotic area stabilization, were less commonly used (34%); routine shunting was more commonly used (60%). The average OPCAB application rate of the staff surgeons not participating in the training was only 8% before training, whereas it was 23% for the visiting surgeons. The most frequently cited teaching expectation was multivessel arterial OPCAB revascularization (90%).
|
The OPCAB complexity score (Table 1 and Figure 1) cited most frequently intraseptal and intramural vessels, and unstable ST segment as OPCAB complexity variables.
|
The decision about retraining was taken by the individual in 64%, by the team in 22%, and by the departmental director in 14% of the teams. Only 4% of the teams funded the retraining expenses (travel and lodging) from personal or institutional resources; the other teams were supported by the industry. The industry signed an educational agreement with the K. U. Leuven.
Follow-up and Statistical Analysis
Late follow-up was complete for all teams, but labor-intensive (average > 5 contacts). Additional variability was calculated indirectly from available variability (eg, the average OPCAB application rate in a unit of the nonparticipating staff surgeons). The OPCAB attitude analysis used matched-pair analysis, after ordinal transformation. The analysis applied univariate and multivariate nontime-related methods (linear and logistic regression) and variable transformations (eg, nominal into ordinal, continuous into nominal, and continuous into mathematical transformations) to obtain optimal relations between studied outcomes and variability.
| Results |
|---|
|
|
|---|
The OPCAB complexity variables most frequently cited at exit were intraseptal vessels and intramural vessels. Figure 1 depicts these 10 most frequently cited complexity criteria versus their prevalence before the retraining. The inferolateral and posterolateral location of coronary anastomoses (10 teams at entry), as well as the sequential arterial grafting (9 teams at entry) and low ejection fraction (16 teams at entry), disappeared from the list at exit.
At 3 Months
The OPCAB attitude at 3 months remained strongly influenced by the training (P <.001, versus at entry). OPCAB was considered beneficial for "all patients" by 64%, for the low-risk patients by 10%, and for the high-risk patients by 26% of the teams. Fifteen teams reduced the beneficial group from "all" to a smaller subset during follow-up (6 teams versus pretraining). The OPCAB attitude at 3 months ("benefit for all") could be predicted reliably (receiver operating characteristic = 0.92) by variables describing the team and the CMEST variability: the size of the clinic ("number of cases"), the pretraining participation in interactive discussions about OPCAB, the CMEST duration (more than 1 day), the CMEST team membership of an anesthesiologist, and the extent of complexity score reduction (at exit versus pre-CMEST).
The complexity score increased slightly at 3 months, versus the exit information, to 1.6 ± 1 (P <.001) but was still significantly lower than the complexity score before OPCAB retraining (mean difference: 2.0; P <.001). The retraining variability was related to the decrease in complexity score at 3 months: the number of clinical cases participated in during the retraining and the deletion at exit of intraseptal and intramural vessels as OPCAB complexity criteria (R2 = 0.66). The OPCAB complexity variables most frequently cited at 3 months were: intraseptal vessels and intramural vessels. Figure 2 depicts the 10 most frequently cited complexity criteria versus their prevalence before the retraining and at exit. The posterolateral location of coronary anastomoses remained absent from the list.
|
The increase of the OPCAB application rate after training could be estimated by pre-visit variability; thus, surgeons mainly doing CABG and those who had already attended large audience OPCAB education programs increased their OPCAB rates, whereas surgeons who had been already performing more than 80% of their CABGs off-pump did not further increase their OPCAB rates after the training. The pretraining attendance of video-transmitted live demonstrations (unrelated to the educational process studied in this manuscript) had a negative impact on the 3-month OPCAB increase. The predictive model was further improved by a CMEST-associated variable: the deletion of intraseptal coronary location as an OPCAB complexity (Table 2). It turned out that some surgeons with no or very limited OPCAB experience were able to perform nearly all cases off-pump in the weeks after our CMEST. The 3-month increase and decrease of the OPCAB application rate is plotted versus the pretraining application rate (Figure 2). A significant correlation was found between OPCAB attitude at 3 months and OPCAB application (P <.001).
|
| Discussion |
|---|
|
|
|---|
Before one can study the effect of additional variability, one has to build evidence about a basic effect of CMEST. This was missing about OPCAB application and conversion. We have tried to create indirect information about the nonvisiting members of a team and have used them as a control group. The analysis includes only 50 teams (70 surgeons), thereby limiting the multivariate correcting capacity.
The reported late application rates were not validated by an independent observer, but there is strong evidence
17
that self-reports of behavior change accurately represent the actual change after CME courses.
Attitude Toward OPCAB
Attitude, a cognitive variable, has been documented
18
to be one of the most important drivers toward change. Self-motivation serves as a driving force to absorb knowledge. Gardner
19
describes 7 important elements influencing the process of change of the individual: reason, research, resonance, representational redescriptions, resources/rewards, real world events, and resistances. Reason or attitude implies that an individual is able to see a logical, rational approach to the pertinent issue and weigh each consideration appropriately. A surgeon would be able, for example, to evaluate each risk and benefit of the OPCAB procedure as it compares with conventional CABG surgery and make an honest assessment as to whether to change his or her belief.
The attitude toward OPCAB in the retrained surgeons was strongly improved by the training as well at exit as at the late evaluation, although somewhat less. The OPCAB attitude at 3 months ("benefit for all") could be predicted reliably, aside through other factors, by training elements (duration of the training more than 1 day, the presence of an anesthesiologist in the team, and extent of complexity score reduction during training).
Complexity Scoring
Complexity scoring is based on cognitive and motor skills, since previous OPCAB experience and exposure will influence this scoring. Surgeons not combining a sling support with an apical suction device and those without OPCAB education experience had more complexity variables at entry.
The scholars were exposed during their training interval to different surgical complexities, addressed as well by the expert as by themselves under the corrective supervision of the expert. Custers and associates
20
and Banderas
21
identified that the effect of this exposure is maintained and even accumulated across repeated exposures, providing observers with opportunities to discern the structure of the modeled actions, to organize and verify what they know, and to give special attention to problematic aspects in subsequent exposures.
The score-reducing effect, at exit, of the training remained stable at 3 months. The posterolateral location of coronary anastomoses disappeared permanently from the list of complexity criteria. The most frequently cited variables at 3 months, intraseptal and intramural coronary anatomy, are already challenging for regular CABG. The prevalence of certain of these complexity criteria in the limited number of attended procedures during the training certainly affected this complexity score. However, surgeons who were not considering an intraseptal coronary as complexity variable for OPCAB at end of the training were more likely to increase their OPCAB rates.
Application and Conversion
The final purpose of a retraining is an improved benefit for the patient. This needs to be preceded by a widened application in the spectrum of patients carrying improvable risk. This study has identified a highly significant increase over a short interval. Nonparticipating surgeons from the same unit did not increase at all (control group), indicative of disappointing absence of knowledge transfer to the colleagues within the unit. Educational material provided was seldom shared within the unit, according to the open questionnaires. The predictive model of the 3-month application rate included characteristic elements of OPCAB retraining (attitude, complexity score). A great variability in training effect was identified. Some surgeons with minimal OPCAB experience before training performed OPCAB in the majority of their patients, a target not reached by 50% of the visiting surgeons.
The appearance of cognitive variables such as attitude and complexity scores in the multivariate model is additional proof of the major importance of cognitive elements in the process of change.
The K.U.Leuven OPCAB retraining model focuses on a team approach. Literature about technology implementation has strongly recommended such an approach when tacit knowledge was deeply imbedded in an interpersonal interaction. This is certainly valid for OPCAB application, where this can improve coordination
22
and reduce complications during the initial experience,
23
and our analysis confirms observations made in unrelated domains. Virtual training models are evaluated in fidelity (similar) to reality (the human heart). Low-fidelity training models are known to be as beneficial
24
to surgical learning as high-fidelity models. Low-fidelity virtual training models are enthusiastically used in the K.U.Leuven resident training and were actively demonstrated to the visiting scholars; only 6 teams actually built such a simple model and practiced with them. This confirms the literature
25
identifying the reluctance of model practicing in surgical trainees. The pretraining experience of a live procedure seemed to have had a lasting negative effect on the posttraining application rate. It is certain that most live procedures fail on aspects of education and technology transfer. The lasting negative effect is disturbing and probably needs reconfirmation in additional trials.
Figure 3
structures the most frequently cited impeding and stimulating factors in the application of a new technology, as identified in scientific literature. The size and the specialization of the originating institution determined the complexity score, the OPCAB attitude, and/or the OPCAB application rate. This has been similarly identified in laparoscopic techniques where size of the clinic and the specialization stimulated the adoption.
26,27
The seniority of the visiting teams had no effect on the posttraining application. No correlation of the years since surgical license and the OPCAB application was observed in a study about adoption of OPCAB in Canada.
28
More experienced surgeons should have a greater capacity for knowledge acquisition and integration, but their return to investment decreases with the number of years left in practice.
27
While Desai and colleagues
28
observed a significant correlation between OPCAB attitude and OPCAB application, we found this correlation only after the training rather than before the training. Furthermore, we still recognize in many surgeons the apparent discrepancy between a positive OPCAB attitude and a low application rate. The OPCAB attitude is not the only influencing factor. In addition to the previous mentioned factors, there is also an important role of the departmental chairman, according to our questionnaire, either as a formal opponent (veto in 6 teams) or sometimes as an absence of role modeling. There was no pretraining written commitment of the chairman to implement the technology in his unit after the training, but this might have been a limitation of this CME. The veto of the chairman was the impeding factor in 55% of the nonstarters after a laparoscopic
29
course. The chairman has to provide the psychologic safety
30
in the application of new technologies.
|
Conversion Rates
The reduction of the conversion rate concomitant with the increase in application after this multimodal retraining is an identifiable improvement in quality of care. A conversion toward ECC, sometimes as frequent as 13%, has been associated with increased mortality
31
and morbidity. Edgerton and coworkers
32
have identified limited experience in OPCAB technique as an important predictor towards conversion.
| Conclusion |
|---|
|
|
|---|
| Appendixes |
|---|
|
|
|---|
Unit
Country; type of hospital (academic, non-academic); number of staff surgeons; number of licensed surgeons; number of surgeons with OPCAB experience; annual number of isolated CABG, isolated valves, combined CABG/valves, assist devices, transplants, congenital; number of isolated OPCAB; OPCAB conversion rate; outcome data: stroke rate(overall and high risk), dialysis (overall and high risk), early mortality (hospital and 3 months)
Team
Structure of the visiting team by number of surgeons; anesthetists, and nurses; home interaction of visiting team; experience with modes of OPCAB retraining; expectations; stabilization methods used; shunt use; OPCAB benefit attitude; retraining decision and financing mode; OPCAB complexity score
Each physician
Years licensed; CABG and OPCAB routine
Appendix 2
Variables of the Exit Form
Team
OPCAB benefit attitude; OPCAB complexity score
Retraining activity
Number of days; number of cases attended, observation of conversion (Y/N); team action: deep stitch placement, cardiac manipulation, shunt insertion, low-fidelity training
Appendix 3
Variables of the 3-Month Form
Unit
Number of isolated CABGs of last 3 months; number of isolated OPCABs of last 3 months; OPCAB conversion rate; late evaluation of their educational material
Team
Structure stability of the visiting team; interdepartmental teaching of surgeon, anesthetist, or nurse; stabilization methods used; shunt use; low-fidelity training experience; OPCAB benefit attitude; OPCAB complexity score; open questions about their OPCAB experience
Each physician
CABG and OPCAB routine
| See related editorial on page 14.
|
| Footnotes |
|---|
| References |
|---|
|
|
|---|
Related Article
This article has been cited by other articles:
![]() |
J. R. Sadaba, D. J. O'Regan, and A. P. Kappetein Adapt or die: The imperative for a culture of innovation in cardio-thoracic surgical training Eur. J. Cardiothorac. Surg., May 1, 2007; 31(5): 959 - 959. [Full Text] [PDF] |
||||
![]() |
R. J. Novick and M. W. Chu Attitude toward and application of off-pump coronary artery bypass after continuing education retraining J. Thorac. Cardiovasc. Surg., January 1, 2006; 131(1): 14 - 15. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |