HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Abstract Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Add to Personal Folders Download to citation manager Author home page(s): Massimo Caputo Barnaby C. Reeves Raimondo Ascione Gianni D. Angelini Permission Requests Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Caputo, M. Articles by Angelini, G. D. Search for Related Content PubMed PubMed Citation Articles by Caputo, M. Articles by Angelini, G. D. Related Collections Cardiac - other Education Coronary disease

J Thorac Cardiovasc Surg 2004;128:907-915
© 2004 The American Association for Thoracic Surgery

Surgery for Acquired Cardiovascular Disease

Monitoring the performance of residents during training in off-pump coronary surgery

^a Bristol Heart Institute, University of Bristol, Bristol, United Kingdom
^b Health Services Research Unit, London School of Hygiene and Tropical Medicine, London, United Kingdom

Received for publication September 19, 2003; revisions received February 6, 2004; accepted for publication February 12, 2004.

^* Address for reprints: Gianni D. Angelini, FRCS, Bristol Heart Institute, University of Bristol, Bristol Royal Infirmary, Bristol BS2 8HW, United Kingdom
g.d.angelini{at}bristol.ac.uk

	Abstract

Top Abstract Methods Results Discussion Appendix References

 
OBJECTIVE: Control charts (eg, cumulative sum charts) plot changes in performance with time and can alert a surgeon to suboptimal performance. They were used to compare performance of off-pump coronary artery bypass surgery between a consultant and four resident surgeons and to compare performance of off-pump coronary artery bypass surgery and conventional coronary artery bypass grafting within surgeons.

METHODS: Data were analyzed for consecutive patients undergoing coronary artery bypass grafting who were operated on by one consultant or one of four residents. Conversions were analyzed by intention to treat. Perioperative death or one or more of 10 adverse events constituted failure. Predicted risks of failure for individual patients were derived from the study population. Variable life-adjusted displays and risk-adjusted sequential probability ratio test charts were plotted.

RESULTS: Data for 1372 patients were analyzed; 769 of the procedures were off-pump coronary artery bypass operations (56.0%). The consultant operated on 382 patients (293 off-pump, 76.7%), and the residents operated on 990 (474 off-pump, 47.9%). Patients operated on by residents tended to be older, more obese, more likely to require an urgent operation, and more likely to need a circumflex artery graft but less likely to have triple-vessel disease. There were 7 conversions (consultant 5, residents 2). The overall failure rate was 8.5% (9.2% for consultant's operations and 8.2% for residents' operations), including 10 deaths (0.7%). Predicted and observed risks of failure were similar for all five surgeons. After 100 off-pump coronary artery bypass operations, performance was the same or better for the residents as for the consultant. For all surgeons, performance was the same or better for off-pump as for conventional coronary artery bypass grafting.

CONCLUSIONS: Off-pump coronary artery bypass surgery can be safely taught to cardiothoracic residents. Implementation of continuous performance monitoring for residents is practicable.

Disseminating a new surgical procedure involves significant scientific, ethical, and logistic issues. In recent years, residents in cardiothoracic surgery have had to gain competence in performing coronary artery bypass grafting (CABG) off-pump (OPCAB)^1-4 as well as conventionally with cardiopulmonary bypass (ONCAB). During recent years, the number of OPCAB operations performed at our institution has increased significantly, and residents have carried out many of these procedures.

We recently reported our early experience in teaching OPCAB surgery by comparing the early and midterm clinical outcomes of ONCAB and OPCAB procedures performed by residents with or without direct consultant supervision.³ However, conventional frequentist statistical methods are not optimal for analyzing sequential data. Control chart techniques (eg, cumulative sum) have the advantage of taking into account the order in which observations accrue while also avoiding the problem of repeated significance testing.^5-8 By providing a graphic summary of changes in performance with time, control charts can alert a surgeon to suboptimal performance.⁸ They are therefore also well suited to monitoring surgical learning curves.⁹

The purpose of this report was to use control charts to describe learning curves for OPCAB for four resident surgeons, to compare performance for consultant and resident surgeons after risk adjustment, and to compare performance for OPCAB and conventional CABG within surgeons after risk adjustment.

	Methods

Top Abstract Methods Results Discussion Appendix References

 
Patient selection and data collection
Standard data are collected prospectively for all patients undergoing CABG at our institution.¹⁰ For this study, data were extracted from the database for consecutive patients who had undergone CABG between April 1996 and September 2002 and who were operated on either by the lead academic consultant (G.D.A., who introduced OPCAB to our institution) or one of four residents who were in years 3 to 6 of the UK National Training Program.¹¹ Patients undergoing emergency or salvage operations, which are rarely carried out by residents at this stage of their training, were excluded. Anesthetic and surgical techniques were standardized for all patients and have been previously reported elsewhere.^12-14

The database describes whether cardiopulmonary bypass was used but not whether the original intention of the surgeon was to carry out OPCAB. Therefore, operative notes for all patients were reviewed to identify conversions from OPCAB to ONCAB. Such operations were recoded as OPCAB, and the analyses were carried out according to the principle of intention to treat.

Training
In our institution, residents train to carry out cardiothoracic operations through a period of 6 years. They are exposed to and start to perform ONCAB and OPCAB from the second year of their training program. With respect to OPCAB surgery, the program aims to start residents on simple cases that require only left anterior descending coronary artery or diagonal grafts; residents then progress to grafting posterior descending coronary arteries.² Details of the OPCAB training experience of the four residents monitored with control charts have been reported previously.¹¹

Data definitions
Perioperative death is rare after elective or urgent CABG operations (<1.0% in our institution during the study period). It is therefore unsuitable for monitoring performance. We thus sought a more sensitive outcome, and in advance of any analyses we defined surgical failure as the occurrence of one or more of the following events^15,16: (1) perioperative death,¹¹ (2) perioperative myocardial infarction,¹² (3) ventricular tachycardia or fibrillation,¹⁷; (4) stroke (permanent or transient),¹⁸ (5) acute renal failure with need for hemodialysis, (6) septicemia defined as development of postoperative fever with positive blood cultures, (7) use of an intra-aortic balloon pump, (8) reoperation for bleeding, (9) sternal rewiring because of infection, (10) postoperative ventilation longer than 48 hours, and (11) need for reintubation.

Consultant supervision was defined as an operation in which the consultant was scrubbed in and acted as first assistant.^3,11 When supervised, residents were supervised by one of five different consultants or occasionally a locum. The primary factor affecting whether a consultant was scrubbed in as first assistant was the identity of the consultant for whom a resident was working at the time of the operation.

Statistical analysis
No formal sample size calculation was carried out. However, all residents included in the study were participating in an official training program,¹¹ and their experience of OPCAB described here included at least 100 OPCAB procedures. Demographic and clinical characteristics of patients were summarized according to surgeon and surgical technique. Some continuously or discretely measured prognostic variables (eg, Parsonnet score; Table 1) were categorized for these summaries and for fitting regression models.

We used multiple regression modeling to investigate whether seniority of surgeon, surgical technique, or accumulating experience (sequence of operation) was associated with the predicted risk of failure. We calculated robust standard errors to take account of clustering of patients within surgeons. These analyses were hypothesis-driven. We also investigated whether for their first 25 operations residents operated on fewer patients (1) considered at high risk from a clinical perspective¹¹ or (2) receiving circumflex coronary artery (Cx) grafts, than subsequently. The cutoff of 25 cases was chosen after discussing with residents when they believed their experience would begin to reach a plateau.

Variable life-adjusted displays (VLADs)²⁰ and risk-adjusted sequential probability ratio tests (SPRTs)^21,22 were plotted. It should be noted that the x-axis in such graphs represents operation number, not calendar time. Boundary lines for SPRT (indications for alert or action) were set to detect an increase in the failure equivalent to an odds ratio of 1.5 (H₁) or to confirm that the observed failure rate was consistent with the rate set as acceptable (H₀). The position of boundary lines was calculated as recently recommended, ²² assuming = ß = .10 (alert) and .05 (action).

All analyses were carried out with STATA version 7 or 8 (Stata Corporation, College Station, Tex).

	Results

Top Abstract Methods Results Discussion Appendix References

 
The study cohort included a total of 1372 cases, 769 of which were OPCAB operations (56.0%). The consultant operated on 382 patients and the residents operated on 990 (284, 267, 190, and 249, respectively for residents 1-4); 293 operations (76.7%) carried out by the consultant and 474 operations carried out by the residents (47.9%, ranging from 36.0%-64.7%) were OPCAB. More than half of the operations carried out by residents were supervised (663/990, 67.0%). The clinical characteristics of patients by surgeon grade and type of operation are summarized in Table 1. Patients operated on by residents and consultants had broadly similar characteristics, although the former tended to be older, more obese, more likely to require an urgent operation, and less likely to have triple-vessel disease. Residents also tended to carry out more Cx grafts but fewer grafts overall. There were 7 acute conversions of OPCAB to ONCAB operations for electrical or hemodynamic instability, 5 carried out by the consultant and 2 carried out by the residents.

Failures
The failure rates were 9.2% (35/382) among patients operated on by the consultant and 8.2% (81/990) among patients operated on by residents, for an overall failure rate of 8.5% (95% confidence interval 7.1%-10.1%). The distributions and incidences of events defining failures are shown in Figure 1. There were 10 deaths (0.7%; 95% confidence interval 0.4%-1.3%), 8 of which occurred after one or more other events. Conversion from OPCAB to ONCAB was not itself considered to constitute failure; failures occurred in 2 of 7 (29%; 95% confidence interval 4%-71%) conversions.

View larger version (18K): [in this window] [in a new window]   Figure 1. Frequencies of events contributing to failures, with occurrence alone or in combination with other events and overall incidence (%). Incidences and frequencies sum to more than overall incidence of failure because some patients had more than one event occur. Re-op, Reoperation; MI, myocardial infarction; VT/VF, ventricular tachycardia or fibrillation; IABP, intra-aortic balloon pump.

View larger version (29K): [in this window] [in a new window]   Figure 2. A, Box and whisker plots showing distributions of predicted risk by consultant versus resident and ONCAB versus OPCAB; mean predicted risk and observed failure rate are also shown for each box and whisker plot. Box and whisker plots show median (middle horizontal line in the box), 25th and 75th percentiles (lower and upper bounds of box; interquartile range), and most extreme observations within 1.5 interquartile ranges of quartiles (lower and upper whiskers); more extreme points are plotted separately as filled gray circles. On-pump, ONCAB procedures; Off-pump, OPCAB procedures. B, Moving average of predicted risk of failure for OPCAB operations for each resident. Moving average was average of predicted risk for previous 5 patients, current patient, and next 5 patients.

Figure 3 shows the percentages of patients operated on by residents who were classified as at high risk on clinical grounds¹¹ and who had a Cx graft grouped according to "early" (first 25 operations) versus subsequent operations. This figure shows that as the residents gained experience the percentages of patients considered at high risk and patients receiving a Cx graft increased for ONCAB but not OPCAB operations. It also shows that once experience had been acquired a smaller proportion of patients undergoing OPCAB than ONCAB received a Cx graft. This latter finding was also true for the consultant's recent OPCAB operations.

View larger version (26K): [in this window] [in a new window]   Figure 3. Proportion of patients operated on by residents who were considered clinically to be at high risk16 (A) and who received Cx grafts (B) according to ONCAB versus OPCAB operation and according to sequence of operation (1-25 vs 26).

View larger version (31K): [in this window] [in a new window]   Figure 4. VLAD (left column) and SPRT (right column) charts for residents compared with consultant (data for consultant's 200 most recent operations within study period are shown for comparison on each chart). The x-axis represents operation number, not calendar time (see text). Note that y-axes are different for VLAD plots (cumulative observed minus predicted risk of failure) and SPRT plots (cumulative log likelihood ratio), and charts have been scaled accordingly. Acceptable performance in VLAD plot should oscillate around 0, whereas acceptable performance in SPRT plot will tend toward "accept" boundary line.9

	Discussion

Top Abstract Methods Results Discussion Appendix References

 
There are four main findings from this study. First, it is safe to teach OPCAB to residents in a setting where consultants regularly practice OPCAB surgery, because we found no indication at all that the failure rate was higher among residents, not even within their first few operations. Second, teaching OPCAB in a residency program is effective, because the average failure rate for OPCAB after adjustment for case mix was similar to or better than that for ONCAB surgery for both consultant and residents. Third, in our training program residents learning OPCAB are not obviously "protected" from high-risk cases, because the predicted risk of failure and the proportion of patients at high risk or patients who required a Cx graft did not increase as residents gained more experience. Fourth, implementing continuous performance monitoring for residents is practicable, because the methods used in this study could be easily programmed in standard office software.

The study was necessarily observational for both logistic and ethical reasons, and it is important to consider this issue and other limitations when interpreting the main findings. The way in which cases are selected by consultants for residents is unlikely to be adequately characterized by our data despite the large number of clinical variables available. The estimates of predicted risk for each case are therefore likely to be affected by residual confounding, not only because the preoperative risk of a poor outcome was inadequately characterized but also because adjusted risk estimates never perfectly take into account all the prognostic factors that were measured. These limitations almost certainly favored residents' operations, because the true risk of the consultant's operations is probably not properly reflected in the predicted risk scores. Residents may therefore not compare as favorably with the consultant as indicated in the graphs, but residual confounding would be unlikely to overturn the basic conclusion that teaching OPCAB is safe and effective.

A change in the designation of main operator from resident to consultant, for example when complications leading to classification as failures occurred, would have led to the performance of residents being overestimated. We do not believe that this occurred to a significant extent. Neither consultants nor residents could recall specific instances of this kind. Consequently, we conclude that changes in designation in the main operator were extremely uncommon. However, residents volunteered that during the early stages of their OPCAB training the consultant may have intervened in one of two ways. The consultant may have taken over in a planned manner to carry out one or more anastomoses, for example a Cx graft. When asked directly about the frequency of such events, residents thought that they might have occurred up to a maximum of 5 times per resident. Alternatively, the consultant may have intervened to show the resident how to position the heart to gain access to carry out the required distal anastomosis; in these instances, the operating resident carried out the anastomosis.

The predicted risks of failure for individual patients were calculated from the entire study cohort. Because we compared resident against consultant and OPCAB against ONCAB, it might be argued that we should have modeled predicted risk with, for example, only the consultant's data. However, there was no evidence that the model differed for consultant and residents (or for OPCAB and ONCAB), and the model would then have been based on a relatively small sample and few events. We observed that the model did not predict failure particularly well, which was possibly a consequence of trying to predict a combined end point; different predictors may be prognostic of different specific events. The total number of failures may also have limited the power to detect important risk factors.

The study also gave equal weight to the varied events that separately or in combination defined failure. Ideally, it would be preferable to have a method for attributing more importance to events that culminated in death, permanent disability, or long-term sequelae than to events from which patients recovered completely. However, the control chart methods described here and previously⁹ are usually applied to binary outcomes, although the SPRT principle can be applied to counts.²² The appropriateness of and best methods for combining "near miss" events need to be researched in more detail; Steiner and colleagues²³ have described a method for combining near misses and deaths but not with adjustment for case mix.

A final point relates to the residents' whose data were included. During the study period, nine other visiting residents and research fellows carried out a total of 71 OPCAB operations (only one of which was unsupervised), although not as part of an official training program. The numbers of operations carried out by these visiting residents were too small to allow meaningful analysis with control charts. However, other analyses pooling the experiences of all informal residents have suggested that they may have had worse outcomes.¹¹ Other intrinsic limitations of control charts, such as interpretation of boundaries and the equal weights given to historic and recent data, have been discussed elsewhere.⁹

Implications for training of residents
Residents in cardiothoracic surgery need to gain experience in OPCAB surgery. Consultants face a dilemma between the duty to deliver the highest possible standard of care to their patients and the responsibility to learn new techniques of coronary surgery themselves and to teach the same techniques to residents. A recent survey from cardiothoracic training centers in the United States²⁴ showed that only 22% of residents had performed 20 or more OPCAB procedures during their training, and only 12% had performed 20 or more complete OPCAB myocardial revascularizations. Of these, only 4% had performed OPCAB Cx revascularization. The survey clearly demonstrated that most residents had not reached proficiency in OPCAB surgery at the end of the residency.

Our study therefore has important implications for training residents in OPCAB surgery. We have previously demonstrated that OPCAB surgery is associated with less renal dysfunction, a less intense systemic inflammatory reaction, less myocardial reperfusion injury, fewer arrhythmias, and overall better early clinical outcomes than ONCAB surgery.²⁵ The findings we report here confirm that multivessel OPCAB surgery is a safe and reproducible surgical technique that can be taught successfully to residents.

This study also shows that it is relatively simple to implement control charts for continuous performance monitoring. This is particularly relevant when learning OPCAB surgery, because the technique is perceived to be technically difficult yet surgeons are under pressure to take up the technique because of its widespread popularization as an alternative to conventional ONCAB.²⁴ Nevertheless, the precise way in which control charts are set up needs to be considered carefully. Risk-adjustment is desirable but requires an accepted method for generating the predicted risk for each patient. VLAD and SPRT control charts, plotting performance against different expectations, are complementary.⁹ For cardiac surgery residents, use of alarm or alert lines (and hence interpretation of the significance of crossing of these boundaries) may not be critical, because competition for training places is so acute. Indeed, it is possible that residents may be oversensitive to changes in gradient on VLAD plots and seek explanations for any tendency for performance to drift upward. (This may not be true in less competitive specialties or for established consultant surgeons). Paradoxically, the use of a "reassurance" boundary in a SPRT plot (confirming H₀) may be more useful for residents than alarm or alert boundaries, because confirmation of an acceptable failure rate could be interpreted as an evidence-based criterion of competency. It is a relatively simple matter to manipulate H₀, H₁, and ß to set the average number of operations that a resident would have to perform to attain this criterion, assuming that the resident's performance conforms to H₀.

Conclusion
Our data show that OPCAB surgery can be safely taught to cardiothoracic residents. We believe that a modern surgical program should expose residents to both ONCAB and OPCAB techniques, because the latter has become an integral part of coronary surgery. We also strongly recommend the development of specific OPCAB training programs in those centers with senior surgeons proficient in the technique. This will positively affect the future expectations of many cardiothoracic residents who are likely to practice OPCAB coronary surgery after their training is completed.

	Appendix

Top Abstract Methods Results Discussion Appendix References

 
Determination of logistic regression model for assigning a predicted risk of failure
Multivariable logistic regression modeling was applied to the data for the whole study population to investigate predictors of failure. All variables listed in Table 1 were considered as possible predictors of failure, but interactions between these variables were not. Multiple regression models were fitted interactively, first by identifying significant predictors separately, second by including significant predictors in a multivariable model, and finally by removing variables that did not reach statistical significance at P < .2.

Increasing age, previous myocardial infarction, and preoperative inotropic support were found to be significant risk factors for failure (P %; .05). Current smoker and operative priority (elective vs urgent) were also included in the final model (Appendix Table 1) because there was a suggestion that they increased the risk of failure (P < .05).

	Footnotes

	References

Top Abstract Methods Results Discussion Appendix References

 

1. Mack MJ. Pro: beating-heart surgery for coronary revascularization: is it the most important development since the introduction of the heart-lung machine? Ann Thorac Surg. 2000;70:1774–1778[Free Full Text]
   
2. Caputo M, Chamberlain MH, Ozalp F, Underwood MJ, Ciulli F, Angelini GD. Off-pump coronary operations can be safely taught to cardiothoracic trainees. Ann Thorac Surg. 2001;71:1215–1219[Abstract/Free Full Text]
   
3. Caputo M, Bryan AJ, Capoun R, Mahesh B, Ciulli F, Hutter J, et al. The evolution of off-pump coronary surgery in a single institution. Ann Thorac Surg. 2002;74:S1403–1407[Abstract/Free Full Text]
   
4. Karamanoukian HL, Panos AL, Bergsland J, Salerno TA. Perspectives of a cardiac surgery resident in-training on off-pump coronary bypass operation. Ann Thorac Surg. 2000;69:42–46[Abstract/Free Full Text]
   
5. MacPherson CK. Statistics: the problem of examining accumulating data more than once. N Engl J Med. 1974;290:501–502
   
6. Altman DG, Royston JP. The hidden effect of time. Stat Med. 1988;7:629–637[Medline]
   
7. Williams SM, Parry BR, Schlup MM. Quality control: an application of the cusum. BMJ. 1992;304:1359–1361
   
8. de Leval MR, François K, Bull C, Brawn W, Spiegelhalter D. Analysis of a cluster of surgical failures. J Thorac Cardiovasc Surg. 1994;107:914–924[Abstract/Free Full Text]
   
9. Rogers CA, Reeves BC, Caputo M, Ganesh JS, Bonser RS, Angelini GD. Control chart methods for monitoring cardiac surgical performance and their interpretation. J Thorac Cardiovasc Surg. In press 2004
   
10. Chamberlain M, Ascione R, Reeves BC, Angelini GD. Evaluation of the effectiveness of off-pump coronary artery bypass surgery in high-risk patients: an observational study. Ann Thorac Surg. 2002;73:1866–1873[Abstract/Free Full Text]
    
11. Ascione R, Reeves BC, Hutter J, Ciulli F, Angelini GD. Trainees operating on high-risk patients without cardiopulmonary bypass: a high-risk strategy? Ann Thorac Surg. In press 2004
    
12. Ascione R, Caputo M, Calori G, Lloyd CT, Underwood MJ, Angelini GD. Predictors of atrial fibrillation after conventional and beating heart coronary surgery: a prospective, randomized study. Circulation. 2000;102:1530–1535[Abstract/Free Full Text]
    
13. Watters MP, Ascione R, Ryder IG, Ciulli F, Pitsis AA, Angelini GD. Hemodynamic changes during beating heart coronary surgery with the ‘Bristol Technique’. Eur J Cardiothorac Surg. 2001;19:34–40[Abstract/Free Full Text]
    
14. Angelini GD, Taylor FC, Reeves BC, Ascione R. Early and midterm outcome after off-pump and on-pump surgery in Beating Heart Against Cardioplegic Arrest Studies (BHACAS 1 and 2): a pooled analysis of two randomised controlled trials. Lancet. 2002;359:1194–1199[Medline]
    
15. Novick RJ, Fox SA, Stitt LW, Swinamer SA, Lehnhardt KR, Rayman R, et al. Cumulative sum failure analysis of a policy change from on-pump to off-pump coronary artery bypass grafting. Ann Thorac Surg. 2001;72:S1016–1021[Abstract/Free Full Text]
    
16. Novick RJ, Fox SA, Stitt LW, Kiaii BB, Swinamer SA, Rayman R. Assessing the learning curve in off-pump coronary artery surgery via CUSUM failure analysis. Ann Thorac Surg. 2002;73:S358–362[Free Full Text]
    
17. Ascione R, Reeves BC, Santo K, Khan N, Angelini GD. Predictors of new malignant ventricular arrhythmias following coronary surgery: a case control study. J Am Coll Cardiol. In press
    
18. Ascione R, Reeves BC, Chamberlain MH, Ghosh AK, Lim KH, Angelini GD. Predictors of stroke in the modern era of coronary artery bypass grafting: a case control study. Ann Thorac Surg. 2002;74:474–480[Abstract/Free Full Text]
    
19. Shroyer AL, Coombs LP, Peterson ED, Eiken MC, DeLong ER, Chen A, et al. The Society of Thoracic Surgeons: 30-day operative mortality and morbidity risk models. Ann Thorac Surg. 2003;75:1856–1865[Abstract/Free Full Text]
    
20. Lovegrove J, Valencia O, Treasure T, Sherlaw-Johnson C, Gallivan S. Monitoring the results of cardiac surgery by variable life-adjusted display. Lancet. 1997;350:1128–1130[Medline]
    
21. Wald A. Sequential tests in industrial statistics. Ann Math Statist. 1945;6:117–186
    
22. Spiegelhalter D, Grigg O, Kinsman R, Treasure T. Risk-adjusted sequential probability ratio tests: application to Bristol, Shipman and adult cardiac surgery. Int J Qual Health Care. 2003;15:7–13[Abstract/Free Full Text]
    
23. Steiner SH, Cook RJ, Farewell VT. Monitoring paired binary surgical outcomes using cumulative sum charts. Stat Med. 1999;18:69–86[Medline]
    
24. Ricci M, Karamanoukian HL, D'Ancona G, DeLaRosa J, Karamanoukian RL, Choi S, et al. Survey of resident training in beating heart operations. Ann Thorac Surg. 2000;70:479–482[Abstract/Free Full Text]
    
25. Ascione R, Caputo M, Angelini GD. Off-pump coronary artery bypass grafting: not a flash in the pan. Ann Thorac Surg. 2003;75:306–313[Abstract/Free Full Text]
    

This article has been cited by other articles:

				F. G. Bakaeen, A. S. Dhaliwal, D. Chu, B. Bozkurt, P. Tsai, S. A. LeMaire, M. J. Wall Jr, J. S. Coselli, and J. Huh Does the Level of Experience of Residents Affect Outcomes of Coronary Artery Bypass Surgery? Ann. Thorac. Surg., April 1, 2009; 87(4): 1127 - 1134. [Abstract] [Full Text] [PDF]

				G. L. Grunkemeier, R. Jin, and Y. Wu Cumulative sum curves and their prediction limits. Ann. Thorac. Surg., February 1, 2009; 87(2): 361 - 364. [Full Text] [PDF]

				S. C. Stoica, D. Kalavrouziotis, B.-J. Martin, K. J. Buth, G. M. Hirsch, J. A. Sullivan, and R. J.F. Baskett Long-Term Results of Heart Operations Performed by Surgeons-in-Training Circulation, September 30, 2008; 118(14_suppl_1): S1 - S6. [Abstract] [Full Text] [PDF]

				M. Caputo, R. R. Anis, C. A. Rogers, N. Ahmad, S. I.A. Rizvi, A. Baumbach, K. R. Karsch, G. D. Angelini, and M. Oberhoff Coronary Collateral Circulation: Effect on Early and Midterm Outcomes After Off-Pump Coronary Artery Bypass Surgery Ann. Thorac. Surg., January 1, 2008; 85(1): 71 - 79. [Abstract] [Full Text] [PDF]

				J. Bergsland, E. Kabil, E. Mujanovic, I. Terzic, J. Roislien, J. L. Svennevig, and E. Fosse Training of Cardiac Surgeons for Bosnia and Herzegovina: Outcomes in Coronary Bypass Grafting Surgery Ann. Thorac. Surg., February 1, 2007; 83(2): 462 - 467. [Abstract] [Full Text] [PDF]

				B. C. Reeves, R. Ascione, M. Caputo, and G. D. Angelini Morbidity and mortality following acute conversion from off-pump to on-pump coronary surgery. Eur. J. Cardiothorac. Surg., June 1, 2006; 29(6): 941 - 947. [Abstract] [Full Text] [PDF]

				A. Karagounis, G. Asimakopoulos, G. Niranjan, O. Valencia, and V. Chandrasekaran Complex off-pump coronary artery bypass surgery can be safely taught to cardiothoracic trainees Interactive CardioVascular and Thoracic Surgery, June 1, 2006; 5(3): 222 - 226. [Abstract] [Full Text] [PDF]

				G. Asimakopoulos, A. P. Karagounis, O. Valencia, D. Rose, G. Niranjan, and V. Chandrasekaran How Safe Is It to Train Residents to Perform Off-Pump Coronary Artery Bypass Surgery? Ann. Thorac. Surg., February 1, 2006; 81(2): 568 - 572. [Abstract] [Full Text] [PDF]

				M. Caputo, B. C. Reeves, C. Rajkaruna, H. Awair, and G. D. Angelini Incomplete Revascularization During OPCAB Surgery is Associated With Reduced Mid-Term Event-Free Survival Ann. Thorac. Surg., December 1, 2005; 80(6): 2141 - 2147. [Abstract] [Full Text] [PDF]

				G. J. Murphy, C. A. Rogers, M. Caputo, and G. D. Angelini Acquiring Proficiency in Off-Pump Surgery: Traversing the Learning Curve, Reproducibility, and Quality Control Ann. Thorac. Surg., November 1, 2005; 80(5): 1965 - 1970. [Abstract] [Full Text] [PDF]

This Article Abstract Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Add to Personal Folders Download to citation manager Author home page(s): Massimo Caputo Barnaby C. Reeves Raimondo Ascione Gianni D. Angelini Permission Requests Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Caputo, M. Articles by Angelini, G. D. Search for Related Content PubMed PubMed Citation Articles by Caputo, M. Articles by Angelini, G. D. Related Collections Cardiac - other Education Coronary disease