|
|
||||||||
J Thorac Cardiovasc Surg 2006;132:5-7
© 2006 The American Association for Thoracic Surgery
Editorial |
a Division of Cardio-Thoracic Surgery, University Hospital, Basel, Switzerland
b Division of General Surgery and Surgical Research, University Hospital, Basel, Switzerland
c Department of Cardiovasular Surgery, University Hospital, Freiburg, Germany
Received for publication January 6, 2006; revisions received March 6, 2006; accepted for publication March 15, 2006. * Address for reprints: Martin Grapow, MD, Division of Cardio-Thoracic Surgery, University of Basel, Spitalstrasse 21, CH-4031 Basel, Switzerland. (Email: mgrapow{at}uhbs.ch).
A recent article by Hannan and coworkers
1
including almost 60,000 patients from New York's cardiac registries forces us to reflect on the reliability of inferences made from randomized controlled trials (RCTs). The same applies to the treatment decisions exclusively derived from findings of RCTs for patients with coronary heart disease under everyday conditions.
Since the mid-1980s, surgical revascularization has become a standardized procedure. Since then, the coronary artery bypass grafting (CABG) technique has continuously improved.
2
The superiority of surgical revascularization over medical therapy was documented at an early stage.
3
Since the introduction of percutaneous transluminal coronary angioplasty and stents, percutaneous coronary intervention (PCI) has become a therapeutic alternative to medical and surgical therapy in many patients with coronary artery disease. There has been growing demand for, and use of, PCI because it is less invasive, so that today it is carried out 3 times more frequently than coronary surgery.
4
Over the last 10 years, numerous prospective RCTs have been conducted to answer the question of whether and in what situations CABG or PCI results in a better medium- and long-term course. Until very recently, the focus of research has been exclusively on RCTs and meta-analyses, whereas large population-based studies or cardiac registry analyses have received less attention.
The value of stringently conducted RCTs is undisputed because they have great internal validity. However, the crucial question is whether their results have relevance to everyday decision making. In RCTs patients are randomly assigned to standard and investigational arms and are followed up over a defined period. The final results of the randomized groups are often compared, irrespective of whether the positive result of one treatment arm was induced in part by using the alternative treatment principle (the intent-to-treat principle) as a result of crossover. Although the intent-to-treat analysis represents a central tenet of RCTs, it might bias the results versus no difference in the context of a comparison of PCI versus CABG. Moreover, it is not an uncommon phenomenon that RCTs are underpowered.
5,6
Clearly, even the most thoroughly planned and well-executed investigation might fail to answer the research question if the sample size is too small. If an underpowered study does not find statistically significant differences, it is unclear whether there is truly no difference between the treatment options or whether the sample size was prohibitively small to provide sufficient evidence for a statistically significant difference.
6,7
Finally, patients are usually recruited on the basis of stringent inclusion and exclusion criteria that are often worryingly dissimilar to the overall patient population with coronary artery disease. Meta-analyses
8
do not resolve this problem because they are based on those studies just described.
This high degree of patient selection represents the crucial limiting factor in many randomized clinical trials; the patients included in such studies seldom reflect the population encountered in routine practice. According to the analysis carried out by Brett and colleagues,
7
many RCTs included markedly less than 10% of all screened patients. Indeed, patients with common-sense indications for CABG and contraindications for PCI (eg, left main stenosis or diffuse, severe 3-vessel diseases) are often precluded from entering an RCT because the premise of an RCT is that all patients benefit equally from both procedures.
By including a population that is known not to benefit from CABG
9
and by excluding the complex cases that predominantly constitute the population undergoing CABG nowadays, these trials were definitely biased against CABG operations and toward the performance of PCI.
10
However, it is striking throughout the literature that the mean number of graftsperipheral anastomoses per patient is usually higher than the mean number of stents per patient. It can thus be concluded that the criterion "completeness of revascularization," which is unquestionably important for the prognosis, is in fact not achieved as a rule in these highly selected RCT patient populations.
If the majority of patients are excluded from participating in RCTs on the basis that they cannot undergo equivalent interventional treatment, it follows that the study results and conclusions are exclusively valid for patients with identical inclusion criteria as those in RCTs. In particular, the finding that mortality did not increase in patients undergoing PCI compared with in those who had undergone CABG in these RCTs only applies in a clinical setting to patients with profiles included in the study. However, this finding has often been extended to patients who would actually have been excluded from the study according to the RCT protocol.
Cohort studies and registry analysis studies try to bridge this gap in knowledge. Population-based studies attempt to derive more general conclusions from the results obtained in a nonselected patient population. Brener and associates
11
compared the clinical course of patients undergoing CABG with that of patients undergoing PCI at the Cleveland Medical Center. These patients had been treated with PCI or an operation, depending on the advice of the managing physician. With regard to their comorbidity, the groups treated with an operation and those treated with PCI differed significantly, with the former being more comorbid. PCI was associated with significantly higher mortality rates (risk-adjusted hazard ratio, 2.3; 95% confidence interval, 1.9-2.9). The results of this population investigated intensively at a single institution have been confirmed in a real-world study by Hannan and coworkers
1
by analyzing 59,314 patients in New York's cardiac registries who underwent either CABG or PCI (all with stents) from 1997 through 2000. Risk adjustment was performed by using both multivariable and propensity-score analysis.
The fundamental difference between multivariable and propensity-score analysis is that the former adjusts for confounders focusing on the relationship between baseline characteristics (eg, age, sex, and comorbidities) and the outcome (overall survival), whereas propensity-score analysis focuses on the relationship between baseline characteristics and the primary predictor variable (CABG vs PCI). Hence propensity-score analysis attempts to reconstruct a situation (case matching) similar to randomization.
12
The major limitation of observational studies is that both propensity-score and multivariable analysis can exclusively adjust for known confounders. Neither propensity-score nor multivariable analysis can risk adjust for unobserved or unknown confounders.
12
This represents an important advantage of RCTs that distribute both known and unknown confounders equally to both study arms.
13
Further limitations of observational studies based on registries might include potential coding errors and missing data.
13
In the investigation by Hannan and coworkers,
1
patients with 2- and 3-vessel disease undergoing CABG had a significantly better long-term overall survival, as well as a lower risk of reintervention, after risk adjustment using both multivariable and propensity-score analysis. Interestingly, in patients with 3-vessel disease, CABG was associated with a significantly lower mortality rate compared with that of PCI, even without risk adjustment. Equivalence with respect to prognosis between PCI and CABG was found only in patients with 2-vessel disease with or without proximal left anterior descending coronary artery involvement in unadjusted survival analyses.
Overall, PCI was performed in 61% of patients with double-vessel disease, whereas only 42% with proximal left anterior descending coronary artery disease and 14% with triple-vessel disease were treated with PCI. On the basis of these results, one can conclude that physicians generally make good choices for their patients.
The investigation by Hannan and coworkers
1
is particularly valuable because it reflects the real-world situation, being based on a large and unselected group of patients in whom the indications for CABG and PCI, respectively, were identified as part of a day-to-day routine. This analysis does not contradict the large numbers of RCTs comparing PCI versus CABG but applies to a much broader patient population. If patients do not meet the inclusion criteria of RCTs, it seems advisable to decide on therapy by referring to large registry analyses or cohort studies. Considering the RCTs available today,
7
there is essentially no significant difference in survival for one of the 2 strategies in the medium- and long-term course. However, surgical intervention is associated with a significantly lower reintervention rate, a greatly reduced recurrence of angina, and a higher rate of complete revascularization.
It is interesting that this synoptic statement is also reflected in clinically unselected studies. Van Domburg and colleagues,
14
at the Rotterdam Thorax Center, compared patient profiles and treatment data, as well as PCI and CABG outcomes, in the same institution before and after introduction of drug-eluting stents. Despite a much higher proportion of 3-vessel disease (75% compared with 22%), diabetes (24% compared with 17%), and much worse left ventricular ejection fraction in the CABG group in the drug-eluting stent era, the mortality of 2.2% within 12 months after CABG compared favorably with the mortality of 4.1% in the PCI group.
In summary, only by considering both results from RCTs and large cohort studies can real-life clinical situations be reflected to a degree capable of providing applicable treatment guidelines useful in a daily clinical setting.
References
This article has been cited by other articles:
![]() |
J. A. Leopold Small-Molecule Glycoprotein IIb/IIIa Antagonists and Bleeding Risk in Women: Too Much of a Good Thing? Circulation, September 26, 2006; 114(13): 1344 - 1346. [Full Text] [PDF] |
||||
![]() |
G. L. Grunkemeier, R. Jin, and A. Starr Prosthetic heart valves: objective performance criteria versus randomized clinical trial. Ann. Thorac. Surg., September 1, 2006; 82(3): 776 - 780. [Abstract] [Full Text] [PDF] |
||||
![]() |
Minerva BMJ, August 5, 2006; 333(7562): 310 - 310. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |