|
|
||||||||
J Thorac Cardiovasc Surg 2008;135:1306-1312
© 2008 The American Association for Thoracic Surgery
Surgery for Acquired Cardiovascular Disease |
Departments of Healthcare Quality Assessment and Cardiothoracic Surgery, Graduate School of Medicine, University of Tokyo, Tokyo, Japan, the Department of Cardiothoracic Surgery, Graduate School of Medicine, Nagoya University, Nagoya, Japan, and Hyogo Medical College, Hyogo, Japan
Received for publication May 22, 2007; revisions received October 21, 2007; accepted for publication October 26, 2007. * Address for reprints: Hiroaki Miyata, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8655, Japan. (Email: hiroaki.miyata{at}gmail.com).
| Abstract |
|---|
|
|
|---|
Methods: We analyzed 4581 procedures from 36 centers between 2003 and 2005 by clinical database. The effect of hospital volume on each outcome was tested by a hierarchical mixed-effects logistic regression model, covering clinical risk factors, procedural year, clinical processes, and hospital volume/surgeon volume as a fixed effect and random intercepts for sites.
Results: Logistic regression model revealed a significant association between hospital bypass graft volume and 30-day mortality (P < .05) and operative mortality (P < .01). Surgeon procedural volume, however, did not have a significant effect on those outcomes. The effect of hospital procedural volume was associated with better outcomes in most patient subgroups: age younger than 65 years (P < .05), age 65 years and older (P < .01), low risk (P = .58), and high risk (P < .01).
Conclusion: In Japan, high-volume compared with low-volume providers had better outcomes. As for public reporting in Japan, hospital-based evaluation might be more credible than surgeon-based evaluation. Although minimal volume standards might be effective to improve quality to some extent, volume has limitations as a marker of quality because of its wide range of variance.
| Introduction |
|---|
|
|
|---|
|
|
| See related editorial on page 1202.
|
Since the Japanese government updated the medical practice laws in June 2006, each local government has had the power to force medical centers to submit and bring forward "certain information" that is useful for patients choosing a hospital from April 2007 (http://www.mhlw.go.jp/topics/bukyoku/soumu/houritu/dl/164-4a.pdf).
As of January 2007, "certain information" includes procedural volume but few outcome indicators, such as operative mortality rate or morbidity rate. However, there is the possibility that "certain information" could include surgeon-specific outcome indicators similar to public reporting in New York State.1,2
In Japan, it is very important to examine whether procedural volume is information that is appropriate to reveal and whether it is accurate.
Measuring and understanding the association between surgical volume and outcome in the delivery of health services has been the focus of much research since the 1980s in the United States.3,4
Recently, two systematic reviews suggested that high volume is associated with better outcomes, but the degree of this association varies greatly.5,6
As the complications included in these findings are partly due to methodologic shortcomings in many studies, it is very important to conduct a rigorous examination of volume-outcome association.
In Japan, whereas 9 studies suggest that a significant relationship between volume and outcomes does exist,7-15
4 studies suggest that no such relationship exists.16-19
Moreover, none of those Japanese studies examines the relationships of hospital and physician volume, appropriateness of patient selection, or risk adjustment by risk model with good calibration (Hosmer–Lemeshow test positive) and discrimination (C-index > 0.75). No association between hospitals' coronary artery bypass graft (CABG) surgery volume and outcome has been reported in Japan.
We undertook a contemporary examination of the association between hospital CABG procedural volume and outcome using clinical data available from the Japanese Adult Cardiovascular Surgery Database (JACVSD). The data collection form is almost identical with that of The Society of Thoracic Surgeons (STS) National Cardiac Database. We examined whether hospital volume and surgeon volume were associated with each outcome category (30-day mortality, 3-day operative mortality). We also examined how the association between hospital CABG volume and operative mortality varied as a function of patient age and predicted surgical risk.
As JACVSD participating hospitals did not cover all centers in Japan, we also examined the database of the Japanese Association for Thoracic Surgery (JATS). Although it was hard to adjust patient preoperative risk because of its aggregate data form, the JATS survey covered nearly all centers in Japan. We considered the nationwide trend and the potential health policy implications of using hospital volume in the context of health policy.
| Methods |
|---|
|
|
|---|
Statistical analysis
The primary yardstick of outcome used by JATS was 30-day mortality, defined as death within 30 days of operation, regardless of the patient's geographic location. Although this criterion includes death within 30 days of operation even when the patient had been discharged from the hospital during those 30 days, patients who died in the hospital at greater than 30 days were ungraspable in the JATS survey. Hospital-isolated CABG annual case volume was averaged over a 4-year period (2001–2004) to increase its stability. Annual hospital procedural volume was divided into quarters (15
, 16–30, 31–50, and >50). The break points were chosen to form 4 fairly equal-sized hospital samples, and similar volume differences were maintained among the groups. We simply showed average mortality rate (and 95% confidence interval) per hospital (
Table 1).
|
We examined isolated CABG surgery procedures, excluding those combined with valve surgery or other major surgical interventions, performed between January 1, 2003, and December 31, 2005. Fifty centers were members of JACVSD as of January 1, 2003. After excluding 11 centers for the aforementioned reason and excluding 3 centers because of extremely low CABG volume (reported < 15 CABG procedures per year), we ultimately included the data from 36 centers (
Table 2).
|
The effect of hospital volume on unadjusted outcomes was tested by a hierarchical mixed-effects logistic regression model. We examined the 6 types of volume index in this study: hospital adult cardiac surgery volume (CABG, valve, thoracic aorta, and other procedures), hospital CABG-related surgery volume (CABG plus valve or other procedures), CABG-only surgery volume per hospital, adult cardiac surgery volume per surgeon, CABG-related surgery volume per surgeon, and CABG-only surgery volume per surgeon (
Table 3). In Japan, isolated CABG surgery accounts for 48% of all adult cardiac surgery, while 29% was valvular heart disease and 19% was thoracic aortic aneurysm.22
These analyses included previously identified clinical risk factors,1
procedure year, clinical process (off-pump CABG surgery, autologous blood transfusion), hospital procedural volume, surgeon volume as a fixed effect, and random intercepts for sites.26
The C-indexes for this model in the study population were 0.83 for 30-day mortality and 0.84 for 30-day operative mortality.
|
65 years;
|
|
|
| Results |
|---|
|
|
|---|
15 procedures per year [n = 133]) were more likely to operate in elective cases. As for the JATS database, we also showed unadjusted 30-day mortality rates by procedural volume at 10 intervals (
101 procedures/year) were lower than 2.0%.
|
Table 3 displays the effect of volume index on each outcome. Only hospital procedural volume affected 30-day mortality and operative mortality significantly. Table 4 demonstrates the effect of hospital and surgeon procedural volume on risk-adjusted 30-day operative mortality rates. As there was colinearity between these factors (r = 0.385), only hospital procedural volume had a significant effect on 30-day operative mortality (P < .001). Overall, the highest mortality rates (3.47%) were observed when patients were treated by low-volume surgeons at middle- to low-volume hospitals, and the best results (1.46%) were obtained by high-volume surgeons at high-volume hospitals. We have shown the effect of volume on outcome in patient subgroups (Tables 5 and 6). Regarding the patient age group, the effect of hospital volume was apparent in both groups (age < 65 years, P <.05; age
65 years, P < .01). Patients at expected high operative risk (>1.5%, P < .01) demonstrated consistently lower mortality when treated at higher-volume centers. In contrast, among those with a risk of less than 1.5%, there was not a significant volume effect on 30-day operative mortality rates.
| Discussion |
|---|
|
|
|---|
The outcome improvement shown in Figure 1 also suggested that the effect of the hospital volume learning curve might be stronger in lower volume distribution in Japan. The reason for the difference regarding volume effect between Japan and other countries may be multifactorial. As many surgeons belong to a single hospital in Japan, information and experiences of conferences on each patient are shared with many cardiac surgeons and other medical staffs in the hospital. Usually, cardiac surgery is performed not by a single consultant but by two or more consultant surgeons with trainees. Characteristics of the Japanese health insurance system might be another reason, because insurance covers a large part of the medical expense with a small individual payment at each operation.28
Patients can stay in the hospital beyond 1 or 2 weeks if needed without extra huge expenses, and they can choose any surgeon and hospital they prefer, regardless of their insurance. Surgeons can conduct surgical and medical treatments at the maximum level with less pressure from the hospital and insurance company compared with surgeons in other countries. Moreover, postoperative care in the intensive or critical care unit is maintained mainly by physicians and not by nursing staffs in Japan, which may lead to better care than otherwise.29
Because of these differences, minimal volume standards for CABG surgery in Japan might be preferable at lower levels than those in the United States.
As noted in previous studies by Peterson,27
Hannan,30
and their associates, Table 4 shows that even for very low numbers of cases, low-volume surgeons have substantially better results when they operate at higher-volume hospitals. High-volume hospitals might also be important as teaching institutes. Tables 5 and 6 show that the volume–outcome relationship may be most evident for higher risk patients (older, more comorbidities). In addition to regionalization of cardiac surgery, patient transfer system (eg, transferring high-risk patients to high-volume hospitals quickly) also needs to be developed for better quality of cardiac surgery in Japan.
As for public reporting, hospital-based evaluation might be more relevant than surgeon-based evaluation. Hospital volume index (total adult cardiac procedure volume, hospital CABG-related surgery procedural volume, and hospital CABG-only procedural volume) was significantly associated with 30-day mortality and operative mortality. On the other hand, the surgeon–volume index was not significantly associated with these outcomes. Inasmuch as there are few open-bed hospitals and most surgeons and their teams belong to a single hospital in Japan, a large proportion of surgeon volume might be accounted for by hospital volume. Other studies suggest that individual report cards might discourage surgeons from operating on high-risk patients, because it is surgeons, not hospitals, that choose whether or not to accept a patient for surgery.1,2
As for the public reporting regarding outcomes of cardiac surgery in Japan, releasing a hospital-based outcome might be more preferable.
In 2002, the Japanese Ministry of Health, Labor and Welfare set minimal standards by references to hospital procedure volume for medical treatment fees on surgery.31
As for cardiac surgery, medical institutes in which the annual cardiac surgery procedural volume was less than 100 had their medical treatment fees lowered by 30%. As many stakeholders objected, these standards were suspended in 2006. Minimal volume standards for CABG surgery in Japan may also be modest not only because most medical institutes (over 60%) had been lowered by those standards32
but also because of the limitation of procedural volume as a marker of CABG quality. Even when a significant association exists, hospital volume is not a complete predictor of outcome for individual hospitals. Inasmuch as hospital procedural volume embraces physicians' skills, experienced interdisciplinary teams, well-organized care processes, and hospital facilities, it is a necessary factor when outcomes are considered. However, many other parameters (namely, outcome monitoring, compliance with process measures, appropriateness of patient selection for surgery) may also be associated with better outcomes.1,33
Thus volume alone is not sufficient for predicting outcome in Japan. In addition, there was wide variance in the results observed among individual centers, particularly those in the low-volume category (Table 1), indicating that not all high-volume providers have better outcomes and not all low-volume providers have worse outcomes. Further studies should include an examination of those parameters to improve the outcomes of individual centers.
Outcome-based evaluation is also an important way to improve quality of CABG surgery. However, surgical mortality has several limitations as an indicator of hospital quality under the present circumstances in Japan because small sample size and low event rates combine to diminish statistical power.34
Although volume is not a complete indicator of quality, high-volume providers have, on the whole, better outcomes than low-volume providers. In addition, the effect of hospital procedural volume was significantly associated with better outcomes in almost all patient subgroups (except for low-risk surgery). Regionalization of medical centers on the basis of hospital procedural volume might be effective to improve quality to some extent. However, regionalization has an impact not only on hospital quality, but also on patients' access, staffing of medical professionals, cooperation with other departments in the hospital, and health care expenditure. As for specific health policy recommendations, further analysis is needed to consider these factors. When case loads become large enough to support outcome measurement through regionalization, it is also feasible to base quality assessments on both outcome data and volume (or on one of these).
Several limitations should be noted. In the JACVSD analysis, we excluded centers that submitted fewer than JATS results, because the appropriateness of patient selection for procedural conditions seemed to be important for a volume–outcome study. A former study also found that high-volume surgeons performed a higher proportion of operations for which the indications were inappropriate than low-volume surgeons.35
It is probably appropriate for fair comparison to exclude centers whose reporting is incomplete. Moreover, improving quality of the database is a continuing issue in JACVSD. As for data accuracy, not only data auditing but also to educate each site's input data in correct definition is important.
| Acknowledgments |
|---|
| Footnotes |
|---|
| References |
|---|
|
|
|---|
Related Article
This article has been cited by other articles:
![]() |
J. Bachet Editorial comment: Toward quality improvement of thoracic aortic surgery: estimating volume-outcome effect from nationwide survey Eur. J. Cardiothorac. Surg., September 1, 2009; 36(3): 521 - 523. [Full Text] [PDF] |
||||
![]() |
N. Motomura, H. Miyata, H. Tsukihara, M. Okada, S. Takamoto, and Japan Cardiovascular Surgery Database Organization First Report on 30-day and Operative Mortality in Risk Model of Isolated Coronary Artery Bypass Grafting in Japan Ann. Thorac. Surg., December 1, 2008; 86(6): 1866 - 1872. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. M. Shahian and S.-L. T. Normand Low-volume coronary artery bypass surgery: Measuring and optimizing performance. J. Thorac. Cardiovasc. Surg., June 1, 2008; 135(6): 1202 - 1209. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |