|
|
||||||||
J Thorac Cardiovasc Surg 2002;123:631-639
© 2002 The American Association for Thoracic Surgery
Surgery for Congenital Heart Disease (CHD) |
From the Departments of Cardiovascular Surgerya and Neuroepidemiology,b Children's Hospital, and the Department of Surgery,c Harvard Medical School, Boston, Mass.
Received for publication June 28, 2001. Revisions requested July 27, 2001; revisions received Aug 2, 2001. Accepted for publication Aug 7, 2001. Address for reprints: Joseph M. Forbess, MD, Department of Cardiovascular Surgery, Children's Hospital, 300 Longwood Ave, Boston, MA 02115 (E-mail: forbess{at}cardio.tch.harvard.edu).
| Abstract |
|---|
|
|
|---|
| Introduction |
|---|
|
|
|---|
The enrollment in the Boston Circulatory Arrest Trial was limited to patients undergoing the arterial switch for D-transposition of the great arteries.
8 This limitation to a single operation and diagnosis was necessary to limit both genetic and perioperative variables in that prospective randomized trial. To expand our understanding of the neurodevelopment of all of our patients, we decided to perform neuropsychologic testing at 5 years of age on all children undergoing cardiac surgery at our institution. This registry includes the entire range of anatomic diagnoses and contemporary surgical treatment strategies for these defects. It is our hope that a registry such as this may produce important normative data regarding the neurodevelopment of patients after repair of congenital heart disease. Moreover, populations that are at particularly high risk for neurodevelopmental delay may thus be identified. Finally, retrospective analyses of anatomic and operative variables can produce preliminary data that may guide the design of future prospective clinical trials.
The results for our patients with single-ventricle anatomy from this registry have been reported elsewhere.
15 This study reports the data obtained from patients without transposition who underwent primary biventricular repairs at our institution.
| Methods |
|---|
|
|
|---|
This study was approved by the Children's Hospital Committee on Clinical Investigation and was conducted in accordance with institutional guidelines. Informed consent was obtained from the parents of all participating patients.
Medical record review
Information was obtained from each patient's medical records concerning anatomic diagnosis, age at repair, duration of cardiopulmonary bypass, use and duration of HCA, minimum hematocrit during cardiopulmonary bypass, lowest rectal temperature attained, and length of postrepair hospital stay.
Developmental assessment
All patients were administered the Wechsler Preschool and Primary Scale of Intelligence-Revised (WPPSI-R)
16 and the Wide Range Assessment of Visual-Motor Abilities (WRAVMA).
17 The WPPSI-R is a standardized measure used to assess intelligence in children aged 3 years through 7 years, 3 months. It is composed of five verbal subtests (Information, Comprehension, Arithmetic, Vocabulary, Similarities) and five performance subtests (Object Assembly, Geometric Design, Block Design, Mazes, Picture Completion), which yield separate verbal IQ (VIQ) and performance IQ (PIQ) scores. A full-scale score (FSIQ) is derived from combined performance on the VIQ and PIQ scales. Mean IQ score (±SD) is 100 ± 15.
The WRAVMA is a standardized measure used to assess visual-motor abilities in children aged 3 years through 17 years. It is composed of three subtests (Drawing, Matching, and Pegboard). These subtests assess visual-spatial (Matching), fine motor (Pegboard), and integrated visual-motor abilities (Drawing). A score for each subtest can be calculated. Mean subtest scores (±SD) are 100 ± 15. A composite score is derived from the performance on the visual-motor, visual-spatial, and fine motor areas evaluated. Mean composite score (±SD) is 100 ± 15.
At the time the child was being evaluated, parents were asked to complete a questionnaire on family demographic information, including parental marital status and maternal and paternal occupational and educational information. Parental IQ was assessed with the Kaufman Brief Intelligence Test.
18 Socioeconomic status was determined with the Hollingshead Four Factor Index of Social Status.
19 This index calculates socioeconomic status on the basis of parental occupation and educational levels. Parental occupations are stratified into 9 categories (eg, 1 for a laborer, 6 for a technician, and 9 for a professional). Education is scored on a scale of 1 to 7 (eg, 1 for a 7th-grade education and 7 for a graduate degree). Parental IQ and socioeconomic status are typically predictors of child IQ.
20 We therefore adjusted for parental IQ or socioeconomic status in some of our statistical analyses. All evaluations were conducted by the same psychologist (K.J.V).
Statistical analysis
The association between continuous predictor and outcome variables was estimated with univariate regression analysis, with adjustment for parental IQ or socioeconomic status. Descriptive statistics were used to present the medical and sociodemographic data of the sample.
| Results |
|---|
|
|
|---|
|
|
|
Visual-motor and visual-spatial skills
The group also performed within the average range in terms of visual-motor skills. Mean composite score on the WRAVMA was 97.1 ± 17.2 (range 45-130). With respect to the individual subtests, mean score on Drawing was 97.6 ± 15.3 (range 59-129). Mean score on Matching was 102.9 ± 12.6 (range 57-134), and mean score on Pegboard was 95.0 ± 16.3 (range 45-141).
Risk factor analysis
Figure 1 displays the FSIQ scores of the study population as a function of parental IQ. Figure 2 shows FSIQ scores as a function of socioeconomic status. Because of the positive correlations between FSIQ and parental IQ (r = 0.24, P = .05) and FSIQ and socioeconomic status (r = 0.39, P = .001), separate univariate regressions adjusted for parental IQ or socioeconomic status were carried out to determine whether other anatomic, surgical, or intraoperative variables were associated with intelligence scores or visual-motor skills. Table 4 displays the variables examined as possible risk factors for worse developmental outcome. Anatomic diagnosis, age at operation, duration of cardiopulmonary bypass, lowest hematocrit, lowest temperature, use of HCA, duration of HCA, and postoperative hospital stay did not predict FSIQ, PIQ, or VIQ when adjusted for either parental IQ or socioeconomic status.
|
|
|
|
| Discussion |
|---|
|
|
|---|
In this study, within the group of patients subjected to HCA there were also differences between patients subjected to more than 39 minutes of HCA and those subjected to 39 minutes of HCA or less on tests of visual-motor and visual-spatial skills. Those patients with more than 39 minutes of HCA clearly had lower scores on these tests of higher order nonverbal processing, such as the WRAVMA. These differences were present regardless of adjustment for parental IQ or socioeconomic status (Table 5
). This spectrum of disability is similar to that detected in patients after the arterial switch procedure at this and other institutions.
2,21,22 Deficiencies in these domains are also seen in other similar adult and pediatric populations considered to be at risk because of a history of cerebral anoxia with or without a history of extracorporeal mechanical circulatory support.
23-25
Despite these concerns related to mechanical circulatory support, cardiopulmonary bypass time and other support-related variables were not predictors of worse outcomes on these neuropsychologic tests. As the number of variables examined increases in studies of such relatively small size, however, drawing conclusions from retrospective data becomes difficult, particularly when the expected differences are fairly subtle. Moreover, the retrospective evaluation of almost any support-related variable is limited in this patient population because of the lack of both internal or external control data. External control subjects who were not operated on are difficult if not impossible to obtain, because many of these defects are lethal without repair or palliation. Internal control data are likewise impossible to obtain for these patients, who generally undergo their operations at ages that preclude preoperative neuropsychologic testing. This is not the case in adult populations, where elegant demonstrations of cognitive decline after cardiopulmonary bypass have been possible.
26
It is also important to note that assigning increased morbidity to HCA longer than 39 minutes may not be entirely sound, because the methods for this technique have changed significantly at this institution during recent years. On the basis of data from animal models and clinical trials, we changed from alpha-stat pH management to a pH-stat strategy in 1996.
2,5,27,28 Eleven patients in this study were previously enrolled in a prospective randomized trial addressing this issue
2 and were independently evaluated for inclusion here. As mentioned previously, data on pH management strategy could not be obtained for most of this study population because the perfusion records for that era are missing. More recently we have been routinely using a higher hematocrit on cardiopulmonary bypass, approximately 30%. The mean hematocrit in this study population was 21.9%. This change in hematocrit management was also motivated by preclinical animal model data and by strongly suggestive data from clinical studies.
29-31 We believe that one must recognize that although HCA clearly carries some potential for neurologic injury, this potential may have been reduced by the described modifications. We speculate that the "critical point," or the temporal threshold after which neurologic injury is extremely likely, has possibly been extended with these measures as well. The evolving nature of the specific method of HCA must be taken into consideration when examining this support technique as a potential risk factor for developmental morbidity.
In addition to parental influence and operative variables, the genotypic propensity toward developmental delay in these patients with congenital heart disease must be considered. Overt examples of this propensity would be clear if one were, for example, to evaluate the IQs of the patients representing an institution's experience with the repair of complete atrioventricular septal defect. This group would almost certainly have lower IQs than the reference range. This would not necessarily be because of any operative variable, but rather because of the prevalence of trisomy 21 in this group. A similar example is the prevalence of Williams syndrome among patients with supravalvular aortic stenosis. A more recently defined association is that of the deletions on chromosome 22 and such cardiac defects as interrupted aortic arch, truncus arteriosus, and tetralogy of Fallot.
32 These 22q11 deletions, as seen in DiGeorge or velocardiofacial syndrome, frequently result in such conotruncal cardiac defects and a constellation of noncardiac findings, including developmental delay.
32
Because one of the aims of this study was to provide an intrainstitutional comparison between patients with biventricular repair and our patients with repaired D-transposition of the great arteries, we excluded patients with these defined syndromes from this analysis. No anatomic diagnosis emerged from the present analysis as posing a risk for worse neurodevelopment. The strength of this conclusion is limited, however, by the low numbers of patients in each diagnostic group and by the exclusion of patients with syndromes known to result in developmental delay. Indeed, a comparison against only the two largest groups, ventricular septal defect (n = 19) and tetralogy of Fallot (n = 20), would require a sample of 13 patients to yield 80% power to detect a difference of 15 IQ points (P = .05). In addition, routine chromosomal analysis was not performed on the study population. It is therefore possible that some patients with 22q11 deletions who did not overtly manifest the velocardiofacial syndrome were included in the study. This lack of correlation between anatomic diagnosis and neurodevelopment may not hold up in a comprehensive analysis of this entire registry, which is now underway. In that analysis of a population that now numbers more than 200 patients, we intend to relax these inclusion criteria so that genotypic influences may be more readily discerned.
A significant limitation of this study is the possibility of selection bias. As described previously, these data are a portion of a registry in development wherein we are attempting to test all patients from our geographic region who have undergone heart surgery at our institution. Because enrollment is voluntary, the population is subject to selection bias. The mean socioeconomic status score of 50.4 in the study population is, for example, significantly higher than the mean values of 42 and 43 seen in two previous prospective randomized trials performed at this institution.
2,13 This raises the possibility that the IQ scores of the study population might overestimate those of the entire population undergoing biventricular repairs. These data are, however, only suggestive of possible selection bias. This bias cannot be confirmed or refuted without obtaining socioeconomic status data from those families that did not participate in the study.
In conclusion, patients with conditions other than D-transposition of the great arteries who underwent primary biventricular repairs for congenital heart disease had FSIQs that were, on average, within the reference range. Parental IQ and socioeconomic status were both predictors of patient IQ at 5 years of age. No operative variable other than the use of HCA for longer than 39 minutes predicted lower scores in our extensive neuropsychologic testing. Patients subjected to more than 39 minutes of HCA had lower scores on tests of visual-motor and visual-spatial performance skills and may in fact have had lower FSIQ scores. Modifications in our HCA methods since the performance of these surgical repairs probably limit the application of this apparent threshold to patients in the current era. No anatomic diagnosis emerged as carrying higher risk for worse developmental outcomes. Future analyses with larger sample sizes may allow us to more accurately assess potential genotypic contributions to developmental delay among these patients with important congenital heart disease.
| Discussion |
|---|
|
|
|---|
A medical oncologist friend of mine born in 1955 with a large isolated ventricular septal defect failed to thrive in early infancy because of uncontrollable heart failure. He was referred by Richard Bing to the already legendary C. Walton Lillehei at the University of Minnesota. My friend was so young and so small that he was at first turned down for corrective surgery. However, at the persistence of the baby's mother, who was a nurse, Lillehei was finally persuaded to attempt repair of the ventricular septal defect. He agreed to do this only after informing my friend's mother that if her baby survived at all he would almost certainly have significant mental retardation and cerebral palsy. A prototype DeWall bubble oxygenator was used. My friend did survive and went on to obtain a PhD from Stanford and an MD from Harvard. He considers himself fortunate, and indeed he is. Neurodevelopmental outcomes were clearly as much of a concern to Lillehei and the other pioneers of heart surgery as they are to those of us involved today. Forbess and colleagues are correct in moving the focus of our attention beyond patient survival and onward to the quality of that survival. Studying neurologic injury associated with cardiac surgery, however, is a much more difficult task, as Gene Blackstone pointed out in a recent editorial in The Journal of Thoracic and Cardiovascular Surgery.
Forbess and colleagues used a battery of standardized assessments rather than high technology to evaluate neurodevelopmental outcomes among 69 patients 5 years of age who had undergone biventricular repair during infancy. HCA was used in half of the cases. As pointed out by Forbess and colleagues, the only operative variable associated with significant neurodevelopmental delay was the use of HCA for longer than 39 minutes. Despite the clear limitations of the retrospective study design, the small number of volunteer subjects, and the inability to compare adequate control subjects, these preliminary data seem to suggest that generous use of HCA as used in Boston at that time may compromise neuropsychologic outcome. I believe that this is the message.
Many of us have intuitively moved away from regular use of HCA in favor of other equally effective surgical strategies. The Loma Linda bias at present is to use the protection of hypothermia at 20°C coupled with aggressive hemodilution to ensure capillary perfusion. We use flow rates ranging from 20 to 40 mL · kg-1 · min-1. If HCA is used at all, it is for brief periods. If more than one period of HCA is anticipated, we use interval perfusion between arrest periods. This same basic approach is used for nearly all complex congenital surgery that we perform. Although we believe that our patients generally have excellent central nervous system outcomes, we have not systemically studied this issue except among infant transplant recipients until quite recently. My colleague in pediatric neurology, Steve Ashwal, and others from Loma Linda University Children's Hospital will soon report preliminary findings of our own prospective randomized evaluation of the operative strategy just described. Both preoperative and serial postoperative magnetic resonance imaging and spectroscopy have been accomplished in an institutional review board-approved pilot study, and we are eager to report these findings.
I have just two questions for Dr Forbess. First, 4 of the children involved in your study had FSIQ scores lower than 70, which would suggest a serious handicap. Were these all among the 16 study patients who underwent prolonged HCA?
Dr Forbess. It was about 50:50 on that, actually. One of the patients who had the most profound delay actually had no circulatory arrest other than a cardiac arrest in the intensive care unit.
Dr Bailey. That gives rise to the second part of this question. Did these patients have perioperative events outside the variables examined, such as cardiac arrest, seizures, or profound hypoxemia? Could you perhaps shed light on these effects on their outcomes?
Dr Forbess. The patient who did end up with a fairly profound delay had an arrest with seizures outside the operating room during the acute postoperative period, but we were not really able to analyze that because we only had 1 patient with those particular problems.
Dr Bailey. For my second question, not included in your evaluation of these 69 children were some potentially significant preoperative variables that could compromise central nervous system outcomes independent of operative strategies. Do you believe that preoperative issues might seriously affect late neurologic outcome? Do you have any plans to include variables such as cardiovascular collapse, profound acidosis or hypoglycemia, hypercyanotic spells, protracted congestive heart failure, nutritional depletion, and other comorbidities in your ongoing studies?
Dr Forbess. On that last issue, we did plan to do this, but it became difficult. We were able to look at things such as lowest pH and whether the patient had a frank cardiac arrest before coming in, but when one starts to look at the episodes of hypercyanosis in the patients with tetralogy, you know as well as I do how it is with a neurologisthow many seizures do they actually see? Well, they see a lot of postictal patients, but they do not see that many seizures. I became uncomfortable with defining the number of patients who had actually had hypercyanosis. I can tell you that preoperative cardiovascular collapse did not seem to come out as significant. Again, I only had about 5 or 6 affected patients in this particular patient population. This is much more of an issue in patients with single-ventricle anatomy, but in a large analysis of the hypoplastic left heart syndrome experience at Boston that I performed in the early 1990s, lowest pH was not a predictor and prenatal diagnosis, which is sort of a surrogate marker for those issues, was not a predictor either.
Dr John Hawkins (Salt Lake City, Utah). I would like to commend you on this study. I think that this is an important area for us to understand what we are doing to these patients from a neurodevelopmental outlook. I have a couple quick questions. First, why did you choose to exclude patients with transposition of the great arteries? This is a large group and may give even more power to your study of differentiating this problem over the long term.
Dr Forbess. Inclusion of patients with transposition would have added about 20 patients to this group. We have published the transposition results from this institution, and the full-scale IQs came out similar to what we found here. I wanted to look at the comparison group of patients without transposition with biventricular repairs to see whether they were similar to the results from our prospective randomized trials. I wanted to see whether the patients with transposition that we previously described represented outliers, either high or low, from our standard population with biventricular repairs.
Dr Hawkins. My second question has to do with the conduct of HCA. I notice that your coldest temperature reached was more than 20°C.
Dr Forbess. That was for all patients, so that includes a mixture of patients with and without HCA.
Dr Hawkins. That is where I was confused, because I was concerned about trying to go longer than 39 minutes for HCA at a temperature greater 20°C.
Dr Forbess. We typically go for around 15°C.
Dr David Clarke (Denver, Colo). I enjoyed your presentation, but one thing that struck me is that you started out with a group of 222 children and ended up with only 30% of them in the study. More than half could not be contacted, and approximately 15% of them refused to cooperate with the study. You must have thought about this; can you tell us what kind of selection bias you consider that this might have introduced into your study?
Dr Forbess. The possibility of selection bias concerns us a great deal. We have wanted to develop this database to generate what we think are normative data for this patient population, because this is something that we have not really done before. We have done prospective randomized trials, which have eliminated a lot of the noise from various diagnoses, but the question in a voluntary retrospective study is, are these parents more likely to bring us smart kids or dumb kids? We do not know. I think that only time will tell as we accrue more and more patients, but it is a difficult question, and the honest answer is that we do not know.
| Footnotes |
|---|
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
B. S. Marino, R. S. Tomlinson, D. Drotar, E. S. Claybon, A. Aguirre, R. Ittenbach, J. S. Welkom, M. A. Helfaer, G. Wernovsky, and J. A. Shea Quality-of-Life Concerns Differ Among Patients, Parents, and Medical Providers in Children and Adolescents With Congenital and Acquired Heart Disease Pediatrics, April 1, 2009; 123(4): e708 - e715. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Farouk, M. Karimi, M. Henderson, J. Ostrowsky, E. Siwik, and H. Hennein Cerebral regional oxygenation during aortic coarctation repair in pediatric population. Eur. J. Cardiothorac. Surg., July 1, 2008; 34(1): 26 - 31. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Uzark, K. Jones, J. Slusher, C. A. Limbers, T. M. Burwinkle, and J. W. Varni Quality of Life in Children With Heart Disease as Perceived by Children and Parents Pediatrics, May 1, 2008; 121(5): e1060 - e1067. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Wernovsky Improving neurologic and quality-of-life outcomes in children with congenital heart disease: Past, present, and future J. Thorac. Cardiovasc. Surg., February 1, 2008; 135(2): 240 - 242. [Full Text] [PDF] |
||||
![]() |
D. E. Creighton, C. M.T. Robertson, R. S. Sauve, D. M. Moddemann, G. Y. Alton, A. Nettel-Aguirre, D. B. Ross, I. M. Rebeyka, and and the Western Canadian Complex Pediatric Therapi Neurocognitive, Functional, and Health Outcomes at 5 Years of Age for Children After Complex Cardiac Surgery at 6 Weeks of Age or Younger Pediatrics, September 1, 2007; 120(3): e478 - e486. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. A. Karsdorp, W. Everaerd, M. Kindt, and B. J.M. Mulder Psychological and Cognitive Functioning in Children and Adolescents with Congenital Heart Disease: A Meta-Analysis J. Pediatr. Psychol., June 1, 2007; 32(5): 527 - 541. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Y. Alton, C. M.T. Robertson, R. Sauve, A. Divekar, A. Nettel-Aguirre, S. Selzer, A. R. Joffe, I. M. Rebeyka, D. B. Ross, and Western Canadian Complex Pediatric Therapies Proje Early childhood health, growth, and neurodevelopmental outcomes after complete repair of total anomalous pulmonary venous connection at 6 weeks or younger J. Thorac. Cardiovasc. Surg., April 1, 2007; 133(4): 905 - 911. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. H. Hovels-Gurich, K. Konrad, D. Skorzenski, B. Herpertz-Dahlmann, B. J. Messmer, and M.-C. Seghaye Attentional Dysfunction in Children After Corrective Cardiac Surgery in Infancy Ann. Thorac. Surg., April 1, 2007; 83(4): 1425 - 1430. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. T. Hussain, A. Bhan, S. Sapra, R. Juneja, S. Das, and S. Sharma The bidirectional cavopulmonary (Glenn) shunt without cardiopulmonary bypass: is it a safe option? Interactive CardioVascular and Thoracic Surgery, February 1, 2007; 6(1): 77 - 82. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. J. Visconti, D. Rimmer, K. Gauvreau, P. del Nido, J. E. Mayer Jr, I. Hagino, and F. A. Pigula Regional Low-Flow Perfusion Versus Circulatory Arrest in Neonates: One-Year Neurodevelopmental Outcome Ann. Thorac. Surg., December 1, 2006; 82(6): 2207 - 2213. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. H. Hovels-Gurich, K. Konrad, D. Skorzenski, C. Nacken, R. Minkenberg, B. J. Messmer, and M.-C. Seghaye Long-Term Neurodevelopmental Outcome and Exercise Capacity After Corrective Surgery for Tetralogy of Fallot or Ventricular Septal Defect in Infancy. Ann. Thorac. Surg., March 1, 2006; 81(3): 958 - 966. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. L. Hanley Religion, politics...deep hypothermic circulatory arrest J. Thorac. Cardiovasc. Surg., November 1, 2005; 130(5): 1236 - 1236. [Full Text] [PDF] |
||||
![]() |
W. T. Mahle, K. Lundine, K. R. Kanter, J. M. Forbess, P. Kirshbom, S. R. Tosone, and R. N. Vincent The short term effects of cardiopulmonary bypass on neurologic function in children and young adults Eur. J. Cardiothorac. Surg., November 1, 2004; 26(5): 920 - 925. [Abstract] [Full Text] [PDF] |
||||
![]() |
C.-H. Yeh, Y.-C. Wang, Y.-C. Wu, Y.-M. Lin, and P. J. Lin Ischemic preconditioning or heat shock pretreatment ameliorates neuronal apoptosis following hypothermic circulatory arrest J. Thorac. Cardiovasc. Surg., August 1, 2004; 128(2): 203 - 210. [Abstract] [Full Text] [PDF] |
||||
![]() |
W. G. Williams, B. W. McCrindle, D. A. Ashburn, R. A. Jonas, C. Mavroudis, E. H. Blackstone, and the members of the Congenital Heart Surgeon's Soci Outcomes of 829 neonates with complete transposition of the great arteries 12-17 years after repair Eur. J. Cardiothorac. Surg., July 1, 2003; 24(1): 1 - 10. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. L. Stavinoha, D. E. Fixler, and L. Mahony Cardiopulmonary Bypass to Repair an Atrial Septal Defect Does Not Affect Cognitive Function in Children Circulation, June 3, 2003; 107(21): 2722 - 2725. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |