AJNS
CLINICAL STUDIES / ETUDES CLINIQUES
 
PREDICTIVE VALIDITY AND USEFULNESS OF VISUAL SCANNING TASK IN HIV/AIDS – A CASE CONTROL ANALYSIS

VALIDITÉ PRÉDICTIVE ET UTILITÉ D'UN TEST NUMÉRIQUE DE CHARGE DE LECTURE LORS DE VIH/SIDA. UNE ANALYSE CONTROLÉ


  1. Department of Medicine, University Teaching Hospital, Benin City, Nigeria

E-Mail Contact - OGUNRIN Olubunmi : bfunmi@uniben.edu


ABSTRACT

Background

There are evidences of brain damage, based on functional neuro-imaging studies, in patients with HIV/AIDS in the developed countries. However there is little or no information among this group of patients in the sub-Saharan Africa due to non-availability of functional neuro-imaging facilities.

Objective

To assess the predictive validity of computerized visual scanning test as a tool to screen for presence of brain damage in HIV/AIDS patients.

Methods

We used a neuropsychological tool, the computerized visual scanning task, a sensitive tool that discriminates between brain-damaged subjects and normal population, to assess the presence of damage in a randomly selected sample of 192 HIV-positive subjects. These subjects’ performances were compared with age, sex and level of education matched 96 controls.

Results

The visual scanning task had a sensitivity of 81.77%, specificity of 81.25% and accuracy of 81.6%. There were significant differences in the performances of the HIV-positive subjects when compared with controls (p<0.05). Furthermore the severity of disease, reflected by the CD4 levels, worsens their performances. Conclusion

The visual scanning task is a useful screening tool for brain damage in HIV/AIDS by inference from impairment of visual information processing and disturbances in perceptual mental strategies. There is progressive neuro-cognitive decline as the disease worsens.

Key words: brain, cognition, HIV/AIDS, predictive validity, visual scanning test


RESUME

Introduction

Des études d’imagerie fonctionnelles sont réalisées lors de VIH/SIDA dans les pays développés. En revanche, il y a peu d’études de ce type réalisées en Afrique subsaharienne compte tenu de l’absence de support technique de ce type

Objectif

Évaluer la validité prédictive d’un test numérique visuel comme moyen de détermination des lésions cérébrales chez les patients VIH/SIDA.

Méthodes

Nous avons utilisé des méthodes neuropsychologique, un test numérique visuel, afin d’apprécier la sensibilité discriminative entre une population atteinte et une population saine. Un échantillon aléatoirement choisi de 192 patients VIH positifs a été étudié. La performance de cette population a été comparée en intégrant l’âge, le sexe et le niveau éducatif de 96 cas-controles.

Résultats

Le test de sensibilité du test numérique visuel était de 81,77% avec une spécificité de 81,25%. Il y avait une différence significative entre les patients VIH positifs et les sujets témoins (p<0,05) De plus la sévérité de la maladie en rapport avec le taux de CD4, aggravait les performances. Conclusion

Le test numérique visuel est un moyen utile d’apprécier les lésions cérébrales chez mes patients VIH/SIDA en corrélant la baisse des performances neurocognitives.

Mots clés: Cognition, VIH, Neuropsychologie, test visuel, SIDA

INTRODUCTION

The HIV/AIDS pandemic has become a global health concern. Its impact on human sufferings, cultures, demographics, economics and even politics is enormous. The sub-Saharan Africa and the Asian countries have been worst hit with increasing mortality, decreasing fertility and depletion of the productive sector of the population20. The prevalence of HIV/AIDS in Nigeria was 5.8% (adult population) as at the end of 200323. Ninety percent of 36.1 million HIV/AIDS patients live in developing countries and 25.3 million are in sub-Saharan Africa with an adult prevalence of 8.8%18,22. There are evidences to show that human immunodeficiency virus (HIV) damages the brain directly through the elaboration of virally mediated toxins (gp120, tat and nef) and indirectly through host toxins (quinolinic acid, tumour necrosis factor alpha, platelet activating factor (PAF), nitric oxide (NO) and neopterins)2,14,21.

These neurotoxic effects promote neurodegeneration by synergism of HIV products with endogenous excitotoxins and interference of HIV with effect of growth factors that are essential for neuronal survival and maintenance. Several studies have demonstrated early brain changes using neuro-imaging techniques (computerized axial tomography and/or magnetic resonance imaging), and functional imaging studies to demonstrate cerebral metabolic dysfunction both at regional and cellular levels5,6,7. The consequences include neuro-cognitive impairments, which manifest either as minor cognitive motor disorder (MCMD) or HIV-associated dementia (HAD).

These neuro-imaging facilities are not available in most sub-Saharan African countries. Neurocognitive impairments in the presence of brain damage have been detected with the computerized visual scanning task (CVST) invented by Goldstein et al4. We used the visual scanning task as a tool to assess the complex information processing and perceptual mental strategies in Nigerian patients with HIV/AIDS and inferred the presence or absence of brain damage based on their performances as compared with healthy, HIV-negative controls.

SUBJECTS AND METHODS

A total of 192 subjects out of 720 patients with positive ELISA test to HIV were randomly selected (using the table of random numbers) from the HIV/AIDS clinic of the University Teaching Hospital, Benin City, Nigeria over a 6 month period (January – June 2004). Then 96 controls were selected randomly from hospital staff members of the outpatient and antenatal clinics. A total of 288 subjects were recruited for the study. The subjects comprised 3 categories: 96 HIV-positive asymptomatic subjects, 96 symptomatic AIDS subjects and 96 healthy sero-negative controls. The ELISA method was used to detect HIV antibodies and diagnose HIV infection, and the CD4 levels were obtained for all subjects with the use of an automated flow cytometry (CyFlow™; Partec GmbH, Munster, Germany) and double-checked with the manual CD4 kit (Coulter®; Partec GmbH, Munster, Germany).

All the subjects were matched for age, sex and level of education. Informed consents were obtained from the patients and controls, and approval to undertake study was granted by the Hospital Ethics Committee. All subjects were interviewed using a basic questionnaire by one of the authors (OF) to obtain demographic variables. The exclusion criteria included subjects less than 18 years of age, patients already on anti-retroviral therapy, those with opportunistic infections (OIs), and patients with co-morbidity (diabetes mellitus, hypertension epilepsy, and associated intracranial disorders e.g. brain tumor, and other metabolic diseases), those with inconclusive diagnosis, major axis 1 psychiatric illness, presence of clinical signs of cardiac failure, alcohol intake above 120gm/week or 13units/week, history of previous head injury with loss of consciousness and patients on anti- cholinergic medications.

COGNITIVE ASSESSMENT TOOL

The computer-assisted visual scanning task (CVST) was used for cognitive assessment. This test was described by Goldstein et al4 in 1973 as a successful instrument for discriminating brain damage from normal and psychiatric populations. DeMita & Johnson developed a computerized version of the same task for the DEC LSI-11/03 computer3. The task has been adapted for the microcomputer by Moerland et al13 as part of the test battery, the Iron Psychology (acronym ‘FePsy’). The task consists of finding a grid pattern out of 24 which matches the one in the centre of the screen (Fig 1). Grid patterns are displayed in a checkerboard fashion and are numbered from 1 to 24. The target pattern is marked by an arrow on the right side and is selected by typing the correct number from the keyboard. 24 different patterns are presented. After 12 presentations the surrounding grids change. Each subject had a total of 24 trials. The testee is asked to react as fast as possible. Results show accuracy and speed of responses and are evaluated within the context of visual (complex) information processing and perceptual-mental strategies. An important variable appears to be the average response time. The average scores were 15.8 seconds (range 7-18 seconds) for a normal control group4,13.

Test presentation and response registration were controlled by a microcomputer, but one of the authors (AOO) was always present to adjust instructions to the individual performance level of the patients. The cognitive assessment was blind as the author (AOO) was not aware of the patients’ HIV status.

It is pertinent to mention that the subjects need not be computer literate to perform the test, as they only need to carry out instructions as they relate to the test. The test is not level of education-based as the tests for primary do not differ from secondary and tertiary levels of education. Language does not affect performance. The test was administered in a reasonably quiet, well-lit room at room temperature of between 22oC and 25oC, between the hours of 10:00 and 13:00 each day of testing with the subject sitting comfortably at a distance of 40 to 60 centimeters from the visual display screen. Care was taken to ensure good brightness and contrast of screen and sufficient sound level of the speaker.

STATISTICAL ANALYSIS

The means of the ages and CD4 levels of the three categories were compared using two-way ANOVA. The means of the response times of the asymptomatic and symptomatic HIV-positive subjects were independently compared with the mean response time of the controls. The level of significance was determined using the chi square for trend and taken as p<0.05. A 2X2 contingency table was used to determine the predictive validity of the visual scanning task using the sensitivity, specificity and predictive values. RESULTS

The mean ages were 32.9+ 8.0 years, 31.5 + 6.7 years and 33.6+7.1 years for the controls, asymptomatic HIV positive and symptomatic AIDS subjects respectively (p = 0.13). The means of the CD4 counts for the controls, HIV-positive asymptomatic and symptomatic subjects were 682±44, 284±62 and 142±36 respectively (p<0.05). The details of demographic information are presented in Table I. The mean response time for the controls, asymptomatic HIV-positive and symptomatic AIDS patients are presented in Table II. There was significant difference in the mean response times of the patients compared to the controls implying impaired perceptual mental functioning and visual information processing in the HIV-positive patients (p<0.05). The response time was prolonged in 31.6% of patients with CD4 levels > 500 (p>0.05), in 77.1% of those with CD4 levels between 200 and 499 and 86.7% of those with CD4 levels <200 (p<0.01). This observation revealed the role of severity of disease and degree of immuno-suppression on visual scanning performance of the affected patients implying that the more severe the disease the worse the cognitive impairment. An inverse relationship thus exists between CD4 levels and mean response times of the subjects - as the CD4 declines the mean response time increases (Fig 2). Abnormal or prolonged response time was observed in 18.4% (18 of 96) of the controls while 81.9% (157 of 192) of the HIV-positive subjects had abnormally prolonged response time. Using the 2X2 contingency table, the CVST has a sensitivity of 81.77%, specificity of 81.25%, predictive value positive (PVP) of 89.71%, predictive value negative (PVN) of 69.03% and an accuracy of 81.6%. DISCUSSION

The predictive validity refers to how well a test will predict a subject’s performance with respect to some meaningful external criterion i.e. a real life event25. For example, a good performance on tests of visual or verbal memory is a good predictor that the subject has difficulty remembering things in day-to-day life. So for a clinician, the issue of validity of an instrument is whether the test is predictive with respect to an external criterion that is clinically meaningful.

Predictive validity is better understood, in the clinical setting, in terms of specificity and sensitivity. In other words, the predictive value of a medical test is measured not by correlational analysis, as in psychometrics, but by conditional probability. It is based on this assertion that we chose to assess the predictive validity of this test.
For clinical settings in sub-Saharan Africa characterized by lack of functional imaging facilities to demonstrate brain damage in patients with HIV/AIDS, we recommend the use of the visual scanning task as a sensitive screening tool for the detection of impaired perceptual mental strategies and complex visual processing thereby inferring presence of significant brain damage in patients with prolonged response time. This test is easy to administer and interpret. Though it is computer-assisted it does not require intensive computer training. This study demonstrated high sensitivity, specificity and predictive values of this test.

A significant limitation of this study is our inability to correlate the patients’ cognitive performances with neuro-imaging changes (CT or MRI). The prohibitive costs of these facilities in Nigerian hospitals, ranging from 33,000naira (~$254) to 60,000naira (~$462) for CT and 70,000naira (~$538.5) to 120,000naira (~$924) for MRI, militated against this.

The pathogenesis of cognitive dysfunction, including impaired complex visual processing and perceptual mental strategies, in HIV/AIDS has been linked to structural and metabolic changes induced by the virus in the brain[8,14,17]. Cerebral atrophy, often accompanied by ventricular enlargement, represents the most common structural changes seen in either computerized axial tomography (CT) or magnetic resonance imaging (MRI)[5,6]. Focal areas of reduced cerebral perfusion were demonstrated by single photon emission tomography in patients with HIV-associated dementia (HAD) as well as in asymptomatic subjects with CD4 counts greater than 500/µl suggesting that brain damage appear during the early stages of infection[19]. Furthermore magnetic resonance spectroscopy (MRS) has shown a reduction in N-acetyl-aspartate, a marker of mature neurons in patients with advanced dementia16 and, in addition, significant elevations in brain choline and myoinositol have been found in all stages of HIV infection providing a marker of early brain involvement[10]. Positron emission tomography with fluoro-deoxygenase has shown two general patterns of metabolic alterations in the HIV brain, hypermetabolism in the basal ganglia and thalamus, possibly characteristic of early stages of HAD and hypometabolism in the cortex that probably correlates with the severity of dementia[5].

The pattern of neurocognitive impairments in HIV infection resembles that seen in other sub-cortical frontal disorders like Parkinson’s disease[9]. There is agreement on the presence of cognitive impairments in symptomatic HIV-positive subjects but there are conflicting reports on its presence in asymptomatic HIV-positive individuals[1,12]. The cognitive decline may be subtle and may not be detectable by conventional neuropsychological tests however definite cognitive decline has been conclusively shown with severe immunosuppression[15]. It may also be that the HIV-induced brain changes are not severe enough to cause significant cognitive dysfunction in the asymptomatic stage. However the use of computerized cognitive testing has proved useful in identifying these subtle cognitive deficits[11,24].

CONCLUSION

We recommend the use of the computerized visual scanning task, especially in clinical settings where functional neuro-imaging facilities are lacking, for the screening of significant brain damage in HIV/AIDS causing neuro-cognitive impairments. There is need for a study that will correlate cognitive impairments with functional neuro-imaging patterns among HIV/AIDS patients in sub-Saharan Africa.

Acknowledgements
The authors acknowledge the assistance and cooperation of the medical officers and laboratory scientists in the HIV/AIDS clinic of the University teaching hospital and HIV laboratory respectively.
Controls (N = 96) Asymptomatic HIV-positive patients (N = 96) Symptomatic AIDS patients (N = 96)
Sex
Male 48 (50%) 48 (50%) 48 (50%)
Female 48 (50%) 48 (50%) 48 (50%)
Age (years)
20 – 29 40 (41.7%) 43 (44.8%) 40 (41.7%)
30 – 39 34 (35.4%) 37 (38.5%) 34 (35.4%)
40 – 49 21 (21.9%) 16 (16.7%) 21 (21.9%)
>= 50 1 (1.0%) 0.0 (0%) 1 (1.0%)
Level of education
Primary 48 (50%) 48 (50%) 48 (50%)
Secondary 36 (37.5%) 36 (37.5%) 36 (37.5%)
Tertiary 12 (12.5%) 12 (12.5%) 12 (12.5%)
Controls (n=96) Asymptomatic HIV-positive (n=96) Symptomatic HIV-positive (n=96)
Mean Age 32.94±8.0 31.47±6.7 p=0.21(a) 33.56±7.1 p=0.33(b)
Mean CD4 levels 682±44 284±62 p<0.01(a) 142±36 p<0.01(b)
CVST (Mean response time in seconds) 17.50±3.76 20.26±2.85 p<0.05(a) 22.08±3.88 p<0.01(b)

(a) the asymptomatic HIV-positive subjects were independently compared with the controls

(b) the symptomatic HIV-positive subjects were independently compared with the controls

Fig 1

Fig 1

Fig 2

Fig 2


REFERENCES

  1. CLIFFORD DB. AIDS dementia. Medical Clinics of North America. 2002;86:537-550.
  2. CORASANITI M.T., BAGETTA G., ROTIROTI D., NISTICÒ G. The HIV envelope protein gp 120 in the nervous system: interactions with nitric oxide, interleukin-1BETA and nerve growth factor signaling, with pathological implications in vivo and in vitro. Biochemistry Phamacol 1998;56:153-6.
  3. DE MITA MA, JOHNSON JH. The validity of a computerized visual searching task as an indicator of brain damage. Behavior Res Methods Instrumentation.1981;13:592-594.
  4. GOLDSTEIN G, WELCH RB, RENNICK PM, et al. The validity of a visual searching task as an indicator of brain damage. J Consulting Clin Psychol. 1973;41:434-437.
  5. HINKIN CH, GORP WG, MANDELKERN MA, et al. Cerebral metabolic changes in patients with AIDS: Report of a six-month follow-up using positron emission tomography. J Neuropsychol Clin Neurosci. 1995;7:180-187.
  6. JARVIK JG, HESSELINK JR, KENNEDY C, et al. Acquired immunodeficiency syndrome. Magnetic resonance patterns of brain involvement with pathologic correlation. Arch Neurol. 1988;45:731-736.
  7. Laubenberger J, Haussinger D, Bayer S, et al. HIV-related metabolic abnormalities in the brain: depiction with proton MR spectroscopy with short echo times. Radiology 1996;199:805-810.
  8. MASLIAH, E., GE, N., MUCKE, L. Pathogenesis of HIV-1 associated neurodegeneration. Crit. Rev. Neurobiol. 1996;10:57-67.
  9. MCARTHUR JC, SACKTOR N, SELNES O. Human immunodeficiency virus-associated dementia. Semin Neurol. 1999;19:129-50.
  10. MEYERHOFF DJ, BLOOMER C, CARDENAS V, et al. Elevated subcortical choline metabolites in cognitively and clinically asymptomatic HIV-patients. Neurology. 1999;52:995-1003.
  11. MILLER EN, SATZ P, VISSCHER BV. Computerized and conventional neuropsychological assessment of HIV-infected homosexual men. Neurology. 1991;41:1608-16.
  12. MILLER EN, SELNES OA, MCARTHUR JC, SATZ P, BECKER JT, COHEN BA, et al. Neuropsychological performance in HIV-infected homosexual men: the multicenter AIDS cohort study (MACS). Neurology. 1990;40:197-203.
  13. MORELAND MC, ALDENKAMP AP, DEALPHERTS WCJ. A neuropsychological test battery for the Apple IIe. Int J of Man-Machine studies. 1986;25:453-67.
  14. NATH A. Human immunodeficiency virus (HIV) proteins in neuropathogenesis of HIV dementia. J Infect Dis. 2002;186 (suppl 2):S193-S198.
  15. ODIASE F, OGUNRIN O, OGUNNIYI A. Effect of progression of disease on cognitive performance in HIV/AIDS. J Natl Med Assoc. 2006;98:1260-1262.
  16. PATEL SH, INGLESE M, GLOSSER G, et al. Whole brain N-acetylaspartate level and cognitive performance in HIV infection. AJNR Am J Neuroradiol. 2003;24:1587-1591.
  17. PATEL SH, KOLSON DL, GLOSSER G, et al. Correlation between percentage of brain parenchymal volume and neurocognitive performance in HIV infected patients. AJNR Am J Neuroradiol 2002;23:543-549.
  18. QUINN TC. Global burden of the HIV pandemic. Lancet. 1996;348:99.
  19. SACKTOR N, HOERTUM RL, DOONIEF G, et al. A comparison of cerebral SPECT abnormalities in HIV-positive homosexual men with and without cognitive impairment. Arch Neurol. 1995;52:1170-1177.
  20. SANI MU, MOHAMMED AZ, ADAMU B, et al. AIDS mortality in a tertiary institution: a four-year review. J Natl Med Assoc. 2006;98:862-866.
  21. SELMAJ KW, RAINE SC. Tumor necrosis factor mediates myelin and oligodendrocyte damage in vitro. Ann Neurol. 1988;12(3):339-46.
  22. THOMAS JO. Acquired immunodeficiency syndrome-associated cancers in sub-Saharan Africa. Semin Oncol. 2001;28:198-206.
  23. UNAIDS report on the global HIV/AIDS epidemic. Joint United Nations Programme on HIV/AIDS, July, 2004.
  24. WHITE DA, HEATON RK, MONSCH AU, HNRC Group. Neuropsychological studies of asymptomatic human immunodeficiency virus-type 1 infected individuals. The HNRC Group. HIV Neurobehavioural Research Center. J Int Neuropsychol Soc. 1995;1:304-15.
  25. WILLIAMS BEN T. Computer aids to clinical decisions. Volume ii. CRC Press Inc. 2000. Boca Raton, Florida, pgs 2-17.



© 2002-2018 African Journal of Neurological Sciences.
All rights reserved. Terms of use.
Tous droits réservés. Termes d'Utilisation.
ISSN: 1992-2647