The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
This article has been corrected | View Correction

Abstract

This study explores the structural relationship between self-report and interview measures of affect in Huntington’s disease. The findings suggest continued use of both to recognize the multidimensionality within a single common consideration of distress.

Huntington’s disease (HD) is an inherited neurodegenerative disorder involving motor, cognitive, and emotional difficulties, for which the prevalence of affective symptoms ranges from 13% to 71% for anxiety1 and from 15% to 69% for depression.2,3 The high prevalence and variability of these estimates suggests that this is an important population to consider whether the assessment of affective symptoms is better undertaken via self-report measures or clinical interview,4 resonant of discussion within the wider psychiatric literature.5

Interviewer-rated measures (involving consultation with both patients and caregivers) of affect are important in HD, because communication impairments and anosognosia may limit the accuracy of reporting difficulties, especially in the advanced stages of the disease.4,6 Self-report ratings of affective symptoms allow individuals to honestly express how they feel outside the context of an interview. However, from an assessment perspective, consideration of whether practitioners and researchers should differentiate between interviewer-rated measures and self-report ratings has not been explored in HD. This is important because the extent to which these assessments represent two separate factors has implications for whether practitioners or researchers should use just one or both forms of assessment.

In addition, there is a further interpretation to be considered. Bifactor analysis models encompass the idea of a single common construct (e.g., general assessment) while also recognizing multidimensionality of concepts (e.g., self-reported and interviewer ratings). Therefore, consideration of a bifactor model, against other models of self-report and interview-assessed affective symptoms, could help elucidate the extent to which HD practitioners need to consider both self-report and interview-based assessment of affect in HD. This study therefore examined a bifactor interpretation of self-report and interview-based assessments of affective distress in HD.

Methods

Sample

This sample comprised 545 participants (52.81% female, mean age=46.21±14.39 years, age range=14–86 years) from 12 European countries recruited to the observational REGISTRY 3 study. From a database of 3,235 visits, inclusion criteria were for respondents’ most recent visit (N=1,474) and for whom a self-report measure of affective symptoms (Hospital Anxiety and Depression Scale [HADS])7 and an interview assessment (Short Problem Behaviors Assessment [PBA-s])8,9 had been presented (N=577). Furthermore, respondents were only included for whom there was a complete response for the aforementioned measures with a verified HD expansion (CAG repeat ≥38), a clinical disease progression profile via a total functional capacity score (mean=9.53±9.53, range=0–13) and total motor score (mean=27.81±23.94, range=0–108) from the United Huntington’s Disease Rating Scale (UHDRS)10 (N=545). This analysis covers assessments made between June 27, 2011 and February 20, 2014. Participants gave written informed consent according to the full ethical approvals required for the REGISTRY study.

It is noteworthy that this analysis is for a sample that was not representative of the wider sample (N=1,474). Although there was no significant difference for inclusion by gender (chi-square=0.10, p=0.747), those not included in the study were significantly older (t=6.10, p<0.001) and showed significantly reduced functional capacity (t=9.12, p<0.001) and greater motor impairment (t=8.37, p<0.001) as assessed by the UHDRS. Therefore, a caveat to the reported findings is of a selection bias; in addition, interview and self-report affective assessments are less likely to have been administered among those who were older and had increased functioning and motor difficulties.

Measurement of Affect Variables

A meta-analysis of the factor structure of the HADS recommended that the instrument is best used as a unidimensional measure of general distress.11 The PBA-s comprises 11 items that, in addition to the affect items, assess irritability, aggression, apathy, obsessive-compulsive behaviors, perseveration, paranoid thinking/delusions, hallucinations, and disorientation. Consistent with previous recommendations,8,11 this study only included the severity and frequency ratings from three items (depressed mood, anxiety, and suicidal ideation) to measure general affective distress.

Statistical Analyses

Confirmatory factor analysis was used to consider how well the data fit to a series of models. Initial assessments of the models reported modification indices of >420 for the frequency and severity item pairing on the PBA-s. The scoring patterns for these items suggested a tendency for the same scores to be obtained for frequency and severity of symptoms when present (66.2%−66.4%). This pattern of a concurrent increase in frequency and severity of symptoms is theoretically and empirically consistent for thresholds for major depression. Therefore, covarying the error terms and freeing fixed parameters in the models for these three item pairs was justified.12 Subsequently, alternative versions (one in which error terms for three PBA-s pairings were covaried and one where they were not) of three models were examined; (a) a unidimensional model representing an underlying latent factor of general affective distress, (b) a 2-factor model comprising self-report and interviewer rating, and (c) a bifactor model with a proposed single common construct (e.g., general assessment) and two group factors (self-reported and interviewer ratings).

Results

To assess the goodness of fit of the data to each of the six models, we used five statistics: the relative chi-square (<3 to be acceptable, <2 to be good), the comparative fit index (CFI), the non-normed fit index (NNFI) (the CFI and NNFI should exceed 0.95 to be good), the root mean square error of approximation (<0.06 is a good fit), and the standardized root mean square residual (values <0.05 are a good fit). The statistics for the six models are presented in Table 1.

TABLE 1. Confirmatory Factor Analysis Fit Statistics for the Different Models Proposed for the Self-Report and Interviewer-Based Assessmentsa

Analysis ModelChi-SquaredfPCMIN/DFCFINNFIRMSEASRMR
Unidimensional3,308.577170≤0.00019.4620.5260.4700.1840.100
Unidimensionalb943.749167≤0.0005.650.8830.8660.0920.077
Two-factor2,724.32169≤0.00016.1200.6140.5660.1670.102
Two-factorb860.599166≤0.0005.1840.8950.8800.0880.072
Bifactor1,687.212150≤0.00011.2480.7680.7060.1370.081
Bifactorb344.559147≤0.0002.3440.9700.9610.0500.035

aA CMIN/DF value <3 is an “acceptable” fit. CFI and NNFI >0.95, RMSEA <0.06, and SRMR <0.05 are a “good” fit. CFI, comparative fit index; CMIN/DF, relative chi-square; NNFI, non-normed fit index; PBA-s, Short Problem Behaviors Assessment; RMSEA, root mean square error of approximation; SRMR, standardized root mean square residual.

bCovaried error terms for three PBA-s pairings.

TABLE 1. Confirmatory Factor Analysis Fit Statistics for the Different Models Proposed for the Self-Report and Interviewer-Based Assessmentsa

Enlarge table

As expected, the fit statistics for each of the models in which the pairs of variables’ error terms were covaried are improved. Except for the bifactor model (where error terms were covaried), the majority of the goodness-of-fit statistics across these did not meet all of the aforementioned criteria for acceptability and therefore did not present an adequate explanation of the data.

In terms of the variance accounted for, the general assessment factor in this model was 26%, with patient and interviewer-rated group factors explaining 53.3% and 20.7%, respectively. In terms of salience of loading on the factors, the mean loadings were lower on the general affective symptoms factor (mean=0.31, range=0.02–0.55) than on the group factors (mean=0.57, range=0.41–0.68). The findings suggest a weighting toward a multidimensional assessment of patient and interviewer ratings.

Discussion

The selection of instruments for the assessment of affective symptoms in HD remains challenging for clinicians and researchers. These findings suggest that the best overall conceptualization of patient and interviewer-rated measures of general affective symptoms (depression and anxiety) in HD may be to recognize a single common construct (e.g., a general assessment of affect) while also recognizing the multidimensionality of the concepts (e.g., self-reported and interviewer ratings), with the recommendation that focus may be on the latter. This can be achieved by using two relatively short assessments (PBA-s and HADS) of general distress among patients with HD.

This commonality, but differentiation, in assessment of affect may come as little surprise to practitioners and researchers (as evidenced by discussion within the psychiatry and HD literatures).4,5 However, the improved explanation of the data as provided by the bifactor model, compared with unidimensional and two-factor models, begins to elucidate the approach that may be adopted, in which consideration of affect can be considered as part of both general and group factors. This may help clarify or provide a context to explore factors (e.g., disease stage, cognitive ability) that underpin or moderate the possible relationship between clinician and patient assessment of affect in HD.

Limitations of this study include that there is an initial selection bias (around age and disease progression) in terms of the administration of both affect assessments in the REGISTRY study. In addition, REGISTRY participants may not be representative of the general HD population. Both of these considerations may reflect that those excluded are potentially more severely impaired and thus are not receiving as frequent monitoring of affective symptoms. In addition, as a Europe-wide study, the precise meanings of questionnaire items may vary across language translations of the instruments. Furthermore, our sample included those in the more advanced stages of the disease and, as a self-report measure, the responses from the HADS may not be reliable among those with severe impairments.

Notwithstanding these limitations, this study suggests the use of both self-report and interviewer measures to examine affective distress in HD.

From the College of Medicine, Biological Sciences and Psychology, University of Leicester, Leicester, UK (JM, MD, MU); the Leicestershire Partnership NHS Trust, Leicester, UK (MD); the Birmingham and Solihull Mental Health Foundation Trust, Birmingham, UK (HR); and Cardiff University, Cardiff, UK (JC).
Send correspondence to Maria Dale; e-mail:

The authors report no financial relationships with commercial interests.

References

1 Dale M, van Duijn E: Anxiety in Huntington’s disease. J Neuropsychiatry Clin Neurosci 2015; 27:262–271LinkGoogle Scholar

2 Julien CL, Thompson JC, Wild S, et al.: Psychiatric disorders in preclinical Huntington’s disease. J Neurol Neurosurg Psychiatry 2007; 78:939–943Crossref, MedlineGoogle Scholar

3 van Duijn E, Craufurd D, Hubers AA, et al.: European Huntington’s Disease Network Behavioural Phenotype Working Group: Neuropsychiatric symptoms in a European Huntington’s disease cohort (REGISTRY). J Neurol Neurosurg Psychiatry 2014; 85:1411–1418Crossref, MedlineGoogle Scholar

4 De Souza J, Jones LA, Rickards H: Validation of self-report depression rating scales in Huntington’s disease. Mov Disord 2010; 25:91–96Crossref, MedlineGoogle Scholar

5 Stuart AL, Pasco JA, Jacka FN, et al.: Comparison of self-report and structured clinical interview in the identification of depression. Compr Psychiatry 2014; 55:866–869Crossref, MedlineGoogle Scholar

6 Hoth KF, Paulsen JS, Moser DJ, et al.: Patients with Huntington’s disease have impaired awareness of cognitive, emotional, and functional abilities. J Clin Exp Neuropsychol 2007; 29:365–376Crossref, MedlineGoogle Scholar

7 Zigmond AS, Snaith RP: The hospital anxiety and depression scale. Acta Psychiatr Scand 1983; 67:361–370Crossref, MedlineGoogle Scholar

8 Callaghan J, Stopford C, Arran N, et al.: Reliability and factor structure of the Short Problem Behaviors Assessment for Huntington’s disease (PBA-s) in the TRACK-HD and REGISTRY studies. J Neuropsychiatry Clin Neurosci 2015; 27:59–64LinkGoogle Scholar

9 Craufurd D, Thompson JC, Snowden JS: Behavioral changes in Huntington disease. Neuropsychiatry Neuropsychol Behav Neurol 2001; 14:219–226MedlineGoogle Scholar

10 Huntington Study Group: United Huntington’s disease rating scale: reliability and consistency. Mov Disord 1996; 11:36–42Google Scholar

11 Norton S, Cosco T, Doyle F, et al.: The Hospital Anxiety and Depression Scale: a meta confirmatory factor analysis. J Psychosom Res 2013; 74:74–81Crossref, MedlineGoogle Scholar

12 MacCallum R: Specification searches in covariance structure modelling. Psychol Bull 1986; 100:107–120CrossrefGoogle Scholar