The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×

Abstract

Neurological soft signs (NSSs) tap into a variety of perceptual, motor, and cognitive functions. The authors administered a battery of NSSs serially to a group of 14 pilot patients recruited from an emergency room after they experienced a mild traumatic brain injury. Patients were seen within 96 hours after injury, and again 30 and 90 days later. Measures of balance, mood, and postconcussive symptoms and impairment were also obtained. NSSs and balance improved across visits. Across visits, NSSs and balance were not significantly associated with any postconcussive outcome measures, although depressive symptoms were. Initial neurological impairment appeared to predict subsequent residual postconcussive symptoms and impairment, but this result requires replication.

Mild traumatic brain injury (mTBI) resulting from physical forces applied to the head or neck is a common condition. Although most patients recover without the benefit of medical intervention over the course of days to weeks, a subset of individuals exhibit a persistent postconcussive syndrome (PCS), with reported functional incapacity.1,2 In the civilian population, the incidence of all-cause TBI has been estimated at 1.7 million new cases annually in the US,3with about two-thirds in the mild range.4 In military combatants, mTBI has been reported in an estimated 237,000 service members during the years 2000–2013.5 Failure to detect, monitor, and/or treat at-risk patients increases the likelihood of long-term morbidity,6 whereas treating patients who are destined to recover on their own wastes clinical and financial resources. Misidentifying recovered mTBI patients as still impaired also expends resources, unnecessarily curtails activities, risks iatrogenic effects, and may lead to unwarranted compensation seeking.7 Silverberg and Iverson have concluded that the literature does not support more than 3 days of enforced total rest following acute mTBI, and that a longer period of inactivity may be associated with adverse outcomes.8 In contrast, Brown et al. noted positive associations among self-reported levels of cognitive activity, postconcussive symptom scores, and time to recovery.9

Presently available means for assessing prognosis after mTBI are inadequate. Postconcussive symptoms comprise an indistinct pool of mostly subjective, somatic, emotional, and cognitive manifestations (e.g., headache, irritability, poor concentration), with individual differences in symptom profiles across patients.2 Some mTBI symptoms overlap with those seen in other conditions such as depression10 and fibromyalgia.11 Factors such as sleep duration can impact performance and thus influence perception of deficits.12 Patients’ self-reports can be confounded by both under- and over-reporting biases.13

The traditional neurological examination is typically unrevealing in mTBI.14 Standardized neuropsychological instruments have been unsuccessful either in defining a consistent pattern of deficits associated with mTBI, or in predicting a given individual's trajectory of recovery and ultimate functional outcome.15,16

Neurological soft signs (NSSs) are objective performance measures of sensorimotor, reflexive, perceptual, and cognitive capabilities. Impaired execution yields subtle indicators of brain dysfunction. Examination of NSSs entails low-tech, inexpensive, relatively brief, and readily administered clinical maneuvers. NSSs have been found to be elevated in a variety of mental disorders, with more than 100 studies of NSSs in the psychiatric literature. Our group has examined the incidence of NSSs among various groups of post-traumatic stress disorder (PTSD) patients.1720 Three of these four studies found a small but consistent elevation in NSSs among PTSD survivors.

In contrast, there have been almost no studies of NSSs in TBI or PCS. One study demonstrated that an NSS examination administered to an acquired brain injury population could be reliably rated by even nonexpert clinicians. The authors concluded from their findings that, “a standardized battery of tests for assessing neurologic soft signs could be a useful adjunct in determining impairment in acquired brain injury patients.”21 Several studies have incorporated solitary or isolated elements of an NSS battery, with promising results. One such study reported that impaired tandem gait was increased almost threefold in patients with a history of mTBI.6 Other studies have found postconcussive impairments in balance.2225 Additional isolated abnormal soft signs found to be present in mTBI include occulomotor and visuomotor tracking dysfunction,26 dysdiadochokinesia,27 and bradykinesia.28

The aim of the present research was to measure NSSs in the acute aftermath of an mTBI and evaluate their ability to track recovery of function and to predict subsequent postconcussive symptoms. A clinical examination battery comprised of 45 NSSs was administered to a small sample of mTBI patients in the days following injury and again at 1 and 3 months postinjury. The following hypotheses were tested: 1) NSSs would be elevated at Visit 1 and trend downward at Visit 2 and Visit 3 as patients recovered; 2) at each visit, NSSs would be positively associated with self-reported postconcussive symptoms; 3) Visit 1 NSSs would predict a) Visits 2 and 3 postconcussive symptoms, b) Visits 2 and 3 self-reported functional impairment, and c) Visit 3 objective impairment on neuropsychological testing. We also included another soft neurological measure, the Modified Balance Error Scoring System (BESS) because it has previously been found to be associated with postconcussive symptoms.29 Because of evidence that the consequences of mTBI are potentially explained by depression,30 we also included measurements of this affective dimension using a validated self-report instrument.

Methods

Patients

All patients were recruited according to a Spaulding Rehabilitation Hospital Institutional Review Board-approved research protocol. Study candidates were drawn from patients presenting with an acute mTBI to the Massachusetts General Hospital Emergency Department (ED), screened by a dedicated ED-based research team, and formally recruited in a subsequent telephone conversation initiated by the first author. At the initial visit, which was mandated to take place within 96 hours of injury occurrence, patients were provided with a full explanation of study procedures and the potential risks and benefits of participation. Written informed consent was obtained using an Institutional Review Board-approved form. Inclusion criteria were the occurrence within the past 96 hours of an mTBI as defined by the Defense and Veterans Brain Injury Center (DVBIC) Conference on the Acute Management of Concussion/Mild Traumatic Brain Injury (mTBI) in the Deployed Setting,5 viz., “Anyone who was dazed, confused, ‘saw stars,’ lost consciousness even momentarily, or ha[d] memory loss as a result of an explosion/blast, fall, motor vehicle crash, or other event involving abrupt head movement, a direct blow to the head or other head injury.”

Any patient with a TBI that was more than mild, as evidenced by skull fracture, reconstructed Glasgow Coma Scale score <13, loss of consciousness >30 minutes, or posttraumatic amnesia >24 hours, was excluded. Additional exclusion criteria were any of the following: age <18 or >65 years; left or mixed handedness; localizable abnormality on neurological examination; structural brain lesion on imaging; hospitalization >1 day; surgical intervention; history of serious neurological condition; current major depressive or dysthymic disorder; current or past psychotic, bipolar, melancholic, substance dependence or abuse disorder, or mental disorder due to a general medical condition; use within the month prior to enrollment of psychoactive medications; a urine specimen containing drugs of abuse; a physical injury or condition that prevented examination of one or more of the 45 NSSs in the battery (e.g., prosthetic limb or paraplegia); or inability to understand the study's procedures, risks, and side effects or to otherwise give informed consent for participation.

Out of a total of 99 patients contacted by telephone following their ED visit, 78 refused to be consented. Obtaining the reason for refusal, or demographic or clinical data, from these individuals was not covered under the Institutional Review Board authorization and, hence, was not carried out. Of the 21 consented subjects, two failed the toxic screen (tetrahydrocannibinol, benzodiazepine); one was excluded for active alcohol dependence; three were excluded for current use of prescribed psychoactive medications for depressive disorder; and one was lost because of attrition. In the remaining 14 patients, mechanisms of injury included fall N=5, motor vehicle or bicycle accident N=3, head striking (other) object N=3, and (other) object striking head N=3.

Measures/Procedure

The primary predictive measure was a battery of 45 NSSs administered and scored according to a technique described in detail elsewhere in the literature.1820 This battery included measures of balance, gait, and somatosensory, visuospatial, simple, and complex motor function. A description of each NSS appears in Table S1 of the data supplement accompanying the online edition of this article. All NSS examinations were performed by the first author (M.S.G.), a senior neuropsychologist who had been trained by the NSS instrument’s creator (T.V.G.). The 1-hour NSS examinations were video-recorded in high definition by a research assistant. They were then encrypted and sent for scoring to a single expert rater (T.V.G.) who was blind to all other clinical information and measures. The NSS battery comprised 45 signs (NSS-45), each scored as 0 - no deficit, 1- mild deficit, 2 - moderate deficit, 3 - marked deficit. An average overall NSS (avgNSS-45) score was calculated by dividing the sum of the scores for all items by 45. This measure has been previously shown to have an inter-rater reliability of 0.74 (intraclass correlation coefficient) for two raters independently scoring blindly from videotapes.18 Because patients’ scores on the great majority of individual NSSs were below the level of mild deficit, we also selected the subset of 7 NSSs (NSS-7) for which the Visit 1 group mean was>1 (i.e., more than mild) for separate analyses (see under Results).

Visit 1 was conducted within 96 hours postinjury. It required approximately 150 minutes and consisted of obtaining informed consent, screening for exclusion criteria, and administration of the following: toxic urine screen; handedness determination (Edinburgh Handedness Inventory)31; Michigan Alcoholism Screening Test (MAST)32; TBI severity determination consisting of an inquiry regarding the circumstances of the injury, the extent of loss of consciousness, and a retrospective approximation of the Glasgow Coma Scale33in the immediate aftermath of the injury; clinical evaluation for current and past psychiatric illness applying DSM-IV-TR criteria; and medication use determination. If the patient passed the screening, the following study measures were then collected: NSS battery, Modified Balance Error Scoring System (BESS),29 Rivermead Post-Concussion Symptoms Questionnaire (RPQ),34 and Beck Depression Inventory (BDI-II).35

Visit 2 was undertaken approximately one month postinjury, required approximately 120 minutes, and repeated the NSS Examination, BESS, RPQ, and BDI-II. A functional adaptation survey, the Mayo-Portland Adaptability Inventory Index-Fourth Edition (MPAI-4),36 was also administered.

Visit 3 was undertaken approximately 3 months postinjury, required approximately 180 minutes, and repeated the NSS Examination, BESS, RPQ, BDI-II, and MPAI-4. In addition, a brief battery of neurocognitive performance measures was administered, consisting of the Trailmaking Test37; Symbol Digit Modalities Test38; California Verbal Learning Test II - Short Form39; Benton Visual Retention Test40; Weschler Memory Scale-Third Edition: Digit Span, Visual Memory Span, Mental Control41; Grooved Pegboard Test42; Wisconsin Card Sorting Test −64 Version43; Controlled Oral Word Association Test44; and Letter Cancellation Test.45 These neurocognitive measures were scored according to standards provided in their respective test manuals, correcting for age, gender, and education as appropriate, generating z-scores that reflected performance levels relative to population norms. To prevent any instrument from disproportionally contributing to overall level of impairment, each test was represented by one or at most two parameters. These z-scores were then averaged into an overall measure of neurocognitive impairment (NCI).

The key predictor variables were avgNSS-45, avgNSS-7, BESS, and BDI-II scores. The key predicted (outcome) variables were the RPQ, MPAI-4, and NCI.

Design

This study’s design was a prospective cohort pilot study in which a single clinical group (patients who had suffered an acute mTBI) was assessed repeatedly for 3 months following their injury.

Statistical Analysis

Data were analyzed according to a general linear mixed effects model (Statistical Analysis System PROC MIXED). There were no missing data. The VISIT variable was arbitrarily assigned a value of 1 (96 hours), 2 (30 days), or 3 (90 days). In order to obtain a measure of effect size, data were standardized prior to analysis, so that the estimates yielded by PROC MIXED represented standardized regression coefficients (β). The ability of the Visit 1 predictor measures to predict the Visits 1, 2, and 3 outcome measures was analyzed by means of Pearson product-moment correlations. Because the hypotheses were directional, one-tailed p values were calculated; significance levels are indicated with asterisks as follows: *p<0.10, **p<0.05, ***p<0.01, ****p<0.001.

Results

Patient Characteristics

Table 1 displays the sample’s demographic profile. Only 2/14 patients reported a discrete period of loss of consciousness related to their injury

TABLE 1. Group Demographic, Psychometric, and Neurological Soft Sign Means by Visita

CharacteristicVisit 1 (96 Hours)Visit 2 (30 Days)Visit 3 (90 Days)
Age (years)32.2 (11.5)
Educational level (grades completed)16.1 (1.8)
Gender6M, 8F
AvgNSS–45 (0–3)**0.5±0.00.4±0.00.4±0.0
AvgNSS–7 (0–3)****1.7±0.361.2±0.361.0±0.36
BESS (0–60)***20.1±10.116.9±5.416.4±7.2
BDI-II (0–63)****7.6±2.95.6±5.81.7±3.6
Rivermead Post-Concussion Symptoms Questionnaire (RPQ) (0–64)***19.6±7.27.7±10.13.7±6.1
Mayo-Portland (0–111)**14.1±13.36.1±9.7
NCI (z-score)0.15±0.54

aNumbers in parentheses indicate range of possible scores. Values shown=mean±SD. *p<0.10, **p<0.05, ***p<0.01, ****p<0.001; one-tailed.

TABLE 1. Group Demographic, Psychometric, and Neurological Soft Sign Means by Visita

Enlarge table

Neurological and affective markers of acute concussion and recovery.

Of the 45 individual NSSs, the group mean score was >1 for only seven NSSs. These included, in descending order: walking on heels (M=2.6), optic agnosia (M=2.1); astereognosis-left (M=2.1), astereognosis-right (M=1.6), Luria's motor sequence task (fist-palm-side)-right (M=1.4), Money Road-Map Test of Direction Sense task (M=1.4), and walking on tiptoes (M=1.1). The average of the scores on these seven items formed the avgNSS-7 measure.

Across visits, avgNSS-45 score was significantly associated with avgNSS-7 score: β=0.85****, and with BESS score: β=0.59****. Additionally, avgNSS-7 score was significantly associated with BESS score: β=0.43****. Neither avgNSS-45 score, avgNSS-7 score, nor BESS score was significantly associated with BDI-II score across visits.

Table 1 presents group mean scores for selected measures by Visit. It will be seen that group mean avgNSS-45, avgNSS-7, and BESS scores declined from Visit 1 to Visit 2 and tended to stabilize between Visits 2 and 3. Group mean BDI-II scores also showed a significant decline over visits, although the effect was more pronounced between Visits 2 and 3.

Neurological and affective associations with postconcussive symptoms and impairment

Across visits, avgNSS-45 score, was not significantly associated with either RPQ score, MPAI-4 score (Visits 2 and 3 only), or NCI score (Visit 3 only). Neither were avgNSS-7 score nor BESS score significantly associated with these latter measures. In contrast, BDI-II score was significantly associated with RPQ score: β=0.16*** and especially with MPAI-4 score: β=1.1****, but not with NCI score. At Visit 3, NCI score was also not significantly associated with RPQ or MPAI-4 score.

In order to control for the possibility that the association between depression and postconcussive symptoms was eclipsing associations between NSSs and the latter, we reperformed the above analyses entering BDI-II score as a covariate. Even after this adjustment, no significant associations emerged across visits between avgNSS-45, avgNSS-7, and BESS scores on the one hand, and RPQ, MPAI-4, and NCI scores on the other.

Subacute neurological and psychological predictors of chronic postconcussive symptoms and impairment.

Pearson product-moment correlations between various Visit 1 predictors and various Visit 1, 2, and 3 outcome measures appear in Table 2. It will be seen that although Visit 1 avgNSS-45 score initially did not significantly predict Visit 1 RPQ score, it went on to significantly predict Visit 2 and Visit 3 RPQ scores. Scatterplots for these associations appear in Figure 1. Visit 1 avgNSS-45 score also significantly predicted Visit 2 and Visit 3 MPAI-4 scores but not Visit 3 NCI score. Parallel but weaker results were obtained with Visit 1 avgNSS-7 score as predictor. Visit 1 BESS score only significantly predicted Visit 2 MPAI-4 score. Visit 1 BDI-II score only significantly predicted Visit 3 NCI score.

TABLE 2. Correlations Between Visit 1 Neurological and Affective Predictors and Visit 1, 2, and 3 Postconcussive Symptoms and Impairment Outcome Measuresa

Visit 1 Predictors (<96 hours)
Outcome MeasuresAvgNSS–45AvgNSS–7BESSBDI-II
Rivermead Post-Concussion Symptoms
Questionnaire
Visit 10.120.080.290.17
Visit 20.58**0.37*0.46*0.31
Visit 30.58**0.39*0.360.29
Mayo-Portland Adaptability Inventory
Index
Visit 20.53**0.360.53***0.44*
Visit 30.53**0.38*0.350.31
Neurocognitive Impairment
Visit 3–0.30–0.24–0.200.56*

aValues shown are Pearson product-moment correlations. *p<0.10, **p<0.05, ***p<0.01, ****p<0.001; one-tailed.

TABLE 2. Correlations Between Visit 1 Neurological and Affective Predictors and Visit 1, 2, and 3 Postconcussive Symptoms and Impairment Outcome Measuresa

Enlarge table
FIGURE 1.

FIGURE 1. Pearson (r) and Spearman (ρ) Correlations Between Average Score of the 45 Neurological Soft Signs at Visit 1 and Rivermead Post-Concussion Symptoms Questionnaire Score at Visits 1, 2, and 3a

a p values are one-tailed

Discussion

The high correlations between the NSS measures and scores on the Balance Error Scoring System suggest that to some degree these measured the same thing. However, the NSS examination goes far beyond balance to measure other aspects of subtle neurological dysfunction. Of the seven most elevated NSSs during Visit 1, only two involved balance (actually gait). The observation that the NSS and BESS scores were significantly higher when first measured within 96 hours of concussion than when reassessed at 1 and 3 months later supports our first hypothesis and suggests that these measures were sensitive to acute manifestations of mTBI. Although this normalizing trend over visits can be seen as validating their use in detecting acute mTBI-related dysfunction, the absence of a control group mandates caution in this interpretation; it is also possible that the reduction in impairment in this measure over time was due to regression to the mean or practice effects. The latter explanation was rendered less likely by the use of alternate forms for the NSSs for which the potential for practice effects was higher due to an obvious recall component, such as tongue twisters and astereognosis. Moreover, no diminution in NSS performance was observed between Visits 2 and 3.

Although as noted above, the NSSs and BESS measures may have been sensitive to mTBI and recovery, they were not sensitive to postconcussive symptoms or impairment, providing no support for our second hypothesis. These negative results echo previous failures to find hard neurological and neuroimaging abnormalities that are directly related to postconcussive symptoms.14,22 One potential explanation for the failure of subtle neurological impairment to explain postconcussive symptoms or impairment in this study is that the majority of our sample only suffered mTBIs that were at the low end of the severity spectrum, with only 2/14 having experienced any discrete loss of consciousness.

Despite the absence of association between the neurological and postconcussive measures across visits, the results provided some evidence supporting our third hypothesis, that subacute neurological compromise (at Visit 1) would predict subsequent postconcussive symptoms, and self-reported functional impairment (at Visits 2 and 3). Although the average Visit 1 score of the 45 NSSs and the initially highest seven NSSs did not predict Visit 1 total Rivermead Post Concussion Symptoms Questionnaire score, as scores on the latter declined across subsequent visits, the Visit 1 NSS scores came to significantly predict them, and the Mayo-Portland Adaptability Inventory Index scores as well, at Visits 2 and 3. These results suggest that initial neurological compromise, either pre-existing or acquired along with the mTBI, may negatively impact recovery from the subacute postconcussive symptoms and impairment that a majority of mTBI patients initially experience, and it may increase the likelihood of their eventually belonging to the subgroup with persistent postconcussive manifestations.

The reliability of the above inferences is reduced by the liberal threshold for statistical significance that was employed, including the use of a one-tailed p value, no Bonferroni-type corrections for multiple comparisons, and the post hoc identification of more severely affected NSSs at Visit 1. We deemed reduction of Type II error to be more important than containing Type I error in this pilot study. Hence, the predictive value of initial subacute neurological impairment for subsequent chronic postconcussive cognitive symptoms suggested in the results is in need of replication and cross-validation in a larger sample.

In contrast to the neurological measures, the presence of self-reported depressive symptoms following mTBI was significantly associated with postconcussive symptoms and functional impairment across visits. This finding comports well with the existing literature on the role of mood dysfunction in mTBI.10 The instrument used to assess depression in the present study, viz., the BDI-ll, was not designed to distinguish symptoms of idiopathic depression from those arising in the setting of brain injury. Moreover, the design of this pilot effort did not allow for the acquisition of pre-mTBI depression or other psychometric data. Thus, our results cannot resolve the origin of the comorbid depression found in this study, specifically whether depressive symptoms (short of a diagnosable depressive disorder, which was an exclusion criterion) represent: 1) a pre-existing risk factor for the development of postconcussive symptoms; 2) an acquired “organic” result of the mTBI, 3) a psychological consequence of having experienced a disturbing head injury, or 4) a combination of the foregoing.

The absence of associations between neurological variables and objective neurocognitive impairment (NCI) is consistent with the prevailing literature, which reports that group data on psychometric tests of cognition are not sensitive to the effects of mTBI following acute recovery.15,16 In contrast, the obtained association between the BDI-II and NCI is congruent with the studies that demonstrate an effect of both depressed mood46 and low effort47 on formal cognitive measures.

From the Dept. of Psychiatry, Massachusetts General Hospital, Boston, MA (MSG, NEW, JDS, RKP); Harvard Medical School, Boston, MA (MSG, JTN, RDZ, RKP); the Dept. of Physical Medicine and Rehabilitation, Massachusetts General Hospital, Boston MA (RDZ); the Dept. of Physical Medicine and Rehabilitation, Spaulding Rehabilitation Hospital, Boston, MA, (MSG, RDZ); and the Dept. of Emergency Medicine, Massachusetts General Hospital, Boston, MA, (JTN).
Send correspondence to Dr. Greenberg; e-mail: .

This work was directly supported by a grant from the United States Army Medical Research and Materiel Command (USAMRMC) Telemedicine and Technology Research Center (TATRC), #W81XWH-11-1-0408 (MSG and RKP). Co-author RDZ is also supported by: NIH/EKS-NICHD 1 R24 #HD065688; USDOE-NIDRR #H133A080035; USAMRAA #W81XWH-11-2-0210; USAMRMC #W81XWH-08-2-0159.

The authors report no financial relationships with commercial interests.

The authors thank Blair Alden Parry, C.C.R.C., B.A., and her team of emergency department recruiters; Judith Frazier, R.N., for scheduling subjects; Maulik Prohit, M.D., for referring subjects; and Lee Hang, Ph.D., for statistical advice.

References

1 Alexander MP: Mild traumatic brain injury: pathophysiology, natural history, and clinical management. Neurology 1995; 45:1253–1260Crossref, MedlineGoogle Scholar

2 Iverson GL: Outcome from mild traumatic brain injury. Curr Opin Psychiatry 2005; 18:301–317Crossref, MedlineGoogle Scholar

3 Faul M, Xu L, Wald MM, et al.: Traumatic Brain Injury in the United States: Emergency Department Visits, Hospitalizations and Deaths 2002-2006. Atlanta, GA, Centers for Disease Control and Prevention, National Center for Injury Prevention and Control, 2010CrossrefGoogle Scholar

4 Langlois JA: Traumatic Brain Injury in the United States: Emergency Department Visits, Hospitalizations, and Deaths. Atlanta, GA, Centers for Disease Control and Prevention, National Center for Injury Prevention and Control, 2006Google Scholar

5 Bazarian J, Boerman H, Bolenbacher R, et al: Defense and Veterans Brain Injury Center Consensus Conference on the Acute Management of Concussion/Mild Traumatic Brain Injury (mTBI) in the Deployed Setting. Washington, DC, July 31 and Aug 1, 2008Google Scholar

6 Vanderploeg RD, Curtiss G, Luis CA, et al.: Long-term morbidities following self-reported mild traumatic brain injury. J Clin Exp Neuropsychol 2007; 29:585–598Crossref, MedlineGoogle Scholar

7 Paniak C, Reynolds S, Toller-Lobe G, et al.: A longitudinal study of the relationship between financial compensation and symptoms after treated mild traumatic brain injury. J Clin Exp Neuropsychol 2002; 24:187–193Crossref, MedlineGoogle Scholar

8 Silverberg ND, Iverson GL: Is rest after concussion “the best medicine?”: recommendations for activity resumption following concussion in athletes, civilians, and military service members. J Head Trauma Rehabil 2013; 28:250–259Crossref, MedlineGoogle Scholar

9 Brown NJ, Mannix RC, O’Brien MJ, et al.: Effect of cognitive activity level on duration of post-concussion symptoms. Pediatrics 2014; 133:e299–e304Crossref, MedlineGoogle Scholar

10 Iverson GL: Misdiagnosis of the persistent postconcussion syndrome in patients with depression. Arch Clin Neuropsychol 2006; 21:303–310Crossref, MedlineGoogle Scholar

11. Aaron LA, Buchwald D: A review of the evidence for overlap among unexplained clinical conditions. Ann Intern Med 2001; 134:868–881Google Scholar

12 McClure DJ, Zuckerman SL, Kutscher SJ, et al.: Baseline neurocognitive testing in sports-related concussions: the importance of a prior night’s sleep. Am J Sports Med 2014; 42:472–478Crossref, MedlineGoogle Scholar

13 Savola O, Hillbom M: Early predictors of post-concussion symptoms in patients with mild head injury. Eur J Neurol 2003; 10:175–181Crossref, MedlineGoogle Scholar

14 Silva MA, Donnell AJ, Kim MS, et al.: Abnormal neurological exam findings in individuals with mild traumatic brain injury (mTBI) versus psychiatric and healthy controls. Clin Neuropsychol 2012; 26:1102–1116Crossref, MedlineGoogle Scholar

15 Randolph C, McCrea M, Barr WB: Is neuropsychological testing useful in the management of sport-related concussion? J Athl Train 2005; 40:139–152MedlineGoogle Scholar

16. Verfaellie M, Lafleche G, Spiro A, et al.: Neuropsychological outcomes in OEF/OIF veterans with self-report of blast exposure: associations with mental health, but not mTBI. Neuropsychology 2013; 28:337–346Google Scholar

17. Gurvits TV, Carson MA, Metzger L, et al. Absence of selected neurological soft signs in Vietnam nurse veterans with post-traumatic stress disorder. Psychiatry Res 2002; 110:81‒85Google Scholar

18 Gurvits TV, Gilbertson MW, Lasko NB, et al.: Neurologic soft signs in chronic posttraumatic stress disorder. Arch Gen Psychiatry 2000; 57:181–186Crossref, MedlineGoogle Scholar

19 Gurvits TV, Lasko NB, Schachter SC, et al.: Neurological status of Vietnam veterans with chronic posttraumatic stress disorder. J Neuropsychiatry Clin Neurosci 1993; 5:183–188LinkGoogle Scholar

20 Gurvits TV, Metzger LJ, Lasko NB, et al.: Subtle neurologic compromise as a vulnerability factor for combat-related posttraumatic stress disorder: results of a twin study. Arch Gen Psychiatry 2006; 63:571–576Crossref, MedlineGoogle Scholar

21 Masanic CA, Bayley MT: Interrater reliability of neurologic soft signs in an acquired brain injury population. Arch Phys Med Rehabil 1998; 79:811–815Crossref, MedlineGoogle Scholar

22. Davis GA, Iverson GL, Guskiewicz KM, et al.: Contributions of neuroimaging, balance testing, electrophysiology and blood markers to the assessment of sport-related concussion. Br J Sports Med 2009; 43(suppl 1):i36‒i45Google Scholar

23 Sheedy J, Geffen G, Donnelly J, et al.: Emergency department assessment of mild traumatic brain injury and prediction of post-concussion symptoms at one month post injury. J Clin Exp Neuropsychol 2006; 28:755–772Crossref, MedlineGoogle Scholar

24 Guskiewicz KM, McCrea M, Marshall SW, et al.: Cumulative effects associated with recurrent concussion in collegiate football players: the NCAA Concussion Study. JAMA 2003; 290:2549–2555Crossref, MedlineGoogle Scholar

25 Parker TM, Osternig LR, VAN Donkelaar P, et al.: Gait stability following concussion. Med Sci Sports Exerc 2006; 38:1032–1040Crossref, MedlineGoogle Scholar

26. Heitger MH, Jones RD, Macleod AD, et al.: Impaired eye movements in post-concussion syndrome indicate suboptimal brain function beyond the influence of depression, malingering or intellectual ability. Brain 2009; 132(pt 10): 2850–2870Google Scholar

27. DeBeaumont L, Theoret H, Mongeon D, et al.: Brain function decline in healthy retired athletes who sustained their last sports concussion in early adulthood. Brain 2009; 32(pt 3): 695–708Google Scholar

28 Gray C, Cantagallo A, Della Sala S, et al.: Bradykinesia and bradyphrenia revisited: patterns of subclinical deficit in motor speed and cognitive functioning in head-injured patients with good recovery. Brain Inj 1998; 12:429–441Crossref, MedlineGoogle Scholar

29 Guskiewicz KM, Ross SE, Marshall SW: Postural stability and neuropsychological deficits after concussion in collegiate athletes. J Athl Train 2001; 36:263–273MedlineGoogle Scholar

30. Hoge CW, McGurk D, Thomas JL, et al.: Mild traumatic brain injury in U.S. Soldiers returning from Iraq. N Engl J Med 2008; 358:453‒463Google Scholar

31 Oldfield RC: The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 1971; 9:97–113Crossref, MedlineGoogle Scholar

32 Selzer ML: The Michigan alcoholism screening test: the quest for a new diagnostic instrument. Am J Psychiatry 1971; 127:1653–1658Crossref, MedlineGoogle Scholar

33. Teasdale G, Jennett B: Assessment of coma and impaired consciousness: a practical scale. Lancet 1974; 304:81–84Google Scholar

34 King NS, Crawford S, Wenden FJ, et al.: The Rivermead Post Concussion Symptoms Questionnaire: a measure of symptoms commonly experienced after head injury and its reliability. J Neurol 1995; 242:587–592Crossref, MedlineGoogle Scholar

35 Beck AT, Steer RA, Ball R, et al.: Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients. J Pers Assess 1996; 67:588–597Crossref, MedlineGoogle Scholar

36 Bohac DL, Malec JF, Moessner AM: Factor analysis of the Mayo-Portland Adaptability Inventory: structure and validity. Brain Inj 1997; 11:469–482Crossref, MedlineGoogle Scholar

37 O’Donnell WE, Reynolds DM, De Soto CB: Neuropsychological impairment scale (NIS): initial validation study using trailmaking test (A & B) and WAIS digit symbol (scaled score) in a mixed grouping of psychiatric, neurological, and normal patients. J Clin Psychol 1983; 39:746–748Crossref, MedlineGoogle Scholar

38 Parmenter BA, Weinstock-Guttman B, Garg N, et al.: Screening for cognitive impairment in multiple sclerosis using the Symbol digit Modalities Test. Mult Scler 2007; 13:52–57Crossref, MedlineGoogle Scholar

39 Jacobs ML, Donders J: Criterion validity of the California Verbal Learning Test-Second Edition (CVLT-II) after traumatic brain injury. Arch Clin Neuropsychol 2007; 22:143–149Crossref, MedlineGoogle Scholar

40 Messinis L, Lyros E, Georgiou V, et al.: Benton Visual Retention Test performance in normal adults and acute stroke patients: demographic considerations, discriminant validity, and test-retest reliability. Clin Neuropsychol 2009; 23:962–977Crossref, MedlineGoogle Scholar

41 Dori GA, Chelune GJ: Education-stratified base-rate information on discrepancy scores within and between the Wechsler Adult Intelligence Scale—Third Edition and the Wechsler Memory Scale—Third Edition. Psychol Assess 2004; 16:146–154Crossref, MedlineGoogle Scholar

42 Ruff RM, Parker SB: Gender- and age-specific changes in motor speed and eye-hand coordination in adults: normative values for the Finger Tapping and Grooved Pegboard Tests. Percept Mot Skills 1993; 76:1219–1230Crossref, MedlineGoogle Scholar

43 Greve KW: The WCST-64: a standardized short-form of the Wisconsin Card Sorting Test. Clin Neuropsychol 2001; 15:228–234Crossref, MedlineGoogle Scholar

44 Iverson GL, Franzen MD, Lovell MR: Normative comparisons for the controlled oral word association test following acute traumatic brain injury. Clin Neuropsychol 1999; 13:437–441Crossref, MedlineGoogle Scholar

45 Mesulam MM: Verbal and Nonverbal Cancellation Tasks. Principles of Behavioral Neurology. Philadelphia, F.A. Davis, 1985Google Scholar

46 Snyder HR: Major depressive disorder is associated with broad impairments on neuropsychological measures of executive function: a meta-analysis and review. Psychol Bull 2013; 139:81–132Crossref, MedlineGoogle Scholar

47 Stulemeijer M, Andriessen TM, Brauer JM, et al.: Cognitive performance after mild traumatic brain injury: the impact of poor effort on test results and its relation to distress, personality and litigation. Brain Inj 2007; 21:309–318Crossref, MedlineGoogle Scholar