Effects of Stimulants on the Continuous Performance Test (CPT)

In the past 10 to 20 years, there has been an increase in the use of pharmacological treatment, and particularly the use of stimulants, for a variety of disorders. This increase is at least in part due to the effectiveness of stimulant medications for individuals with attention-deficit/hyperactivity disorder (ADHD), as well as other disorders across the lifespan.¹ Among school-age children, this increase in the use of stimulant medication has been documented by a number of researchers.^2–5 As a result of the increased use of stimulant medication, the American Academy of Child and Adolescent Psychiatry⁶ advocated systematic monitoring of medication effects across behavioral domains for children and youth with ADHD. The same need for medication monitoring extends into adulthood if optimal functioning is the desired outcome.

Inattention or distractibility is a behavior that is often targeted for change with medication. Swanson⁷ identified six measures that were found to be appropriate for monitoring pharmacological effects in children. Swanson included objective laboratory measures of inattention as one type of information that can be used to monitor medication effects. The continuous performance test (CPT) is one group of paradigms for the evaluation of attention (and, to a lesser degree, impulsivity) that has been used for medication monitoring. The CPT is reported to be the most popular clinic-based measure of sustained attention and vigilance,⁸ and it has been described as the most sensitive measure for monitoring medication effects.^9,10 The basic paradigm of a CPT involves selective attention or vigilance for an infrequently occurring stimulus.¹¹ CPTs are generally characterized by rapid presentation of continuously changing stimuli among which there is a designated “target” stimulus or “target” pattern. The duration of the task varies, but the task is intended to be of sufficient length to measure sustained attention.

The usefulness of a CPT in monitoring medication effects,^12–14 as well as the effects of other treatments,¹⁵ has been researched. Some advantages and disadvantages of using a CPT to monitor the effects of medication are described by Bergman et al.¹⁶ One advantage to using a CPT is that CPTs are purported to have excellent face validity and appear to measure the ability of a person to concentrate on a single task for a certain length of time. Another advantage is that a CPT is an objective tool to gather quantifiable information on the improvement or deterioration of attention as a result of a particular treatment, in this case medication. CPTs also are inexpensive and easy to administer. Taken together, these advantages may explain the frequency with which a CPT is used as an objective measure of attention.¹⁶

The original CPT was developed in 1956 by Rosvold et al.¹⁷ to study vigilance. In the original CPT task, letters were presented visually one at a time, at a fixed rate, with 920 ms between presentations. The subject's task was to respond by pressing a lever whenever the letter X, designated as the target, appeared and to inhibit a response when any other letter appeared; this version can be referred to as the X-CPT. Rosvold et al. also introduced a variation of this task, the AX-CPT, in which the target was the letter X, but only if the X was immediately preceded by the letter A. Rosvold and colleagues found that the X-CPT correctly classified 84.2% to 89.5% of younger subjects with identified brain damage. Although the X-CPT had adequate classification accuracy, the classification accuracy improved with the more difficult AX-CPT.

Currently there are multiple variations in the components of the basic CPT task. For example, the target stimulus in the CPT may be a letter as in the original version, a number,¹⁸ a designated playing card,¹⁹ a picture of an object or person,²⁰ or a word.²¹ The task may be the simpler X-CPT, or an AX-CPT, or a further modification of the AX such that the target must be preceded by itself (XX-CPT).^22,23 Other versions may define the target such that color and letter are critical features (e.g., orange T followed by blue S,²⁴ or such that two digits in a number series (or letters in an alphabetic string) are the same in two consecutive stimuli sets (Identical Pairs or CPT:IP^25,26 ). Another modification involves a change in the response set such that the directions are to respond to all stimuli except the designated target (not-X-CPT) as in the Conners' CPT.²⁷ In general, the CPTs that use pictures of objects have been used more frequently with younger children or individuals of limited cognitive ability,²⁸ while the more difficult tasks involving repeated patterns, such as the CPT:IP, have been used predominantly with adults. In addition to changes in the target, presentation of the target differs; it may be visual, as in the original version of the CPT, it may be auditory,²¹ or it may use both auditory and visual stimuli within the same task.²⁹

The target type and criteria are not the only variations among CPTs. Studies have varied the frequency of the target,³⁰ the duration of the stimulus presentation,³¹ and the quality of the stimulus presented.^32,33 Further modifications include the addition of “distraction conditions.”^34,35 The time lapse between presentations of the stimuli (interstimulus interval; ISI) has been varied as well, some studies having used a shorter, longer, or variable interval.^36,37 In addition, the CPT can be designed so that subjects receive feedback on their performance following either correct responses, incorrect responses, or both.^38,39

Variables of interest in scoring the CPT have changed as well. When Rosvold and colleagues¹⁷ first introduced the CPT, the focus was on the number of correct hits as an indicator or index of attention. Since that time other variables have been used as measures of attention, including omission errors (the number of targets not responded to) and relative accuracy (the number of correct hits out of the total targets presented). In contrast, the number of commission errors (the number of responses to stimuli other than the target) is frequently reported as a measure of impulsivity. Sometimes, the reaction time (time elapsed between stimulus presentation and response) is reported along with the standard deviation of the reaction time. Alternatively, many researchers use the measures of sensitivity (d′) and bias (beta) based on signal detection theory in reporting CPT scores.^26,40 The signal detection indices may be more sensitive to differences in CPT performance than either omission or commission errors.⁴¹ Sensitivity is dependent on the intensity of the stimulus and the sensitivity of the subject; it is believed to reflect the ability of the individual to discriminate between the signal (or target stimulus) and irrelevant noise (or nontarget stimuli). Bias or response style is presumed to be related to the strategy used in making decisions on whether to respond or not. Bias is believed to reflect the extent to which the individual is likely to respond quickly (and hence increase the likelihood of errors) or to respond more conservatively. However, concerns have been raised by some as to the applicability of signal detection theory to CPT performance.^42,43

Since 1956, the CPT has continued to be used in the study of attention, as well as impulsivity, with consistent findings of sensitivity to dysfunction in the central nervous system.⁴⁴ With this sensitivity to dysfunction, and an understanding that stimulant medications act on the central nervous system via interactions with neurotransmitters or neuromodulators, it is logical to assume that CPTs would be sensitive to stimulant-related changes in brain function as they relate to attention. It is generally believed that the catecholamine neurotransmitters (e.g., dopamine, norepinephrine) are involved in both attention and inhibition.^45,46 The involvement of the dopaminergic system in children, adolescents, and adults with ADHD has been reviewed extensively,⁴⁷ and this system has been implicated in brain–behavior models of attention.^48–50

The extant meta-analyses have looked at research on specific effects of a single class of medication or of a single medication,^51,52 with the type or version of CPT used kept constant. The purpose of the present review was to provide a synthesis of the CPT research related to both prescribed stimulant medications and other stimulants, in order to determine the effects of stimulants in general on attention as measured by the CPT. A secondary goal was to determine the extent to which the type of stimulant used should be considered in interpretation of CPT results.

The sheer number of CPT versions is a major disadvantage when trying to synthesize the literature quantitatively (e.g., through meta-analysis). There is no research to date on the relative sensitivity of the various CPTs or score types. When possible, we computed effect sizes (ES) and examined ES for differing CPT types and score types. Score types examined included correct hits, omission errors, commission errors, reaction time, sensitivity (d′), and bias (lnB or beta), these being the types more frequently reported. In addition, some studies reported on the mean ISI (i.e., the adaptive rate) or standard deviation of the reaction time, as well as various other indices of variability. Because of the variations in how results were reported, as well as the differing parameters of the tasks, the synthesis provided will be more qualitative than quantitative in nature.

METHODS

The literature search included review of citations listed in PsycINFO (310 entries), MEDLINE (192 entries), and ERIC (13 entries) from 1966 through 1999, using “continuous performance test” as a search prompt. When overlapping entries were accounted for, the total number of original entries was 342. Several studies cited in the databases, however, were not available in English or were specific to animals and therefore were not included in this review. Dissertations were included; in the event a dissertation had been published, the publication (as opposed to the dissertation) was included. Additional references were generated from the review of the cited articles. In some cases, although the research reviewed included a vigilance task, it was determined that the task used was not a “continuous performance test.” Because of the vast numbers of vigilance tasks in general as well as the variety of CPTs available, only those studies that included a vigilance task that constituted a CPT were included. For this review, the defining characteristics of a CPT were based on paradigms from Rosvold et al.¹⁷ such that the task had to involve the presentation of constantly changing stimuli with some clearly defined “target” stimulus or pattern that occurred at a low frequency relative to the number of stimuli presented over the duration of the task. Paper-and-pencil vigilance tasks, even when referred to as a continuous performance test,⁵³ were not included. Of the identified articles, 77 were found to be empirical studies that included stimulant medications or other stimulants. These were then further limited to those studies that used a randomized, placebo-controlled design. As a result, only 45 studies were included in the final analysis.

Effect size (ES) was calculated when sufficient information was provided in an article reporting on an empirical study. ES values were computed to transform data to a common metric. When means and standard deviations were reported in a study, ES was calculated by dividing the difference between baseline scores (or placebo scores, if no baseline data were available) and medication scores by the standard deviation of the gain.⁵⁴ As neither pre/post correlations nor test-retest reliabilities were consistently available for the various CPTs used, the calculated ES values should be considered conservative estimates. When means and standard deviations were not available, the ES values were derived from inferential statistics (e.g., F-values), using the procedure set by Wolf.⁵⁵

RESULTS

Psychostimulants for ADHD

Psychostimulants or stimulant medications are the most frequently prescribed medications to address the behavioral complex of inattention, impulsivity, and hyperactivity associated with attention-deficit/hyperactivity disorder (ADHD) or attention deficit disorder (ADD). Psychostimulants are believed to act on the catecholaminergic system as they mimic the actions of dopamine and norepinephrine,⁵⁶ both of which are believed to be involved in attention processes.⁴⁹ The exact mechanisms by which psychostimulants bring about the changes in the catecholamines have not been determined as yet. It appears that dextroamphetamine, for example, increases the availability of norepinephrine, dopamine, or both, while it is believed that methylphenidate (MPH; Ritalin) has predominant effects on the dopaminergic system.⁵⁶ Prescribed psychostimulants generally include methylphenidate, pemoline (Cylert), dextroamphetamine (d-amphetamine; Dexedrine), methamphetamine (Desoxyn), and a combination of amphetamine and dextroamphetamine (Adderall).

Stimulants have been found to be effective medications for children with ADHD for more than 20 years.⁵⁷ Prescriptions for psychostimulants are becoming increasingly common; it is estimated that prescriptions increased by approximately 248% in the 1980s.⁵⁸ Safer and Krager^3,4 suggested, on the basis of their findings, that the number of children with ADHD who were treated with medication doubled every 4 to 7 years. Given that only 3% to 5% of the population is projected to have ADHD,⁵⁹ this increase in the prescription rate of psychostimulants, and methylphenidate in particular, has raised concerns.^60,61 Short-term improvements of attention and impulsivity with psychostimulants, shown on a variety of behavioral indices, are well established in the literature.⁶² Kavale⁵¹ performed a meta-analysis on 135 studies to examine the efficacy of stimulant drug treatment for ADHD on 5,300 children. To be included in his meta-analysis, a published study had to include a comparison group or condition (e.g., a placebo control). His study included MPH, dextroamphetamine, and pemoline. The conclusion Kavale reached was that treatment for hyperactivity with all major stimulant drugs, except caffeine, is effective. Attention and concentration, including speed, reaction time, and automatic functioning on simple tasks, were found to improve with stimulant medication, whereas the number of errors decreased with stimulant treatment. Moderate effect sizes were found on various measures of attention in Kavale's meta-analysis. For example, Porteus Mazes⁶³ were used in 16 studies with a mean ES of 0.54. For the continuous performance or vigilance tasks across 8 studies, the mean ES was 0.56.¹⁷ In fact, the results suggested an average 75% decrease in error scores and a 65% decline in reaction times on CPTs. These findings are comparable with other studies.^9,64–67

Of the 77 studies that addressed the effects of stimulant medications on CPT performance, 39 focused on methylphenidate. A summary of these findings by specific stimulant, as well as studies comparing the efficacy of stimulants and other medications, are presented below.

Methylphenidate

Methylphenidate is the most commonly used of the stimulant medications for the treatment of ADHD^68–70 and has been found to result in improved behavior for 80% to 85% of the ADHD population.⁶⁹ MPH has a short half-life (4 to 6 hours); therefore, it is commonly administered twice a day, once in the morning and once in the afternoon. A rebound effect may occur in the late afternoon or early evening, when the medication wears off in about one-third of the children with ADHD.⁵⁶ With this rebound effect, symptoms of ADHD become evident again as the child becomes more irritable and noncompliant. This could explain why teachers notice more improvements with the use of the drug and parents notice more of the side effects. Because of the short half-life and potential rebound effect, increasing the number of times medication is consumed from two to three times per day is being considered by some practitioners.⁷¹ For these same reasons (short half-life and potential rebound effect), there has been interest in developing stimulants that remain effective for longer periods of time. Slow-Release Ritalin (SR-20) is one such medication and is increasingly being prescribed.⁵⁷ For standard MPH, 0.3 mg/kg is the dose frequently prescribed; this dosage level has been found to be effective on both cognitive and behavior ratings, including CPT performance.⁶² Notably, attention, as measured by CPT performance, has been reported to improve with MPH not only in individuals with ADHD, but in control subjects as well.

Research suggests that MPH improves attention, impulse control, and possibly academic performance.⁷² For example, a meta-analysis by Losier et al.⁵² of studies using similar types of CPT tasks found that children with ADHD who were treated with MPH made significantly fewer commission and omission errors. Consistent with these findings, the majority of studies having randomized, placebo-controlled conditions that were included in this review indicated a reduction in both commission and omission errors with administration of MPH.^13,73–87 Some studies indicated that MPH resulted only in significantly decreased commission errors. For example, one study using adult volunteers found reduced commission error scores but no reduction in omission errors or reaction time improvements.⁸⁸ In other studies, involving children with ADHD, a main effect for MPH treatment was found only for omission errors. For example, using a visual X-CPT, Aman et al.⁸⁹ found significant improvements in omission error scores. Improvement in omission errors or correct responses on an AX-CPT was found for aggressive and nonaggressive children⁹⁰ and for children with ADD⁹¹ as well. Other researchers have found improved reaction time^23,84,91,92: when reaction time was included as a measure of CPT performance and doses of MPH ranged from 0.3mg/kg to 0.9mg/kg, effect sizes ranged from 0.02 to 1.21.

Although a majority of studies focus on correct responses, omission errors, commission errors, and reaction time, a handful of studies have evaluated the effects of MPH on CPT performance by using signal detection theory indices of sensitivity (d′) and bias (lnB). For the five studies that included indices of SDT, as well as correct hits, omission errors, or commission errors, d′ was fairly consistent with the direct performance measures. For example, effect sizes for the Klorman et al.⁴⁰ study were 0.41 for omission errors, 0.30 for commission errors, and 0.39 for d′. Interestingly, for the same study, dosage, and task parameters, the effects size of reaction (0.73) is not comparable, suggesting a greater impact on reaction time as opposed to other indices of performance and further suggesting that reaction time differences are not captured by d′. In a study by Solanto et al.,⁸³ the effect size for correct hits (0.64) and d′ (0.55) were also fairly consistent. As with correct hits, omission errors, and commission errors, studies reporting on CPT performance as reflected by d′ and lnB generally suggest improved performance with stimulant medications.

Not all studies with MPH showed benefits. A few studies found no significant drug effects for MPH on commission errors, omission errors, correct responses, or reaction time.⁹³ Handen et al.⁹⁴ found reduced errors scores with MPH, but the improvements in performance were not statistically significant. Aman et al.⁹⁵ found a ceiling effect on omission errors for the X-CPT used, and this resulted in no change being evident. Many studies that used the Gordon Diagnostic System (GDS)¹⁸ found significant drug effects when doses of approximately 0.3 mg/kg to 0.5 mg/kg were administered.⁹⁶ Thus, the medication level, as opposed to the task, may account for the lack of positive results. Consistent with the idea that “effectiveness” of the treatment is in fact being measured, Kupietz and Balka,⁹⁷ using the Test of Variables of Attention,⁹⁸ found significant improvements in performance for both the placebo and the MPH conditions, suggesting that some documented improvements may be due to the individual's belief that medication will improve attention.

The majority of research to date on MPH has focused on school-age children or youth. As yet, less is known about the impact of MPH on preschoolers. Musten et al.⁷⁹ used the GDS with preschoolers to investigate the usefulness of MPH (0.3mg/kg and 0.5mg/kg) with a preschool population as well. Results indicated omission scores on the GDS improved with MPH at both dosage levels (ES=0.26 and 0.33, respectively). It was concluded that MPH had the same effects with preschool and school aged children. With the focus on children and youth, there is a paucity of research with adults. Koelega⁹⁹ suggested that the lack of published material on the effects of MPH on CPT performance in adults may be due to a ceiling effect associated with some of the CPT measures used. Aman et al.'s⁹⁵ study of 12 normal adults with a mean age of 28.3 years found a decrease in commission errors with MPH, but no changes in reaction time or correct hits, possibly due to the ease of the task (i.e., a ceiling effect). Although available research on adults continues to be limited, preliminary findings are consistent with the majority of studies with children and youth, suggesting that MPH results in improved CPT performance.

Other Prescribed Psychostimulants

Although the majority of studies included MPH, it is not the only psychostimulant used in the treatment of attention problems. Others include dextroamphetamine (d-amphetamine; Dexedrine, slow-release Dexedrine spansule [DS]), and pemoline. Of these, dextroamphetamine is the second most frequently prescribed medication behind MPH for ADHD.⁶² Seven studies were found that examined the effects of the dextroamphetamines on CPT performance; however, no study using the CPT was found with the most recently developed dextroamphetamine saccharate/sulfate (Adderall).

The results for efficacy of dextroamphetamine as measured by the CPT are not consistent. Differences in age, clinical status, dosage levels, and CPT types may have resulted in the extreme differences in effect sizes found. Most studies using dextroamphetamine explored the effects on children with hyperactivity, ADHD, and ADD and on normal control subjects. Sostek et al.¹⁰⁰ and Wiengartner et al.¹³ found improvements in vigilance for both control subjects and children with hyperactivity. Conners⁷⁴ found improvements on both commission and omission errors with Dexedrine treatment. The research of Pelham et al.⁵⁷ using the slow-release form of dextroamphetamine (DS) indicated beneficial effects of DS on CPT performance for the X-CPT, but not the AX-CPT.

Pemoline is another of the psychostimulant drugs; only two studies were found that examined the impact of pemoline on attention, as measured by the CPT. This drug, like most stimulants, has been found to improve motor activity, fine motor coordination, and goal-directed behavior and to reduce impulsiveness and distractibility.¹⁰¹ Pemoline has a longer half-life than dextroamphetamine or MPH, which allows for only one dose to be administered per day.⁵⁷ Pemoline has been shown to have similar effects to MPH and SR-20 with children with ADHD at 56.25mg/day.⁵⁷ On the other hand, Conners and Taylor⁹³ found no significant effects on any CPT variable after administration of approximately 10 to 60 mg/day of pemoline. Thus, research related to the impact of pemoline on attention as measured by CPT performance is equivocal.

Other Stimulants

Additional substances included in the category of stimulants are caffeine and nicotine. Stimulants such as caffeine and nicotine are used daily in our society because they are thought to reduce fatigue and enhance concentration. There are mixed reports on caffeine as an effective stimulant. It is commonly believed that caffeine may decrease restlessness and fidgetiness, and increase sustained attention. Results with the CPT do not support these beliefs. One interesting finding was that when the effects of a number of stimulants were compared, only the difference between caffeine and methylphenidate was statistically significant, with minimal effect (ES=0.11) on CPT performance evidenced as a result of caffeine consumption.⁵¹ Similarly, minimal to no effects were found for commission or omission errors or reaction time after caffeine consumption for normal control groups.¹⁰² These results suggest that the impact of stimulants may depend not only on the CPT type, CPT index of performance used, stimulant type, and dosage, but also on the type of sample (clinical or control) included in the study.

The effects of nicotine exposure have been examined with the CPT as well. People who were exposed to nicotine in utero had higher rates of commission errors than the control group.¹⁰³ More direct evidence of the impact of nicotine is available from empirically controlled studies. In adult smokers, normal intake of nicotine decreased the variability of reaction time but was not statistically significant.¹⁰⁴ Using an adaptive-rate interstimulus interval (i.e., a condition in which the rate of presentation increased following a correct response), Levin et al.¹⁰⁴ found that for subjects who did not usually smoke and were exposed to nicotine only as part of the research protocol, mean ISIs were significantly reduced compared with results prior to exposure. Levin's group¹⁰⁵ found that low levels of nicotine (e.g., a 7-mg patch) resulted in decreased omission and commission errors for the control group. With a group of individuals with schizophrenia who were taking haloperidol (Haldol), Levin and colleagues¹⁰⁶ investigated the interaction of various doses of nicotine and haloperidol. At the lowest nicotine level of 7 mg, decreased omission errors and faster reaction times were found, but commission errors increased. In contrast, at the highest dosage (21-mg patch), there was a strong, positive effect on commission errors (ES=0.77), a minimal effect on omission errors (ES=0.15), and a marked decrease in reaction time (ES=–0.58). Based on these limited studies, it would appear that nicotine exposure in utero may result in increased commission errors, while direct nicotine exposure may result in decreased omission errors, commission errors, and reaction time.

Comparative Results Across Stimulants

A number of studies have compared the efficacy of the various stimulant medications on attention, as well as impulsivity, as measured by CPT performance. Based on Kavale's⁵¹ meta-analysis, the mean effect sizes for MPH, dextroamphetamine, pemoline, and amphetamine (Benzedrine) were all moderate, ranging from 0.44 to 0.63. When standard MPH and SR-20 were compared, results suggested that both drugs were effective and that there were no significant differences in CPT performance between medication treatments.^16,23,57 While SR-20 may be less effective in the afternoon than a second administration of MPH,¹⁶ results favored long-lasting stimulants for improvements in overall CPT performance.⁵⁷ Conners⁷⁴ compared the effects of MPH and dextroamphetamine treatment with children with minimal brain dysfunction and found that both drugs reduced the number of commission and omission errors as compared with the placebo condition. MPH was found to have slightly more positive effects than dextroamphetamine. Hagerman et al.¹⁴ compared MPH, dextroamphetamine, and placebo effects. Of the three conditions, only the MPH condition showed evidence of improved attention. Further, it was noted that MPH resulted in fewer reported side effects than dextroamphetamine.

Summary

Of the psychostimulants, MPH is the most studied. Of the MPH studies, the majority indicated improvement on some aspect of CPT performance; only five studies indicated no significant improvement. Results of studies using CPTs and psychostimulants are generally positive and suggest that, depending on the drug, the dosage, and the type of CPT used, improvement may be seen in attention, as evidenced by increased correct hits or decreased omission or commission errors. In a majority of studies, reaction time is decreased and less variable with stimulant medication. Additionally, stimulant medications generally resulted in decreased reaction times as well as decreased variability. Notably, research suggests that higher doses of stimulant medication are associated with improved performance only up to an optimal dosage, and then performance begins to decline.¹⁰⁷ That these changes in CPT performance reflect differences in CNS functioning is evident in associated changes in event-related potential, such that MPH resulted in increased amplitude of P3 as well as decreased latency of P3 to target stimuli.^23,77

DISCUSSION

Stimulant medications are frequently prescribed to address the behavioral symptoms associated with ADHD based on the belief that there is a neurological or neurochemical basis to attention problems. Psychostimulants have been found to improve CPT performance for both control subjects and clinical populations over the short term. Further research is needed on the effectiveness of the dextroamphetamines, particularly Adderall, as well as pemoline. Initial findings suggest that stimulants such as caffeine and nicotine do not affect overall CPT performance; however, because of the limited number of studies available and equivocal findings, it may be appropriate to control for (or consider) possible nicotine or caffeine effects when interpreting CPT results. It may be prudent for caffeine and nicotine intake be to controlled for as part of the standardization process for CPTs as well.

Additional research is needed with regard to the best CPT task parameters (score type, difficulty level, interstimulus interval) for appropriate evaluation of the effects of stimulant medications on attention. In some instances, significant pre/post-treatment differences were evident on one version of the CPT, but not others. Klorman et al.⁴⁰ found the XX-CPT to be more sensitive to changes in brain functioning that resulted from medication for a clinical sample of children. When auditory and visual AX-CPT were compared, the auditory CPT was found to be more sensitive to apparent improvement.⁸⁴ Other studies with an auditory version found improvements with stimulant medication or with placebo.⁹⁸ Further, significant dose-by-task interactions were evident in studies that used more than one type of CPT. Thus, interpretation of CPT performance may be a function not only of the medication, but of variations in the task that increase or decrease the sensitivity of the CPT to the changes in the CNS.

Score type appears to make a difference as well; omission errors appear to be more sensitive than commission errors to medication, but not appreciably so. Although reported less frequently, correct hits and reaction time appear to be sensitive to changes in brain function as a result of medication as well. Signal detection theory indices (d′, beta) were not reported with sufficient frequency to determine their relative sensitivity to changes produced by stimulants. Similarly, we were not often able to compute effect sizes for other indices of CPT performance or for variability of reaction time and performance over time, and therefore we cannot comment on the relative sensitivity of these indices. Notably, regardless of the type of score used, there is consistent evidence that stimulants can have mixed effects; some score types show positive and moderate effect size while others, in the same study, demonstrate negative or minimal effect size.^96,100,106 More research with various measures of CPT performance is needed to determine the most appropriate score type or index to be used in monitoring medication efficacy.

Presumably, medications are prescribed with the intent of improving one's functional ability. Negative impacts on attention can be detrimental to functioning and therefore need to be considered as an element of treatment monitoring. The American Academy of Child and Adolescent Psychiatry⁶ advocated the use of multiple methods for medication monitoring with children and youth (to include parent and teacher input) as well as adults with ADHD. Brown and Sawyer⁶² recommend that medication management be monitored over time as well. Although these concerns are specific to the monitoring of stimulant medication with children and youth, the same practice is needed with all medications for ADHD patients of all ages.

Direct observation of behavior in naturalistic settings would provide optimal monitoring information, but it is not always feasible. Reports of parents and teachers (or spouses, employers) can assist in monitoring; however, often there is a disparity of findings across raters, and obtaining this information over time can be intrusive in the workplace. As for laboratory measures, a vast number of neuropsychological measures can be used for the purpose of monitoring treatment effects on attention and executive control, so why use a CPT? The chief reasons are that a CPT provides a quick, relatively inexpensive, objective measure of the impact of medications on at least some components of attention, as well as their impact on processing speed (as measured by reaction time) and executive control.

Because there are some indications that stimulant medication may have a negative impact on some children,¹⁰⁸ additional research is needed to identify the characteristics of those individuals who demonstrate a positive response to stimulants. Given dose effects on CPT performance and the need to identify the optimal dosage for a given individual, a CPT may provide an objective measure of dose effectiveness over time. However, monitoring stimulant effects by using objective measures over the short term, and simply addressing any immediate and measurable difficulties with inattention or disinhibition, is not sufficient. Currently there are few controlled long-term outcome studies on the effects of stimulant medications.^1,109 Outcome studies of stimulant medication use that incorporate overall functioning across social, school or work, and community contexts over extensive periods of time are needed.

ACKNOWLEDGMENTS

This study was presented in part at the National Academy of Neuropsychology, Washington, DC, November 1998.