DMCA
Validity of DSM-IV ADHD 1 Validity of DSM-IV attention-deficit/hyperactivity disorder symptom dimensions and subtypes
BibTeX
@MISC{Willcutt_validityof,
author = {Erik G Willcutt and Joel T Nigg and Bruce F Pennington and Mary V Solanto and Luis A Rohde and Rosemary Tannock and Sandra K Loo and Caryn L Carlson and Keith Mcburnett and Benjamin B Lahey and Erik Willcutt},
title = {Validity of DSM-IV ADHD 1 Validity of DSM-IV attention-deficit/hyperactivity disorder symptom dimensions and subtypes},
year = {}
}
OpenURL
Abstract
ABSTRACT DSM-IV criteria for ADHD specify two dimensions of inattention and hyperactivity-impulsivity symptoms that are used to define three nominal subtypes: predominantly hyperactive-impulsive type (ADHD-H), predominantly inattentive type (ADHD-I), and combined type (ADHD-C). To aid decision-making for DSM-5 and other future diagnostic systems, a comprehensive literature review and meta-analysis of 546 studies was completed to evaluate the validity of the DSM-IV model of ADHD. Results indicated that DSM-IV criteria identify individuals with significant and persistent impairment in social, academic, occupational, and adaptive functioning when intelligence, demographic factors, and concurrent psychopathology are controlled. Available data overwhelmingly support the concurrent, predictive, and discriminant validity of the distinction between inattention and hyperactivity-impulsivity symptoms, and indicate that nearly all differences among the nominal subtypes are consistent with the relative levels of inattention and hyperactivity-impulsivity symptoms that define the subtypes. In contrast, the validity of the DSM-IV subtype model is compromised by weak evidence for the validity of ADHD-H after first grade, minimal support for the distinction between ADHD-I and ADHD-C in studies of etiological influences, academic and cognitive functioning, and treatment response, and the marked longitudinal instability of all three subtypes. Overall, it is concluded that the DSM-IV ADHD subtypes provide a convenient clinical shorthand to describe the functional and behavioral correlates of current levels of inattention and hyperactivity-impulsivity symptoms, but do not identify discrete subgroups with sufficient long-term stability to justify the classification of distinct forms of the disorder. Empirical support is stronger for an alternative model that would replace the subtypes with dimensional modifiers that reflect the number of inattention and hyperactivity-impulsivity symptoms at the time of assessment. Keywords: ADHD, DSM-IV, DSM-5, validity, subtypes, symptoms Validity of DSM-IV ADHD 3 Validity of DSM-IV Attention-Deficit/Hyperactivity Disorder dimensions and subtypes Despite over 30 years of research since subtypes of attention-deficit/hyperactivity disorder (ADHD) were first specified in the third edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-III; American Psychiatric Association, 1980), the optimal approach to describe heterogeneity among individuals with ADHD remains unclear. Diagnostic criteria for ADHD in the fourth edition of the DSM (DSM-IV; American Psychiatric Association, 1994) defined three nominal subtypes based on differential elevations on two dimensions of nine symptoms of inattention and nine symptoms of hyperactivity-impulsivity. The Predominantly Inattentive Type (ADHD-I) includes individuals with six or more symptoms of inattention and fewer than six symptoms of hyperactivity-impulsivity, the Predominantly Hyperactive-Impulsive Type (ADHD-H) includes individuals with six or more symptoms of hyperactivity-impulsivity and fewer than six symptoms of inattention, and the Combined Type (ADHD-C) is defined by six or more symptoms on both dimensions. This paper describes the results of a comprehensive literature review and meta-analysis that was conducted to critically evaluate the validity of the DSM-IV model of ADHD. We also review the much smaller group of studies that tested the validity of several alternative approaches to subtype classification, and conclude with recommendations for future diagnostic models of ADHD. Several factors suggest that a comprehensive review of the DSM-IV ADHD symptom dimensions and subtypes is needed to aid decision-making for DSM-5 and other future diagnostic systems: 1. The literature search for the present review identified over 450 relevant papers that were not included in previous systematic reviews of ADHD subtypes (e.g., 2. No previous empirical reviews have systematically evaluated whether the distinction between inattention and hyperactivity-impulsivity symptoms is internally and externally valid and should be retained in future diagnostic systems. 3. ADHD-H emerged unexpectedly for the first time as a result of the DSM-IV field trials , and the validity of this new subtype has never been comprehensively evaluated. 4. Previous reviews based on a small subset of the studies included in the current review reached different conclusions regarding the validity of the distinction between ADHD-C and ADHD-I. Several Validity of DSM-IV ADHD 4 authors concluded that ADHD-C and ADHD-I are valid subtypes within the overarching ADHD diagnosis (e.g., A final important overarching question is whether the nominal DSM-IV subtypes provide any unique information that is not conveyed by the differential elevations of the subtypes on the two symptom dimensions (e.g., Levels of analysis for the evaluation of the validity of a mental disorder The criteria which must be met for a mental disorder to be considered valid have been the focus of considerable debate in the literature. Because space constraints for the current paper preclude a comprehensive discussion, several benchmark papers that discuss these issues are listed in Section 3.1 of the online supplemental materials. These papers consider a range of important considerations, including the role of theory in the development of diagnostic criteria, the extent to which the definition of a mental disorder is influenced by social values, and the utility of a dimensional versus categorical conceptualization of mental disorders. For the current review we focus on the criteria for the validation of a mental disorder that were initially proposed by Robins and Guze (e.g., Robins & Guze, 1970) and later expanded for childhood disorders Internal validity and longitudinal stability Before testing the external validity of ADHD, the DSM-IV symptom dimensions and subtypes must be shown to have adequate internal and inter-rater reliability. In addition, because ADHD is defined as a chronic condition that is expected to be relatively stable across development (American Psychiatric Association, 1994), results regarding the short-term and long-term stability of the ADHD symptom dimensions and subtypes provide another key criterion to evaluate the validity of the DSM-IV model. Validity of DSM-IV ADHD 5 Criterion and predictive validity Concurrent and future functional impairment. Criterion validity refers to a significant association between a construct and an important independent external criterion Despite this caveat, previous studies provide important information regarding this essential criterion in several ways. A number of studies defined groups with ADHD based on DSM-IV symptom criteria only, then tested whether each symptom dimension or subtype was associated with significant functional impairment (e.g., Confounding factors. It is often unclear whether functional impairment or other external measures are associated with ADHD per se or with other factors that are often correlated with ADHD, such as lower intelligence, other concurrent disorders, and low socioeconomic status or other demographic variables. Therefore, some researchers argue that these variables should always be controlled in statistical analyses to ensure that impairment associated with ADHD cannot be explained more parsimoniously by group differences on these correlated variables (Lahey et al., 1998). Alternatively, it is possible that ADHD symptoms may directly cause group differences on measures such as tests of intelligence Validity of DSM-IV ADHD 6 Harrington, Discriminant validity Evidence regarding discriminant validity provides one of the most decisive tests of the validity of the DSM-IV model of ADHD. To justify their distinction, the DSM-IV dimensions and subtypes must be shown to have differential associations with important external variables such as measures of functional impairment, developmental course, etiological influences, pathophysiology, or treatment response. If the symptom dimensions and subtypes are associated with identical external correlates, it would be most parsimonious for future diagnostic criteria to collapse the symptom dimensions and subtypes to form a single disorder without subtypes. In contrast, if the external correlates of the dimensions or subtypes are completely different the subtypes may be best conceptualized as distinct and unrelated disorders. The most compelling support for the DSM-IV model would be provided by a more nuanced pattern in which some key correlates are shared across dimensions and subtypes, whereas other important criterion measures are uniquely associated with each symptom dimension and subtype. For example, the distinction between DSM-IV ADHD-C and ADHD-I would be validated if ADHD-C was more strongly associated with weak response inhibition, whereas ADHD-I was characterized by a more pronounced weakness in sustained attention. METHODS Due to space constraints, this section provides a brief overview of the review procedures, and a comprehensive description of the literature search and methodology of the meta-analysis is provided in section 1 of the online supplemental materials. Supplement section 1 includes specific information regarding the statistical power of the meta-analysis and the procedures that were used to test and correct for any significant publication bias or heterogeneity among the effects. Validity of DSM-IV ADHD 7 Literature search A comprehensive search of the relevant literature was completed to identify all published studies that included data relevant to the internal or external validity of the DSM-IV ADHD symptom dimensions or subtypes. Studies across the developmental spectrum were included in the review, but studies of children and adolescents were analyzed separately from studies of adults to evaluate potential developmental differences in the validity of the dimensions or subtypes. The literature search identified 546 papers based on 386 independent samples that met inclusion and exclusion criteria for the review. A meta-analysis was completed for each criterion measure if data were available from multiple studies that used designs and measures that were sufficiently similar to justify pooled analyses (e.g., reliability and developmental course of the dimensions and subtypes, functional impairment, comorbidity, and neuropsychological functioning). A formal meta-analysis was not completed for several other validity criteria because the specific methods of the available studies were not sufficiently similar to allow effects to be combined across studies (e.g., studies using electrophysiological and neuroimaging methods, studies of specific candidate gene polymorphisms, and treatment studies). Instead, a qualitative review of each of these domains is provided in the body of the manuscript, and a comprehensive list of studies of each criterion is included in section 3 of the supplemental materials. Presentation of results The results of the meta-analyses are summarized in Cohen's d RESULTS Internal validity, reliability, and symptom utility Factor analyses Exploratory and confirmatory factor analyses have been conducted on parent, teacher, and selfreport ratings of over 60,000 children and adolescents (Supplement Estimates of internal consistency are high for both symptom dimensions (mean α = .89 -.92 in studies of children and adolescents and .82 -.86 in studies of adults; Supplement Tables 3 and 4), and correlations between inattention and hyperactivity-impulsivity symptoms are moderate to high but less than unity (r = .63 -.75; Supplement Tables 3 and 4). These converging results suggest that DSM-IV inattention and hyperactivity-impulsivity are distinguishable but substantially correlated dimensions. Results were less clear when confirmatory factor analyses were conducted to test whether symptoms of impulsivity and hyperactivity should be separated. Some studies suggested that a three-factor model with separate impulsivity and hyperactivity factors provided a small but significant improvement in fit over the two-factor DSM-IV model (studies are listed in the notes for Supplement Discrimination from other disorders. Because ADHD frequently co-occurs with a range of internalizing and externalizing disorders, it is also essential to test whether the DSM-IV symptom dimensions are separable from symptoms of these correlated disorders. Item pools for several factor analyses included Validity of DSM-IV ADHD 9 symptoms of DSM-IV ADHD and symptoms of oppositional defiant disorder (ODD), conduct disorder (CD), or internalizing disorders (Supplement Symptom utility Although factor analyses provide strong support for the overall internal validity of the DSM-IV symptom dimensions, a closer examination of the psychometric characteristics of the individual items suggests that two inattention symptoms may have important weaknesses. The mean factor loading of inattention symptom c, does not seem to listen when spoken to directly, was weaker than the mean loading of any other inattention symptom in analyses of both parent and teacher ratings. In addition, this item cross-loaded on the hyperactivity-impulsivity factor in 73% of studies that reported secondary loadings (Supplement DSM-IV inattention symptom h, easily distracted by extraneous stimuli, also frequently cross-loaded on the hyperactivity-impulsivity factor, but additional research is needed to test whether this item may have greater utility in adults Inter-rater agreement Studies of children and adolescents reported moderate correlations between parent and teacher ratings of both symptom dimensions (r = .43 for inattention and .42 for hyperactivity-impulsivity; Supplement Low to moderate rates of inter-rater agreement are a nearly ubiquitous finding across all measures of psychopathology, indicating that this is a central issue for the field, and not a unique problem for ADHD (e.g., Based on these data, the DSM-IV field trials used an algorithm in which each symptom reported by either the parent or teacher during a structured interview was counted as a positive symptom , and the optimal symptoms and diagnostic thresholds for DSM-IV ADHD were determined based on this algorithm. Future research is needed to compare the validity of this procedure to other alternative algorithms for the combination of ratings by multiple informants, but this topic is beyond the scope of the current review. Conclusions regarding internal validity and reliability The distinction between inattention and hyperactivity-impulsivity symptoms is strongly supported by factor analytic studies, and both symptom dimensions are internally consistent. Inter-rater agreement is moderate for the symptom dimensions and low for the nominal subtypes, at least partially due to true differences in behavior across settings. Validity of DSM-IV ADHD 11 Temporal stability and developmental course Symptom dimensions Test-retest reliability was high for both symptom dimensions over periods less than one year (r = .78 -.82 in children and adolescents and .70 -.73 in adults; Supplement Although the rank order of individuals in the population remains stable, longitudinal studies suggest that inattention and hyperactivity-impulsivity symptoms follow different developmental trajectories. Over the first nine years of a prospective longitudinal study, children first diagnosed with DSM-IV ADHD in preschool exhibited a significant age-related decline in hyperactive-impulsive behaviors that was not related to pharmacologic or psychosocial treatment, whereas symptoms of inattention did not change significantly Subtypes To our knowledge no studies reported test-retest reliability estimates for the DSM-IV subtypes for periods less than one year, but five studies examined the stability of the subtypes 5 to 9 years after an initial assessment was completed Validity of DSM-IV ADHD 12 In addition to the unpredictable shifts between subtypes exhibited by some individuals with ADHD, longitudinal studies suggest that a subset of individuals shift systematically from ADHD-C to ADHD-I across development. Individuals with ADHD-C at the initial assessment were equally likely to meet criteria for ADHD-C or ADHD-I at the final follow-up assessment, whereas most individuals with ADHD-I at initial testing either continued to meet criteria for ADHD-I or no longer met criteria for any ADHD subtype Existing data suggest that ADHD-H is less stable than ADHD-C or ADHD-I, although samples are small in all studies Conclusions regarding developmental course and stability Both DSM-IV symptom dimensions have adequate stability over intervals up to five years, but hyperactivity-impulsivity symptoms decline more than inattention symptoms across development in both population-based samples and groups with ADHD. The overall diagnosis of DSM-IV ADHD has moderate stability over periods up to nine years, but the nominal subtypes are unstable in both systematic and unsystematic ways. Functional impairment Symptom dimensions Both DSM-IV ADHD symptom dimensions are significantly associated with global, social, academic, and adaptive impairment in children, adolescents, and adults The discriminant validity of the symptom dimensions is supported by significant differences in the relative magnitude of their associations with specific aspects of functional impairment. In comparison to hyperactivity-impulsivity symptoms, inattention symptoms are significantly more strongly associated with shy and passive social behavior and impaired adaptive functioning in children and adolescents, global impairment and lower life satisfaction in adults, and impaired academic functioning across the developmental spectrum Subtypes Groups of children and adolescents with ADHD-C, ADHD-I, and ADHD-H are more impaired than groups without ADHD on measures of nearly all domains of concurrent and future functional impairment (studies of concurrent impairment are summarized in Discriminant validity of the DSM-IV ADHD subtypes is supported by significant differences in specific aspects of functional impairment, most of which are consistent with the relative levels of inattention and hyperactivity-impulsivity symptoms that characterize the subtypes. Groups of children and adolescents with ADHD-C are significantly more impaired than groups with ADHD-I or ADHD-H on Validity of DSM-IV ADHD 14 aspects of functioning that are strongly associated with both symptom dimensions, such as global impairment, overall social functioning and prosocial behavior, and tendency to be disliked by peers Conclusions regarding functional impairment Symptoms of inattention and hyperactivity-impulsivity are associated with multiple aspects of concurrent and future functional impairment after an extensive list of confounds are controlled. Significant differences in the strength of the relations between the symptom dimensions and specific domains of impairment indicate that the distinction between inattention and hyperactivity-impulsivity has discriminant validity and is clinically important. Similarly, ADHD-C, ADHD-I, and preschool ADHD-H are clearly valid in the fundamental sense of being associated with concurrent and future functional impairment, although few studies have included adolescents with ADHD-H or adults with any of the subtypes. Distinctions among the DSM-IV subtypes convey clinically relevant information about functional impairment that is nearly all consistent with the relative levels of inattention and hyperactivity-impulsivity that define the subtypes. Comorbid Mental Disorders Symptom dimensions Inattention and hyperactivity-impulsivity symptoms are significantly associated with symptoms of all other disorders that were included in previous studies, but several of these associations differ in magnitude Subtypes Results of the meta-analysis indicated that in comparison to groups without ADHD, each DSM-IV ADHD subtype is associated with significant elevations of symptoms of all measured mental disorders and higher rates of most categorical diagnoses Conclusions regarding concurrent mental disorders Differential associations between inattention and hyperactivity-impulsivity symptoms and symptoms of other mental disorders provide additional support for the distinction between the DSM-IV symptom dimensions. Similarly, significant differences in rates of comorbid symptoms and disorders indicate that the subtypes convey clinically meaningful information that is consistent with the correlates of the two symptom dimensions. Validity of DSM-IV ADHD 16 Neurocognitive Correlates Neuropsychological studies Symptom dimensions. Both DSM-IV symptom dimensions are inversely correlated with all neuropsychological constructs that were included in the meta-analysis Scheres, Lee, & Sumiya, 2008). Subtypes. Comparisons among the subtypes on neuropsychological measures are consistent with the results for the symptom dimensions. Groups of children, adolescents, and adults with high levels of inattention (ADHD-C and ADHD-I) performed more poorly than comparison groups without ADHD on nearly all neuropsychological measures, and the only significant differences between these groups in the meta-analysis were slightly larger weaknesses in groups with ADHD-C than groups with ADHD-I on measures of response inhibition and response variability (g = 0.17 and 0.18; In contrast to the robust neuropsychological weaknesses that characterize ADHD-I and ADHD-C, differences between groups with ADHD-H and comparison groups without ADHD were smaller and less consistent in the meta-analysis. Studies of children and adolescents found that groups with ADHD-C and ADHD-I performed worse than groups with ADHD-H on measures of processing speed, vigilance, response variability, and multiple dimensions of executive functions. Only a handful of studies have included small samples of adults with ADHD-H, limiting the conclusions that can be drawn. Validity of DSM-IV ADHD 17 Electroencephalography and event-related potentials Studies using electrophysiological measures such as the electroencephalogram (EEG) and event-related potentials (ERPs) have reported robust differences between ADHD and comparison groups, and some have examined the DSM-IV symptom dimensions or subtypes (Supplement Section 3.4 lists these studies). When reported, EEG spectral power and coherence differences between ADHD subtypes were either not significant (e.g., Loo et al., 2010) Neuroimaging Symptom dimensions. Three structural magnetic resonance imaging (MRI) studies found that higher levels of hyperactivity-impulsivity symptoms were associated with smaller volumes of the ventral striatum, right amygdala, and lateral thalamus, brain regions that are involved in action selection and response to reward and punishment (Carmona et al., 2009; Frodl et al., 2010; Conclusions from neuropsychological, neurophysiological, and neuroimaging studies Neuropsychological studies provide strong support for the distinction between the inattention and hyperactivity-impulsivity symptom dimensions, and groups with ADHD-C and ADHD-I are significantly more impaired than groups with ADHD-H on a range of neuropsychological measures. In contrast, neuropsychological studies found few differences between ADHD-C and ADHD-I, and most EEG and ERP studies reported results consistent with a quantitative difference in severity between ADHD-C and ADHD-I. Initial neuroimaging studies have yielded intriguing results, but all studies were dramatically underpowered for subtype comparisons and all findings await independent replication. At present, a dearth of adequately powered brain imaging studies represents an important gap in the knowledge base regarding DSM-IV ADHD dimensions and subtypes. Etiology Family and twin studies Symptom dimensions. Family and twin studies indicate that individual differences in both inattention and hyperactivity-impulsivity are significantly familial and highly heritable, and common genetic influences explain most of the phenotypic covariance between the symptom dimensions (e.g., Subtypes. A meta-analysis of family studies showed a small but significant increase in subtype-specific familiality for ADHD-I and ADHD-C However, cotwins and siblings of probands with ADHD-I also exhibited significantly higher rates of ADHD-C than the biological relatives of control probands, suggesting that ADHD-I and ADHD-C are also due in part to shared familial influences. Validity of DSM-IV ADHD 19 Family members of probands with ADHD-H were significantly more likely to meet criteria for ADHD than expected by chance (34%), but more family members met criteria for ADHD-C (17%) or ADHD-I (9%) than ADHD-H (7%). Similarly, most twin studies found that ADHD-H was not significantly heritable, arguing against the validity of ADHD-H as a distinct etiological type. Molecular genetic studies Molecular genetic studies suggest that the etiology of ADHD is polygenic, with multiple genes that each account for a relatively small proportion of the total variance in ADHD symptoms in the population (e.g., Symptom dimensions. In studies that tested for associations between polymorphisms in 51 candidate genes and the DSM-IV ADHD symptom dimensions, at least one study reported nominally significant associations between 19 genes and inattention symptoms and between 20 genes and hyperactivity-impulsivity symptoms. For 17 of these genes at least one study reported a significant association with each symptom dimension, consistent with the finding that covariance between inattention and hyperactivity-impulsivity symptoms is due to common genetic influences. Subtypes. Candidate gene studies reported significant associations for 40 of 73 candidate genes tested for ADHD-C, 24 of 48 genes tested for ADHD-I, and 0 of 19 genes tested for ADHD-H. A subset of studies reported that a specific candidate gene was significantly associated with ADHD-C or ADHD-I, but not with the other subtype. However, no studies reported a significant difference in direct comparisons of ADHD-C and ADHD-I, and in many cases the effect of the candidate gene was in the same direction for both subtypes, but only one subtype crossed the threshold of statistical significance. This pattern is particularly important because most studies were dramatically underpowered, especially for ADHD-I. Candidate gene studies of ADHD-H must be interpreted even more cautiously due to small sample sizes in virtually all studies. Nonetheless, it is striking that no candidate gene study reported a significant association between ADHD-H and any polymorphism, a pattern that is consistent with the low heritability of Validity of DSM-IV ADHD 20 ADHD-H in twin studies. Similarly, both a meta-analysis of studies of a polymorphism in the dopamine D5 receptor gene Conclusions regarding familial and genetic influences Twin studies indicate that inattention and hyperactivity-impulsivity symptoms are highly heritable, and are due to both shared and unique genetic influences. Similarly, ADHD-I and ADHD-C are familial and highly heritable, and family, twin, and candidate gene studies suggest that these subtypes are due in part to shared etiological influences. In contrast, family, twin, and molecular genetic studies all suggest that genetic influences may be less important for ADHD-H than for ADHD-C and ADHD-I. Overall, molecular genetic studies of subtype distinctions remain sparse and underpowered, and additional research should be encouraged. Treatment Response Medication Symptom dimensions. Over 25 treatment studies have reported medication effects separately for the two symptom dimensions for atomoxetine, aripiprazole, guanfacine, methylphenidate, mixed amphetamine salts, modafinil, and reboxetine (studies are listed in Online Supplement Section 3.6). All of these studies reported significant reductions in both inattention and hyperactivity-impulsivity symptoms in response to treatment, with little evidence of differential efficacy for the symptom dimensions. conditions with systematic medication management only, multicomponent behavior therapy only, both medication management and behavior therapy, or a community control condition. The group that received behavior therapy only showed significant improvement in both inattention and hyperactivity-impulsivity symptoms after 14 months, and these gains were sustained at a follow-up assessment completed 96 months after the initiation of treatment (Molina et al., 2009). Similarly, a recent study reported that a working memory intervention led to a significant reduction in both inattention and hyperactivity-impulsivity symptoms Subtypes. Three controlled psychosocial treatment studies compared outcomes in groups of children and adolescents with ADHD-I and ADHD-C, and found that both groups showed significant improvement after social skills training Conclusions regarding treatment The construct validity of DSM-IV ADHD is supported by the significant response to intervention of the two symptom dimensions and both ADHD-C and ADHD-I. To date, treatment studies have provided little evidence of differential efficacy for the dimensions or subtypes, but additional data are needed before definitive conclusions can be drawn regarding ADHD-H. Evidence based on alternative definitions of ADHD subtypes To this point we have limited our remarks to studies of DSM-IV ADHD. Due to the mixed support for the distinction between ADHD-C and ADHD-I, several different approaches have been used in an attempt to identify an hypothesized inattentive group without significant hyperactivity that is more clearly distinct from ADHD-C. To provide a comprehensive summary of existing data regarding heterogeneity in ADHD, we briefly review these studies before summarizing the overall conclusions of the review. Latent class analysis As an alternative to the DSM-IV model, a number of studies have tested the validity of subtypes identified by latent class analyses of ADHD symptoms (studies listed in Online Supplement Section 3.7). These studies identified subgroups that are related to but partially distinct from those specified in DSM-IV, and some studies found that the LCA groupings may be somewhat more strongly familial than DSM-IV Validity of DSM-IV ADHD 22 subtypes Refined inattentive subgroup In their benchmark review, To test this hypothesis, several studies imposed a more stringent upper bound on the hyperactivity-impulsivity symptom dimension by requiring that individuals in a refined inattentive group exhibit no more than two or three hyperactivity-impulsivity symptoms (studies are listed in Online Supplement Section 3.8). These studies have reported potentially important success differentiating these refined inattentive subgroups from ADHD-C on a subset of measures of neuropsychological functioning. However, all studies had small samples, no specific finding has yet been replicated, and most studies found that the ADHD-C and refined inattentive groups exhibited similar weaknesses on a range of other neuropsychological measures. Overall, these initial data are not sufficient to validate this approach to identify a refined inattentive subgroup, but further research should be encouraged. Sluggish cognitive tempo DSM-IV diagnostic criteria use the same list of nine inattention symptoms to define both ADHD-I and ADHD-C, implying that the nature of the attentional difficulties that characterize the two subtypes is the same. In contrast, several authors hypothesized that ADHD-I might be uniquely associated with a Validity of DSM-IV ADHD 23 specific cluster of inattentive behaviors characterized by sluggish cognitive tempo (SCT; potential items are listed in Although SCT items and DSM-IV inattention symptoms are highly correlated (Supplement However, results of the meta-analysis indicate that groups with ADHD-C also exhibit significant elevations of SCT in comparison to groups without ADHD (Supplement Overall Conclusions Important gaps remain in the literature on DSM-IV ADHD, including limited data on ADHD-H in adolescents and on all subtypes and symptom dimensions in adults, small samples in studies of longitudinal stability, and the paucity of neuroimaging studies of ADHD subtypes. Nonetheless, the results of this review support several clear conclusions regarding the validity of the DSM-IV model of ADHD, along with additional conclusions that are necessarily more nuanced. Conclusion 1: DSM-IV criteria for ADHD identify individuals with significant functional impairment DSM-IV criteria for ADHD successfully identify children, adolescents, and adults with significant and persistent impairment in social, academic, occupational, and overall global and adaptive functioning when intelligence, demographic factors, and concurrent psychopathology are controlled, with the important exception that the validity of ADHD-H after preschool remains unclear. With that caveat, Validity of DSM-IV ADHD 24 existing data indicate that any revised diagnostic criteria for ADHD should continue to capture all individuals who meet criteria for DSM-IV ADHD. Conclusion 2: The DSM-IV inattention and hyperactivity-impulsivity symptom dimensions are valid Available data overwhelmingly support the concurrent, predictive, and discriminant validity of the distinction between inattention and hyperactivity-impulsivity symptoms. These results argue for the retention of separate inattention and hyperactivity-impulsivity symptom dimensions in the diagnostic criteria for ADHD, whether or not future diagnostic systems include nominal subtypes. Conclusion 3: Evidence is mixed regarding the discriminant validity of DSM-IV ADHD subtypes Subtype comparisons revealed quantitative differences between the three subtypes on measures of concurrent mental disorders and some aspects of functional impairment. The distinction between ADHD-H and the other two subtypes is also supported by results indicating that ADHD-H is less heritable and is associated with significantly less academic and cognitive impairment. On the other hand, ADHD-C and ADHD-I are associated with similar adaptive, academic, and neuropsychological impairment, are due at least in part to shared etiological influences, and appear to respond similarly to pharmacological and psychosocial interventions, calling into question the discriminant validity of these subtypes. Conclusion 4: Correlates of the nominal subtypes are consistent with the differential elevations of the subtypes on the two symptom dimensions With the exception of the higher rates of sluggish cognitive processing and shy and passive social behavior in ADHD-I than ADHD-C, the external correlates of the subtypes are almost entirely consistent with the relative levels of inattention and hyperactivity-impulsivity symptoms that characterize each subtype. These results suggest that the nominal subtypes may add relatively little unique information beyond that provided by the symptom dimensions. Conclusion 5: DSM-IV subtype classifications are unstable over time Emerging longitudinal data present the strongest challenge to the external validity of the nominal DSM-IV subtypes. Although a subset of children with each DSM-IV subtype continued to meet criteria for the same subtype five to nine years later (18 -41%), nearly as many met criteria for one of the other subtypes (10 -32%). Critically, some individuals with each subtype at the initial assessment met criteria for each of the other DSM-IV subtypes at least once during a 9-year follow-up study that included annual Validity of DSM-IV ADHD 25 assessments (e.g., Recommendations for future diagnostic systems The dilemma that is confronted for DSM-5 and other future diagnostic systems is simply stated. Diagnostic criteria for ADHD need to somehow describe the heterogeneity that clearly exists among individuals diagnosed with ADHD without reifying distinctions between symptom dimensions or subtypes that lack sufficient empirical support. Existing data provide no perfect solution to this dilemma, in part because diagnostic criteria must balance multiple considerations. For example, the optimal diagnostic model may differ depending on the relative importance assigned to the clinical utility and user-friendliness of the diagnostic criteria versus the strength of empirical support for the model. In this final section we briefly summarize the strengths and weaknesses of three potential options for future diagnostic criteria in the context of these considerations. Option #1: Retain the DSM-IV symptom dimensions and subtypes Advantages of this option are several. The DSM-IV model reflects the well-validated distinction between the inattention and hyperactivity-impulsivity symptom dimensions. Although most of the differences between the DSM-IV subtypes appear to be explained by the symptom dimensions, the nominal subtypes may be more user-friendly for clinicians and more easily understood by individuals with ADHD than diagnostic criteria based on symptom dimensions alone. The paucity of data comparing subtypes in key domains such as molecular genetics and neuroimaging could be used to argue that the elimination of subtypes is premature, and the retention of the DSM-IV subtype structure would encourage additional research on this specific model of heterogeneity. Despite these advantages, the DSM-IV subtype model has several important weaknesses. The results of this review suggest that nominal subtypes may not be necessary to describe heterogeneity in ADHD, and the retention of the DSM-IV model could tacitly discourage needed research to test Validity of DSM-IV ADHD 26 alternative approaches. Studies of etiological influences, academic and cognitive functioning, and treatment response provide minimal support for the distinction between ADHD-I and ADHD-C, and existing data call into question the validity of ADHD-H after early childhood. Finally, the strongest argument against the DSM-IV model is the marked instability of the subtype classifications over time (59% of all cases with ADHD continue to meet criteria for ADHD 5 years later, but only 35% meet criteria for the same subtype). These data provide little justification for the conceptualization of nominal subtypes of ADHD as stable, trait-like entities. If for practical reasons the decision is made to retain the DSM-IV subtypes in DSM-5 or other future diagnostic systems, it would be advisable to emphasize strongly that the subtypes are a description of the individual's current symptom presentation that is likely to change over time in both systematic and unsystematic ways. In addition, rather than continuing to include ADHD-H as a distinct subtype, a better option may be to eliminate ADHD-H while retaining a category of ADHD, Not Otherwise Specified. This revision would allow ADHD diagnostic criteria to continue to capture the subgroup of individuals that currently meet criteria for ADHD-H and experience significant functional impairment, while avoiding the reification of ADHD-H as a discrete subtype in the absence of sufficient data demonstrating its validity. Option #2: Create new nominal subtype classifications Earlier we reviewed several alternative approaches that have been proposed to describe heterogeneity in ADHD. These include subtype schemes generated by latent class analyses, the incorporation of new inattention symptoms characterized by sluggish cognitive processing, and the use of a more stringent definition of low hyperactivity-impulsivity to define a primarily inattentive group that is less contaminated by subthreshold cases of ADHD-C. Each of these approaches would provide a fresh start on subtypes and stimulate new research that could eventually lead to the discovery of new and potentially more valid subtype designations. However, the disadvantages of creating new nominal subtype definitions at this juncture are overwhelming. Although promising results have been reported in individual studies, systematic validity data do not exist for any specific alternative subtype scheme, and revisions to the current diagnostic criteria to create new subtypes would be premature. Nonetheless, continued research should be encouraged to test the validity of these and other alternative models. Validity of DSM-IV ADHD 27 Option #3: Single disorder with dimensional modifiers Finally, the results of this review and meta-analysis suggest that a dimensional approach to describe heterogeneity in ADHD also warrants consideration for DSM-5 and future diagnostic systems. For example, the model proposed by This dimensional model also has important potential drawbacks. Any changes to the current diagnostic criteria will complicate interpretation of previous research studies that were based on DSM-IV criteria, and the elimination of nominal subtypes could potentially lead clinicians and researchers to be less attentive to the heterogeneity that clearly exists among individuals with ADHD. Furthermore, a dimensional model may be more complex to communicate effectively between clinicians, patients with ADHD, and their families. To address these important concerns, one potential option would be to designate specific ranges on the two modifiers as mild / low (e.g., 0 -2 current symptoms), moderate / subthreshold (e.g., 3 -5 current symptoms), and high / severe (e.g., 6 or more current symptoms). As suggested for the DSM-IV model, a statement in the text could emphasize that these modifiers describe the individual's current state, and are likely to change over time. In addition to simplifying communication among professionals and individuals with ADHD, this hybrid model would provide a structured framework to encourage and facilitate additional research on the validity of configural subgroups. For example, the high/severe ranges on the dimensional specifiers identify groups consistent with the current DSM-IV subtypes, and the combination of the specifiers for mild / low hyperactivity-impulsivity and high / severe inattention is consistent with the criteria used to define the refined inattentive groups in the studies reviewed earlier. Limitations Validity of DSM-IV ADHD 28 Due to the extensive published literature of 546 studies relevant to the validity of the DSM-IV ADHD symptom dimensions and subtypes, unpublished studies were not included in the review. Statistical tests for publication and other selection biases suggest that the exclusion of unpublished studies and the unintentional omission of any published studies that were not identified by the search procedures had minimal impact on the overall pattern of results. Nonetheless, the results of the review should be interpreted in the context of this potential limitation. Despite the immense literature synthesized in this report, perhaps the most important limitation of the current review is the limited number of available studies in several important domains. Meta-analyses were underpowered for several key comparisons involving ADHD-H and nearly all analyses of ADHD subtypes in adults, indicating that these are preliminary results that should be interpreted with caution. Similarly, the existing literature on DSM-IV ADHD includes relatively few studies of preschool children, suggesting that the present results are most clearly generalizable to school-age children and adolescents. In contrast to comparisons involving ADHD-H, power was high for nearly all comparisons of DSM-IV ADHD-C and ADHD-I. However, few studies have compared ADHD-C and ADHD-I using electrophysiological or neuroimaging approaches that may be especially sensitive to subtype differences. Further, very few studies of any subtype reported results separately as a function of sex, age, ethnicity, rater, or comorbid mental disorders, limiting the power to detect effects of these potential moderator variables. Additional research is needed in each of these domains. Overall Summary and Conclusions The distinction between inattention and hyperactivity-impulsivity symptoms is strongly supported across nearly all level of analysis, and subtype differences on some measures of functional impairment and concurrent mental disorders provide support for the discriminant validity of the nominal DSM-IV subtypes. In contrast, the validity of the DSM-IV model is compromised by weak evidence for the validity of ADHD-H after first grade, minimal evidence for discriminant validity of ADHD-I and ADHD-C in studies of etiology, academic and cognitive functioning, and treatment response, and the marked longitudinal instability of all three subtypes. Overall, it is concluded that the DSM-IV ADHD subtypes may provide a convenient clinical shorthand to describe the functional and behavioral correlates of current levels of inattention and Validity of DSM-IV ADHD 29 hyperactivity-impulsivity symptoms, but do not identify discrete subgroups with sufficient long-term stability to justify the classification of distinct forms of the disorder. Instead, empirical support is strongest for a model that describes heterogeneity among individuals with ADHD by incorporating dimensional modifiers that reflect the number of inattention and hyperactivity-impulsivity symptoms at the time of assessment. Validity of DSM-IV ADHD 30