Concurrent Validity of the Behavior Rating Inventory of Executive Function in Children With Attention Deficit Hyperactivity Disorder

authors:

avatar Mojgan Zarrabi 1 , avatar Zahra Shahrivar 2 , * , avatar Mehdi Tehrani Doost 2 , avatar Mojgan Khademi 3 , avatar Ghazale Zargari Nejad 4

Department of Psychiatry, Roozbeh Hospital, Tehran University of Medical Sciences, Tehran, IR Iran
Department of Child and Adolescent Psychiatry, Roozbeh Hospital, Tehran University of Medical Sciences, Tehran, IR Iran
Department of Child and Adolescent Psychiatry, Shahid Beheshti University of Medical Sciences, Tehran, IR Iran
Institute for Cognitive Sciences Study, Tehran, IR Iran

how to cite: Zarrabi M, Shahrivar Z, Tehrani Doost M, Khademi M, Zargari Nejad G. Concurrent Validity of the Behavior Rating Inventory of Executive Function in Children With Attention Deficit Hyperactivity Disorder. Iran J Psychiatry Behav Sci. 2015;9(1): -. https://doi.org/10.17795/ijpbs213.

Abstract

Background:

Attention deficit hyperactivity disorder (ADHD) is a common psychiatric disorder in which impairment of executive functions plays an important role.

Objectives:

The main objective of this study was to assess the validity of the Behavior Rating Inventory of Executive Function (BRIEF) in children with ADHD.

Patients and Methods:

Thirty children, aged 7-12 years, attending the child and adolescent clinic of Roozbeh hospital and diagnosed with ADHD according to interview with a child and adolescent psychiatrist, formed our ADHD group. In contrast, thirty participants of the control group were selected from 7 to 12 year-old students according to Conners’ Teacher/Parent Rating Scale and did not have ADHD. The kiddie schedule for affective disorders and schizophrenia-present and lifetime version-Persian version was also completed for all children to rule out other psychiatric disorders. After oral consent, parents of 60 children (ADHD = 30, control = 30), completed three questionnaires of ADHD-Rating Scale-IV, Conners’ Parent Rating Scale-Revised: Short Version and BRIEF.

Results:

Children in ADHD group got higher scores than those in the control group in all subscales and indices of BRIEF (P < 0.001). There were also good correlations between subscales and indices of BRIEF and the two other rating scales (P < 0.001).

Conclusion:

BRIEF could be used as a valid tool to assess behavioral aspects of executive functions, especially to discriminate children with ADHD and normal ones.

1. Background

Executive functions (EFs) are referred to a group of cognitive abilities responsible for goal-directed activities. They inhibit inappropriate behaviors and help us to respond to new situations by shifting our mind quickly and easily from one subject to another. These functions are considered as important factors in cognitive development of children. In fact, they are the main part of all social and personal activities (1). Observing executive dysfunction in patients with brain damage has suggested the prefrontal lobe as the central part of the brain in management of executive functioning (1). Besides, presence of executive dysfunction in many psychiatric disorders such as attention deficit hyperactivity disorder (ADHD) has become an important field of research in child and adolescent psychiatry (2).

ADHD is a common psychiatric disorder characterized by hyperactivity, impulsivity and inattentiveness, inappropriate to child’s age. Children with ADHD can be easily distracted by any stimulus and cannot sustain their attention for a long period on a subject (3). ADHD is not a simple deficit in attention, but a developmental impairment in a broad spectrum of EFs, which needs to be assessed carefully (4). For many years, assessment of EF in children was based on psychiatric interview and behavioral scales and questionnaires, which were not designed specifically for children and could not capture all aspects of executive abilities (2, 5).

Although many neuropsychological tests were developed to assess EF using direct measures of attention, mental flexibility and inhibitory control that do not rely on parent report, they are usually expensive, time-consuming and need experienced professional work. Therefore Gioia et al. (6) designed the Behavior Rating Inventory of Executive Function (BRIEF) to evaluate EF in 5-18 year-old children. Through its behavioral aspects, BRIEF makes it easy to assess existence and quality of EFs by accomplishment of a pen and paper questionnaire. From the early appearance of BRIEF, many researchers tried to compare its reliability, validity and correlation with other standardized instruments in ADHD and other psychiatric impairments such as Tourette syndrome and autism spectrum disorder (4, 7, 8).

2. Objectives

According to their results, diagnostic groups got significant higher scores in all subscales of BRIEF than the normal group. This is the first study in Iran to assess the validity of BRIEF in a group of children with ADHD compared with normal children.

3. Patients and Methods

3.1. Participants

Thirty children aged 7 to 12 years referred to the child and adolescent psychiatry clinic at Roozbeh hospital in Tehran were recruited using the simple convenient sampling method. All the participants were diagnosed as having ADHD-combined type was diagnosed in all children by a board certified child and adolescent psychiatrist based on DSM-IV-TR criteria. They did not have any history of major psychiatric disorders such as oppositional defiant or conduct disorder. All of them were drug naïve as well. The control group included 30 volunteers selected randomly from students of two elementary schools in Tehran, a female school and a male school. The controls matched for their ages, genders and IQs (based on the scores of the Raven IQ test) with the ADHD group. They did not have any history of psychiatric disorders or referral to mental health services. According to the teacher and parents’ Conners’ rating scale, they did not have the diagnosis of ADHD.

3.2. Procedure

The study was explained for parents and written consents were obtained. It was also conducted with full approval of the Institutional Review Board (IRB). The Kiddie Schedule for Affective Disorders and Schizophrenia, Present and Lifetime version, Persian version (KSADS-PL-P), was performed for all participants by a fellow of child and adolescent psychiatry to evaluate other psychiatric disorders. The Raven Progressive Matrices test was performed to assess IQ in the two groups. To eliminate any bias, IQ tests were performed between 2-4 pm. Then parents filled three questionnaires for their children; the ADHD rating scale (ADHD-RS), the Conners’ parent rating scale revised-short version (CPRS) and the BRIEF Parent form.

3.3. Rating Scales

3.3.1. BRIEF

The BRIEF (6) is an 86-item questionnaire to assess the EFs in girls and boys of 5-18 years old. There are two rating forms; teacher and parent questionnaire. Parents with at least a fifth grade education can answer these questions easily. BRIEF assesses eight non-overlapping subscales, inhibition, shifting and emotional control that result in an index; Behavioral Regulation Index (BRI), and initiation, working memory, monitoring, planning/organizing and organization of materials which are combined to make Meta Cognition Index (MCI), and a total score; “Global Executive Composite” made by these two indices. The higher the score is, the more dysfunction exists. BRIEF is developed for a wide spectrum of children with developmental and acquired neurological disorders such as learning disabilities, ADHD, traumatic brain injury, low birth weight, Tourette syndrome and pervasive developmental disorder/autism. It also contains two validity subscales of negativity and inconsistency to detect bias associated with rating scales. BRIEF has gotten both convergent and divergent validity, as well as high internal consistency (α = 0.8-0.98) and the test-retest reliability which was 0.82 and 0.88 for parent and teacher forms, respectively. There were also moderate correlations between teacher and parent ratings (r = 0.32-0.34) (6).

3.3.2. ADHD Rating Scale IV (ADHD-RS-IV)-Home Version

The ADHD-RS-IV (9) is an 18-item questionnaire, developed specifically to screen ADHD children and adolescents between 5 and 18 years old. There are two questionnaires; home and school versions, which reveal child’s behavior over the past six months at home and school. It consists of two subscales; inattention (9 items) and hyperactivity/impulsivity (9 items). Thus, we would have three raw scores at the end; 1) inattention score, 2) hyperactivity/impulsivity score and a total score by adding them together.

The scale has acceptable levels of inter-rater reliability, test-retest reliability, internal consistency, convergent validity, discriminant validity and responsiveness (10). The psychometric properties of the Farsi version of ADHD-RS-IV has been reported by Ghanizadeh previously (11).

3.3.3. Conners’ Parent Rating Scale-Revised: Short Version (CPRS-RS)

The Revised Conners’ Rating Scale (12) has three types; parent, teacher and self-report. Each has a short and a long version. CPRS-RS contains 27 items, introducing four subscales; 1) oppositional subscale, 2) inattention/cognitive Problem, 3) hyperactive/impulsive and 4) ADHD Index. The items are based on DSM-IV criteria of ADHD, so it can be used to confirm the diagnosis of ADHD.

Psychometric properties of the revised scale appear adequate as demonstrated by good internal reliability coefficients, high test-retest reliability and effective discriminative power (13). Tehrani Doost et al. found that psychometric properties of the CPRS were good in an Iranian clinical population. They suggested that CPRS was a useful instrument to discriminate children with ADHD from typically developing individuals (14).

3.3.4. K-SADS-PL

The K-SADS-PL (15) is a semi-structured interview to assess psychiatric diagnosis in children and adolescents aged 6-18 years. It assesses present and lifetime status of psychiatric disorders as well as the severity of symptoms. The K-SADS-PL is introduced from K-SADS-P according to the fourth edition of DSM and is capable of generating 32 DSM-III-R and DSM-IV Axis I child and adolescent psychiatric disorders. Diagnoses are made as definite, probable (greater than or equal to 75% of symptoms criteria met) or not present. The K-SADS-PL has excellent inter-rater reliability and results comparable to semi-structured and fully structured child diagnostic interviews. The test-retest reliability kappa coefficients are in the excellent range for present and lifetime diagnosis of major psychiatric disorders (15). The Persian version of the K-SADS-PL (K-SADS-PL-P) has been validated by Shahrivar et al. (16) in Iran. Based on their study, specificities were more than 81% for all disorders and sensitivities for most major diagnosis were between 75% and 100%. The Kappa agreements for most diagnoses were higher than 0.4 and the test-retest reliabilities were between 0.38 and 0.87.

3.3.5. Raven’s Standard Progressive Matrices

The Raven’s Standard Progressive Matrices (SPM) is a standard measure for non-verbal intelligence and perceptual reasoning. It was used as the intelligence test to match the IQs of the two groups (17). SPM has been validated and standardized for 5-18-year old children and adolescents in Iran (18).

3.4. Statistical Analysis

Statistical analysis was performed using SPSS 15 (Softonic International, S.A.). The prevalence of subscales and indices were calculated by descriptive statistics. T-independent test was performed to compare the differences between two groups of variables. The Pearson correlation test was performed to find the correlation between the variables of the questionnaires.

4. Results

As can be seen in Table 1, thirty children in each group were enrolled (6 girls and 24 boys). The mean ages were 8.96 years (SD = 1.5) in ADHD group and 9.03 (SD = 1.4) in control group. The IQ means were 110.86 (SD = 10.77) and 115.33 (SD = 7.07) in ADHD and control groups, respectively. There were no significant differences between the two groups regarding their age, gender and IQ.

Table 1.

Demographic Characteristics of the Attention Deficit Hyperactivity Disorder and the Control Group a,b

DemographicsADHD (n = 30)Control (n = 30)Significancy
Gender1.000
Female66
Male2424
Age, y8.96 ± 1.559.03 ± 1.410.863
IQ110.86 ± 10.77115.33 ± 7.070.064

4.1. Group Comparison on BRIEF Subscales and Indices

The means of all eight subscales and two indices of BRIEF are summarized in Table 2. It shows significant differences between ADHD and control groups for all BRIEF subscales (P < 0.001).

Table 2.

Comparing Attention Deficit Hyperactivity Disorder and Control Groups Based on the Behavior Rating Inventory of Executive Function Scales a,b

BRIEF Subscales and IndexesADHD GroupControl GroupP Value
Inhibit22.90 ± 4.8512.20 ± 2.520.001
Shift15.17 ± 3.7210.47 ± 2.110.001
Emotional control22.27 ± 4.5114.43 ± 3.600.001
Initiate17.07 ± 3.2111.57 ± 2.770.001
Working memory22.37 ± 4.0813.60 ± 2.900.001
Plan/organize26.70 ± 4.3616.80 ± 3.190.001
Organization of materials14.00 ± 3.229.27 ± 2.870.001
Monitor19.23 ± 3.0512.43 ± 2.500.001
BRI59.50 ± 11.2037.10 ± 6.620.001
MCI98.40 ± 14.3763.67 ± 11.680.001
GEC157.90 ± 23.14100.77 ± 17.020.001

4.2. Group Comparison on ADHD-RS

As shown in Table 3, in both inattention and hyperactivity subscales, the differences between the two groups were significant.

Table 3.

Comparing Attention Deficit Hyperactivity Disorder and Control Groups Based on the Attention Deficit Hyperactivity Disorder-Rating Scale Results a,b

ADHD-RSADHDControlP Value
Inattention16.17 ± 5.333.13 ± 3.450.001
Hyperactive17.90 ± 5.763.30 ± 3.310.001
Total34.07 ± 10.446.43 ± 5.800.001

4.3. Group Comparison on CPRS-RS

Scores of all four subscales of CPRS-RS are listed in Table 4. Just like the two other questionnaires, the differences were significant between the two groups.

Table 4.

Comparing Attention Deficit Hyperactivity Disorder and Control Groups Based on the Conners’s Parent Rating Scale-Revised: Short (CPRS-RS) a,b

CPRS-RS SubscalesADHDControlP Value
ValueT ScoreValueT Score
Oppositional10.50 ± 4.4269.062.87 ± 2.2248.930.001
Inattention11.83 ± 4.1269.061.93 ± 2.3947.480.001
Hyperactive-Impulsive11.00 ± 4.5074.661.87 ± 1.9449.060.001
ADHD Index23.87 ± 6.8769.865.13 ± 4.0846.310.001

4.4. Correlations Between BRIEF and ADHD-RS-IV

Correlations between BRIEF and ADHD-RS are presented in Table 5. In ADHD group, most BRIEF variables were significantly correlated with ADHD-RS variables (P < 0.05). In both groups MCI was much more correlated with ADHD-RS Inattentive symptoms (r = 0.723 in ADHD group, r = 0.739 in control group) than with hyperactivity symptoms (r = 0.560 in ADHD group, r = 0.259 in control group). On the contrary, BRI was strongly correlated with ADHD-RS hyperactivity symptoms (r = 0.591 in ADHD group, r = 0.549 in control group) than with Inattentive symptoms (r = 0.437 in ADHD group, r = 0.548 in control group).

Table 5.

Correlations Between Behavior Rating Inventory of Executive Function scales and the Attention Deficit Hyperactivity Disorder-Rating Scale Subscales a

BRIEF Subscales and IndexesADHD Rating Scale IV
InattentionHyperactivityTotal
ADHDControlADHDControlADHDControl
Inhibit0.589 b0.503 c0.714 b0.468 c0.695 b0.566 c
Shift0.398 c0.374 c0.473 c0.1510.464 c0.308
Emotional control0.511 c0.457 c0.608 b0.621 b0.596 b0.626 b
Initiate0.462 c0.547 c0.2520.2830.375 c0.487 c
Working memory0.674 b0.624 b0.447 c0.1630.591 b0.464 c
Plan/organize0.644 b0.586 b0.492 c0.1190.600 b0.416 c
Organization of materials0.587 b0.681 b0.530 c0.0620.592 b0.440 c
Monitor0.397 c0.636 b0.2440.486 c0.3370.655 b
BRI0.437 c0.548 c0.591 b0.549 c0.549 c0.639 b
MCI0.723 b0.739 b0.560 c0.2590.678 b0.587 c
GEC0.660 b0.717 b0.633 b0.387 c0.687 b0.647 b

4.5. Correlations Between BRIEF and CPRS-RS

Correlations between BRIEF and CPRS-RS are shown in Table 6. In both groups, most BRIEF variables were correlated with CPRS variables significantly. As can be seen, similar to the pattern of Table 3, the BRIEF MCI was more correlated with CPRS-RS inattentive symptoms (r = 0.621 in ADHD group, r = 0.730 in control group) than hyperactivity symptoms (r = 0.560 in ADHD group, r = -0.021 in control group). Considering BRI, although it was strongly correlated with CPRS-R: S Oppositional symptoms (r = 0.778 in ADHD group, r = 0.523 in control group), there was a significant correlation between BRI and hyperactivity symptoms (r = 0.585 in ADHD group, r = 0.387 in control group).

Table 6.

Correlations Between Behavior Rating Inventory of Executive Function Scales and the Conners’ Parent Rating Scale Revised-Short Version Subscales and Index a

BRIEF Subscales and IndexesConners’ Parent Rating Scale
OppositionalInattentionHyperactivityADHD Index
ADHDControlADHDControlADHDControlADHDControl
Inhibit0.514 b0.441 b0.3400.3440.569 b0.2890.520 b0.291
Shift0.721 c0.1210.381 b0.423 b0.551 b0.0310.464 b0.509 b
Emotional control0.889 c0.608 c0.382 b0.1960.597 c0.512 b0.554 b0.435 b
Initiate0.3510.386 b0.570 b0.473 b0.2100.0810.585 c0.399 b
Working memory0.427 b0.0200.730 c0.745 c0.396 b-0.0660.716 c0.723 c
Plan/organize0.551 b0.1900.740 c0.758 c0.502 b-0.1620.652 c0.536 b
Organization of materials0.510 b0.1600.1400.464 b0.534 b-0.1280.507 b0.471 b
Monitor0.2790.2600.388 b0.546 b0.2600.2360.470 b0.645 c
BRI0.778 c0.523 b0.3310.367 b0.585 c0.387 b0.490 b0.503 b
MCI0.576 c0.2410.621 c0.730 c0.560 b-0.0210.701 c0.669 c
GEC0.717 c0.364 b0.546 b0.643 c0.631 c0.1320.673 c0.652 c

4.6. Age Effects

According to linear regression, BRIEF scores were not influenced by children’s age in any group (P > 0.05).

5. Discussion

This study was designed to evaluate the validity of parent rating of BRIEF in children with ADHD. Therefore, as the first step, we intentionally eliminated referees who had another disorder in addition to ADHD, since EDF can be observed in many psychiatric disorders. Our findings strongly indicated that BRIEF could differentiate children with ADHD from normal group; executive dysfunction of these children could be reflected on BRIEF questionnaire.

The parent ratings of BRIEF were significantly correlated with two other parents’ ratings, which are used to evaluate ADHD symptoms in children and adolescents. This finding supports the concurrent validity of the parent form of BRIEF, which has been reported by others (4, 19, 20). The patterns of correlation between BRIEF subscales and indices with CPRS and ADHD-RS suggest discriminative validity of the BRIEF rating to compare different types of ADHD. Working memory is theoretically based on attentional functioning, so the BRIEF working memory subscale is expected to be correlated with attention scales of other rating scales. Likewise, the BRIEF inhibit subscale should correlate with measures of externalizing behaviors. The results of our study showed that the BRIEF MCI, especially working memory has a high degree of correlation with ADHD-RS and CPRS inattention scales. Conversely, the BRIEF BRI particularly inhibition is strongly correlated with hyperactivity indices of the two other parent ratings. These results are consistent with the findings of multiple studies (4, 8, 21), although Sullivan and Riccio (22) suggested that the ability of BRIEF to distinguish ADHD and different clinical groups deserves further investigations.

The BRIEF considers behavioral patterns, which are compatible with ADHD symptoms, so it can be used to find the symptoms of basic behavioral dysregulation such as sustained attention and inhibition of competing responses. The items of BRIEF can help parents and teachers to better understand the nature of behavioral criteria of ADHD in their kids. Another finding of our study was lower mean scores of all subscales and indices of BRIEF in our control group than the normal children reported in the manual of BRIEF. It would be due to some methodological or probable cross-cultural differences and suggests further investigations.

Our study had some limitations. First, the small sample size and the narrow age range of the participants limit generalizability of the results. Secondly, we did not consider teachers’ ratings on ADHD symptoms, an informative pool of data, which could be quite helpful. Third, as all participants with ADHD had its combined type, we could not evaluate the validity of BRIEF to differentiate ADHD subtypes. In conclusion, the BRIEF can be considered as a valid tool to discriminate children with ADHD from typically developing children referred to psychiatric clinics.

Acknowledgements

References

  • 1.

    Anderson VA, Anderson P, Northam E, Jacobs R, Mikiewicz O. Relationships between cognitive and behavioral measures of executive function in children with brain disease. Child Neuropsychol. 2002;8(4):231-40. [PubMed ID: 12759820]. https://doi.org/10.1076/chin.8.4.231.13509.

  • 2.

    Gioia GA, Isquith PK, Guy SC, Kenworthy L. Behavior rating inventory of executive function. Child Neuropsychol. 2000;6(3):235-8. [PubMed ID: 11419452]. https://doi.org/10.1076/chin.6.3.235.3152.

  • 3.

    Rappley MD. Clinical practice. Attention deficit-hyperactivity disorder. N Engl J Med. 2005;352(2):165-73. [PubMed ID: 15647579]. https://doi.org/10.1056/NEJMcp032387.

  • 4.

    Mahone EM, Cirino PT, Cutting LE, Cerrone PM, Hagelthorn KM, Hiemenz JR, et al. Validity of the behavior rating inventory of executive function in children with ADHD and/or Tourette syndrome. Arch Clin Neuropsychol. 2002;17(7):643-62. [PubMed ID: 14591848].

  • 5.

    Donders J. The Behavior Rating Inventory of Executive Function: Introduction. Child Neuropsychol. 2002;8(4):229-30. https://doi.org/10.1076/chin.8.4.229.13508.

  • 6.

    Gioia GA. BRIEF: Behavior rating inventory of executive function: Professional manual. Odessa: Psychological Assessment Resources; 2000.

  • 7.

    Gilotty L, Kenworthy L, Sirian L, Black DO, Wagner AE. Adaptive skills and executive function in autism spectrum disorders. Child Neuropsychol. 2002;8(4):241-8. [PubMed ID: 12759821]. https://doi.org/10.1076/chin.8.4.241.13504.

  • 8.

    Qian Y, Wang YF. [Reliability and validity of behavior rating scale of executive function parent form for school age children in China]. Beijing Da Xue Xue Bao. 2007;39(3):277-83. [PubMed ID: 17572784].

  • 9.

    Dupaul GJ, Power TJ, Anastopoulos AD, Reid R. ADHD Rating Scale-IV Checklists, Norms, and Clinical Interpretation. New York: The Guilford Press; 1998.

  • 10.

    Faries DE, Yalcin I, Harder D, Heiligenstein JH. Validation of the ADHD Rating Scale as a clirlician administered and scored instrument. J Atten Disord. 2001;5(2):107-15. https://doi.org/10.1177/108705470100500204.

  • 11.

    Ghanizadeh A, Jafari P. Cultural structures of the Persian parents' ratings of ADHD. J Atten Disord. 2010;13(4):369-73. [PubMed ID: 19487578]. https://doi.org/10.1177/1087054709332421.

  • 12.

    Conners CK. Conners' Rating Scales-Revised Technical Manual. New York: Multihealth Systems; 1997.

  • 13.

    Conners CK, Sitarenios G, Parker JD, Epstein JN. The revised Conners' Parent Rating Scale (CPRS-R): factor structure, reliability, and criterion validity. J Abnorm Child Psychol. 1998;26(4):257-68. [PubMed ID: 9700518].

  • 14.

    Tehrani Doost M. The validity and reliability of the Conners's Parent Rating Scale-Revised in an Iranian sample. Tehran: Tehran University of Medical Sciences; 2011.

  • 15.

    Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, Moreci P, et al. Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): initial reliability and validity data. J Am Acad Child Adolesc Psychiatry. 1997;36(7):980-8. [PubMed ID: 9204677]. https://doi.org/10.1097/00004583-199707000-00021.

  • 16.

    Shahrivar Z, Kousha M, Moallemi S, Tehrani-Doost M, Alaghband-Rad J. The Reliability and Validity of Kiddie-Schedule for Affective Disorders and Schizophrenia - Present and Life-time Version - Persian Version. Child Adolesc Ment Health. 2010;15(2):97-102. https://doi.org/10.1111/j.1475-3588.2008.00518.x.

  • 17.

    Raven JC, Court JH, Raven J. Manual for Raven's standard progressive matrices. Oxford: The Oxford Psychologists Press; 1996.

  • 18.

    Baraheni MT. Preliminary research for normalizing Raven advanced matrices tests in Iran. J Psychol. 1972;2:205-21.

  • 19.

    Bussing R, Schuhmann E, Belin TR, Widawski M, Perwien AR. Diagnostic utility of two commonly used ADHD screening measures among special education students. J Am Acad Child Adolesc Psychiatry. 1998;37(1):74-82. [PubMed ID: 9444903]. https://doi.org/10.1097/00004583-199801000-00020.

  • 20.

    Schachar R, Sandberg S, Rutter M. Agreement between teachers' ratings and observations of hyperactivity, inattentiveness, and defiance. J Abnorm Child Psychol. 1986;14(2):331-45. [PubMed ID: 3722627].

  • 21.

    McCandless S, O' Laughlin L. The Clinical Utility of the Behavior Rating Inventory of Executive Function (BRIEF) in the diagnosis of ADHD. J Atten Disord. 2007;10(4):381-9. [PubMed ID: 17449837]. https://doi.org/10.1177/1087054706292115.

  • 22.

    Sullivan JR, Riccio CA. Diagnostic group differences in parent and teacher ratings on the BRIEF and Conners' Scales. J Atten Disord. 2007;11(3):398-406. [PubMed ID: 17932389]. https://doi.org/10.1177/1087054707299399.