Abstract

Objective. To assess the effectiveness of peer inclusion in interventions to improve the social functioning of children with ADHD. Methods. We searched four electronic databases for randomized controlled trials and controlled quasi-experimental studies that investigated peer inclusion interventions alone or combined with pharmacological treatment. Data were collected from the included studies and methodologically assessed. Meta-analyses were conducted using a random-effects model. Results. Seventeen studies met eligibility criteria. Studies investigated interventions consisting of peer involvement and peer proximity; no study included peer mediation. Most included studies had an unclear or high risk of bias regarding inadequate reporting of randomization, blinding, and control for confounders. Meta-analyses indicated improvements in pre-post measures of social functioning for participants in peer-inclusive treatment groups. Peer inclusion was advantageous compared to treatment as usual. The benefits of peer inclusion over other therapies or medication only could not be determined. Using parents as raters for outcome measurement significantly mediated the intervention effect. Conclusions. The evidence to support or contest the efficacy of peer inclusion interventions for children with ADHD is lacking. Future studies need to reduce risks of bias, use appropriate sample sizes, and provide detailed results to investigate the efficacy of peer inclusion interventions for children with ADHD.

1. Introduction

Attention-Deficit Hyperactivity Disorder (ADHD) is the most prevalent neurobehavioural disorder affecting school-aged children [1]. Impaired social functioning is regarded as one of the core deficits for children with ADHD [2, 3]. Individuals with ADHD frequently present with deficits in the following executive function domains: problem solving, planning, flexibility, orienting, response inhibition, sustained attention, and working memory [4]. They also experience affective difficulties, such as motivation delay and mood dysregulation [4]. These difficulties appear to form the basis of the social skills problems in children with ADHD [5, 6].

Quality friendships are important for children’s development and serve as a protective factor for those at risk for current and future difficulties [7]. While having friends has been found to be developmentally advantageous throughout the lifespan [8], more than 50% of children with ADHD experience peer rejection from their classmates [3, 9]. Typically developing peers often describe children with ADHD as being annoying, boisterous, irritating, and intrusive [6]. Furthermore, the interpersonal relationships of children with ADHD are frequently characterised as being negative and conflicting [3, 10]. Children with ADHD are likely to have difficulties in establishing and maintaining satisfying interpersonal relationships as a result of difficulty with cooperative play with peers, perspective taking, responding to social cues, and self-regulation, placing them at higher risk of social isolation [11].

There is a large body of empirical research that demonstrates that children with ADHD experience pervasive social difficulties that can cause social maladjustment in adolescence and adulthood [3, 7, 12]. Impairments in social functioning can lead to school dropout, academic underachievement, low self-esteem, and troublesome interpersonal relationships with family members and peers [13]. As a result, children with ADHD are at greater risk of developing adverse problems in adolescence and adulthood, including anxiety, depression, aggression, and early substance abuse [3].

There is much debate surrounding the causes of social skills deficits in children with ADHD. Some researchers theorise that the social difficulties of children with ADHD are a result of having limited knowledge of age-appropriate social skills, proposing that the social skill deficits are caused by deficits in skill acquisition [3]. Other researchers have drawn from the well documented cognitive model of ADHD to explain the mechanisms underlying social skill deficits in children with ADHD [52]. In this conceptual model, Barkley [52] concluded that children with ADHD possess adequate social skills but fail to apply them in specific social situations; thus their social skills deficit is a result of a performance deficit.

Recent reviews conclude that performance deficits are the likely cause of social problems in children with ADHD [99, 100]. Children with ADHD appear to possess age-appropriate social skills; however they fail to apply this knowledge to functionally interact with others [101]. This lack of application of knowledge is likely due to a range of cognitive and affective difficulties, where children with ADHD may demonstrate disproportionate emotional reactions and decreased perspective taking and forethought, impacting their ability to apply the necessary skills during spontaneous social interactions with peers [52].

Several clinical practice guidelines, including those of the National Institute for Health and Clinical Excellence (NICE) in the United Kingdom, have concluded that nonpharmacological interventions are a necessary component when treating children with ADHD [102]. The effectiveness of using nonpharmacological interventions, such as parent training (PT), cognitive-behavioural therapy (CBT), social skills training (SST), school-based interventions, academic interventions, and multimodal treatment, has been reviewed for children and adolescents with ADHD [102104]. Although SST has been reviewed extensively, the core components of psychosocial treatment, such as the use of peers in the interventions aimed at improving social skills, have not been systematically investigated for children with ADHD.

Peers are commonly included in psychosocial interventions for children. Peer inclusion interventions are often coupled with psychoeducational interventions such as parent training and/or school-based interventions where teachers implement daily report cards and behaviour response-token strategies [104]. Peer inclusion interventions can also be implemented within the context of a summer treatment program where a range of different psychosocial interventions are conducted to improve ADHD symptoms, social functioning, and overall impairment [105]. Peer inclusion in interventions is postulated to have multiple benefits. Including peers in interventions may motivate children to participate and allow the intervention to be conducted in group settings, enhancing the feasibility of the approach [46, 55]. Moreover, including peers in interventions has the possibility of improving intervention outcomes [106]. From a social learning theory perspective, children are presented with frequent opportunities where social skills, behaviours, and consequences are modelled during group interactions [107]. Across the literature on psychosocial interventions for children with developmental disorders, the types of peer inclusion have been broadly described and categorised as follows: (a) peer involvement, (b) peer mediation, and (c) peer proximity.

Peer involvement has been most commonly used in SST and summer treatment programs (STP) interventions for children with ADHD. Peer involvement is most commonly characterised by interventions where participants facilitate each other’s learning. Therefore, the number of opportunities to reinforce and practice target skills is increased, enhancing the success of treatment outcomes. The children are taught social interaction strategies such as sharing, helping, prompting, instructing, or praising [108]. However, peers included in these interventions often include children with similar diagnoses and skill difficulty in a group therapy context. Thus, intervention may incorporate facilitator-led role-plays and interactions, where the focus is on increasing social skills through instructions during peer-to-peer interactions [53, 61, 66, 69].

Peer-mediated intervention involves an extension of peer involvement as the peer is a key component and an active agent of change for the intervention. In peer-mediated interventions, peers are trained to provide instruction and facilitate social interactions with the target child/client [109]. Peer-mediated intervention involves a combination of peer initiation, modelling, prompting, and reinforcing of the desired behaviour [106]. Peer-mediated interventions can be readily incorporated into a child’s environment, particularly in inclusive settings, and can support the generalisation of skills across different environments [106]. Peer-mediated interventions are based on the notion that individuals’ behaviour is influenced by their peers, an influence that can be both overt and powerful [110]. For these reasons, typically developing peers have been most commonly incorporated into peer-mediated intervention with stringent criteria regarding peer selection [106, 111].

Peer proximity involves carefully selected peers of increased skill, likely without a diagnosis, who are placed in close proximity to the child, such as sitting at the same table in a classroom [112]. Central to both peer-mediated and peer-proximity approaches is the careful and purposeful selection of peers. Commonly used inclusion criteria for peers in both peer-mediated and peer-proximity interventions were as follows: typical social and language development, absence of behaviour difficulties, an interest in interacting with the target child, and regular availability [46, 106, 108, 111]. The direct interaction between the client and their peers, which is the central characteristic of peer-mediated and peer-proximity interventions, has many practical advantages and benefits including fostering inclusion in school settings [111]. An example of such an advantage is the abundance of typically developing peers in schools and the use of a practical approach to provide services to children with additional needs that could lower cost and alleviate pressures on teachers, health professionals, and parents [113].

A peer-mediated approach is the most empirically supported model of social skills interventions for children with Autism Spectrum Disorders (ASD) [108]. However, further research is required to strengthen the evidence base of the use of peers in social interventions for children with ADHD. Similar to children with ADHD, children with ASD experience significant social skills impairments. Training peers to support social skills development in target populations is regarded as ecologically valid for children and has the potential to address the problem of limited generalisability of treatment effects in adult mediated interventions [114]. As such there is a need to conduct a systematic review to examine the effectiveness of peer inclusion in interventions aimed at improving the social functioning for children with ADHD.

This systematic review aimed to examine the efficacy of peer inclusion in interventions targeting the social functioning of children with ADHD. To capture the use of peers in interventions in the existing literature and for the purpose of this systematic review, peer inclusion interventions were defined as interventions that reported peer involvement, peer mediation, or peer proximity. We also aimed to identify and summarise the key characteristics of a range of peer inclusion interventions, which will be used to analyse the feasibility of using peers in treatment interventions for ADHD. Furthermore, we conducted a meta-analysis to examine the significance of improvements and effect sizes of peer inclusion interventions designed to improve the social functioning of children with ADHD. The manner in which improvements and effect sizes varied between specific treatment approaches was also examined.

2. Method

The methodology and reporting of this systematic review were based on the PRISMA statement (see Supplementary Table  1). The PRISMA statement checklist covers areas considered necessary for the transparent reporting of systematic reviews in areas of health care [115].

2.1. Information Sources

To locate eligible studies, the fifth author conducted literature searches across four electronic databases between November 4 and 7, 2016. The searched databases included the following: CINAHL, PsycINFO, Embase, and Medline with the following dates of coverage 1937–2016, 1887–2016, 1902–2016, and 1946–2016, respectively. Supplementary search approaches such as checking reference lists were also used to identify studies.

2.2. Search Strategy

Studies were identified through the following procedure during the initial and updated searches. First, an electronic database search was conducted using CINAHL, PsycINFO, Embase, and Medline. Two categories of search terms (e.g., Mesh and Thesaurus terms) were used in combination: (1) disorder (Attention-Deficit Hyperactivity Disorder (ADHD), Attention-Deficit Disorder (ADD), and Attention-Deficit Disorder with hyperactivity) and (2) psychosocial interventions (peer, friend, friendship, buddy, playmate, group therapy, group intervention, group role-play, play group, play therapy, play treatment, play intervention, camp(s), school-based, play-based intervention, psychosocial, social skills, SST, social groups, social behaviour/behaviour, and group counselling). Limitations applied to the search included subject age (preschool child [2–5 years], child [6–12 years], and adolescent [13–18 years]), English language, and humans. The full electronic search strategy used for one of the major databases (Embase) is reported in Table 1. Using subheadings, free text searches were also conducted for all four databases for studies published within the year prior to the search. The search terms and limitations for the free text searches are also described in Table 1.

2.3. Inclusion/Exclusion Criteria

The following criteria for inclusion were applied: (1) children and/or adolescents had to have a primary diagnosis of ADHD according to the Diagnostic and Statistical Manual of Mental Disorders 3rd Edition (Revised, DSM-III-R) or Diagnostic and Statistical Manual of Mental Disorders 4th Edition (DSM-IV) criteria; (2) studies included a control group; (3) the interventions included peers; (4) the treatment content focused on social functioning; and (5) the treatment outcome could be related to the peer inclusion intervention. Multimodal intervention programs in which the peer inclusion intervention was part of a variety of empirically based behavioural components were included if results can be extrapolated to provide insight into the value of including peers as a core variable. These criteria were selected to identify peer inclusion intervention studies that would be classed as either level II or III on the National Health and Medical Research Council (NHMRC) Hierarchy of Evidence [116]. The NHMRC Hierarchy of Evidence was developed by the Australian NHMRC to rank and evaluate the evidence of healthcare interventions [116]. According to the NHMRC Hierarchy of Evidence, level I studies are systematic reviews of randomized controlled trials (RCTs), level II studies are a well-designed RCTs, and level III studies are, for example, quasi-experimental designs without random allocation. Studies with level III evidence were included as it was unlikely that a search limited only to level II studies would identify all required studies to review the literature.

2.4. Systematic Review
2.4.1. Methodological Quality

The NHMRC Evidence Hierarchy “levels of evidence” [116] and the Kmet appraisal checklist [117] were used to assess the methodological quality of the included studies. Kmet has a three-point ordinal scoring system (yes = 2, partial = 1, and no = 0) that provides a systematic, reproducible, and quantitative means of simultaneously assessing the quality of research encompassing a broad range of study designs [117]. The total Kmet score can be converted into a percentage score, with a Kmet score of >80% considered strong quality, a score of 60–79% considered good quality, a score of 50–59% considered adequate quality, and a score < 50% considered to have poor methodological quality.

2.4.2. Data Collection Process

A data extraction form was created to extract the data within the included studies. We extracted the data under the following categories: participant diagnosis, control group, age range, mean and standard deviation, inclusion criteria, treatment condition, outcome measures, treatment outcomes, peer/parent/teacher components, skills taught, medication use, method and level of evidence, use of blinding and randomization, and methodological quality (using Kmet).

2.4.3. Data Items, Risk of Bias, and Synthesis of Results

During data collection, data points across all studies were extracted using comprehensive data extraction forms. During this process, risk of bias was assessed at an individual study level during the Kmet rating [117]. Data was then extrapolated and synthesised into a number of categories: participant characteristics, inclusion criteria, treatment conditions and outcomes, components of studies, components of the interventions, and methodological quality. The principal summary measures to assess treatment outcomes were effect sizes and significance of data. We only analysed the effect sizes of the social skills outcomes for the peer inclusion interventions, as the focus of this review was on the use of peers to facilitate social skills development. Interrater reliability for abstract selection and Kmet ratings were established by two independent assessors based on Weighted Kappa calculations. There was no evident bias in scoring study quality and extractor bias of the reviewers conducting this systematic review, as neither reviewer has formal or informal affiliations with any of the authors of the published studies included.

2.5. Meta-Analysis
2.5.1. Data Analysis

Data was extracted from the relevant studies in order to compare the effect sizes for the following: pre-post measures of social skills using peer inclusion interventions and mean difference in social skills measures from pre to post between peer inclusion interventions versus comparison controls. Three studies [5557] were excluded from both analyses as the reported data was not separated from other typically developing peers or other diagnoses. One further study was excluded as true baseline measures could not be provided [63]. To compare effect sizes for both the peer inclusion and comparison group conditions, group means, standard deviations, and sample sizes for pre- and postmeasurements were then entered into Comprehensive Meta-Analysis Version 3.3.070 [118].

Effect sizes were generated in Comprehensive Meta-Analysis using a random-effects model, as it was unlikely that the included studies have the same true effect due to variations in sampling, intervention approaches, outcome measurement, and participant characteristics. Heterogeneity was estimated using the statistic to determine the spread of effect sizes about the mean and to estimate the ratio of true variance to total variance. Effect sizes were calculated using the Hedges g formula for standardized mean difference (SMD) with a confidence interval of 95% and were interpreted using Cohen’s convention as follows: as small; as moderate; and as large [119].

Forest plots of effect sizes for social skill measures’ score were generated for the following: (1) pre-post groups for peer inclusion interventions and (2) peer inclusion interventions versus comparison groups. Subgroup analyses were then used to explore the effect sizes as a function of the following: (1) specific type of peer inclusion intervention (peer involvement, peer mediation, or peer proximity) in pre-post group analysis and (2) comparison group type (medication only, treatment as usual, and another therapy) for the peer inclusion intervention versus comparison group analysis.

Publication bias was assessed using Comprehensive Data Analysis software following the Begg and Muzumdar’s rank correlation test which reports the rank correlation between the standardized effect size and the variances of these effects [120]. The statistical procedure produces tau which is interpreted as a value of 0 indicating no relationship and deviations away from 0 indicating a relationship, as well as a two tailed value. If asymmetry is caused by publication bias, high standard error would be associated with larger effect sizes. If larger effects are presented by low values, tau would be positive, while if large effects are represented by high values, tau would be negative. Publication bias was also assessed using Duval and Tweedie’s trim-and-fill procedure [121]. The procedure investigates the publication bias funnel plot, which is expected to be symmetric. That is, it is expected that studies will be dispersed equally on either side of the overall effect. The trim-and-fill procedure initially trims the asymmetric studies from the right-hand side to locate the unbiased effect and then fills the plot by reinserting the trimmed studies on the right as well as their imputed counterparts to the left of the mean effect size. The program is looking for missing studies based on a fixed-effect model and is looking for missing studies only to the left side of the mean effect.

3. Results

3.1. Study Selection

A total of 3,395 studies were found across the following databases: CINAHL (280), PsycINFO (1073), Embase (1448), and Medline (594). Only one study was identified through searching of additional sources. The 3,395 studies identified through subject headings and free text searches were screened for duplicate titles and abstracts with 618 duplicates removed. Two researchers reviewed abstracts for inclusion in the review. To ensure rating accuracy, 20 randomly selected abstracts were assessed by both raters to achieve consensus before rating the remaining abstracts. A third researcher (second author) was consulted if agreement could not be reached between the first two researchers to achieve 100% consensus. The agreement (Weighted Kappa) between raters for all abstracts was 0.832 (95% CI 0.5648–1.000). A five-point ordinal scale was constructed to rate abstract eligibility using the five inclusion criteria (described earlier), and abstracts with a score of 4 or 5 were selected for full-text review.

After assessing the abstracts based on criteria created by the research team, a total of 65 studies were identified. Full-text records were accessed to determine if the studies met inclusion criteria. Of these 65 studies, 7 were not intervention studies, 19 did not provide a description of peer inclusion in the interventions with 8 of those studies assessing ADHD symptoms and not social skills outcomes, 8 were peer inclusion studies but did not report social skills outcomes, 4 were peer inclusion studies but did not include a comparison group, 1 was a protocol paper describing an included interventions, and 2 studies were not in English (Figure 1). A list of the studies published in peer reviewed journals that were excluded and reasons for their exclusion are provided in Table 2. Based on the inclusion criteria, 17 intervention studies were selected (see Table 3). All included studies used a controlled design, provided a detailed description of the population, and included the use of peers to facilitate treatment outcomes. The design and rationale of one of the studies [53] were reported in another publication [122]. Therefore both articles were assessed together to maximise data collection.

3.2. Description of Studies

The included studies are described in detail in Tables 35. The information was grouped and synthesised as follows: peer inclusion intervention studies for children with ADHD (Table 3); intervention components of included studies (Table 4); and methodological quality of included studies (Table 5).

3.3. Participants

The 17 studies included a total of 2,567 participants aged between 6 and 16 years with 74% of participants being male. A total of 2,284 participants received a diagnosis of ADHD. Diagnosis was confirmed with various tools based on the international DSM-III-R or DSM-IV with parent and teacher interviews or reports on symptomology. The children with ADHD had the following comorbidities in the included studies: anxiety disorder, affective disorder, tic disorder, depressive disorder, learning disorder, conduct disorder (CD), developmental disorder, and oppositional defiant disorder (ODD), with the exception of Hantson, Wang [59], and Hannesdottir Hannesdottir, Ingvarsdottir [58] that did not report on comorbidities. There was a large variation of sample sizes between the included studies, ranging from 24 to 579 participants (Table 3). Of the included studies, only two trials reported a power analysis to determine a sample size calculation before the start of the trial [64, 68].

3.4. Interventions

The 17 studies comprised multiple interventions, including Social Skills Training (SST) [5456, 59, 60, 67, 68], behavioural treatment [57, 66, 69], behavioural and SST [62, 63], and multimodal behavioural/psychosocial treatment [53, 58, 61, 64, 65]. The interventions involved various components of peer inclusion elements and parents and/or teacher involvement (see Table 4).

3.5. Experimental Groups

Ten studies involved child focused SST [5456, 5860, 62, 63, 67, 68], with four of these studies incorporating additional parent training [55, 59, 60, 68]. Pfiffner et al. [66] used child focused SST and parent training with the addition of teacher consultation in the experimental group. The MTA trials consisted of child focused SST, parent training, teacher consultation, and classroom behavioural intervention [64, 65]. Haas et al. [57] and Jensen et al. [61] used a behavioural treatment in the context of a summer treatment program; Jensen et al. [61] also included parent training and school-based treatment. Three trials assessed child focused SST and parent training with medical treatment in the experimental group against medical treatment alone [53, 68, 69]. Abikoff et al. [53] also included academic planning skills training and individual psychotherapy. Hannesdottir et al. [58] included additional executive function training via computer-based activities.

3.6. Control Groups

Six studies used medications in both experimental and control groups and added one (or more) therapy to medication—thus using “medication only” as the control group [53, 61, 64, 65, 68, 69]. Ten studies utilised either typically developing children or no treatment or assigned participants to waitlist control groups [5460, 63, 66, 67]. Kolko et al. [62] compared a social-cognitive skills training program against a social activities group where children were merely provided with semistructured opportunities for socialisation rather than a peer-mediated intervention.

3.7. Use of Peers

There was great variation between studies as to the degree of detail used in describing and reporting on the characteristics of the included peers. Of the 17 studies, only 3 used non-ADHD diagnosed or typically developing peers to facilitate intervention [55, 57, 63]. Additionally, the involvement of the peers in the intervention varied, with no identified studies reporting detailed involvement of peers to be considered peer-mediated interventions according to our adopted definition. Sixteen studies reported peer involvement [5362, 6469] and one study reported a peer-proximity intervention [63].

3.8. Risk of Bias in Included Studies

Of the nine RCTs, only two reported generation of random allocation in detail [63, 68]. The other seven RCTs did not report the generation of allocation sequence; therefore the risk of bias was unclear [53, 54, 58, 64, 66, 67, 69]. The MTA trial did report the concealment of allocation, unlike the other trials; thus risk of bias was unclear for those studies. The blinding of participants or clinicians involved in the delivery of interventions is a well-known difficulty [123, 124]. All studies in this review were at risk of bias due to limited blinding of participants. Of the included studies, only two reported blinding for all outcomes [63, 68] and six studies reported blinding for at least one of the outcomes [53, 57, 62, 64, 66, 69]. The studies at high risk of bias due to lack of blinding were as follows: Choi and Lee [54], Frankel et al. [55], Guli et al. [56], Hantson et al. [59], Huang et al. [60], Hannesdottir et al. [58], Jensen et al. [61], MTA Cooperative Group [64], and Shechtman and Katz [67].

Eight studies included data of medicated and nonmedicated children and therefore were at high risk of confounding bias [5660, 62, 63, 66]. Huang et al. [60] recognised this potential for bias and analysed the impact of drug compliance on results through linear mixed modelling. Waxmonsky et al. [69] conducted a sample size calculation for the primary outcome measure, however not the secondary outcome measures which included the social skills outcome. This may have increased the risk of Type 2 errors as the analysis may not have had the required power to detect trends for all outcome measures. Many of the authors may have had potential invested interest bias, as they have conducted previous research on the topic [53, 5557, 61, 6368].

The Begg and Mazumdar rank correlation procedure produced a tau of −0.032 (two-tailed ), indicating there is no evidence of publication bias. This finding was supported by Duval and Tweedie’s trim-and-fill procedure using the fixed-effect model; the point estimate for the combined studies is 0.607 (95% CI: 0.522, 0.692). Using trim and fill these values are unchanged. Under the random-effects model the point estimate for the combined studies is 0.562 (95% CI: 0.431, 0.693). Using trim and fill these values are unchanged. Both of these procedures indicate the absence of publication bias (see Figure 2 for funnel plot).

3.9. Methodological Quality

We identified 17 studies published between 1990 and 2016 for children with ADHD. Of these selected studies, nine were randomized controlled trials (RCTs), six were quasi-experimental studies, and two were longitudinal follow-up studies. Of these studies, eleven were classified as level II evidence and six as level III evidence based on the NHMRC Evidence Hierarchy NHMRC [116]. The overall methodological quality of the studies ranged from good to strong with ten studies ranked as good and four as strong according to the Kmet ratings (Table 5). The interrater agreement (Weighted Kappa) for the Kmet ratings was 0.74 (95% CI 0.61–0.86).

3.10. Effects of Interventions: Meta-Analysis Results
3.10.1. Effect of Peer Inclusion Interventions on Pre-Post Social Skills Outcomes

The pre-post intervention effect sizes for the included studies ranged from 0.167 [60] to 1.345 (large; [59]) (Figure 3). In five of the peer inclusion groups, effect sizes were large, indicating that peer inclusion accounted for a significant proportion of standardized mean difference for these five studies. A significant postintervention between-group effect size total in favour of peer inclusion interventions was found using a random-effects model (, , Hedges , and 95% CI = 0.459–0.709), indicating moderate improvement in social skills outcomes following peer inclusion interventions. Between-study heterogeneity was significant (, and ), with showing heterogeneity accounted for 48.417% of variation in effect sizes across studies, as opposed to chance.

3.10.2. Effect of Confounds on Pre-Post Social Skills Outcomes

Given the significant heterogeneity, subsequent subgroup analyses were conducted comparing effect sizes between intervention groups to examine variables that could potentially confound social skills outcomes. Comparisons were made based on the following: (a) the presence or absence of parent training and psychoeducation within the interventions; (b) study design (i.e., quasi-experimental design, RCT); (c) methodological quality rating (i.e., good, strong); (d) the presence or absence of blinding for outcome measurement; and (e) the outcome rating respondent (i.e., self-rated, parent rated, teacher rated, and combined parent and teacher rated).

All subgroup comparisons produced a significant result (see Table 6). While analyses based on level of parent involvement, methodological quality rating, and blinding of outcomes measures produced significant results, the differences in effect sizes for subgroups in these comparisons were negligible. Effect sizes for comparisons based on respondent type for outcome measurement ranged from a large positive effect for ratings completed by parents and teachers, to moderate positive effects for ratings completed by teachers or parents or the child with ADHD. Intervention effect favoured RCT studies to a small degree.

3.10.3. Factors Mediating the Intervention Effect

Given the significant results found in all subgroup analyses and similarities in effect sizes for a majority of the comparisons, metaregression was performed to determine if any of the variables contributed as a significant mediator of intervention effect. All variables of the subgroup analysis were entered as covariates in the regression model. Results showed that variable of parents as raters for outcome measurement was the only variable contributing as a significant mediator of intervention effect (; ). See Table 7 for full results of the metaregression.

3.10.4. Effect of Peer Inclusion Interventions on Social Skills Compared with Comparison Groups

When comparing peer inclusion interventions and comparison groups, the difference between the pre-post scores for peer inclusion groups and each comparison group type was not significant (; ). Heterogeneity in the included studies was significant (; p = 0.006), with % indicating the percentage of variability due to heterogeneity rather than chance. The subgroup analysis indicated when peer inclusion interventions were compared to medication only interventions or treatment as usual, no significant difference was measured ( and , resp.). A significant but small effect in favour of peer inclusion interventions was measured when compared to other interventions (, , Hedges , 95% CI = 0.048–0.436).

4. Discussion

This study aimed to systematically evaluate and analyse the efficacy of peer inclusion interventions in improving social functioning in children diagnosed with ADHD, using systematic review and meta-analysis procedures. The meta-analysis included both RCTs and quasi-experimental studies of peer inclusion interventions, in order to broaden the scope and include all studies which involved peer included elements.

4.1. Systematic Review Findings

All but one study by Mikami et al. [63], which employed peer proximity, utilised peer involvement interventions in the form of peer modelling and role-plays. Children were didactically presented with social skills scenarios and were required to teach the other children the correct and incorrect use within a range of contexts. The inclusion of parents and teachers to facilitate generalisability of treatment effects was common for most of the studies included. Eight studies included parent training and psychoeducation of ADHD as an add-on to the peer involvement intervention [53, 55, 59, 60, 64, 66, 68, 69]. Of these eight studies, four also included teacher consultation and daily report cards to increase the behavioural outcomes achieved at school [53, 64, 66, 69].

An important finding is that only 3 of the 17 studies used typically developing peers or peers without a diagnosis for the intervention. This is in stark contrast to findings of a systematic review investigating peer-mediated interventions for children with ASD where 34 of the 42 studies reported using peers with no disability used for the intervention [111]. Moreover, empirical studies have shown the potential negative effect that the involvement of peers with behavioural problems may have on the behaviour of children with ADHD [125127]. In fact, one study reported that the behaviour of children with the inattentive subtype of ADHD deteriorated following the peer intervention, postulating these children may imitate some of the negative behaviours displayed by other children [126]. The lack of typically developing peers included in the interventions may have reduced potential benefits. There is emerging evidence in literature suggesting that peer inclusion interventions should take the following inclusion criteria for peers into account: typical social and language development, absence of behaviour difficulties, an interest in interacting with the target child, and regular availability [46, 106, 108, 128]. Moreover, it is widely accepted that skill generalisation of social skills is difficult for children with ADHD [129, 130]. As such interventions may have better outcomes when conducted with typically developing peers (including siblings) in the child’s natural social environment [113].

Another important finding is that none of the studies used peer-mediated interventions, only peer involvement and peer proximity. Given that a peer-mediated approach is the most empirically supported model of social skills intervention for children with ASD [108], it is a surprising finding that none of the studies employed peer mediation which, at least in ASD literature, has the best support for improving social functioning. Both children with ASD and ADHD experience significant impairments in social functioning and, given the concomitant presentation of social skills difficulties in these comorbid conditions, a greater overlap in the approach to address the social skills difficulties was expected. The findings of this systematic review point to an urgent need for researchers to give serious consideration to both the inclusion criteria of peers involved in the intervention (i.e., including peers without behavioural problems) and their approach to peer inclusion interventions (i.e., consider incorporating peer-mediated interventions).

A noteworthy limitation of these studies is the paucity of blinding. Without blinding, results may be exposed to a high risk of bias as teachers, parents, and investigators may have vested interests or rate children better due to knowledge of treatment efficacy [124]. Parents are often known as the experts of their children’s behaviour; however, they may be inclined to rate their child differently due to a close attachment or a false sense of achievement based on knowledge of treatment. Teachers and investigators may also report incorrect improvements of the treatments if they are aware of diagnosis and/or the treatment itself [123, 124]. The seven randomized controlled trials included in this review are also at high risk of bias due to a paucity of information regarding randomization methods, allocation concealment, and power to detect trends. This is problematic as it limits the ability to blind key stakeholders and determine the necessary number of participants required to detect significance of results [123, 124].

Social skills interventions often have difficulty generalising skills outside of the treatment setting [61, 65]. Peer inclusion interventions aim to address this issue by providing contextual peer relationships to facilitate learning whereby social skills can be further applied to other settings [105]. The included studies did not provide a clear justification as to the efficacy of peer inclusion interventions or the effect of generalisability; however, they do present clear pre-post and follow-up findings of significant improvements in social skills competences and peer interactions through the use of multiple components including peers, parents, and teachers versus waitlist controls or equivalent no treatment controls. Further research should aim to determine the efficacy of treatments where these components are combined and separated to allow for a more clear analysis of the effects of the peer included component of social skills interventions.

4.2. Meta-Analysis Findings
4.2.1. Pre-Post Effects and as a Function of Level of Peer Inclusion

We attempted to include as many studies in the meta-analysis as were deemed appropriate, with only four studies being excluded due to inadequate reporting of results or lack of true baseline measurement [5557, 63]. The meta-analysis revealed a significant improvement in social skills measures and peer relationships for children and adolescents with ADHD when the pre-post scores of participants in the intervention groups were analysed as a whole. However, significant heterogeneity indicated that effect sizes varied across the studies more than would be expected by chance and that these studies cannot be assumed to have been recruited from the same sample. This is unsurprising, given the variation in the treatments including peers and the profile of the participants included in each of the studies.

It is important to note that only peer involvement interventions were included in this meta-analysis. We were unable to make comparisons based on types of peer inclusion, as the single study looking at a peer-proximity intervention did not report true baseline data and hence was not included in the meta-analysis. As such, the literature remains unclear as to the level of peer inclusion required in an intervention in order to maximise the effect of interventions on social skills and peer relationships. Peer proximity should be considered in the future development and evaluation of interventions so that stronger conclusions can be drawn as to the ideal level of peer inclusion for maximising benefits.

The subgroup analysis revealed significant differences between studies based on level of parent involvement, study design, methodological quality, blinding of outcome measures, and the rater completing outcome measurement. However, when effect sizes are compared, negligible differences were identified in three of the comparisons. Interventions involving parents did not differ greatly from interventions without a parent training component, studies with strong methodological quality found similar effects to studies with “good” methodological quality, and blinded outcome measures produced similar results to measures that were not blinded. This lack of conclusive results calls for further research into peer inclusion interventions

The most significant finding of the meta-analysis is the influence that the person chosen to rate outcome measurements can have upon study findings. The person who rated the children’s social skills outcomes following peer inclusion interventions showed significance between subgroup differences. Studies that reported on combined parent-teacher ratings showed overall large effect sizes, whereas individual parent, teacher, or child self-ratings demonstrated overall moderate effect sizes. Furthermore, using parents as raters was found to significantly mediate the intervention effect. Careful consideration should be given to measurement selection clinically, and in future studies of peer inclusion, such that observations from a variety of raters are considered and interpreted in the light of these results.

4.2.2. Effects as a Function of Treatment Group Type

Overall, the peer inclusion interventions did not significantly differ from the three comparison group types. The subgroup analysis showed that peer inclusion interventions were more effective in improving social skills and peer relations than comparison interventions for children and adolescents diagnosed with ADHD, but the effect size was small. However, the heterogeneity indicates that participants in these studies cannot be assumed to be drawn from the same sample, suggesting that peer inclusion interventions may not result in better social skills outcomes when compared with other social skill interventions in children and adolescents with ADHD. Further studies are needed to establish the generalisability of the results of this subgroup analysis.

In contrast, the question of whether peer inclusion interventions were more efficacious when compared with other psychosocial and behavioural therapies and pharmacological treatment could not be determined. Results from the meta-analysis revealed that the subgroup overall effect size for medication only as comparison group slightly favoured medication over peer inclusion interventions. Conversely, when looking at the subgroup of peer involvement interventions that were compared to treatment as usual comparison groups results slightly favoured peer inclusion interventions. However, for both subgroup analyses the differences were not significant. It is possible that, as previous research suggests, usual course of medication for children and adolescents peer should be used in combination with psychosocial therapies, such as peer-inclusive treatments in order for clear therapeutic gains to be made.

4.2.3. Other Possible Confounds

The large variation in effect sizes of within-groups pre- to posttest comparisons of peer inclusion interventions could be due to the differing length of treatments in the reviewed studies. Interestingly, in the studies with large effect sizes (e.g., [59, 64]) the treatment programs which included peer involvement interventions were intensive and/or involved long periods of treatment, whereas the study with the smallest effect sizes [69] was designed to be less intensive, replicating an outpatient model in order to curtail the need for extensive involvement of mental health professionals. This indicates that length and intensity of peer involvement intervention could be a confounding factor on posttreatment outcomes. Future research with matched participants receiving varying lengths and intensity of peer involvement interventions are needed to investigate whether length and intensity are significant factors in increasing treatment outcomes. Furthermore, inconsistency in effect sizes may be attributed to a number of confounding variables such as the following: (a) the use of different treatment components; (b) large variation of sample sizes across and within studies; and (c) the influence of medicated and nonmedicated data. Including parents and teachers in the interventions was common amongst the interventions reviewed, with eight studies providing parents with training in addition to peer involvement [53, 55, 59, 60, 64, 66, 68, 69]. Four of those studies also included behavioural therapeutic techniques [53, 64, 66, 69]. As such, the addition of these treatment components parallel with peer involvement makes it difficult to isolate the specific effect of peer inclusion in these interventions. Total sample sizes ranged between 24 and 579 participants with only two studies conducting power analyses to determine their appropriate sample size. Medication was a potential confounder for studies where participants’ improvements may have been influenced by the use of medication [57, 59, 62, 63]. Some studies assessed medicated and nonmedicated participants within treatment groups but did not control for their potential confounding influence within their analysis [57, 59, 62, 63]. Therefore the use of this confounding data may have significantly impacted the reliability of results for treatment groups attempting to report on the effectiveness of peer inclusion interventions. Comparing several outcomes across a multitude of different treatments may also cause the comparisons to differ significantly with unclear inferences, as was evident in the Kolko et al. [62] and Mikami et al. [63] studies.

5. Limitations

The current study underwent a rigorous review process by searching relevant databases, comprehensively screening abstracts between two independent researchers, and ensuring acceptable interrater reliability agreements for study selection and Kmet methodological quality ratings. Despite the care that was taken to reduce bias, this review is subject to a number of limitations. Every study was at a risk of bias due to inadequate blinding, randomization, or incomplete control of confounding variables. In addition, a scarce amount of evidence was available to draw conclusions from regarding the efficacy of peer inclusion interventions on social functioning, which limited the translatability of the findings to practical settings. These methodological limitations were contributors to comparatively poorer Kmet ratings of the studies.

6. Conclusion

The limitations of pharmacological treatment make it necessary to investigate the use of psychosocial interventions such as peer inclusion interventions as an addition or alternative to medication. It is clear that interventions which include peer inclusion components may be an appropriate SST method for children with ADHD. However, RCTs and quasi-experimental studies of children with ADHD which meet all the criteria for peer mediation are needed. This meta-analysis found evidence of a substantial difference between peer inclusion interventions plus medication treatment versus medication alone. Peer inclusion interventions were significantly better at improving social competence and peer relations than no treatment or waitlist control groups, indicating that psychosocial interventions are valuable in treatment. There is a need for more studies to test the use of peer-mediated interventions; use typically developing peers; appropriately calculate sample size; and control for medication as a potential confound. In addition, the reporting on the specific characteristics and involvement of peers in the intervention, as demonstrated in the peer inclusion interventions for ASD research, will assist with clarity regarding methods, effectiveness, and outcomes. Furthermore, the current review systematically highlighted the necessity for more high quality studies to evaluate the use of peer inclusion interventions where the design allows for effect sizes to be calculated separately for peer, teacher, and parent components.

Additional Points

References [5369] are the studies included in the review while all the other references are additional references.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this article.

Acknowledgments

The authors would like to thank Lauren Parsons, Rebecca Totino, and Cally Kent for research assistant support.

Supplementary Materials

Supplementary Table  1: the methodology and reporting of this systematic review and meta-analysis in accordance with The PRISMA 2009 Checklist. (Supplementary Materials)