<?xml-model href='http://www.tei-c.org/release/xml/tei/custom/schema/relaxng/tei_all.rng' schematypens='http://relaxng.org/ns/structure/1.0'?><TEI xmlns="http://www.tei-c.org/ns/1.0">
	<teiHeader>
		<fileDesc>
			<titleStmt><title level='a'>Intervention Effects on Language in Children With Autism: A Project AIM Meta-Analysis</title></titleStmt>
			<publicationStmt>
				<publisher></publisher>
				<date>05/22/2020</date>
			</publicationStmt>
			<sourceDesc>
				<bibl> 
					<idno type="par_id">10286315</idno>
					<idno type="doi">10.1044/2020_JSLHR-19-00167</idno>
					<title level='j'>Journal of Speech, Language, and Hearing Research</title>
<idno>1092-4388</idno>
<biblScope unit="volume">63</biblScope>
<biblScope unit="issue">5</biblScope>					

					<author>Micheal Sandbank</author><author>Kristen Bottema-Beutel</author><author>Shannon Crowley</author><author>Margaret Cassidy</author><author>Jacob I. Feldman</author><author>Marcos Canihuante</author><author>Tiffany Woynaroski</author>
				</bibl>
			</sourceDesc>
		</fileDesc>
		<profileDesc>
			<abstract><ab><![CDATA[Purpose              This study synthesized effects of interventions on language outcomes of young children (ages 0–8 years) with autism and evaluated the extent to which summary effects varied by intervention, participant, and outcome characteristics.                                      Method              A subset of effect sizes gathered for a larger meta-analysis (the Autism Intervention Meta-analysis or Project AIM) examining the effects of interventions for young children with autism, which were specific to language outcomes, was analyzed. Robust variance estimation and metaregression were used to calculate summary and moderated effects while controlling for intercorrelation among outcomes within studies.                                      Results              A total of 221 outcomes were gathered from 60 studies. The summary effect of intervention on language outcomes was small but significant. Summary effects were larger for expressive and composite language outcomes compared to receptive language outcomes. Interventions implemented by clinicians, or by clinicians and caregivers together, had summary effects that were significantly larger than interventions implemented by caregivers alone. Participants' pretreatment language age equivalent scores positively and significantly moderated intervention effects, such that effects were significantly larger on average when samples of children had higher pretreatment language levels. Effects were not moderated by cumulative intervention intensity, intervention type, autism symptomatology, chronological age, or the proximity or boundedness of outcomes. Study quality concerns were apparent for a majority of included outcomes.                                      Conclusions              We found evidence that intervention can facilitate improvements in language outcomes for young children with autism. Effects were largest for expressive and composite language outcomes, for children with initially higher language abilities, and for interventions implemented by clinicians or by caregivers and clinicians combined. However, quality concerns of included studies and borderline significance of some results temper our conclusions regarding intervention effectiveness and corresponding moderators.]]></ab></abstract>
		</profileDesc>
	</teiHeader>
	<text><body xmlns="http://www.tei-c.org/ns/1.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink">
<div xmlns="http://www.tei-c.org/ns/1.0"><p>during early childhood (e.g., <ref type="bibr">Billstedt et al., 2007;</ref><ref type="bibr">Eisenberg, 1956;</ref><ref type="bibr">Gillberg &amp; Steffenburg, 1987;</ref><ref type="bibr">Kobayashi et al., 1992;</ref><ref type="bibr">Lotter, 1974;</ref><ref type="bibr">Rutter et al., 1967)</ref>, making this an especially important focus of intervention efforts.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Language Development in Children With Autism</head><p>Children with autism are highly heterogeneous in their ability to understand and use language <ref type="bibr">(Kjelgaard &amp; Tager-Flusberg, 2001;</ref><ref type="bibr">Tager-Flusberg et al., 2005)</ref>. Although some children with autism experience severe language impairments, others display language abilities within the average (or even above average) range relative to their typically developing peers <ref type="bibr">(Bacon et al., 2019;</ref><ref type="bibr">Norrelgen et al., 2015;</ref><ref type="bibr">Rose et al., 2016;</ref><ref type="bibr">Tager-Flusberg et al., 2005)</ref>. Long-term outcomes of autistic individuals have most commonly been associated with language "production" (i.e., expressive language) acquired during early childhood <ref type="bibr">(Billstedt et al., 2007;</ref><ref type="bibr">Eisenberg, 1956;</ref><ref type="bibr">Gillberg &amp; Steffenburg, 1987;</ref><ref type="bibr">Kobayashi et al., 1992;</ref><ref type="bibr">Lotter, 1974;</ref><ref type="bibr">Rutter et al., 1967)</ref>. However, children with autism may also display impairments in language "understanding" (i.e., receptive language) that impact their ability to participate fully in a range of life experiences, as well as their social, academic, and vocational success <ref type="bibr">(Charman et al., 2003;</ref><ref type="bibr">Ellis Weismer et al., 2010;</ref><ref type="bibr">Gillum &amp; Camarata, 2004;</ref><ref type="bibr">Hudry et al., 2010;</ref><ref type="bibr">Luyster et al., 2008;</ref><ref type="bibr">Maljaars et al., 2012;</ref><ref type="bibr">Volden et al., 2011;</ref><ref type="bibr">Woynaroski et al., 2016)</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Intervention Recommendations</head><p>When language is impaired in young children with autism, individualized interventions and family-centered supports are recommended (American Speech-Language-Hearing Association, n.d.). These interventions may include home-or clinic-based treatment delivered directly by certified professionals (e.g., certified speech-language pathologists or other trained professionals) and/or caregivers, integration of low-tech or high-tech communicative supports (e.g., Picture Exchange Communication System, speech-generating devices), and structured visual supports (e.g., activity schedules and video modeling of targeted skills). Prior work has shown that intervention (considered broadly) can facilitate improvements in language outcomes for children with autism <ref type="bibr">(Hampton &amp; Kaiser, 2016)</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Putative Moderators of Intervention Effectiveness on Language Outcomes</head><p>However, it is possible that the extent to which interventions are able to influence child language outcomes varies by characteristics of the intervention, the child, and the specific language outcome being measured. We discuss each of these putative moderators of intervention effects in detail below.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Intervention Characteristics</head><p>Various intervention characteristics may moderate effects of treatment on language outcomes. The type of intervention, total amount of intervention delivered (cumulative intensity), and delivery agent (interventionist) are intervention features that may be particularly influential on whether and to what extent interventions are able to influence language outcomes of young children on the autism spectrum.</p><p>Intervention type. Multiple intervention approaches have been promoted and used to support language development in children with autism. These approaches vary in terms of their philosophical underpinnings and application. Traditional behavioral interventions, which are adult-led interventions grounded in operant learning theory (e.g., early intensive behavioral intervention <ref type="bibr">[EIBI]</ref>, Picture Exchange Communication System), are perhaps the most commonly recommended approach for this population. Prior meta-analyses have suggested that behavioral interventions can have positive impacts on language and communication outcomes <ref type="bibr">(Reichow et al., 2012</ref><ref type="bibr">(Reichow et al., , 2018))</ref>, but recent work has suggested that these effects may be inflated by the inclusion of outcomes from low-quality investigations <ref type="bibr">(Sandbank et al., 2019)</ref>. In contrast, developmental approaches (e.g., DIR/Floortime, Hanen models) are rooted in constructivist theories that posit that children must be active participants in their own learning experiences. Prior work has shown that developmental approaches can facilitate improvements in language <ref type="bibr">(Casenhiser et al., 2013)</ref>. However, recent meta-analytic work has suggested that the summary effect of developmental interventions on language outcomes is not significantly different from zero <ref type="bibr">(Sandbank et al., 2019)</ref>. Naturalistic Developmental Behavioral Interventions (NDBIs; <ref type="bibr">Schreibman et al., 2015)</ref> employ strategies from both of the aforementioned approaches and are frequently deployed to target improvements in language in young children with autism. These interventions blend behavioral and constructivist techniques to target language milestones in the context of natural interactions between children and caregivers. Intervention targets are chosen using the developmental sequence established in research on typical child development. Prior meta-analytic work has suggested that the summary effect of NDBIs on language outcomes is positive and significantly different from zero, but this estimate may be heavily influenced by outcomes from investigations wherein assessors were aware of group assignment <ref type="bibr">(Sandbank et al., 2019)</ref>. Sensory-based interventions, which target improvements in sensory processing and related skills by modulating auditory, visual, tactile, and/or other sensory input, have aimed to improve language outcomes in children with autism. Recent metaanalytic and systematic reviews of sensory-based interventions, however, have suggested that sensory-based approaches may have limited effectiveness for improving language and related outcomes (e.g., <ref type="bibr">Barton et al., 2015;</ref><ref type="bibr">Sandbank et al., 2019)</ref>. TEACCH (Treatment and Education of Autistic and Related Communication Handicapped Children; TEACCH on language outcomes <ref type="bibr">(Virues-Ortega et al., 2013)</ref>. Finally, technology-based interventions are those that use technology <ref type="bibr">(e.g., computers, video games, robots)</ref> as the primary medium of instruction and support, thereby capitalizing on autistic persons' reported special interest in technology, which provides predictable formatting and user-controlled pace of information delivery <ref type="bibr">(Knight et al., 2013)</ref>. Although studies have shown that the integration of technology into other intervention approaches can enhance intervention effects on language acquisition <ref type="bibr">(Kasari et al., 2014)</ref>, recent meta-analytic works suggest there are few studies of interventions "entirely mediated" through technology that document their effects on language outcomes <ref type="bibr">(Sandbank et al., 2019)</ref>. If intervention type significantly moderates language outcomes, it may provide support for the choice of specific interventions over others for targeting receptive and expressive language in children with autism.</p><p>Cumulative intensity. The cumulative amount of intervention provided may also moderate intervention effects on language of children on the autism spectrum. In general, greater amounts of intervention are thought to yield greater effects for children with autism, and recommendations for high numbers of intervention hours per week (e.g., &gt; 25 hr per week; <ref type="bibr">Odom et al., 2010)</ref> are rooted in this claim. In some cases, evidence has seemingly supported this assertion. For example, initial studies of EIBI suggested that children receiving the most hours of intervention made the greatest gains <ref type="bibr">(Lovaas, 1987;</ref><ref type="bibr">Reichow &amp; Wolery, 2009)</ref>. However, in recent meta-analytic work examining intervention effects on spoken language outcomes for children with autism, <ref type="bibr">Hampton and Kaiser (2016)</ref> failed to find evidence that treatment intensity moderated effects. At least one study suggested that the effect of treatment intensity on child outcomes may vary as a function of autism symptomatology. In their recent randomized comparison of different intervention intensities, Yoder and colleagues found that increased intensity did improve intervention effects, but only for participants with lower Autism Diagnostic Observation Schedule (ADOS)-calibrated severity scores (P. J. <ref type="bibr">Yoder et al., 2018</ref><ref type="bibr">Yoder et al., , 2019))</ref>. If intensity does significantly moderate effects of intervention on language outcomes, such that more intense intervention yields larger effects, this will add to evidence supporting calls for increased access to high-intensity intervention for at least some children with autism. However, it is possible that a higher number of intervention hours does not yield better outcomes, or that this association is quadratic, where modest increases in intervention dosage (e.g., 5-10 hr per week) yield substantial improvements compared to lower and higher dosages.</p><p>Interventionist. Intervention effects may also vary depending on whether the intervention is delivered by a clinician, a caregiver, or a combination of both. Clinicians are trained professionals who may have special knowledge of ways to elicit communication, sustain interaction, and increase targeted opportunities for language learning. Alternatively, caregivers may be more ideal agents of change because they are familiar interaction partners, spend large amounts of time with their children, and have meaningful relationships with them. Thus, interventions that are delivered primarily through caregivers may be delivered throughout the day and across contexts and may therefore facilitate greater and more generalized changes. Moreover, when caregivers and clinicians work together to deliver interventions, they may capitalize on the expert knowledge of the clinician and the familiarity and consistent presence of the caregiver, thereby facilitating larger effects than interventions delivered by clinicians or caregivers alone. Prior meta-analytic work suggests this may be the case for interventions targeting language outcomes. <ref type="bibr">Hampton and Kaiser (2016)</ref> found that interventions delivered by both parents and clinicians yielded larger treatment effects on spoken language outcomes than interventions delivered by parents or clinicians alone.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Participant Characteristics</head><p>Intervention effects on language outcomes may also vary according to mean-level characteristics of the participants enrolled in the study, such as chronological age, autism symptomatology, and entry-level language ability. Chronological age. A common recommendation for children with autism is that intervention begins as early as possible, with some advocating for intervention to begin even prior to diagnosis (e.g., <ref type="bibr">Beaudoin et al., 2014;</ref><ref type="bibr">Boyd et al., 2010;</ref><ref type="bibr">Landa, 2018;</ref><ref type="bibr">Reichow, 2012)</ref>. This recommendation stems from neuroscientific theories of neuronal plasticity, which suggest brain architecture is most malleable at younger ages, potentially allowing for greater developmental improvements associated with intervention <ref type="bibr">(Dawson, 2008)</ref>. Additionally, early studies of EIBI have suggested treatment gains were greatest for participants that began intervention at an early age <ref type="bibr">(Lovaas, 1987)</ref>. However, age was not associated with treatment gains in subsequent studies of EIBI <ref type="bibr">(Eldevik et al., 2012;</ref><ref type="bibr">Hayward et al., 2009;</ref><ref type="bibr">Reichow &amp; Wolery, 2009)</ref>, and a recent metaanalysis examining the effects of intervention (considered broadly) on spoken language outcomes in children with autism found that age did not significantly moderate effects of intervention on outcomes <ref type="bibr">(Hampton &amp; Kaiser, 2016)</ref>. In contrast, a recent meta-analysis of intervention effects on an outcome developmentally related to language, social communication, suggested that age did moderate intervention effects <ref type="bibr">(Fuller &amp; Kaiser, 2019)</ref>. If age does significantly moderate treatment effects on outcomes, such that intervention effects are larger for younger children compared to older children, it will bolster the evidence prioritizing access to earlier diagnostic and intervention services.</p><p>Autism symptomatology. The heterogeneous nature of autism may also impact the effects of intervention on language outcomes. Prior work has shown that children with fewer or less severe impairments related to the core features of autism demonstrated greater improvements in language while receiving intervention <ref type="bibr">(Ben-Itzchak &amp; Zachor, 2007;</ref><ref type="bibr">Gordon et al., 2011)</ref>. However, other rigorous tests of intervention efficacy have failed to document significant associations between pretreatment autism symptomatology scores and change in language outcomes <ref type="bibr">(Rogers et al., 2019)</ref>. It is also possible that the association between autism symptomatology and intervention effects on language is further complicated by intervention intensity. P. J. <ref type="bibr">Yoder et al. (2018</ref><ref type="bibr">Yoder et al. ( , 2019) )</ref> compared effects of Applied Behavior Analysis therapy and the Early Start Denver Model as delivered at relatively low and high intensities and found that, across intervention types, children with lower autism symptomatology scores benefited more from high-intensity intervention compared to those with higher autism symptomatology scores. Thus, intervention may have differential effects depending on autism severity, and a greater understanding of this association could add to evidence supporting the development of more individualized intervention protocols.</p><p>Language ability. Several studies have shown that initial language ability predicts eventual language outcomes in both developmental and intervention studies of children with autism, where children with higher initial scores on measures of language ability exhibit steeper developmental slopes and benefit more from interventions targeting language <ref type="bibr">(Paul et al., 2013;</ref><ref type="bibr">Vivanti, Prior, et al., 2014;</ref><ref type="bibr">P. Yoder et al., 2015)</ref>. These findings suggest that stronger foundational language skills may allow children with autism to "tune in" and learn more from linguistic interactions that occur in developmental and intervention contexts <ref type="bibr">(Woynaroski et al., 2016)</ref>. Given that initial language age equivalents in months are commonly reported in participant demographics and that this scale is comparable across studies even when different language measures are used, it is possible to use language age equivalency scores and meta-analytic strategies to determine if there is a significant interaction between pretreatment language ability and intervention effects on language outcomes. As several individual studies have documented a positive association between language ability and intervention gains, it is likely that average participant language age equivalency will moderate intervention effects on language, such that larger effects are observed for participant samples with greater average language age equivalence scores at study entry.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Outcome Characteristics</head><p>Effects of intervention on language in young children with autism may further vary according to a number of different characteristics of the outcome measures employed.</p><p>Language outcome subtype. Language encompasses both the comprehension and production of a spoken, written, or other communicative symbol system (e.g., American Sign Language). Language outcomes can therefore be divided into those that index receptive language, expressive language, or both receptive and expressive skills (i.e., language composite). Multiple studies have suggested that children with autism may display disproportionate delays or deficits in receptive relative to expressive language (e.g., <ref type="bibr">Barbaro &amp; Dissanayake, 2012;</ref><ref type="bibr">Hudry et al., 2014;</ref><ref type="bibr">McDaniel et al., 2018;</ref><ref type="bibr">Woynaroski et al., 2016)</ref>.We hypothesized that receptive language may also be less responsive to intervention than expressive language and that effect sizes indexing intervention effects on receptive language would thus be significantly smaller than those for expressive language outcomes in this clinical population. We expected that summary effects for composite language, which index intervention effects on receptive and expressive language together, would likely be smaller than summary effect sizes for expressive language alone, but larger than summary effect sizes for receptive language.</p><p>Proximity. Intervention outcomes that are directly taught or prompted by the intervention are considered "proximal," whereas outcomes that are broader and/or developmentally beyond what was directly taught or prompted are considered "distal." In terms of language outcomes, children's production of particular linguistic forms that were the focus of the intervention (e.g., saying "hello" or "goodbye") could be considered proximal, whereas performance on a standardized language assessment could be considered distal. Distal effects are more desirable because they suggest that the intervention has tapped into a developmental process, making continued child growth after the intervention has stopped more likely (e.g., <ref type="bibr">Kasari et al., 2008)</ref>. However, previous research syntheses have shown that interventions are more likely to show proximal effects <ref type="bibr">(Yoder et al., 2013)</ref> and that proximal effects tend to be larger than distal effects in young children with autism <ref type="bibr">(Sandbank et al., 2019)</ref>.</p><p>Boundedness. Some intervention outcomes are measured in contexts that are very similar to the intervention itself, including the materials used, the procedures for eliciting the outcome (e.g., prompting and reinforcement), the interaction partner, and the setting. If this is the case, the outcome can be considered potentially "context bound." In contrast, outcomes that are measured in contexts that are very different from the intervention on the dimensions listed above are considered more highly "generalized." In most cases, generalized outcomes are more favorable, as they suggest that the outcome has become an established part of the child's repertoire and is not dependent on particular aspects of the intervention in order to occur. Similar to the aforementioned findings for proximal effects, however, research has shown that interventions are more likely to produce effects on context-bound outcomes <ref type="bibr">(Yoder et al., 2013)</ref> and that effect sizes tend to be larger for context bound as compared to generalized outcomes in young children on the autism spectrum <ref type="bibr">(Sandbank et al., 2019)</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Current Investigation</head><p>The primary purpose of the current investigation was to estimate the summary effect of intervention (considered broadly) on language outcomes as a whole and to evaluate the extent to which intervention effects vary by language outcome subtype (e.g., receptive, expressive, composite) for children with autism during the early childhood period (i.e., between birth and 8 years of age). Although prior meta-analytic work has estimated the summary effects of specific intervention approaches (e.g., behavioral, developmental, NDBI, parent-implemented treatments) on language outcomes <ref type="bibr">(Roberts &amp; Kaiser, 2011;</ref><ref type="bibr">Sandbank et al., 2019)</ref>, as well as the summary effect of intervention on spoken language outcomes <ref type="bibr">(Hampton &amp; Kaiser, 2016)</ref>, no prior meta-analysis has estimated the summary effects of intervention across approaches and across broader language outcomes in young children with autism. The secondary purpose of this investigation was to examine the degree to which intervention effects on language outcomes were moderated by various characteristics of the intervention approach, participant sample, and outcomes measured. Our research questions were as follows:</p><p>1.</p><p>Are the summary effects of intervention on language outcomes in children with autism, considered broadly, and by subtype of receptive, expressive, and composite language outcomes, significant and positive?</p><p>2.</p><p>Are the effects of intervention on language outcomes moderated by any one of nine putative moderators (intervention type, cumulative intensity, interventionist, participant age, autism symptomatology, entrylevel language ability, language subtype, proximity, and boundedness)?</p><p>Given prior evidence and theory, we hypothesized that summary effects would be significantly larger for interventions with greater cumulative intensity, as well as for those interventions that were delivered by a combination of parents and clinicians as compared to either parents or clinicians alone. Second, we hypothesized that summary effects would be larger for participant samples with lower mean age and autism symptomatology scores, as well as with higher entry-level language ability. Finally, we hypothesized that intervention effects would be smaller for receptive relative to expressive and composite language outcomes and that effects for proximal and context-bound outcomes would be significantly larger than effects for distal and generalized outcomes.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Method</head><p>The current review article is part of a larger systematic review and quantitative synthesis of all nonpharmacological intervention studies of young children with autism, referred to as the Autism Intervention Meta-analysis or Project AIM <ref type="bibr">(Sandbank et al., 2019)</ref>. Relevant search and coding procedures are reiterated here briefly.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Search</head><p>A wide search strategy was used for the initial project <ref type="bibr">(Sandbank et al., 2019)</ref>. Nine online databases (Academic Search Complete, CINAHL Plus with Full Text, Education Source, Educational Administration Abstracts, ERIC, MEDLINE, PsycINFO, Psychology and Behavioral Sciences Collection, and SocINDEX with Full Text) were searched with the following search terms: autis*, ASD, PDD, Aspergers, intervention, therapy, teach*, treat*, program, package, assign*, control group, BAU, "wait list," RCT, random*, quasi, "treatment group," "intervention group," "group design," and trial. Synonymous terms were joined with the boolean operator "OR," and groups of terms across categories were joined with the boolean operator "AND." The final electronic search was completed on November 16, 2017. To gather unpublished data, we also searched the National Database for Autism Research, the National Institutes of Health Matchmaker, and the Institute of Education Sciences to identify researchers who had been awarded federal grants to study autism interventions. Of 106 researchers identified through this search, 90 were contacted by e-mail with a request to share eligible outcome data. The contact information for the remaining investigators could not be found. The initial search yielded 12,933 results and captured a broad scope of the intervention literature (i.e., reporting on effects of all intervention types on all outcome types for children with autism across early childhood). Studies were eligible for inclusion in the current meta-analysis if they were experimental or quasi-experimental group design studies examining the effect of an intervention on language outcomes for young children (aged 0-8 years) with autism, regardless of whether or not the intervention was explicitly reported to directly target language. A total of 60 studies met the inclusion criteria for this subgroup analysis of the larger Project AIM data.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Coding Procedures</head><p>After the search and screening process, studies were coded for study, participant, intervention, and outcome characteristics. The coding manual used by primary and reliability coders is available upon request from the first author, and data have been deposited in the Open Science Framework: <ref type="url">https://osf.io/ha76c/?view_only= 55f42fb1e14a4af3a16d5885b301a8b5</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Participant Characteristics</head><p>Studies were coded to include pre-intervention chronological age in months, autism symptomatology, and entry-level language ability of study samples. Autism symptomatology scores were taken from eligible measures when reported. These included all versions of the ADOS, the Autism Diagnostic Interview-Revised, and the Childhood Autism Rating Scale. Scores were then categorized as either "moderate" or "high" using published guidelines for score interpretation <ref type="bibr">(Gotham et al., 2009;</ref><ref type="bibr">Hus et al., 2014;</ref><ref type="bibr">Luyster et al., 2009;</ref><ref type="bibr">Schopler et al., 1988)</ref> or guidance from individuals with expertise in the quantification of autism symptomatology from the aforementioned standardized measures (K. <ref type="bibr">Gotham, personal communication, November 8, 2018)</ref>. When autism symptomatology scores were not reported or when reported scores could not be categorized based on published guidelines, autism symptomatology was coded as missing. When reported, initial language ages in months were also extracted from the study.</p><p>Expressive language age was prioritized over receptive language age (as we suspected, expressive language age would be more commonly reported), but receptive and total language age were extracted if expressive language age was not reported.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Intervention Characteristics</head><p>Interventions were coded as belonging to one of nine categories. These included animal-assisted therapy, behavioral, developmental, NDBI, cognitive behavior therapy, sensory based, technology based, and TEACCH. Interventions that were not captured by these categories were coded as "other." Explicit criteria that were used to categorize intervention approaches are detailed in the main project report <ref type="bibr">(Sandbank et al., 2019)</ref>. The cumulative intensity of intervention in hours participants received was also coded when estimable from study details. For interventions that incorporated parent training while child participants were present, training time was included in intensity calculations. Parent training hours were excluded from intensity calculations if children were not present during this time. Lastly, the person/s who delivered the intervention to the participants was coded as either caregivers, clinicians, educators, peers, or technology (e.g., when the intervention was completely mediated through a DVD or computer). If a substantial portion (&gt; 40%) of intervention hours was delivered by individuals from two of the above categories, either working together at the same time or separately, then the type of interventionist was coded as "combination."</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Outcome Characteristics</head><p>The outcomes analyzed in this review article are those that index the postintervention language ability of the participants in treatment conditions relative to contrast/control groups. Language outcomes were further classified as indexing receptive, expressive, or composite language ability. As outlined in the study of <ref type="bibr">Sandbank et al. (2019)</ref>, each outcome was also coded for quality indicators, including the risk of selection bias, attrition bias, detection bias, correlated measurement error related to parent/teacher training, and reliance on caregiver report. Selection bias was coded as high for outcomes taken from studies that were quasi-experimental or that featured insufficient randomization procedures (as opposed to randomized controlled trials [RCTs]). Attrition bias was coded as high for outcomes for which data were missing for more than 20% of participants, where intent-to-treat analysis was not employed. Detection bias was coded as high for outcomes collected by assessors who were aware of group assignment. The potential threat of correlated measurement error related to parent/teacher training was coded as high when parents or teachers participated in the study as both interventionists and assessors (see <ref type="bibr">Sandbank et al., 2019</ref>, for an expanded rationale regarding this quality indicator).</p><p>Outcomes were also coded in regard to their proximity to intervention targets and their boundedness to intervention contexts. Outcomes were coded as proximal if they indexed skills that were directly taught or prompted during intervention. They were coded as distal if they indexed skills (a) that were not directly targeted in the intervention and/or (b) that were measured via developmentally scaled assessments, which are designed to capture developmental progress across a given domain rather than acquisition of specific skills. Outcomes were coded as context bound if they were measured in contexts that were the same or similar to the intervention context, potentially context bound if they were measured via a report from a parent or teacher that delivered the intervention (as these assessments do not indicate the extent to which children displayed language gains with partners who were not part of the intervention), and generalized if they were measured in a context that differed from that of the intervention context on several dimensions (e.g., interaction partner, interaction style, materials, setting).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Effect Size Information</head><p>Unadjusted postintervention means, standard deviations, and ns were extracted for treatment and contrast groups. This information was used to calculate the standardized mean difference reflecting the difference between groups after intervention. Standardized mean differences were then converted to Hedge's g to correct for small sample sizes (applicable to sample sizes &lt; 50), which was the effect size metric used for analyses. Effect sizes were transformed as necessary so that higher effects consistently reflected outcomes that favored the intervention group.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Analyses</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Summary Effect Estimation</head><p>The summary effects of intervention were estimated for all language outcomes and for subgroups of receptive, expressive, and composite outcomes, using intercept-only robust variance estimation (RVE; <ref type="bibr">Hedges et al., 2010)</ref> metaregression models. A primary assumption of metaanalysis is that effects are independent, but this assumption is violated when multiple effects are extracted from individual studies. To address this violation, we used RVE to account for the within-study dependence of effects. RVE estimates the covariance structure of metaregression coefficients by assuming a common correlation between all effect sizes (&#961;). RVE is a useful approach because it does not require assumptions about the distribution of effect sizes or their weighting scheme <ref type="bibr">(Tipton, 2015)</ref>. All RVE analyses were conducted with &#961; set at 0.8 and then followed by sensitivity analyses to ensure that changing the value of &#961; did not substantially change summary effect estimates. We also applied the small sample adjustments proposed by <ref type="bibr">Tipton (2015)</ref>, which correct degrees of freedom to allow the researcher to evaluate whether the RVE approach was suitable for the given analysis. Results with fewer than four degrees of freedom should not be trusted <ref type="bibr">(Tanner-Smith &amp; Tipton, 2014)</ref>.</p><p>where effect sizes are treated as the dependent variable in a regression model, and study-level covariates (i.e., moderators) are entered as predictors. Prior to building metaregression models, we first examined putative associations between continuous pretreatment predictors and intervention outcomes using visual inspection of bubble plots to ensure that linear models were sufficient and that the addition of quadratic terms was not needed. For categorical predictors, metaregression analyses were used to determine the intervention effect in each subgroup in reference to nominated reference subgroups. Metaregression analyses were conducted on the following putative moderators: intervention type, intervention intensity, interventionist, chronological age, autism symptomatology, language age, and language outcome subtype. An exploratory post hoc metaregression analysis was also carried out to test a potential interaction between autism spectrum disorder symptomatology and intervention intensity that was suggested by the results of one recent RCT testing the efficacy of treatments delivered at relatively high versus low intensity in young children with autism (P. J. <ref type="bibr">Yoder et al., 2018)</ref>. Summary effect estimates and metaregression analyses were conducted with the R package Robumeta <ref type="bibr">(Fisher et al., 2017)</ref>, and plots were created with the R package Metafor <ref type="bibr">(Viechtbauer, 2010)</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Publication Bias</head><p>Finally, we conducted tests of publication bias, because a publication process, which gives preferential treatment to studies that document significant intervention effects over studies with null results, can yield a set of published studies that are largely unrepresentative of the complete body of evidence and lead to an overestimation of summary effects. Publication bias potentially threatens all meta-analytic results; therefore, it is essential that metaanalyses in speech, language, and hearing research include multiple tests designed to evaluate the potential influence of publication bias <ref type="bibr">(Chow, 2018)</ref>. Common methods for this purpose involve testing the association between effect sizes and their precision, because effect estimates from small studies should vary most (due to random error), whereas effect estimates from large studies should vary least. To this end, we visually inspected funnel plots of effect sizes plotted against their standard errors and tested the asymmetry of these plots using an Egger's regression test <ref type="bibr">(Egger et al., 1997)</ref>. The results of these tests provide quantitative information that allow us to evaluate the likelihood that summary effects were influenced by publication bias.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Results</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Reliability</head><p>All reliability calculations were completed using the irr package <ref type="bibr">(Gamer et al., 2012)</ref> in R studio (R Core Team, 2017). Coding reliability was calculated for 100% of studies included in the larger meta-analysis, using two-way random, single measures, absolute intraclass correlations for continuous variables (ICC[A, 1]; <ref type="bibr">McGraw &amp; Wong, 1996)</ref> and unweighted kappa coefficients for categorical variables (J. <ref type="bibr">Cohen, 1960)</ref>. Reliability was high. Average kappa values across categorical variables included in the current review article was .82 (range: .73-.91), and the average intraclass correlation across continuous variables was .88 (range: .81-.96).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Descriptives of Included Study Samples and Outcomes</head><p>A total of 221 outcomes gathered from 60 studies featuring a total of 2,908 participants were included in the current analyses. Of included outcomes, 130 were coded as expressive, 79 were coded as receptive, and 12 were coded as tapping both expressive and receptive language (composite language). The mean number of language outcomes reported per study was 3.68 (min = 1, max = 14). On average, participants were 47.5 months old (SD = 16.45). The average percentage of male participants across samples was 82.7%. Average participant language age was 20.19 months (SD = 7.52) for studies in which it was reported. See Table <ref type="table">1</ref> for included studies and their corresponding participant and intervention characteristics.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Outcome Quality</head><p>Figure <ref type="figure">1</ref> reflects outcome-level quality indicators. Out of 221 outcomes, 135 (61%) indexed intervention effects in RCTs, 25 (11%) were coded as having high risk of attrition bias due to a large percentage of missing outcome data, and 126 (51%) were coded as having high detection bias due to reliance on assessors that were aware of group assignment. The threat of correlated measurement error related to parent/teacher training was marked as high for 71 outcomes (32%), where parents or teachers participated both as interventionists and assessors. A total of 59 outcomes (26%) were derived from caregiver report. We coded 21 outcomes (9.5%) as proximal to intervention targets. Finally, 31 outcomes (14%) were coded as bound to the context of intervention, 47 outcomes (21%) were coded as potentially context bound, and 143 (65%) were coded as generalized.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Summary Effects of Intervention on Language Outcomes</head><p>Forest plots of included effect sizes and summary effects for receptive, expressive, and composite language outcomes are presented in Figures <ref type="figure">2, 3,</ref> and<ref type="figure">4</ref>. Across all language outcomes and intervention types, the RVE summary estimate with small sample corrections was 0.184 (95% CI [0.075, 0.292], p = .001). Metrics for quantifying the dispersion of effect sizes suggest there was substantial heterogeneity (I 2 = 58.6%, &#964; 2 = 0.123, &#964; = 0.351). For expressive language outcomes, the RVE summary estimate was 0.18 (95% CI [0.077, 0.283], p = .001). For receptive language outcomes, the RVE summary estimate was 0.135 (95% CI [0.000, 0.269], p = .05). For composite language outcomes, the RVE summary estimate was 0.284 (95% CI [-0.0465, 0.614], p = .084). Following benchmarks for main effects proposed by <ref type="bibr">Cohen (1988)</ref>, where effect sizes of 0.2, 0.5, and 0.8 are considered small, moderate, and large, respectively, these effects are relatively small. However, it should be noted that summary effects for education interventions tend to fall within a range of 0.20-0.30 <ref type="bibr">(Hill et al., 2008)</ref>, so the magnitude of these effect sizes might be more appropriately interpreted as moderate.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Moderator Analyses</head><p>Table <ref type="table">2</ref> provides descriptive information for putative moderators. Detailed results of tested metaregression models are presented in Table <ref type="table">3</ref> with both uncorrected and corrected p values <ref type="bibr">(Benjamini &amp; Hochberg, 1995)</ref>. Benchmarks for small, moderate, and large moderator effects are 0.10, 0.20, and 0.40, respectively <ref type="bibr">(Tipton, 2015)</ref>, but these benchmarks are meant to complement Cohen's benchmarks for main effects. If we consider a main effect of 0.25 to be moderate, then the corresponding moderate metaregression coefficient estimate would be 0.13 (e.g., half of the main effect benchmark). Significant intercept estimates should not be interpreted as evidence that effects were significantly moderated by tested predictors. Rather, this suggests that the summary effect of intervention is significantly different from zero when the value of the predictor is 0 (for continuous moderators), or that the summary effect of the reference category is significantly different from 0 (for categorical moderators).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Intervention Characteristics</head><p>Results from the metaregression models that included intervention variables indicated that effect sizes were not moderated by intervention type (see Table <ref type="table">3</ref>) or by cumulative intervention intensity in hours. However, interventionist was a significant moderator of effect sizes, when alpha was nominally set at .05. Results from the metaregression model that included the categorical variable of interventionist, with caregiver as the reference category, indicated that intervention effects were significantly larger for interventions implemented by clinicians compared to caregivers alone (B = 0.33, p = .044) and marginally larger for those implemented by a combination of interventionists (e.g., caregivers and clinicians working together, B = 0.26, p = .058) compared to caregivers alone. However, when p values were corrected to account for multiple comparisons, they did not pass the significance threshold. Effect sizes for interventions implemented by other interventionist types (e.g., educator, computermediated instruction) did not significantly differ from caregiver-implemented intervention effects. Figure <ref type="figure">5</ref> displays summary effects and confidence intervals by interventionist type.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Participant Characteristics</head><p>Results from metaregression models that included participant characteristics suggested that chronological age at intervention onset did not moderate intervention effect sizes (B = 0.03, p = .641). Autism symptomatology    categorizations also did not moderate intervention effects: Significantly different effects were not observed for participant samples rated as "high symptomatology" compared to samples for which autism symptomatology was categorized as "moderate" (B = 0.09, p = .639). Language age in months did significantly moderate intervention effects, such that higher mean language ages were associated with larger intervention effects (B = 0.25, p = .010). This result was significant even after correcting for multiple comparisons. Figure <ref type="figure">6</ref> displays a bubble plot of effect sizes plotted against participant mean language age equivalents.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Outcome Characteristics</head><p>Results from the metaregression model that included outcome type as a categorical variable, with expressive outcomes as the reference category, indicated that intervention  effects were significantly smaller for receptive outcomes compared to expressive outcomes (B = -0.13, p = .047), though this effect was not significant after correcting for multiple comparisons. Effect sizes for composite language outcomes did not differ significantly from expressive outcomes (B = 0.16, p = .277). Figures <ref type="figure">2,</ref><ref type="figure">3</ref>, and 4 display RVE summary estimates for receptive, expressive, and composite language outcomes, respectively. Effect sizes did not significantly vary as a function of outcome boundedness or distality. Compared to outcomes coded as context bound, effect sizes were smaller but not significantly different for outcomes coded as potentially context bound (B = -0.28, p = .161), as well as those coded as generalized (B = -0.25, p = .216). Effect sizes for outcomes coded as proximal were, on average, larger than those coded as distal, but this difference was not statistically significant (B = 0.29, p = .344).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Exploratory Post Hoc Analysis</head><p>Results from the exploratory metaregression model that tested a putative interaction between intervention intensity and autism symptomatology categorization indicated the interaction term was not significant (B = -0.176, p = .5).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Publication Bias Analyses</head><p>Results of the Egger's regression test of funnel plot asymmetry for the full model (i.e., across all language outcomes and intervention types) was significant, z = 2.52, p = .012, indicating evidence of publication or small sample bias. Follow-up analyses indicated that this effect was driven by the expressive language outcomes model, z = 4.54, p &lt; .001. Neither the receptive language outcomes model, z = 1.38, p = .17, nor the composite language outcomes model, z = 0.66, p = .51, showed evidence of publication or small sample bias. Funnel plots of effect sizes plotted against their standard errors, across all outcomes, according to outcome type are presented in Figure <ref type="figure">7</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Discussion</head><p>The purpose of this meta-analysis was to determine whether existing interventions significantly improve language of young children with autism, considered broadly and more specifically according to subtype of receptive, expressive, and composite language outcome. As well, we sought to determine whether intervention effects were moderated by various aspects of the participant samples, interventions, and outcomes. These results suggest that interventions on average yield small-to-moderate, significant improvements in language outcomes for children  with autism in early childhood. Summary effect estimates of intervention are significantly smaller for receptive language outcomes relative to summary effects for expressive language outcomes for children with autism during this developmental period. In addition to type of language outcome, other significant moderators of intervention effects included the interventionist/s and the entry-level language ability of participants. However, only entry-level language ability was a significant moderator after correcting for multiple comparisons. We failed to find evidence that intervention type, cumulative intervention intensity, chronological age of participants, participant autism symptomatology, boundedness of the outcome, and distality of the outcome significantly moderated intervention effects, though it is possible that study-level factors, measurement imprecision, and a limited number of studies prevented us from uncovering a potentially true association between any of these putative moderators and intervention effects. Analysis of study quality indicates that there are several areas in which study designs will need to be improved in future research in order to draw strong conclusions about the effects of interventions on language outcomes of young children with autism. Below, we discuss findings for each moderator explored in this study and corresponding recommendations for primary intervention research.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Intervention Characteristics and Intervention Effects</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Intervention Type</head><p>Though our prior work suggested that intervention effects may vary substantially by intervention type for some outcomes of interest in young children on the autism spectrum <ref type="bibr">(Sandbank et al., 2019)</ref>, we did not find evidence in the current review article to suggest that summary effects across language outcomes significantly vary according to intervention type. In other words, though summary effect estimates differ to some degree by intervention type, the confidence intervals surrounding each of these estimates are wide (suggesting high variability of effects within intervention type) and overlap with one another. This should not be construed as evidence that all intervention approaches targeting language outcomes in this population are equivalent. The philosophical underpinnings and techniques employed in these interventions differ extensively, and these differences likely matter. However, at least one recent randomized comparison of this nature documented nonsignificantly different improvements in groups assigned to receive distinct intervention approaches, adding to the evidence that intervention approaches motivated by opposing philosophies may be associated with similar effect sizes (P. J. <ref type="bibr">Yoder et al., 2018</ref><ref type="bibr">Yoder et al., , 2019))</ref>.</p><p>It is also possible that effects of intervention type vary according to participant (sample) characteristics. Such interactions have been observed in prior clinical trials of interventions targeting language and communication outcomes in young children with autism (e.g., P. <ref type="bibr">Yoder &amp; Stone, 2006)</ref>. We were unable to test this question in the present synthesis, as the limited number of studies and missing data prohibited the addition of Intervention Type &#215; Participant Characteristic product terms as predictors in models summarizing effects of interventions on language outcomes. Future RCTs that permit the testing of differential effects of high-quality instantiations of different intervention approaches according to child characteristics are thus necessary to elucidate whether certain interventions are more optimal choices compared to others for facilitating improvements in language for specific subgroups of children on the autism spectrum and thereby advance us toward more personalized treatment planning for this clinical population.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Intensity</head><p>We did not find evidence that greater intervention intensities were significantly associated with greater gains in language. This finding is consistent with the findings of prior meta-analyses of intervention effects on language <ref type="bibr">(Hampton &amp; Kaiser, 2016;</ref><ref type="bibr">Virues-Ortega, 2010)</ref> and related outcomes <ref type="bibr">(Fuller &amp; Kaiser, 2019)</ref> in children with autism, though it departs from frequent assertions that more intervention will yield more improvement. It is possible that a true association between cumulative intensity and intervention effects is complicated by aspects of treatment intensity other than the cumulative number of hours of intervention, such as within-session dosage (i.e., number of teaching episodes effectively delivered per intervention session), dose frequency (i.e., number of intervention sessions per week), and/or the total duration (i.e., total number of weeks over which intervention is provided), as well as participant characteristics, such as autism symptomatology. Though some of the aforementioned, more fine-grained aspects of intervention intensity could not be analyzed because they were not extracted in the original coding system for the larger meta-analysis (and notably often were not reported in extant studies), we were able to conduct exploratory post hoc analyses to examine whether autism symptomatology interacted with cumulative intensity to predict intervention effects. The results of this analysis are discussed below.</p><p>If future meta-analyses are to clarify the impact of intervention intensity on outcomes, it will be important for investigators to report a range of metrics that comprehensively describe intervention dose, dose frequency, and duration <ref type="bibr">(Warren et al., 2007)</ref>, as well as participant characteristics that may predict a differential response to more versus less intense intervention, such as autism symptomatology. Future randomized comparisons of low-and high-intensity versions of single interventions can also increase our understanding of the overall impact of intervention intensity and provide a framework for moderator analyses that elucidate the extent to which this impact differs by participant characteristics. Finally, sequential multi-assignment randomized trial design studies may be particularly useful for determining the extent to which increases in intervention intensity alter the trajectory of change for children who may initially show no or minimal gains during intervention. Until then, it will be important for professionals recommending high-intensity intervention to weigh the potential positive impact of increased intervention with the potential negative impact of stress that high-intensity interventions can place on young children and their families.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Interventionist/s</head><p>We did find evidence that the implementer of the intervention <ref type="bibr">(clinician, caregiver, educator, combination, etc.</ref>) is a key factor that impacts the magnitude of intervention effects on language outcomes. Compared to interventions implemented by caregivers alone, for which the summary effect was small and not significantly different from zero, interventions delivered primarily by clinicians and interventions delivered by a combination of interventionists (i.e., caregivers and clinicians working together) yielded significantly larger effects, though these results for moderated effects notably no longer exceeded the threshold for statistical significance after correcting for multiple comparisons. The largest summary effect estimate was observed for interventions delivered by clinicians only. This result contrasts with the findings of <ref type="bibr">Hampton and Kaiser (2016)</ref>, who found that the summary effect of clinician-led interventions on spoken language outcomes was very small and not significantly different from zero. The inclusion of approximately 200 more effect sizes in our analysis of this question likely explains the apparent discrepancy in findings across syntheses.</p><p>The summary effects for interventions delivered primarily by educators and for interventions mediated entirely through technology were also small and not significantly different from the summary effect for treatments delivered by caregivers. These results suggest that, though caregivers and educators are primary figures in young children's lives, their ability to directly effect change in language outcomes may be limited. Clinicians who have specialized training in language development and treatment (e.g., speech language pathologists) are likely the most equipped to facilitate language development, either by working directly with children or working with caregivers and educators to provide intervention across the natural environments that children encounter each day. However, we note that there may be language outcomes that were not measured in this analysis (e.g., those that tap more social and/or pragmatic features of language) that may be more influenced by caregivers than by clinicians.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Participant Characteristics and Intervention Effects</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Chronological Age</head><p>Chronological age did not emerge as a significant moderator of intervention effects on language outcomes in this meta-analysis. This finding is consistent with prior meta-analytic work in this area <ref type="bibr">(Hampton &amp; Kaiser, 2016)</ref> but may also be due to the restricted age range defined for eligible studies (i.e., aged 0-8 years). Our results should not be construed as evidence that early intervention is not important for children with autism. Multiple studies included in this meta-analysis demonstrated that intervention can have positive effects on language outcomes for very young children with autism, and early gains in language may produce cascading effects on development in related domains as children age. Thus, early access to diagnosis and intervention continue to be necessary for children with autism. Rather, we see our results as adding to mounting evidence that advancing age does not place a limit on the amount of change that can be achieved with intervention. Rather, children can benefit from language interventions throughout early childhood (i.e., birth to 8 years).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Autism Symptomatology</head><p>We additionally did not find evidence that autism symptomatology moderated intervention effects on language outcomes for children on the autism spectrum. A number of challenges may have limited our ability to detect a true association between autism symptomatology and intervention effects, and these are detailed in the Limitations section. The relatively recent creation of the ADOS calibrated severity score algorithms <ref type="bibr">(Gotham et al., 2009)</ref>, which provide a continuous measure of symptomatology that is comparable across age groups and ADOS modules, could facilitate direct comparison of separate participant samples going forward. Thus, increased reporting of calibrated severity scores to quantify autism symptomatology could allow future meta-analysts to better estimate the true impact of autism symptomatology on intervention effects.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Language Ability</head><p>As we predicted, our results suggested that intervention effects on language outcomes were dependent on children's entry-level language ability, such that children with higher initial language age equivalency scores at study entry benefited more from language interventions than children with lower initial language age equivalency scores. This finding is consistent with prior evidence and theory that initial developmental achievements in language provide a foundation for further development, creating a "rich get richer" phenomenon, where children with substantial developmental delays benefit less from intervention than their more advanced peers. Further work must be done to develop and test interventions that facilitate improvement for this subgroup of children on the spectrum, especially since recent work suggests that merely intensifying available interventions (i.e., increasing from 5 to 15 hr per week) do not yield added benefit for this group on average (P. J. <ref type="bibr">Yoder et al., 2018</ref><ref type="bibr">Yoder et al., , 2019))</ref>. There is at least some evidence that suggests that language development in this subgroup of children benefits from more explicit, adult-led interventions than naturalistic, child-led approaches <ref type="bibr">(Paul et al., 2013</ref><ref type="bibr">, P. Yoder &amp; Stone, 2006)</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Outcome Characteristics and Intervention Effects</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Language Outcome Type</head><p>As we anticipated, intervention effects varied depending on the aspect of language that was indexed, such that receptive outcomes were significantly smaller than both expressive and composite language outcomes, when alpha was nominally set at .05. Though expressive language acquisition is often a key focus of intervention for children with autism, these findings add to a large literature suggesting children with autism may have considerable difficulty with receptive language acquisition and may require interventions and Individualized Education Program goals that specifically target receptive skills (e.g., <ref type="bibr">Barbaro &amp; Dissanayake, 2012;</ref><ref type="bibr">Charman et al., 2003;</ref><ref type="bibr">Ellis Weismer et al., 2010;</ref><ref type="bibr">Gillum &amp; Camarata, 2004;</ref><ref type="bibr">Luyster et al., 2008;</ref><ref type="bibr">Maljaars et al., 2012;</ref><ref type="bibr">Pickles et al., 2014;</ref><ref type="bibr">Volden et al., 2011;</ref><ref type="bibr">Woynaroski et al., 2016)</ref>. Persistent deficits in receptive language may contribute to later academic difficulties such as poor reading comprehension, as well as social difficulties stemming from an inability to follow complex conversational exchanges, negatively impacting long-term outcomes of persons with autism. Thus, it is important that clinicians' focus on acquisition of spoken language for this population does not come at the exclusion of targeting receptive language skills.</p><p>It is notable that the expressive language outcomes showed significant evidence for publication and/or small study bias, whereas the receptive language outcomes did not. Given that our search strategy included an extensive gray literature search (see <ref type="bibr">Sandbank et al., 2019)</ref>, it is likely that small study bias or some other factor influenced the expressive language model (see Figure <ref type="figure">7</ref>, which shows effect sizes to the right of the funnel have large standard errors, indicating small sample sizes). The presence of bias may have led to inflated summary effect sizes in analyses focused on effects of intervention on expressive outcomes. Therefore, more primary research (or possibly publication of previously completed but presently unpublished primary research) exploring treatment effects on both receptive and expressive language outcomes, particularly rigorous research conducted with large samples, is needed to fully understand the impact of intervention on these domains in young children with autism.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Boundedness and Distality</head><p>Though we found evidence in prior work that boundedness and distality moderated effect sizes of intervention across all outcomes of interest to young children with autism, without regard to outcome type <ref type="bibr">(Sandbank et al., 2019)</ref>, in the present synthesis, we did not find evidence that these outcome characteristics moderated intervention effects on language outcomes specifically. On average, language outcomes that were coded as "potentially contextbound" or generalized were smaller than those coded as context bound, but the confidence intervals for the aforementioned outcome types overlapped. Similarly, language outcomes that were coded as proximal were larger, on average, than those coded as distal, but not significantly different. Our failure to replicate prior findings regarding the effect of boundedness and distality on intervention outcomes may have been a product of reduced power, as fewer outcomes and studies were included in the current analysis compared to that of the larger project (see <ref type="bibr">Sandbank et al., 2019)</ref>. Even so, future investigators should consider these outcome characteristics when planning and interpreting results from intervention studies to ensure that readers do not overestimate an intervention's potential to effect change in outcomes and contexts beyond those that were directly targeted in treatment.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Outcome Quality</head><p>Our claims in regard to the efficacy of interventions on language outcomes should be tempered in light of the quality concerns apparent in the included studies. Similar to the larger meta-analysis from which this subset of study outcomes was drawn, a lack of naive coders and assessors is evident for a majority of outcomes. This quality concern indicates that the summary-level effects we report may be overestimated in comparison to "true" intervention effects, though this issue is unlikely to have affected findings from moderator analyses. Researchers should continue to work toward designing intervention studies that are randomized and increase efforts to ensure that assessors and coders are not aware of intervention assignment.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Strengths</head><p>The multiple strengths of this review article include the use of comprehensive search techniques and advanced meta-analytic tools. First, the wide initial search strategy employed in the larger project likely permitted the identification of more studies than would have been identified in a more targeted search. However, one caveat of this is that, because our search terminology did not specifically include the term "language," we may have captured studies of interventions that were not specifically language oriented but that simply included measures of language growth and/or outcome as a secondary analysis. However, even if this was the case, presumably, investigators tracked language as a secondary outcome because they had reason to believe that this domain might be distally impacted by the intervention of interest. Thus, we see it as a strength that these effects were also included in this meta-analysis. A second strength of this review article was the use of RVE <ref type="bibr">(Hedges et al., 2010)</ref>, which allowed us to include multiple language outcomes from each study and then to statistically account for their intercorrelation, increasing the precision of our summary estimates.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Limitations</head><p>The primary limitations of this review article are related to power. First, we were unable to test more complex moderation models due to missing data. While the available data were sufficient to justify metaregression models with single moderator terms, we were unable to test models with multiple moderators, because listwise deletion of missing data for any single predictor would have greatly reduced the number of cases in a given model and the corresponding power of that model. Second, most significant moderator results were associated with borderline p values and were no longer significant after correcting for multiple comparisons. Multiple uncorrected comparisons are a common issue in meta-analytic literature and can give rise to Type I errors (i.e., the true effect is zero, but researchers incorrectly reject the null) and skew conclusions about the summary effects of intervention and putative moderators <ref type="bibr">(Polanin &amp; Pigott, 2015)</ref>. While researchers agree that multiple comparisons can pose a threat, there is less agreement on how to address this threat in metaanalysis <ref type="bibr">(Borenstein et al., 2011)</ref>. In many cases, researchers choose a lower significance criterion (&#945;) for treating results as significant. Although choosing a more stringent alpha level will reduce the risk of a Type I error, it will also reduce the power to detect an effect and consequently increase the risk of a Type II error (i.e., the true effect is not zero, but researchers fail to reject the null). In balancing the risk for Type I and II errors, researchers must consider the potential consequences of each relative to their own results. For example, if significant results are likely to be interpreted as definitive and trigger an immediate change in practice, then a stringent alpha level should be chosen to avoid a Type I error. Alternatively, if significant results are likely to be interpreted as highlighting potentially important findings and inviting replication, then a less conservative alpha level may be chosen to avoid a Type II error. In regard to the current findings, given that power for tests of moderators in meta-analysis is often already very low <ref type="bibr">(Hedges &amp; Pigott, 2004)</ref> and given that our results are unlikely to be interpreted as definitive and produce an immediate change in clinical practice, we believe it would be imprudent to rely on a more stringent alpha criterion when interpreting our results (though we have included corrected p values in Table <ref type="table">3</ref> and explicitly highlighted all instances wherein significant results did not survive corrections for multiple comparisons to allow readers to draw their own conclusions). Rather, we suggest that our results highlight potentially important intervention, participant, and outcome characteristics that may influence intervention effects for children with autism, while also calling for replication.</p><p>Finally, an additional limitation of this review article was the forced dichotomization of autism symptomatology. Forced dichotomization of a continuous variable will always result in the loss of information, and in this case, that loss may have obscured a true association. These limitations further prevented us from examining with precision the potential complex interactions between intervention, participant, and outcome characteristics, which might have increased our understanding of "what works" and "for whom" and "for what" <ref type="bibr">(Sneider, 2018)</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Future Meta-Analytic Research</head><p>Though the results of this meta-analytic investigation are informative, they are limited in scope to language outcomes and should not be assumed to generalize to intervention effects on all outcomes of young children with autism. Moderating associations of intervention, participant, and outcome characteristics on intervention effects likely differ across outcome domains. Thus, future meta-analytic investigations should examine the extent to which these variables moderate intervention effects on other outcomes of interest, particularly those that are core challenges for autistic children, such as social communication and sensory function. It will also be important to examine moderating associations within studies of newer interventions that have recently gathered a large evidence base, such as NDBIs, across outcome types <ref type="bibr">(Schreibman et al., 2015)</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Conclusions</head><p>Existing interventions can likely affect small but significant improvements in language outcomes on average for children with autism between birth and 8 years of age. Effects are largest for expressive language outcomes and when interventions are delivered by clinicians or clinicians working in combination with caregivers or educators. Children with higher language ability at entry to treatment may stand to make greater gains as a result of intervention than those with more substantial language impairments or lower entry-level language ability. However, some concerns regarding study quality, in particular the high prevalence of assessors and coders who are not naive to group assignment, prevent us from making strong claims in regard to intervention effectiveness. Thus, more rigorous clinical trials are necessary to increase our confidence in the degree to which interventions can facilitate language development for this clinical population in early childhood.</p></div><note xmlns="http://www.tei-c.org/ns/1.0" place="foot" xml:id="foot_0"><p><ref type="bibr">Mesibov &amp; Shea, 2010)</ref> is a classroom-based intervention that heavily incorporates visual cues and structured work systems. Although TEACCH is one of the most widely used interventions for children with autism, relatively few group design studies have documented the effects of 1538 Journal of Speech, Language, and Hearing Research &#8226; Vol. 63 &#8226; 1537-1560 &#8226; May 2020 Downloaded from: https://pubs.asha.org Delmar Cengage Learning on 06/17/2020, Terms of Use: https://pubs.asha.org/pubs/rights_and_permissions</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" xml:id="foot_1"><p>Downloaded from: https://pubs.asha.org Delmar Cengage Learning on 06/17/2020, Terms of Use: https://pubs.asha.org/pubs/rights_and_permissions</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" xml:id="foot_2"><p>Sandbank et al.: Intervention Effects on Language in Autism 1541 Downloaded from: https://pubs.asha.org Delmar Cengage Learning on 06/17/2020, Terms of Use: https://pubs.asha.org/pubs/rights_and_permissions</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="1546" xml:id="foot_3"><p>Journal of Speech, Language, and Hearing Research &#8226; Vol. 63 &#8226; 1537-1560 &#8226; May 2020 Downloaded from: https://pubs.asha.org Delmar Cengage Learning on 06/17/2020, Terms of Use: https://pubs.asha.org/pubs/rights_and_permissions</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="1548" xml:id="foot_4"><p>Journal of Speech, Language, and Hearing Research &#8226; Vol. 63 &#8226; 1537-1560 &#8226; May 2020 Downloaded from: https://pubs.asha.org Delmar Cengage Learning on 06/17/2020, Terms of Use: https://pubs.asha.org/pubs/rights_and_permissions</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="1552" xml:id="foot_5"><p>Journal of Speech, Language, and Hearing Research &#8226; Vol. 63 &#8226; 1537-1560 &#8226; May 2020 Downloaded from: https://pubs.asha.org Delmar Cengage Learning on 06/17/2020, Terms of Use: https://pubs.asha.org/pubs/rights_and_permissions</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="1558" xml:id="foot_6"><p>Journal of Speech, Language, and Hearing Research &#8226; Vol. 63 &#8226; 1537-1560 &#8226; May 2020 Downloaded from: https://pubs.asha.org Delmar Cengage Learning on 06/17/2020, Terms of Use: https://pubs.asha.org/pubs/rights_and_permissions</p></note>
		</body>
		</text>
</TEI>
