- About this Journal ·
- Abstracting and Indexing ·
- Aims and Scope ·
- Article Processing Charges ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Recently Accepted Articles ·
- Reviewers Acknowledgment ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents
International Journal of Otolaryngology
Volume 2012 (2012), Article ID 724214, 8 pages
Assessment of Single-Word Production for Children under Three Years of Age: Comparison of Children with and without Cleft Palate
1Department of Audiology and Speech-Language Pathology, Clinical and Rehabilitative Health Sciences, East Tennessee State University, P.O. Box 70282, Johnson City, TN 37614, USA
2Department of Audiology and Speech-Language Pathology, Center of Excellence in Early Childhood Learning and Development, East Tennessee State University, Johnson City, TN 37614, USA
3Department of Speech and Hearing Sciences, University of Washington, 1417 NE 42nd Street, Seattle, WA 98105, USA
4Department of Special Education, Vanderbilt University, 110 Magnolia Circle, Nashville, TN 37201, USA
Received 13 August 2011; Accepted 2 January 2012
Academic Editor: Steven Goudy
Copyright © 2012 Nancy J. Scherer et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Background. This study reports comparative phonological assessment results for children with cleft lip and/or palate (CLP) to typically developing peers using an evaluation tool for early phonological skills. Methods. Children without clefts (NC = noncleft) and 24 children with CLP, ages of 18–36 months, were evaluated using the Profile of Early Expressive Phonological Skills (PEEPSs) . Children interacted with toy manipulatives to elicit a representative sample of target English consonants and syllable structures that are typically acquired by children between 18 and 27 months of age. Results. Results revealed significant differences between the two groups with regard to measures of consonant inventory, place of articulation, manner of production, accuracy, and error patterns. Syllable structure did not indicate differences, with the exception of initial consonant clusters. Conclusions. findings provide support for PEEPS as a viable option for single-word assessment of children with CLP prior to 3 years of age.
Early intervention based on appropriate and thorough analyses of articulatory and phonological skills is essential; largely due to the role phonology plays in early linguistic development [1–9]. Evidence across a number of studies indicates that phonological abilities, in addition to lexical development, are the two distinguishing characteristics in identifying children as late talkers at an early age [2, 6–8, 10]. For example, Paul and Jennings  reported that toddlers who were identified as late talkers had a smaller consonant repertoire and a lower percentage of consonant accuracy compared to typically developing age peers. Based on their findings, Paul and Jennings recommended that the overall number of different consonants in a young child’s inventory be used as a sensitive indicator of development and delay and that syllable complexity serves as an effective means for monitoring phonological development. In an investigation of late talker development, Williams and Elbert  examined a number of phonetic and phonological measures, including phonetic inventory, syllable structure, syllable diversity, sound variability, percentage of consonants correct, and error patterns. They reported that both quantitative and qualitative phonetic and phonological measures were important in determining recovery from late talking or persistence of a phonological delay.
In addition to phonology’s role in early identification, a number of phonetic and phonologic measures have been reported to predict future performance with regard to persistence versus recovery of delayed speech and language development in young children. Carson et al.  summarized evidence across several studies that indicate that typically developing children 24–31 months of age had significantly larger and more diverse phonetic inventories for vowels and consonants across all word positions compared to children with SLI-E , produced significantly more complex syllables, and were more accurate in their productions than late-talking toddlers . Similarly, Thal et al.  reported that children identified as late talkers made greater gains in lexical development if they had larger phonetic inventories and 10 or more words in their vocabularies than children who had smaller phonetic inventories and an expressive lexicon with less than 10 words. Paul and Jennings  concluded that global measures of phonological ability, such as syllable structure complexity, phonetic inventory size, and percentage of consonants, can be used as prognostic indicators of development for children identified as late talkers. In a longitudinal study of recovery or persistence of delay, Carson et al.  examined 20 different phonological measures, including the number of different consonants (overall and in initial and final positions), number of different consonant clusters (in initial and final positions), and percentage of syllable structures with final consonants. Similar to the quantitative findings reported by Williams and Elbert , they found that the greater the delay in phonological development at two years, the more at risk the child was for continuing delays at three years.
Despite the role of phonology in the early identification and prediction of language delay, assessment tools of early phonological skills have not been available . The importance of early phonological assessment is especially important for children with cleft lip and/or palate (CLP) who are at risk for early speech and language delays due to the presence of the cleft during the first year of life [13–18]. For some children, this delay persists through the preschool period and may impact early literacy skills [19–24]. It is thought that early structural deficits restrict the speech sound inventories of young children with CLP, which in turn limits vocabulary growth. It has been established that young children with CLP produce more words beginning with nasals, vowels, glides, and fewer words beginning with oral stop consonants than children without clefts . It is also apparent that they show an early preference for sounds made at the labial, velar, and glottal place of articulation .
The recent focus on early intervention for children with CLP attempts to change the trajectory of early speech and language development; however, limitations in speech assessment materials for children under three years restrict the ease and accuracy of speech sound assessment that, in turn, drives goal selection for treatment . Assessment of phonological development for children with CLP, as well as all young children, has been based primarily on parent report (e.g., McArthur Communication Development Inventories)  or a brief subtest within a larger standardized test (e.g., Sequenced Inventory of Communicative Development; ). These measures, however, are extremely limited and cannot provide a representative or even sufficient evaluation of the key phonetic and phonemic characteristics which are required for an age-appropriate clinical assessment. The Parameters of Care from the American Cleft Palate-Craniofacial Association  recommend a speech-language evaluation twice in the first two years of life and again at three years of age. A single-word measure of speech production specifically designed to assess the major components of phonological development in young children would be helpful in identifying children who would benefit from early intervention.
Assessment of speech sound development in children less than three years of age is challenging due to the inherent variability in early language and phonological development [29, 30]. This variability is due in part to the strategies young children use to select words from their vocabulary and to the absence of phonological rules that govern the more stable sound system observed in older children . We know that the phonological characteristics of the words play an important role in determining which words a child includes in their early vocabularies for typically developing children, as well as children with cleft lip and palate [25, 31–35]. Children choose words with phonological characteristics that are consistent with their developing sound systems and avoid words with characteristics that are outside their sound system. A second feature of early word learning is that words are produced as an unanalyzed whole. This learning strategy results in significant variability in children’s production of speech sounds and poor association between the child and adult model. It is important, therefore, to assess sufficient exemplars with representative phonetic characteristics to check for consistency and variability and to sample words with sounds that do not occur in routine conversation in addition to sounds that the child uses frequently [36, 37].
The Profiles of Early Expressive Phonological Skills (PEEPSs; ) was developed to assess consonant inventory, place of articulation, manner of production, syllable structure, accuracy, and error patterns of children between 18–36 months of age. PEEPS was constructed to represent the diversity of place, manner, and voicing of English consonant production, as well as different syllable structures. Finally, multiple exemplars of the different phonetic characteristics were included across a number of words in order to check consistency and variability of children’s early phonological skills. The purpose of this study was to compare the phonologic development of a group of children with CLP between 18–36 months to a group of children without clefts (NC) using the PEEPS assessment tool.
This study was approved by the East Tennessee State University (ETSU) and Vanderbilt University Institutional Review Boards and the study was conducted with the understanding and consent of the parents of the participants. Forty-two children without cleft lip and/or palate and 26 children with cleft lip and/or palate between the ages of 18 and 36 months of age participated in this study. Mean age of the NC group was 25.5 months. (SD = 7.4 months) and mean age of the children with CLP was 27.4 months (SD = 6.5 months). The NC group had 16 males and 26 females and the children with CLP had 16 males and 10 females. No significant gender differences were identified for the phonological components analyzed. The NC children were recruited from the university childcare centers at ETSU. They had no cognitive, speech-language, or hearing impairments, as reported by their parents. The children with cleft lip and palate were part of an ongoing longitudinal study of early intervention at two sites: ETSU in Johnson City, TN, and Vanderbilt University in Nashville, TN. The children with CLP had not received any intervention at the time of this study. All of the children with CLP met the following inclusion criteria: (1) palate repair by 12 months of age; (2) absence of dysmorphology associated with a genetic syndrome according to a geneticist, cognitive delay, or sensorineural hearing loss; (3) monolingual English speaking family. The children with CLP had PE tubes placed bilaterally between the time of lip and/or palate repair. All the children passed a hearing screening at the time of evaluation although 75% of the children had reports of 3–5 middle ear infections since birth. Five children had bilateral CLP, 16 had unilateral CLP, and 5 had cleft palate. The children with CLP had a mean receptive and expressive language standard score of 103 (SD = 7) and 89 (SD = 10), respectively, on the Preschool Language Scale-4 .
2.2. Assessment Procedures
Each child was assessed individually using the PEEPS  either in a clinic setting or in their childcare center by a speech-language pathologist or graduate student in speech-language pathology trained in its administration. The testing took approximately 15–20 minutes and was recorded with a digital video recorder. The assessment was transcribed by a speech-language pathologist or graduate student in speech-language pathology trained in phonetic transcription.
PEEPS consists of a total of 60 words divided into two sections: a Basic Word List of 40 words for younger children (18–24 months) and an Expanded Word List of an additional 20 words for older children (24–36 months). The words were selected on the basis of two criteria: (1) age of acquisition (AOA) based on vocabulary words from the MacArthur Communicative Development Inventories ; (2) phonetic characteristics to elicit target English consonants across all places, voice, and manner categories of production, as well as in different syllable structures. Specifically, words were selected that are typically acquired by children between 18 and 27 months of age, as determined by Dale and Fenson . The AOA for the total test words was 20.5 months (range 18–27 months) with the AOA for the Basic Word List at 19.4 months (range 18–21 months) and 22.7 months for the Expanded Word List (range 21–27 months). Thus, all but two of the total test words (96.7%) were acquired by 24 months of age. Additionally, words were selected to represent the diversity of place, manner, and voicing of English consonant production, as well as syllable structure. The Basic Word List included words to elicit production of target consonants in all seven places of English consonant articulation, all five manner classes, voiced and voiceless consonants, and simple syllable structures (CV, CVC, CVCV), along with some multisyllabic words (“peek-a-boo” and “belly button”) and a word-final nasal cluster (e.g., “hand”). The Expanded Word List builds on the Basic Word List with additional words that sample more polysyllabic words (e.g., “dinosaur”), complex syllable structures that elicit clusters in all three word positions (e.g., “truck,” “monkey,” and “drink”), and includes additional consonants in word positions that were not examined in the Basic Word List. Finally, multiple exemplars of the different phonetic characteristics were included across a number of words in order to check consistency and variability of children’s early phonological skills.
The children were seated at a table or on the floor. A wireless microphone was worn in an adapted shirt and a video camera was placed on a tripod with full-face view of the child. An assistant was available to reposition the camera to maintain full-face view. A brief 5-minute warm-up activity with novel toys was available if the children did not immediately engage with toy manipulatives. The words were elicited in any order through interaction with toy manipulatives. The manipulatives were placed in a soft sack that was used to playfully engage the child in pulling the items out of the bag and naming each one as it was pulled out. Only a few items were placed in the sack at a time and the child was asked to pull out one toy at a time. A hierarchy of elicitation strategies was employed to facilitate naming of the target words. At the first level, spontaneous elicitation was attempted by simply asking “What is that?” If the child did not label the toy, the child was prompted by the clinician and then asked them again “What is this?” If the child still did not spontaneously label the item, then sentence completion was used; for example, “The baby is sleepy. Put the baby in the…(bed).” The third level of elicitation involved modeling the word by saying “It’s a fish!” Look at this pretty fish. Would you like this? What do you want?” If the child gave a different label for a target word, then the clinician recast it with a model and then asked a question to elicit the word. For example, “That’s right, you can call this a “baby,” but I sometimes call it a “doll.” What do I call it?” If the child still did not label the item after the model, then the toy was put back in the sack and the child had the opportunity to label the toy later. Following the assessment, the children’s responses were phonetically transcribed using the International Phonetic Alphabet .
2.3. Measures of Phonological Development
Phonologic components assessed included phonetic inventory (word initial, medial, and final), including segmental characteristics of place (labial, alveolar, and velar), voice, and manner of consonant production, syllable structure (production of two and three syllable words, initial consonant clusters); accuracy (Percentage of Consonants Correct: PCC; [41, 42]); error patterns (presence of common phonological processes of substitution or deletion; compensatory error use for children with CLP); nasal emission (percent of words with nasal emission, for CLP children).
2.4. Procedural Fidelity and Reliability
The procedural fidelity of the PEEPS administration was assessed through coding of 50% of the assessment session for each child. Videotapes of the testing sessions were reviewed and coded by a graduate student in speech-language pathology not associated with the assessments of the children. Table 1 displays the average percent agreement for the children with CLP and without clefts for the five major components of the administration. All components for both groups achieved a reliability score of ≥91% agreement.
Transcription reliability was performed on 25% or more of each child’s assessment by a speech-language pathologist or graduate student familiar with the phonetic transcription of young children with phonological disorders. In order to be considered an agreement, the consonant needed to be transcribed identically for place, manner, and voicing. Interjudge reliability ranged from 78% to 94% (mean 85%) for children with CLP and 90%–96% (mean 93%) for the children without clefts. A weighted was calculated to examine transcription agreement based on the frequency of occurrence of different manner classes. A of .76 for the children with CLP and .85 for the noncleft children was obtained indicating excellent agreement for both groups . However, since many of the disagreements that did occur involved compensatory articulation errors, these disagreements were examined further. Forty-five percent (32/72) of the disagreements included compensatory errors of glottal stops (i.e., /k in duck), pharyngeal fricatives (i.e., /in shoe), and posterior nasal fricatives (i.e., /s in sock). All words with disagreements were retranscribed by two senior investigators to reach consensus.
3. Results and Discussion
3.1. Phonetic Inventory
Table 2 shows the mean, standard deviation, -test, probability, and effect size for three measures describing the children’s phonetic inventory. The total number of consonants correct on the PEEPS showed significantly fewer correct consonants for the children with CLP when compared to the NC children (, , ). When initial and medial/final consonants were examined separately, both variables showed significantly fewer consonants than the NC group (, , ; , , ). Effect sizes (Cohen’s ) were calculated using G*Power (version 3.0.10; http://www.psycho.uni-duesseldorf.de/aap/projects/gpower). Values ranged from −4.72 to 4.72 for the statistically significant comparisons, indicating large effect sizes (see Table 2).
The growth in acquisition of initial and medial/final consonants is shown in Figures 1 and 2. Figure 1 shows the number of correct initial consonants used on the PEEPS for children with CLP (circles) and NC children (squares) across the ages of 18 to 36 months. The linear (CLP: dotted line) and curvilinear (NC: solid line) polynomials and means (filled symbols) are displayed for the groups. For the NC children, there is substantial growth in consonant production between 18 and 24 months of age. This corresponds with the rapid growth that typically occurs as children move from the unanalyzed whole-word stage to a rule-governed stage of phonological acquisition. The children with CLP showed a gradual improvement in consonant production over time, as indicated by the slope of the linear regression. Figure 2 illustrates the number of correct medial/final consonants on the PEEPS for children with CLP (circles) and NC children (squares) across the 18 to 36 month ages. The children with CLP produced fewer medial/final consonants correct than initial consonants (shown in Figure 1) whereas the NC children produced similar numbers of medial/final and initial consonants correct. The pattern of variability in early sound production for NC children at 18–24 months of age appears for medial/final consonants whereas the children with CLP show gradual increase in correct sound production through 36 months of age.
The presence or absence of three places of articulation features (labial, alveolar, velar) was examined for both groups. The children with CLP showed the presence of fewer place contrasts than the NC children. Particularly, the children with CLP produced fewer alveolar-velar contrasts (, ), labial-velar contrasts (, ), and presence of all three contrasts (, ) than did the children with NC. The groups did not differ in the presence of labial-alveolar contrasts (, ).
3.2. Syllable Structure
The production of consonants correct in two and three syllable words on the PEEPS was examined for both groups and showed no significant differences between the groups (, ; , ). The consonants correct within initial consonant clusters, however, showed significantly fewer correct productions for the children with CLP than the NC children (, , ). Final consonant clusters could not be compared because so few children in either group produced them.
The Percent Consonants Correct (PCC; ) was calculated for the total PEEPS sample and separately by manner class (see Table 2). The mean total PCC for the children with CLP was 34.9% compared to the NC children with 86.5% (, , ). When the manner class PCCs were compared, nasals, stops, fricatives, affricates, and liquids showed significantly poorer scores for the children with CLP than the NC children. The glides did not show a difference between the groups. The effect sizes for all comparisons were high, ranging from a of 1.67 to 4.72.
Figure 3 summarizes PCC for the total PEEPS sample for children with CLP (circles) and NC children (squares) from 18 to 36 months of age. The growth in PCC was greatest between 18 and 24 months of age for the NC children. In contrast, the children with CLP showed slow, gradual acquisition of consonant production over time.
3.4. Error Analysis
The percent of words with sound errors on the PEEPS indicated a large difference between the groups, with the children with CLP significantly higher (Mean = 76.3%, SD = 17) than the NC children (Mean = 10.7%, SD 9.8; , , ). An analysis of the error types indicated that children with CLP used more substitutions and omissions than did the NC children (, , ; , , ).
Figures 4 and 5 represent the percent of consonant omissions and substitutions on the PEEPS for children with CLP (circles) and NC children (squares) across ages from 15 to 37 months of age. The NC children showed a rapid decrease in their consonant omission and substitution patterns from 18 to 24 months of age whereas the children with CLP demonstrated a gradual reduction in omission and substitution patterns across the 18–36 month range.
3.5. Compensatory Errors
The children with CLP used a mean percent of compensatory errors on the PEEPS of 7.0, SD 6.8; the NC group used none. Fifteen of the 26 children with CLP used compensatory errors at least twice during the sample. Thirteen of the 15 children had fewer than 10 (3–13% of the words in their sample) compensatory errors in the sample. The remaining two children had 13 and 14 errors, respectively (18% of the words in their sample). Glottal stops were the predominant compensatory error used, with pharyngeal fricative the second most used error pattern. Posterior nasal fricatives were used 1-2 times by three children.
3.6. Nasal Emission
Nasal emission was coded on consonant production of the PEEPS. Three of the 26 children with CLP used nasal emission on more than 2 occurrences. The three children used nasal emission on an average of eight words on the PEEPS. Additionally, these three children also used 1-2 occurrences of posterior nasal fricative substitutions. No direct measurements of velopharyngeal function were conducted on these young children.
4. Conclusions and Discussion
The PEEPS protocol provided a systematic and developmentally appropriate means of assessing differences between a group of children with and without early speech delays. PEEPS provided a profile of early phonological development that captured consonant inventory, syllable structure, accuracy, and error analysis from 18 to 36 months of age. From the results from this study, PEEPS revealed significant differences between typical phonological development and delays across all four major parameters in comparison to the children with CLP. Additionally, the rate of growth revealed that children with CLP were slower than the NC children in all phonological measures. Finally, qualitative differences in addition to quantitative differences were noted with regard to compensatory errors and nasal emission.
In conclusion, the following observations can be summarized from these results.–The typical profiles at 18 months reflect what is known about normal phonological acquisition with regard to individual variability and a whole-word strategy.–The shift to a rule-based strategy at 24 months for typically developing toddlers was observed with variability across children being largely extinguished at that age.–The CLP children mirrored normal development at a slower pace; in general, reflecting the 18-month NC children at 30 months, which was a full 12 months later.
4.1. Clinical Implications
This first examination of PEEPS  suggests that it provides an instrument to assess reliably the phonetic and phonological development of typical and atypical children between the ages of 18 and 36 months. Additionally, the data from the children with CLP could be used to design appropriate intervention strategies. For example, if the phonological profile of a child with CLP reflects a whole-word stage of lexical and phonological acquisition, implementation of a broad-based intervention strategy directed to an emerging sound system might be indicated. This could include a parent-implemented naturalistic language approach rather than a more structured, rule-based phonological approach. PEEPS, therefore, provides a thorough and developmentally appropriate method for assessing the phonological skills of toddlers that can allow for early intervention for phonological disorders.
4.2. Future Research Directions
These results represent a preliminary examination of PEEPS and additional studies with larger samples of typically and atypically developing children are needed. In addition, future studies are needed that compare PEEPS to a reference standard, such as a language sample, to evaluate test specificity and sensitivity.
This study was funded in part by the National Institutes on Deafness and Other Communicative Disorders (R21DC9654) and the East Tennessee State University Center of Excellence in Early Childhood Learning and Development.
- A. L. Williams and C. Stoel-Gammon, Profiles of Early Expressive Phonological Skills: PEEPS.
- C. P. Carson, T. Klee, D. K. Carson, and L. K. Hime, “Phonological profiles of 2-year-olds with delayed language development: predicting clinical outcomes at age 3,” American Journal of Speech-Language Pathology, vol. 12, no. 1, pp. 28–39, 2003.
- B. Dodd and B. McIntosh, “The input processing, cognitive linguistic and oro-motor skills of children with speech difficulty,” International Journal of Speech-Language Pathology, vol. 10, no. 3, pp. 169–178, 2008.
- B. Dodd, B. Mcintosh, D. Erdener, and D. Burnham, “Perception of the auditory-visual illusion in speech perception by children with phonological disorders,” Clinical Linguistics and Phonetics, vol. 22, no. 1, pp. 69–82, 2008.
- C. Ferguson and C. Farwell, “Words and sounds in early language acquisition,” Language, vol. 51, no. 2, pp. 39–49, 1975.
- R. Paul and T. J. Elwood, “Maternal linguistic input to toddlers with slow expressive language development,” Journal of Speech and Hearing Research, vol. 34, no. 5, pp. 982–988, 1991.
- R. Paul and P. Jennings, “Phonological behavior in toddlers with slow expressive language development,” Journal of Speech and Hearing Research, vol. 35, no. 1, pp. 99–107, 1992.
- C. Stoel-Gammon and P. Beckett-Herrington, “Vowel systems of normally developing and phonologically disordered children,” Clinical Linguistics and Phonetics, vol. 4, no. 2, pp. 145–160, 1990.
- A. L. Williams and M. Elbert, “A prospective longitudinal study of phonological development in late talkers,” Language, Speech, and Hearing Services in Schools, vol. 34, no. 2, pp. 138–153, 2003.
- L. Rescoria and N. B. Ratner, “Phonetic profiles of toddlers with specific expressive language impairment (SLI-E),” Journal of Speech, Language, and Hearing Research, vol. 39, no. 1, pp. 153–165, 1996.
- D. Thal, M. Oroz, and V. McCaw, “Phonological and lexical development in normal and late-talking toddlers,” Applied Psycholing, vol. 16, no. 4, pp. 407–424, 1995.
- B. McIntosh and B. J. Dodd, “Two-year-olds' phonological acquisition: normative data,” International Journal of Speech-Language Pathology, vol. 10, no. 6, pp. 460–469, 2008.
- D. A. Olsen, A Descriptive Study of the Speech Development of a Group of Infants with Cleft Palate, Northwestern University, Evanston, Ill, USA, 1965.
- M. M. O'Gara and J. A. Logemann, “Phonetic analyses of the speech development of babies with cleft palate,” Cleft Palate Journal, vol. 25, no. 2, pp. 122–134, 1988.
- S. Peterson-Falzone, M. Hardin-Jones, and M. Karnell, Cleft Palate Speech, Mosby, St. Louis, Mo, USA, 2010.
- J. Russell and P. Grunwell, “Speech development in children with cleft lip and palate,” in Analyzing Cleft Palate Speech, P. Grunwell, Ed., pp. 19–47, Whurr Publishing, London, UK, 1993.
- K. L. Chapman, M. Hardin-Jones, J. Schulte, and K. A. Halter, “Vocal development of 9-month-old babies with cleft palate,” Journal of Speech, Language, and Hearing Research, vol. 44, no. 6, pp. 1268–1283, 2001.
- N. J. Scherer, L. L. D'Antonio, and H. McGahey, “Early intervention for speech impairment in children with cleft palate,” Cleft Palate-Craniofacial Journal, vol. 45, no. 1, pp. 18–31, 2008.
- S. J. Peterson-Falzone, “Speech outcomes in adolescents with cleft lip and palate,” Cleft Palate-Craniofacial Journal, vol. 32, no. 2, pp. 125–128, 1995.
- N. J. Scherer, L. L. D'Antonio, and J. H. Kalbfleisch, “Early speech and language development in children with velocardiofacial syndrome,” American Journal of Medical Genetics, vol. 88, no. 6, pp. 714–723, 1999.
- D. Sell, P. Grunwell, S. Mildinhall et al., “Cleft lip and palate care in the United Kingdom—the clinical standards advisory group (CSAG) study. Part 3: speech outcomes,” Cleft Palate-Craniofacial Journal, vol. 38, no. 1, pp. 30–37, 2001.
- M. A. Hardin-Jones and D. L. Jones, “Speech production of preschoolers with cleft palate,” Cleft Palate-Craniofacial Journal, vol. 42, no. 1, pp. 7–13, 2005.
- A. Lohmander and C. Persson, “A longitudinal study of speech production in Swedish children with unilateral cleft lip and palate and two-stage palatal repair,” Cleft Palate-Craniofacial Journal, vol. 45, no. 1, pp. 32–41, 2008.
- K. Chapman, “The relationship between early reading skills and speech and language performance in young children with cleft lip and palate,” Cleft Palate-Craniofac Journal, vol. 48, no. 3, pp. 301–311, 2011.
- T. Estrem and P. A. Broen, “Early speech production of children with cleft palate,” Journal of Speech and Hearing Research, vol. 32, no. 1, pp. 12–23, 1989.
- L. Fenson, P. S. Dale, J. S. Reznick, et al., MacArthur Communicative Development Inventories, Singular, San Diego, Calif, USA, 1993.
- D. Hedrick and E. Prather, Sequenced Inventory of Communicative Development Inventories, Singular, San Diego, Calif, USA, 1984.
- American Cleft Palate-Craniofacial Association, Parameters for Evaluation and Treatment of Patients with Cleft Lip/Palate or Other Craniofacial Anomalies, American Cleft Palate-Craniofacial Association, Chapel Hill, NC, USA, 2009.
- A. Holm, S. Crosbie, and B. Dodd, “Differentiating normal variability from inconsistency in children's speech: normative data,” International Journal of Language and Communication Disorders, vol. 42, no. 4, pp. 467–486, 2007.
- A. V. Sosa and C. Stoel-Gammon, “Patterns of intra-word phonological variability during the second year of life,” Journal of Child Language, vol. 33, no. 1, pp. 31–50, 2006.
- R. G. Schwartz and L. B. Leonard, “Do children pick and choose? An examination of phonological selection and avoidance in early lexical acquisition,” Journal of Child Language, vol. 9, no. 2, pp. 319–336, 1982.
- N. J. Scherer, “The Speech and Language Status of Toddlers with Cleft Lip and/or Palate Following Early Vocabulary Intervention,” American Journal of Speech-Language Pathology, vol. 8, no. 1, pp. 81–93, 1999.
- M. M. Vihman, “Phonology and the development of the lexicon: evidence from children's errors,” Journal of Child Language, vol. 8, no. 2, pp. 239–264, 1981.
- M. M. Vihman, “Variable paths to early word production,” Journal of Phonetics, vol. 21, pp. 61–82, 1993.
- E. Willasden, “Lexical selectivity in Danish toddlers with cleft palate,” The Cleft Palate-Craniofacial Journal. In press.
- C. Stoel-Gammon, “Phonological skills of 2-year-olds,” Language, Speech, and Hearing Services in Schools, vol. 18, pp. 323–329, 1987.
- C. Stoel-Gammon, “Issues in phonological development and disorders,” in Research on Child Language Disorders: A Decade of Progress, J. Miller, Ed., pp. 255–265, Pro-Ed, Austin, Tex, USA, 1991.
- I. L. Zimmerman, V. G. Steiner, and R. E. Pond, Preschool Language Scale Fourth Edition (PLS-4), Pearson, San Antonio, Tex, USA, 2002.
- P. S. Dale and L. Fenson, “Lexical development norms for young children,” Behavior Research Methods, Instruments, and Computers, vol. 28, no. 1, pp. 125–127, 1996.
- L. Shriberg and R. D. Kent, Clinical Phonetics, Allyn & Bacon, Boston, Mass, USA, 3rd edition, 2003.
- L. D. Shriberg and J. Kwiatkowski, “Phonological disorders. III: a procedure for assessing severity of involvement,” Journal of Speech and Hearing Disorders, vol. 47, no. 3, pp. 256–270, 1982.
- L. D. Shriberg, D. Austin, B. A. Lewis, J. L. McSweeny, and D. L. Wilson, “The percentage of consonants correct (PCC)metric: extensions and reliability data,” Journal of Speech, Language, and Hearing Research, vol. 40, no. 4, pp. 708–722, 1997.
- J. R. Landis and G. G. Koch, “The measurement of observer agreement for categorical data,” Biometrics, vol. 33, no. 1, pp. 159–174, 1977.
- J. Cohen, Statistical Power Analysis for the Behavioral Sciences, Erlbaum, Hillsdale, NJ, USA, 2nd edition, 1988.