This study investigates the storage vs. composition of inflected forms in typically-developing children. Children aged 8–12 were tested on the production of regular and irregular past-tense forms. Storage (vs. composition) was examined by probing for past-tense frequency effects and imageability effects – both of which are diagnostic tests for storage – while controlling for a number of confounding factors. We also examined sex as a factor. Irregular inflected forms, which must depend on stored representations, always showed evidence of storage (frequency and/or imageability effects), not only across all children, but also separately in both sexes. In contrast, for regular forms, which could be either stored or composed, only girls showed evidence of storage. This pattern is similar to that found in previously-acquired adult data from the same task, with the notable exception that development affects which factors influence the storage of regulars in females: imageability plays a larger role in girls, and frequency in women. Overall, the results suggest that irregular inflected forms are always stored (in children and adults, and in both sexes), whereas regulars can be either composed or stored, with their storage a function of various item- and subject-level factors.
Citation: Dye CD, Walenski M, Prado EL, Mostofsky S, Ullman MT (2013) Children's Computation of Complex Linguistic Forms: A Study of Frequency and Imageability Effects. PLoS ONE 8(9): e74683. doi:10.1371/journal.pone.0074683
Editor: Mark Aronoff, Stony Brook University, United States of America
Received: February 22, 2013; Accepted: August 7, 2013; Published: September 9, 2013
Copyright: © 2013 Dye et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: Support for this project was provided to MTU from NIH R01 MH58189, NIH R01 HD049347, the National Alliance for Autism Research, the Mabel Flory Trust, and the Simons Foundation. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
How is language computed in the mind? Although we now know that language computation requires both storage and composition, it remains unclear which aspects of language are stored and which are (de)composed, and under what circumstances. Moreover, this is even less well understood in children than adults. In adults, a considerable amount of research has investigated this issue by probing for storage effects in the on-line computation of existing inflected forms, in particular in the contrast between regular and irregular inflected variants (e.g., walked vs. dug), which can be equated for phonological, semantic, and other factors. Here, we examine this issue in children.
Storage/composition theoretical models
A variety of theoretical proposals regarding the computation of existing inflected forms have been put forth. These can be grouped in two broad classes: single-mechanism models and dual-system models.
Single-mechanism models propose that all inflected forms are computed with the same basic mechanisms. For example, according to connectionist models, all previously-encountered inflected words are represented in a distributed associative memory –. Such models suggest that forms that exhibit a common and consistent inflectional pattern (regular forms, as well as some irregulars, such as sing-sang, ring-rang) rely primarily on phonological representations in this distributed memory. Rule-only models constitute another type of single-mechanism model. Here, too, all inflected forms (i.e., both regular and irregular) are handled by the same or similar mechanisms, which in this case, involve rule-based processes –.
Dual-system models, on the other hand, hold that while some inflected forms are stored, the computation of others depends on (de)composition by rule-governed processes in a separate computational and neurocognitive system. Irregularly inflected forms (e.g., dug), which cannot be fully specified by a default rule, are claimed to depend on memorized representations. Regulars hold a different status. Some dual-system models hold that regulars are always composed (e.g., walk +ed) by a default rule –. Others, however, suggest that even if regulars can be assembled by rule-governed processes, they can also be stored, and indeed often are, with the likelihood of storage depending on various item-level (e.g., frequency) and subject-level (e.g., sex) factors –. For example, women, who appear to have superior verbal memories as compared to men –, may also be more likely than men to store regularly inflected forms , , .
These models, as well as similar ones, have been proposed not only for adults, but also for children. Models claiming the dependence of all inflected forms on (an associative) memory suggest that children, like adults, rely on word storage or pattern association for both regulars and irregulars. For example, Bybee ,  suggests that the child memorizes specific verb items (whether regular or irregular forms), and forms networks of associations among them, which eventually reveal common subparts (e.g., play in plays and playing) and allow for generalization of common inflection patterns by analogy. Connectionist models also emphasize the dependence of all the child's forms (regardless of regularity type) on memory , –. Rule-only models suggest that children would gradually induce multiple rules from the lexicon through ‘minimal generalization’ .
Dual-system models have taken a different approach to the development of the representation and computation of inflected forms. Children are thought to initially memorize both regular and irregular inflected forms (e.g., talked, dug), though by an early age, e.g. by around age 3 for English past-tense, they acquire the appropriate rule(s) – as evidenced, for example, by their fairly consistent –ed affixation not only of regulars (e.g., talk-talked), but also of nonce verbs (e.g., rick-ricked), and even irregular verbs, resulting in over-regularizations such as goed or eated –. Thus, at least after a very early age, children are thought to compute inflected forms in a qualitatively similar way to adults – that is, depending on both storage and composition, even though the extent to which each of these may be relied on may differ between children and adults. For example, the fact that adults hardly ever over-regularize , , is explained on a dual-system view by the tendency for children to have been exposed to fewer irregularly-inflected forms than adults; children thus have weaker memory traces for irregulars than adults, making it more likely for a child to fail at retrieving an irregular form from memory and thus less likely to resort to rule-based composition and over-regularizations .
Frequency effects and imageability effects as diagnostic tests of storage
In the current study we use two related techniques to investigate the storage vs. composition of existing (real) regular and irregular English past-tense forms in children. These two techniques – probing for frequency effects and for imageability effects – can help distinguish between storage and composition, and can therefore be used to test predictions made by various models with respect to this distinction.
The method of probing for “frequency effects” is based on the fact that lexical forms that are more frequently encountered are also more rapidly or more successfully accessed in memory than forms encountered with lower frequency, findings which hold for both adults and children –. If inflected forms are stored, they should exhibit such frequency effects. That is, such forms should show correlations between their inflected-form frequencies and measures of their accessibility (e.g., response times). In contrast, inflected forms that are composed rather than stored should not exhibit such correlations, once access to their stems is controlled for. The presence of frequency effects therefore can and has been used as a diagnostic test of the storage of inflected forms.
A second and more recent method for investigating the storage of lexical forms involves probing for “imageability effects” . The logic of imageability effects is based on the well-documented finding that, in adults as well as children, lexical items for which a visual mental image is more easily formed are also more easily memorized and accessed than forms that are harder to visualize –. Therefore, stored forms, including stored inflected forms, may be expected to exhibit imageability effects: that is, correlations between their imageability and measures of their accessibility. For example, if irregular past tense forms are stored, those of verbs with higher imageability (e.g., dug) should be better memorized and thus accessed faster than those of verbs with lower imageability (e.g., thought), regardless of the fact that their (stored) stems should also show this effect. Such imageability effects should hold even when stem access is controlled for (e.g., by presenting the stems to subjects in a production paradigm). In contrast, inflected forms that are composed would not be expected to show imageability effects (e.g., walked vs. balked), once access to their stems is controlled for. Note that if lexical access to stems rather than past-tense forms was in fact driving imageability effects in past-tense production, we would expect to see imageability effects on all past-tense forms, including forms that are posited to be composed (e.g., regulars in males); as we will see however, this is not the case, either in the present study or for previous findings . Thus imageability effects on inflected forms seem to be due to the retrieval of those forms rather than their stems (even though the imageability of stems and past-tense forms are likely to be the same or very similar). In sum, inflected forms that are stored should exhibit imageability effects in addition to or instead of frequency effects (depending on which of these factors has the greatest influence), allowing imageability effects to be used as another diagnostic of storage.
It should be noted that whereas proponents of different theoretical views largely agree that the presence of frequency effects is indicative of storage , there is less consensus concerning the interpretation of an absence of frequency effects (imageability effects are a new diagnostic, and have not been discussed in this respect, but one may expect a similar argument to apply). Single mechanism proponents have argued that a lack of frequency effects on certain inflected forms need not necessarily indicate that these forms are not stored. For example, given that all regulars have a similar stem-past phonological transformation, this generalized phonological pattern is thought to be learned in associative memory, leaving little or no influence for the frequencies of individual past-tense forms. In this case the contribution of neighboring (i.e., phonologically similar) regulars to a given verb's memory traces may overwhelm the contribution of each verb's individual past tense frequency, resulting in weakened past tense frequency effects for regulars , , .
In contrast, proponents of dual-system models claim that inflected forms that depend on composition rather than storage are not expected to exhibit frequency effects, once confounding factors, including phonological similarity to other verbs, are controlled , . On this view, irregularly inflected forms should always show signs of storage (e.g., from frequency and/or imageability effects), whereas regulars should show storage in some circumstances but not others (e.g., for females but not for males). Importantly, this particular pattern of predictions has not been made by single-mechanism models, allowing the two types of models to be potentially distinguished.
Previous evidence from adults
Most studies of frequency effects on existing inflectional forms have focused on adults. A number of studies have reported frequency effects for irregular but not regular inflected forms. This pattern of results has been observed for English past-tense forms , , , , , German noun plurals , , German past participles , and French verb forms . Consistent with this pattern, a lack of frequency effects has also been reported for regular inflected forms in Dutch . However, other studies have reported frequency effects for regular inflected forms, for example in English noun plurals , English past tense forms , , Finnish noun plurals , and Dutch verb forms .
These discrepant findings for regular inflected forms may be explained by a range of item and subject-level factors that may influence the storage of regulars. Results from several studies support this view, and have revealed that only certain types of regulars show frequency effects, or certain subject groups show frequency effects on regulars. For example, frequency effects have been observed for higher-frequency (but not lower-frequency) regular forms in a number of studies, including in English regular past-tense forms , , , Dutch noun plurals , Swedish definite nouns , and Finnish (genitive, locative, and partitive) nouns , . Of particular interest in the current study, frequency effects on regulars have been observed in women but not men for English past tense forms , and were found to be stronger in women than men for Danish noun, verb, and adjective forms .
To our knowledge, imageability effects on the processing of inflectional morphology have been examined thus far in only one study, Prado and Ullman (2009) , which found imageability effects for irregular but not regular past-tense forms among men. In contrast, imageability effects were not observed for women on either regulars or irregulars . See Discussion below.
Previous evidence from children
In children, who represent the focus of the current investigation, only a handful of empirical studies of frequency effects on existing (i.e., not nonce) inflected forms have been carried out, and no studies have examined imageability effects. The findings with regards to frequency effects on regular forms have been somewhat mixed. One study of frequency effects on the processing of inflected forms in British English  examined accuracy rates in the production of regular and irregular past-tense forms in 36 typically-developing children ages 5;5 to 8;9 (as well as children with Specific Language Impairment, not discussed here). Frequency effects were observed for irregulars but not regulars. Similar results were obtained in a study on German past participles, in which reaction times were obtained from 40 children between 5 and 12 years old, all of whom listened to verb stems and were asked to produce corresponding past participle forms . Again, frequency effects were found for irregulars but not for regulars. In contrast, two studies have reported frequency effects on either both  or neither  regulars and irregulars. A study of 15 Quebec French-speaking children aged 2;11 to 4;6 reported frequency effects on accuracy across both regular and irregular past tense (passé composé) forms . In contrast, a study of 18 British English-speaking children, mean age 11, found no frequency effects on response times across regular and irregular past-tense forms . Finally, a recent study of 307 British English-speaking 4–8 year old children investigating frequency effects in noun plurals and past tenses found inconsistent frequency effects for both regulars and irregulars across age groups though the dependent variable (percentage of responses with inflected forms) collapsed together correctly inflected and over-regularized responses, making it difficult to assess the results with respect to correctly inflected forms . Note that studies of children's production of nonce or overregularized forms (or other errors) , – are beyond the scope of the present study, which focuses on the computation of correct existing forms.
Although these previous studies of frequency effects constitute important initial steps in the investigation of the storage/composition distinction of inflected forms in children, they do not take into account a number of issues, some or all of which may have contributed to inconsistencies across the results. First, no prior study on children has examined imageability effects. Given that imageability effects have been shown to be a useful diagnostic of storage in adults , investigating imageability effects in children may shed light on the storage versus composition of inflected forms at younger ages as well. Second, previous studies of children have not explored the role of subject-level factors such as sex. Given that sex has been found to influence frequency as well as imageability effects in adults , , this factor should also be examined in children. Analyses stratified by sex might help explain potential frequency or imageability effects on regulars, and may explain at least some of the inconsistencies across previous results. Methodologically, frequency has previously been treated as a dichotomous variable in most studies, divided into ‘high’ and ‘low’ frequency groups. This dichotomization may have led to degraded measurement and loss of power , . Additionally, the data have generally been averaged over subjects and responses, a technique that has similar consequences , . Statistical techniques such as those used in the current study avoid this loss of power and therefore could lead to the detection of frequency effects where they might have remained undetected in previous studies.
The Current Study
Here we investigate children's storage vs. composition of existing English past-tense forms by examining both frequency and imageability effects, as well as the possibility of sex differences with regard to these effects. Methodologically, we use approaches that avoid the loss of power entailed by using averaged data and dichotomizing continuous variables, and we control (experimentally and/or statistically) for a large number of potentially confounding factors. Finally, we provide direct comparisons with adult data in order to probe for developmental changes between boys and girls and adult men and women.
We tested forty-five healthy right-handed monolingual North American English-speaking children (8–12 years old, mean age = 9.67, SD = 1.35; 22 girls) from the greater Washington DC area. The age range for the children was selected a priori based on the following considerations: a) we wanted to examine children who are past what is traditionally considered the age of overregularization , and b) the age range was similar to the age ranges in previous work investigating frequency effects on the production of past-tense forms in children , . The children had a mean of 4.6 years of education (SD = 1.4). Handedness was assessed based on the Edinburgh questionnaire . All children had normal or corrected-to-normal hearing and vision, and none had any known history of developmental, psychiatric or neurological disorders. Ten children produced correct answers for fewer than half of the items of either verb type (regular and irregular). Since only response times to correct answers were analyzed (see below), these children were excluded to avoid insufficient data points from any child (note that including these ten children in the analyses yielded an almost identical pattern of findings). The remaining 35 children (8–12 years old; mean age = 9.91, SD = 1.38; 16 girls) had a mean of 4.89 years of education (SD = 1.47). Children were also tested on the Reading section of the Wechsler Individual Achievement Test Second Edition (WIAT-II)  and scored within the normal range (two of the 35 children analyzed did not complete this test). Reading scores for girls (M = 118.2, SD = 8.81) did not differ statistically from those for boys (M = 112.1, SD = 11.36, t(31) = 1.69, p = 0.100).
In addition, we directly compared the data from the children to data from 71 adults (18–50 years, mean age = 24.97, SD = 7.83; mean 15.34 years of education, SD = 1.79; 35 women), whose frequency and imageability effects were previously reported in Prado and Ullman (2009) . All adults met the same language, handedness, and neuropsychological criteria as the children.
This study was approved by the Georgetown University Institutional Review Board. Children's parents provided written consent and children provided oral assent, which was documented by the experimenter on the consent form at the beginning of the test session.
The Past Tense Production Task
Subjects were tested on a past tense production task that has been described in detail in previous literature , . In summary, we examined subjects' performance on the production of 29 irregular verbs (e.g., hold-held), and 29 regulars (e.g., fail-failed: these did not include inconsistent regulars, whose stems are phonologically similar to the stems of irregulars, e.g., squeeze-squeezed, whose stem is similar to freeze-froze). The test items did not include any no-change verbs (e.g., hit-hit) or any verbs for which both a regular and an irregular past-tense are acceptable (e.g., dive-dived/dove). The 29 regulars and 29 irregulars were matched group-wise on the following measures (further described below): stem (uninflected form) frequency, past-tense frequency, and imageability (paired t-tests, ps>.40).
To quantify past-tense frequency (and stem frequency), two counts were used in combination: (1) a frequency count extracted by a stochastic part-of-speech analyzer from a 44 million word corpus of unedited Associated Press news wires ,  (AP); and (2) the Francis and Kucera  count (FK), derived from a 1 million word corpus composed of a variety of sources. All analyses were carried out on the natural logarithm of the sum of the two frequency counts, first augmented by 1 to avoid the undefined ln(0).
These frequency counts were chosen for several reasons. First, frequency counts from large corpora are highly desirable because they provide much greater signal than those from small corpora. Since it was crucial to have large corpora, it was not possible to use corpora specifically involving children in the relevant age range, which are typically much smaller in size. Second, this decision is also in line with previous studies, which have likewise used adult frequency counts in work with children in the same age range as our subjects , , . Third, it has been shown that verb familiarity ratings obtained from children in this age range correlate with adult frequency counts ; additionally, frequency counts based on child-addressed speech as well as child speech correlate with adult frequency counts . It might be argued that the potential inappropriateness of adult frequency counts for children could lead to a high likelihood of false negatives for children's frequency effects. However, in the present study children did not in fact show weaker frequency effects than adults on irregulars (which must be stored), suggesting that the adult frequency counts employed here are sufficient to detect frequency effects in the children examined in this study.
Only verbs that were likely to be known by 8-year-olds were included, as determined by the unanimous judgments of five adult native speakers of North-American English, based on the procedure described in . Additionally, note that the children in our study responded accurately enough for us to detect frequency effects on irregulars, and were even more accurate on regulars (see Results).
The imageability ratings, which were taken from Prado and Ullman (2009) , ranged from 1 (low imageability) to 5 (high imageability). As in previous studies of imageability in children , , the present study used imageability ratings obtained from adults. Although it might be argued that the use of adult imageability ratings as a predictor for both age groups might lead to a higher likelihood of false negatives in children than adults (i.e., weaker imageability effects in children), in fact the only reliable difference between children and adults found for imageability effects (on regulars) was more reliable in children (girls) than adults (women), arguing against such a confound (see Results).
The imageability ratings were based on the uninflected form of the verb (e.g., dig, walk), which was used as a proxy for the imageability of the past tense since, as a semantic property, imageability is not expected to differ between the uninflected form and the past tense form. The details of the methodology used for obtaining these imageability ratings are described in Prado and Ullman (2009) . In brief, 28 subjects completed a paper and pencil task in which they were asked to rate a set of words, including the verbs used in the present investigation, in terms of their imageability (on a scale from 1 to 5). Half of the subjects who contributed the ratings were men and half women. Mean imageability ratings were computed for each item over all subjects. The imageability ratings across all regulars and irregulars did not differ between the males and females; additionally the regulars and irregulars did not differ in their imageability ratings. The obtained imageability ratings correlated with previously published imageability ratings.
Each verb stem was presented alone and in the context of a sentence, with a second sentence containing a blank to elicit the past-tense form (e.g., fail. Every day I fail an exam. Just like every day, yesterday I ____ an exam), all displayed simultaneously on the computer screen . The sentences were identical apart from the verb and the post-verbal material (which was composed of two words, neither of which was inflected or of low frequency). Items were pseudo-randomized, and item order was controlled for statistically (see below). Subjects were instructed to produce the missing form as quickly and accurately as possible. Response time (RT) data were recorded via a microphone connected to a computerized timer, and were measured from the time the sentence appeared on the screen to the time the subject initiated their response.
Frequency and imageability effects were examined on RT data. During testing, the experimenter noted items where the RTs were not triggered by the subject's response; these response times were not analyzed. RT analyses were performed only on correct first-responses (94.29% of all first responses to the 58 regular and irregular verbs). Very fast responses, that is RTs faster than 500 ms, were discarded as being likely due to computer error (3.64% of non timer-error correct responses). Extreme outliers for each subject – that is, responses whose RTs were more than 3.5 standard deviations from the given subject's mean– were also excluded (0.32% of correct responses).
The RT data were analyzed in SAS for Windows Release 9.3 (Cary, NC) using mixed-effects regression modeling. This statistical method allows each individual RT from each subject to be entered into one model, without averaging the RTs in a way that would result in a substantial loss of information. Moreover, it allows both item- and subject-level covariates that may influence the pattern of results to be included in the same model. Variables such as frequency and imageability were entered into the model as continuous factors, rather than dichotomized (e.g., as a two-level factor of ‘high’ vs. ‘low’ frequency, as in many previous studies), thereby avoiding loss of power and other problems , . Mixed-effects regression models account for subject variability by including the baseline performance (model intercept) of each subject as a random effect. For more complete discussions of this statistical method, see References , ; for similar analyses, see Reference .
In our model, natural logarithm-transformed RT was the dependent variable; imageability, past-tense frequency (natural-log transformed; see above), verb-type (regular vs. irregular) and age-group (child vs. adult) were included as fixed effects. Interactions were specified between age-group, verb-type, and each of frequency and imageability separately, generating separate frequency and imageability coefficients for children and adults, separately for regular and irregular verbs. As in previous work, we included a random effect of subject on the intercept . Significance of all effects was assessed using α = 0.05. All p-values are reported as two-tailed. Degrees of freedom were computed using the Satterthwaite approximation.
Fourteen potentially confounding subject- and item-level variables were included as covariates in all analyses. Explicitly including these covariates in the model allows one to directly account for variability attributable to them, which enhances prediction accuracy and decreases the size of the residual error . The fourteen covariates, which are described in detail in Table 1, included two subject-level variables (education and sex), and twelve item-level variables controlling for a range of phonological, semantic and other properties of the verbs (e.g., phonological neighborhood).
Table 1. Covariates included in the mixed-effects model.doi:10.1371/journal.pone.0074683.t001
All fourteen covariates were entered as fixed main effects into the mixed-effects model described above. The covariates were also tested for additional inclusion as random effects in the model . To evaluate whether an item-level covariate should be (additionally) included as a random effect (by subject), which would allow the model to account for differences in the effect of the covariate between subjects, each covariate was separately entered as a random effect into a model that was otherwise identical to the model with the covariates included only as fixed effects. The subject-level covariates were tested in the same way. Any covariate whose inclusion as a random effect resulted in a substantial Akaike's Information Criterion reduction (AIC, a smaller-is-better measure of model fit), as compared to the model with covariates entered only as fixed effects, was retained as a random effect (as well as a fixed effect) in the final mixed-effects model; otherwise it was included only as a fixed effect. Of the fourteen covariates, only verb order improved model fit as a random factor (from AIC = 2118.7 to AIC = 2002.1), and was therefore (additionally) included as such.
Children's regulars versus irregulars
Over all children (n = 35), examination of the effect of imageability on past tense production response times revealed significant negative coefficients (i.e., the magnitude of the coefficient was significantly greater than zero) both for irregular and for regular past tense forms, with no reliable difference between the coefficients for the two verb types (Figure 1A). That is, significant imageability effects were found for both irregular and regular past-tense forms. Examination of the effect of frequency on response time revealed a significant negative coefficient for irregular past tense forms (i.e., frequency effects were found on irregulars), whereas frequency effects were not observed for regular past tense forms; the difference between the coefficients for the two verb types was significant (Figure 1B).
Figure 1. Children's imageability and frequency effects for regular and irregular past-tense forms.
In each scatterplot, the line represents the prediction of the mixed effects regression model with regard to the effect of imageability or frequency on the natural logarithm of response times, with the effect of all covariates removed. Points on the graph represent residuals from the model (with the effects of the covariates removed) for the 29 regular and 29 irregular verbs. B represents the unstandardized regression coefficient, indicating the slope of the regression line, t represents the t-statistic of the comparison between B and zero, and p represents the statistical significance of this comparison.doi:10.1371/journal.pone.0074683.g001
Thus, the children exhibited imageability effects on irregulars as well as regulars. In contrast, they exhibited frequency effects on irregulars only. The children's lack of frequency effects on regulars does not appear to be explained by confounding statistical or experimental factors. First, it is not explained by ceiling effects on regulars: the RT variance did not differ (as measured by Folded F-tests) between the verb types (F(28,28) = 1.23, p = .592). Note also that the mean RTs for regulars and irregulars did not differ (regulars: M = 7.80, SE = 0.02; irregulars: M = 7.79, SE = 0.02; t1(34) = 0.20, p = .841, t2(56) = 0.21, p = .838). Second, it is also not accounted by low power due to smaller sample sizes for regulars. In fact, there were more correctly-produced past-tense forms (on which the RT analyses were carried out) for regulars than irregulars (accuracy on regulars: M = 97.92%, SE = 0.52%; irregulars: M = 78.74%, SE = 3.66%; t1(34) = 10.86, p<.0001, t2(56) = 5.19, p<.0001). Third, as noted above, the regular and irregular verbs were matched on imageability, as well as stem and past-tense frequency. Moreover, fourteen potentially explanatory variables were included as covariates in the regression model, statistically equating regulars and irregulars with regard to various properties.
Regulars versus irregulars in boys versus girls: Could the inclusion of female subjects explain imageability effects on regulars?
The previous study examining adults' frequency and imageability effects on past tense production revealed sex differences for regulars . In particular, storage (i.e., frequency) effects on regulars were largely due to such effects for women but not men . We therefore examined the possibility that similar sex differences may exist in children; in other words, that the storage (i.e., imageability) effects on regulars observed in the present study may be due to the data from the girls. We thus examined imageability effects on regulars and irregulars in girls versus boys. Likewise, even though no overall frequency effect was found for regulars, we also investigated whether boys and girls differed in frequency effects, as was previously found for adults. To generate separate imageability and frequency coefficients for boys and girls, we added an interaction with sex (male vs. female) to the verb-type by age group by imageability interaction and to the verb-type by age group by frequency interaction in the same model as described above.
Imageability effects in girls versus boys.
The sex by verb-type by imageability interaction was significant (Figure 2; center box). Girls showed significant imageability effects on regulars, but not irregulars, with the verb-type difference not significant (Figure 2A). In contrast, boys showed significant imageability effects on irregulars, but not regulars, with a significant verb-type difference (Figure 2B). Additionally, the coefficients for irregulars did not differ between the boys and girls, whereas the coefficients for regulars did differ significantly between the sexes (Figure 2; middle row).
Figure 2. Children's imageability effects for regular and irregular past-tense forms, by sex.
In each scatterplot, the line represents the prediction of the mixed effects regression model with regard to the effect of imageability on the natural logarithm of response times, with the effect of all covariates removed. Points on the graph represent residuals from the model (with the effects of the covariates removed) for the 29 regular and 29 irregular verbs. B represents the unstandardized regression coefficient, indicating the slope of the regression line, t represents the t-statistic of the comparison between B and zero, and p represents the statistical significance of this comparison.doi:10.1371/journal.pone.0074683.g002
The observed lack of imageability effects on regulars in boys does not seem to be attributable to confounding factors such as ceiling effects or low power. First, the RT variance in boys did not differ (as measured by Folded F-tests) between regulars and irregulars: F(28,28) = 1.25, p = .557. Moreover, boys' mean RTs for regulars and irregulars did not differ (regulars: M = 7.757, SE = 0.027; irregulars: M = 7.786, SE = 0.024; t1(18) = 0.24, p = .811, t2(56) = 0.80, p = .425). Second, boys produced more correct past-tense forms for regulars than irregulars (accuracy on regulars: M = 97.50%, SE = 0.7%; irregulars: M = 76.22%, SE = 0.38%; t1(18) = 9.65, p<.0001, t2(56) = 5.58, p = .0001). Finally, note that the same subject- and item-level covariates described above were included in the model used in this analysis.
Frequency effects in girls versus boys.
The three-way interaction between sex, verb-type and frequency was not significant (Figure 3; center box). For the girls, there was a significant frequency effect for irregulars but not regulars, though the difference between the two verb types was not significant (Figure 3A). For the boys, a negative frequency coefficient for irregulars approached significance, and differed significantly from the coefficient for regulars (which was positive, Figure 3B). The coefficients for irregulars did not differ between the boys and girls, whereas the coefficients for regulars did differ significantly between the sexes (Figure 3; middle row). Over both verb types, frequency effects were found in girls (B = −0.017, t(5290) = 2.89, p = .004), but not in boys (B = −0.001, t(5299) = 0.11, p = .915), with a significant difference between them (B = −0.017, t(5195) = 2.36, p = .018).
Figure 3. Children's frequency effects for regular and irregular past-tense forms, by sex.
In each scatterplot, the line represents the prediction of the mixed effects regression model with regard to the effect of frequency on the natural logarithm of response times, with the effect of all covariates removed. Points on the graph represent residuals from the model (with the effects of the covariates removed) for the 29 regular and 29 irregular verbs. B represents the unstandardized regression coefficient, indicating the slope of the regression line, t represents the t-statistic of the comparison between B and zero, and p represents the statistical significance of this comparison.doi:10.1371/journal.pone.0074683.g003
In summary, examination of potential sex differences among the children indicated that girls but not boys showed imageability effects on regulars, which may largely explain the imageability effects on regulars in the full group of children. Conversely, boys but not girls showed imageability effects on irregulars. We also examined potential sex differences in frequency effects; here, neither girls nor boys showed frequency effects for regulars (although the coefficients for girls and boys were significantly different), while both sexes showed frequency effects for irregulars (these only approached significance for boys, but did not differ from the frequency effects found in girls).
Further analyses: Comparisons between children and adults
In order to probe for potential developmental changes, we directly compared children's patterns of imageability and frequency effects on regulars and irregulars to the data from adults previously obtained in Prado and Ullman (2009) . Because sex differences were observed here for children (the sex by verb-type by imageability interaction was significant, as were the sex differences in both the imageability and frequency coefficients for regulars), below we examined males and females separately in the comparisons with adults, both for imageability and for frequency effect analyses. (Note that the pattern for adults obtained here was similar to that reported in Prado and Ullman (2009) , though the coefficients and p-values are slightly different, since the model here included additional data (the children's data) and additional covariates).
Imageability effects in children versus adults.
For females, the age-group (children vs. adults) by verb-type (regular vs. irregular) by imageability interaction was significant (B = −0.070, t(5337) = 2.04, p = .041), indicating that the pattern of imageability effects differed between girls and women. Girls showed significantly stronger imageability effects than women on regulars (B = 0.070, t(5437) = 3.34, p<.001), while on irregulars girls and women did not differ (B = 0.001, t(5407) = 0.03, p = .972). In contrast to girls, women did not show imageability effects for regulars (B = 0.006, t(5403) = 0.46, p = .648) or for irregulars (B = −0.015, t(5385) = 1.08, p = .280), and there was no significant difference between the verb types for women (B = −0.020, t(5334) = 1.13, p = .260).
For males, the age-group by verb-type by imageability interaction was not significant (B = 0.004, t(5339) = 0.11, p = .915) and the boys and men did not differ in the magnitude of the imageability effect (across both verb types: B = 0.021, t(5442) = 1.21, p = .225). This indicates that the pattern of imageability effects did not differ between boys and men.
Frequency effects in children versus adults.
In females, the age-group by verb-type by frequency interaction was not significant (B = 0.011, t(5430) = ,0.95 p = .344). The age group difference over both verb types (regulars and irregulars) was not significant (B = 0.003, t(5153) = 0.38, p = .701), indicating that the pattern of frequency effects over both verb types did not differ between girls and women.
In males, the age-group by verb-type by frequency interaction was not significant (B = 0.011, t(5425) = 0.93, p = .353). The age group difference over both verb types was not significant (B = −0.010, t(5139) = 1.57, p = .115), indicating that the pattern of frequency effects did not differ between boys and men.
This study examined frequency and imageability effects in the production of (correct) existing English regular and irregular past tense forms in monolingual 8–12 year old children. It additionally directly compared these findings with adult data. The results can be summarized as follows.
Children exhibited imageability as well as frequency effects on irregulars. In contrast, they showed only imageability effects on regulars. When we examined whether the pattern of effects differed between boys and girls, the interaction with sex indicated that the pattern differed by sex for imageability effects but not frequency effects (central panels of Figures 2 and 3). Specifically, boys and girls differed significantly in imageability effects on regulars, with only girls showing such effects. In contrast, boys and girls did not differ significantly in imageability effects on irregulars (Figure 2). For frequency effects, the sex by verb-type interaction was not significant, though over both verb types, girls but not boys showed frequency effects.
Within-sex comparisons between children and adults indicated that with regard to imageability effects, females but not males showed age-group differences. Specifically, for females, imageability effects were found only on regulars and only in girls – that is, not on irregulars in either age group, and not in women in either verb type. For frequency, no age group differences were observed in either males or females.
The following pattern emerges from the data (see Table 2). For females, between childhood and adulthood imageability effects on regulars disappear. In contrast, frequency effects on regulars in females do not change reliably during this period (the frequency coefficients were not significantly different between girls and women), though the frequency effect reaches significance (it is reliable) in women , but not in girls (Figure 3). For irregulars, the pattern does not change from childhood to adulthood: both girls and women show frequency effects and neither shows imageability effects.
Table 2. Summary of frequency and imageability effects, by verb type, sex and age group.doi:10.1371/journal.pone.0074683.t002
Males exhibited a somewhat different pattern. For regulars, neither frequency nor imageability effects change from childhood to adulthood; no effects of either type were found in either age group (Table 2). Likewise, for irregulars, the pattern of effects does not change reliably with age. Here, however, both boys and men show imageability effects; frequency effects also do not differ significantly between boys and men, though they reach significance only in men (approaching significance in boys).
This pattern of results does not appear to be explained by confounding experimental or statistical factors: the findings are not explained by ceiling effects, by differences in power, or by numerous item- and subject-level covariates. Note also that the sex differences in imageability effects on regulars cannot be attributed to potential sex differences in reading levels, since the boys and girls in this study did not differ in reading abilities (see Methods).
Given the different interpretations of the lack of frequency effects (and potentially of imageability effects) under single-mechanism and dual-system frameworks, we discuss the results separately from the two perspectives.
Within a single-mechanism framework, all inflected forms – regular and irregular – are expected to depend on stored representations in all subjects: that is, in children and adults, and in both sexes. Therefore, the significant frequency effects found in the full group of children on irregulars are expected in this view. The significant imageability effects on irregulars in the full group of children could presumably also be accounted for, although it is important to point out that, to our knowledge, imageability has not thus far been considered in connectionist models of inflectional morphology. Children's lack of frequency effects on regulars might be argued to be due to the contribution of neighboring (i.e., phonologically similar) verbs to the memory traces of regular forms overwhelming the contribution of each verb's individual past tense frequency (see Introduction). However, our inclusion of phonological neighborhood as a covariate (see Table 1) suggests that phonological consistency might not explain the lack of frequency effects on regulars. Finally, although the observed pattern of sex differences on imageability effects might potentially be explainable by single-mechanism models, to our knowledge such models have not thus far addressed such differences (for additional discussion, also see ). Thus, it remains to be seen whether future connectionist models can accommodate the findings reported here.
Within a dual-system framework, irregular inflected forms are expected to be stored by all language users. Based on prior results, regular inflected forms may tend to be stored by women, but not men . One possibility is that children follow this adult pattern. Indeed, boys do show the same pattern as men, lacking both frequency and imageability effects on regulars, but showing evidence of both imageability and frequency effects on irregulars. This suggests that, just like men, boys compose regulars but store irregulars. Girls show a somewhat different pattern. For irregulars, girls show the same pattern as women, with frequency but not imageability effects; the frequency effects indicate the storage of irregularly inflected forms. However, girls do not show the same pattern as women for regulars: girls show imageability effects but not frequency effects, whereas women show the opposite pattern. This suggests that girls, like women, store regulars, but the lexical properties that influence this storage change over the course of development.
Here we suggest that the overall pattern of results reflects three different principles. First, we suggest a developmental trajectory in which imageability precedes frequency as a mechanism facilitating the storage of inflected forms. This interpretation is supported by several lines of evidence. Previous findings indicate that reliance on imageability (including with regard to language) decreases between childhood and adulthood; in other words, children rely more on imageability than adults , , . At the same time, it is plausible that frequency increasingly influences memory traces between childhood and adulthood. That is, frequency may play a larger (i.e., more significant) role in lexical access with increasing exposure to language. In this view, over time, as increasing exposure to words strengthens the memory traces for those forms, frequency plays an increasingly important explanatory role in lexical access. Additionally, it is plausible that over the course of development, the frequency (exposure) distribution of words experienced by a given individual will increasingly (i.e., as the signal outweighs the noise) reflect the more general frequency distribution in the population (which is measured by frequency counts), leading to increasing frequency effects with time. The notion that frequency effects have an increasing influence during development is further supported by previous findings which overall suggest more sporadic frequency effects on past tenses in children as compared to adults, even for irregulars (see Introduction).
Second, girls may tend to develop language skills earlier than boys –. Indeed, brain areas involved in language appear to develop earlier in girls than boys , . More generally, females (girls as well as women) have been argued to have superior verbal skills than males –, . Since the influence of frequency may be more intrinsically dependent on language skills than imageability (e.g., the former crucially depend on linguistic forms, whereas the latter rely heavily on semantics), the storage of linguistic forms may be influenced earlier and more strongly by frequency (but perhaps not by imageability) in females than males. Conversely, since males (both boys and men) may tend to have advantages over females at visuo-spatial processing , ,  imageability (but not frequency) may play an earlier and perhaps larger explanatory lexical access role in males than females.
Third, the storage of irregular inflected forms may depend more on frequency than regular inflected forms. Since irregulars can only be stored, every encounter with an irregular past-tense form should influence its storage; frequency would thus play an important role for irregulars earlier on than for regulars (which may be either stored or composed).
Together, these three principles may explain the pattern of results observed here. For irregular past tenses, girls may already show a significant effect of frequency, which may thus explain a substantial degree of the variability in the access of these forms, leaving imageability (and perhaps other factors) with little explanatory power – especially if the influence of imageability is not particularly strong in girls due to the status of their visual-spatial skills. In other words, 8-12 year old girls may have already shifted from imageability to frequency as a factor facilitating the storage of these forms. For regular past tenses, girls also tend to rely on storage (e.g., due to their memory advantages; see below), but still depend on imageability as a means to do so, in line with the expectation that regulars undergo the shift to frequency later than irregulars. However, by adulthood, women should have transitioned from imageability to frequency as the dominant mechanism underlying access, even for regulars, as we suggest younger girls have already done for irregulars. Thus women show frequency effects but not imageability effects for both verb types.
For males, the story is somewhat different. On irregulars, boys show reliable imageability effects, whereas their frequency effects do not reach significance. This is consistent with strong visuo-spatial skills and weaker verbal skills in boys (as compared to girls), leading to strong imageability effects but the slower development of frequency effects. Note that the imageability and frequency effects may also affect each other: the weaker frequency effects are less likely to overwhelm imageability effects, while strong imageability effects may further weaken the effect of frequency. By adulthood, men still show imageability effects on irregulars, even though they have developed clear frequency effects by this point. Again, this is consistent with strong visuo-spatial skills in males as well as weaker verbal skills, even though the cumulative effect of frequency is strong enough to lead to significant frequency effects. For regulars, there is no indication of any storage for either boys or men. One possibility is that adult men are delayed even relative to young girls in their reliance on memory for these forms. However, this seems implausible, since the men ranged in age from 18 to 50. Alternatively, males and females may tend to have different computational strategies for regular forms, both as children (at least around age 10) and as adults. On this view, females often store regulars, while males tend to rely on composition, with this sex difference likely due in part to a lexical memory advantage for females , .
Overall, within a dual system framework, the results from the current study provide further support for a model in which irregular inflected forms are always stored, whereas regular inflected forms may be composed, but can also be stored, with various item- and subject-level factors modulating their storage vs. composition , , . Moreover, the present study has revealed for the first time a developmental trajectory that is at least somewhat different for boys and girls.
This study was designed to contribute to our understanding of the distinction between the storage and composition of complex linguistic forms. Specifically, it attempted to fill an existing gap concerning frequency and imageability effects on regular and irregular inflected forms in children. The findings suggest that 8–12 year old children store irregulars more reliably than regulars. However, the pattern of storage is also influenced by sex. Boys show evidence of storage for irregulars but not regulars, while girls show evidence of storage for both. Additionally, boys seem to rely particularly on imageability and girls particularly on frequency for lexical storage and access. Although not ruling out single-mechanism models, the new child data are compatible with a dual-system view in which idiosyncratic (unpredictable) forms, such as irregular inflected forms, are stored, whereas rule-governed forms, such as regular inflected forms, can be either composed or stored, with storage a function of various factors. The findings also indicate that there is a developmental shift in the basis of storage between the age range studied (8–12) and adulthood. Imageability may play a greater role in the memorization of inflected words in children than adults, whereas frequency may play a greater role in the memorization of inflected forms in adults than children, a finding which will need to be confirmed in future studies.
The current findings make a number of contributions to the previous literature on frequency effects on inflected forms in children. First, this study demonstrates the utility of mixed effects modeling in this area of investigation. Because of the improved methodology used here, the present results strengthen previous reports of frequency effects on children's processing of irregular but not regular forms , . As the first study to examine imageability in addition to frequency effects in children's processing of inflected forms, this study builds on previous work by providing further insight into the bases of lexical storage in children. The findings additionally corroborate recent acquisition evidence regarding a link between imageability and inflected forms; this evidence indicates that children acquire inflected (plural) forms earlier in development for higher imageability than lower imageability nouns . Taken together, these different lines of research provide growing evidence regarding the relation between imageability and inflected forms from both acquisition and processing. Most importantly, the current study contributes several new discoveries to the field of child language, including the findings that regulars can to some extent be stored in children (as well as adults), that there appear to be sex differences with regard to storage effects in children (as well as adults), and that the bases of storage of inflected forms appears to change to some degree between childhood and adulthood.
The present investigation has also brought to light some novel predictions and directions for future research. For example, imageability effects on irregulars were reliable in males but not in females. Because irregulars (unlike regulars) must rely on stored representations in all theoretical frameworks , this pattern may be taken as evidence that imageability has a stronger influence on lexical storage in males than females, perhaps due both to strong visuo-spatial skills in males and strong verbal skills in females. Note that a stronger influence of imageability in males than females leads to an interesting prediction, namely that the often observed pattern of imageable (concrete) words being acquired earlier by children than abstract (less imageable) words , , – may hold more strongly for boys than for girls. In contrast, girls may perhaps learn abstract words earlier than boys. To our knowledge, these predictions have not yet been examined.
Finally, it is important to keep in mind that this study examined only 8–12 year old children and adults. Nevertheless, it is not unreasonable to extrapolate from the patterns of frequency and imageability effects in the two age groups. In particular, intermediate age groups (e.g., adolescents) should show similar frequency and imageability patterns as the two age groups where they did not differ, or intermediate patterns where they did. However, it is difficult to extrapolate to younger (e.g., toddlers) or older (e.g., the elderly) age groups. Thus the influence of frequency, imageability and sex in younger and older age groups warrants examination in future studies. Likewise, the present investigation focused solely on inflectional morphology, in particular on English past tense. Future studies should investigate whether the current results might generalize to other tasks (e.g., ), other inflectional paradigms, other languages, and other aspects of language, including derivational morphology and syntax.
We thank the members of the Georgetown Brain and Language Lab for their assistance with the project, and in particular Jarrett Lovelett for formatting the figures.
Conceived and designed the experiments: MU CD MW. Performed the experiments: SM EP. Analyzed the data: CD MU MW EP. Contributed reagents/materials/analysis tools: MU CD SM. Wrote the paper: CD MU MW.
- 1. Elman JL, Bates EA, Johnson MH, Karmiloff-Smith A, Parisi D, et al. (1996) Rethinking innateness: A connectionist perspective on development. Cambridge, Massachusetts: The MIT Press. xviii, 447.
- 2. Seidenberg M (1992) Connectionism without tears. In: Davis S, Connectionism: Theory and Practice. New York: Oxford University Press. 84–137.
- 3. Stemberger JP, MacWhinney B (1986) Frequency and the lexical storage of regularly inflected forms. Mem Cognit 14: 17–26. doi: 10.3758/bf03209225
- 4. Joanisse MF, Seidenberg MS (1999) Impairments in verb morphology after brain injury: a connectionist model. Proceedings of the National Academy of Sciences of the United States of America 96: 7592–7597. doi: 10.1073/pnas.96.13.7592
- 5. McClelland JL, Patterson K (2002) Rules or connections in past-tense inflections: what does the evidence rule out? Trends in Cognitive Sciences 6: 465–472. doi: 10.1016/s1364-6613(02)01993-9
- 6. Woollams AM, Joanisse M, Patterson K (2009) Past-tense generation from form versus meaning: Behavioural data and simulation evidence. Journal of Memory and Language 61: 55–76. doi: 10.1016/j.jml.2009.02.002
- 7. Albright A, Hayes B (2003) Rules vs. analogy in English past tenses: A computational/experimental study. Cognition 90: 119–161. doi: 10.1016/s0010-0277(03)00146-x
- 8. Anshen F, Aronoff M (1988) Producing morphologically complex words. Linguistics 26: 641–655. doi: 10.1515/ling.1918.104.22.1681
- 9. Pylkkanen L, Marantz A (2003) Tracking the time course of word recognition with MEG. Trends in Cognitive Science 7: 187–189. doi: 10.1016/s1364-6613(03)00092-5
- 10. Stockall L, Marantz A (2006) A single route, full decomposition model of morphological complexity: MEG evidence. The Mental Lexicon 1: 85–123. doi: 10.1075/ml.1.1.07sto
- 11. Marslen-Wilson W, Tyler LK (1998) Rules, representations, and the English past tense. Trends in Cognitive Sciences 2: 428–435. doi: 10.1016/s1364-6613(98)01239-x
- 12. Taft M (1979) Recognition of affixed words and the word frequency effect. Memory and Cognition 7: 263–272. doi: 10.3758/bf03197599
- 13. Tyler LK, de Mornay-Davies P, Anokhina R, Longworth C, Randall B, et al. (2002) Dissociations in processing past tense morphology: Neuropathology and behavioral studies. Journal of Cognitive Neuroscience 14: 79–94. doi: 10.1162/089892902317205348
- 14. Ullman MT (2004) Contributions of memory circuits to language: The declarative/procedural model. Cognition 92: 231–270. doi: 10.1016/j.cognition.2003.10.008
- 15. Alegre M, Gordon P (1999) Frequency Effects and the Representational Status of Regular Inflections. Journal of Memory and Language 40: 41–61. doi: 10.1006/jmla.1998.2607
- 16. Baayen RH, Dijkstra T, Schreuder R (1997) Singulars and Plurals in Dutch: Evidence for a parallel dual-route model. Journal of Memory and Language 37: 94–117. doi: 10.1006/jmla.1997.2509
- 17. Lehtonen M, Niska H, Wande E, Niemi J, Laine M (2006) Recognition of inflected words in a morphologically limited language: frequency effects in monolinguals and bilinguals. Journal of Psycholinguistic Research 35: 121–146. doi: 10.1007/s10936-005-9008-1
- 18. Lehtonen M, Laine M (2003) How word frequency affects morphological processing in monolinguals and bilinguals. Bilingualism: Language and Cognition 6: 213–225. doi: 10.1017/s1366728903001147
- 19. Soveri A, Lehtonen M, Laine M (2007) Word frequency and morphological processing in Finnish revisited. The Mental Lexicon 2: 359–385. doi: 10.1075/ml.2.3.04sov
- 20. Prado E, Ullman MT (2009) Can imageability help us draw the line between storage and composition? Journal of Experimental Psychology: Language, Memory, and Cognition 35: 849–866. doi: 10.1037/a0015286
- 21. Kramer JH, Delis DC, Daniel M (1988) Sex differences in verbal learning. Journal of Clinical Psychology 44: 907–915. doi: 10.1002/1097-4679(198811)44:6<907::aid-jclp2270440610>3.0.co;2-8
- 22. Trahan DE, Quintana JW (1990) Analysis of gender effects upon verbal and visual memory performance in adults. Archives of Clinical Neuropsychology 5: 325–334. doi: 10.1093/arclin/5.4.325
- 23. Kimura D (1999) Sex and cognition. Cambridge, MA: The MIT Press.
- 24. Maitland SB, Herlitz A, Nyberg L, Backman L, Nilsson LG (2004) Selective sex differences in declarative memory. Memory and Cognition 32: 1160–1169. doi: 10.3758/bf03196889
- 25. Ullman MT, Miranda RA, Travers ML (2008) Sex differences in the neurocognition of language. In: Becker JB, Berkley KJ, Geary N, Hampson E, Herman J, et al., Sex on the Brain: From Genes to Behavior. NY NY: Oxford University Press. 291–309.
- 26. Bybee JL (1985) Morphology: A study of the relation between meaning and form. Philadelphia: Benjamins.
- 27. Bybee JL (1995) Regular morphology and the lexicon. Language and Cognitive Processes 10: 425–455. doi: 10.1080/01690969508407111
- 28. Plunkett K, Marchman V (1991) U-shaped learning and frequency effects in a multi-layered perceptron: Implications for child language acquisition. Cognition 38: 43–102. doi: 10.1016/0010-0277(91)90022-v
- 29. Plunkett K, Marchman V (1993) From rote learning to system building: Acquiring verb morphology in children and connectionist nets. Cognition 48: 21–69. doi: 10.1016/0010-0277(93)90057-3
- 30. Rumelhart DE, McClelland JL (1986) On learning the past tenses of English verbs. In: McClelland JL, Rumelhart DE, PDP Research Group, Parallel distributed processing: Explorations in the microstructures of cognition. Cambridge, MA: Bradford/MIT press. 272–326.
- 31. Marcus GF, Pinker S, Ullman MT, Hollander M, Rosen TJ, et al. (1992) Overregularization in language acquisition. Monographs of the Society for Research in Child Development 57: 1–165. doi: 10.2307/1166115
- 32. Berko J (1958) The child's learning of English morphology. Word 14: 150–177.
- 33. Pinker S (1984) Language learnability and language development; Wanner E, editor. Cambridge, MA: Harvard University Press.
- 34. Stemberger JP (1989) The acquisition of morphology: Analysis of a symbolic model of language acquisition. Department of Linguistics, University of Minnesota: Unpublished manuscript.
- 35. Forster KI, Chambers SM (1973) Lexical access and naming time. Journal of Verbal Learning and Verbal Behavior 12: 627–635. doi: 10.1016/s0022-5371(73)80042-8
- 36. Frederiksen JR, Kroll JF (1976) Spelling and sound: Approaches to the internal lexicon. Journal of Experimental Psychology: Human Perception and Performance 2: 361–379. doi: 10.1037/0096-1522.214.171.1241
- 37. Gleason JB, Ratner NB, editors (1998) Psycholinguistics. 2 ed. Fort Worth: Harcourt Brace College Publishers.
- 38. Majerus S, Van der Linden M (2003) Long-term memory effects on verbal short-term memory: A replication study. British Journal of Developmental Psychology 21: 303–310. doi: 10.1348/026151003765264101
- 39. Rubenstein H, Garfield L, Milliken JA (1970) Homographic entries in the internal lexicon. Journal of Verbal Learning and Verbal Behavior 9: 487–492. doi: 10.1016/s0022-5371(70)80091-3
- 40. Balota DA, Cortese MJ, Sergent-Marshall SD, Spieler DH, Yap MJ (2004) Visual Word Recognition of Single-Syllable Words. Journal of Experimental Psychology: General 133: 283–316.
- 41. James CT (1975) The role of semantic information in lexical decisions. Journal of Experimental Psychology 104: 130–136. doi: 10.1037/0096-15126.96.36.199
- 42. Kennet J, McGuire L, Willis SL, Schaie KW (2000) Memorability functions in verbal memory: a longitudinal approach. Experimental Aging Research 26: 121–137. doi: 10.1080/036107300243597
- 43. Kroll JF, Merves JS (1986) Lexical access for concrete and abstract words. Journal of Experimental Psychology: Learning, Memory, and Cognition 12: 92–107. doi: 10.1037/0278-73188.8.131.52
- 44. Mellet E, Tzourio N, Denis M, Mazoyer B (1998) Cortical anatomy of mental imagery of concrete nouns based on their dictionary definition. NeuroReport 9: 803–808. doi: 10.1097/00001756-199803300-00007
- 45. Paivio A (1963) Learning of Adjective-Noun Paired Associates as a Function of Adjective-Noun Word Order and Noun Abstractness. Canadian Journal of Psychology 17: 370–379. doi: 10.1037/h0083277
- 46. Paivio A (1967) Paired-associate learning and free recall of nouns as a function of concreteness, specificity, imagery, and meaningfulness. Psychological Reports 20: 239–245. doi: 10.2466/pr0.19184.108.40.206
- 47. Strain E, Patterson K, Seidenberg MS (1995) Semantic effects in single-word naming. Journal of Experimental Psychology: Learning, Memory and Cognition 21: 1140–1154. doi: 10.1037//0278-73220.127.116.110
- 48. Schwanenflugel PJ, Akin CE (1994) Developmental trends in lexical decisions for abstract and concrete words. Reading Research Quarterly 29: 250–264.
- 49. Yarmey AD, O'Neil BJ (1969) S-R and R-S paired-associate learning as a function of concreteness, imagery, specificity, and association value. The Journal of Psychology 71: 95–109. doi: 10.1080/00223980.1969.10543076
- 50. Marantz A (2005) Generative linguistics within the cognitive neuroscience of language. The Linguistic Review 22: 429–445. doi: 10.1515/tlir.2005.22.2-4.429
- 51. Daugherty K, Seidenberg M (1992) Rules or connections? The past tense revisited. Milwaukee Rules Conference, Milwaukee.
- 52. Ullman MT (1999) Acceptability ratings of regular and irregular past tense forms: Evidence for a dual-system model of language from word frequency and phonological neighbourhood effects. Language and Cognitive Processes 14: 47–67. doi: 10.1080/016909699386374
- 53. Baayen H, Schreuder R, de Jong N, Knott A (2002) Dutch inflection: the rules that prove the exception. In: Nooteboom S, Weerman F, Wijnen F, Storage and Computation in the Language Faculty. Dordrecht, Netherlands: Kluwer Academic. 61–92.
- 54. Prasada S, Pinker S, Snyder W (1990) Some evidence that irregular forms are retrieved from memory but regular forms are rule-generated. 31st Annual Meeting of the Psychonomic Society, New Orleans.
- 55. Seidenberg M, Bruck M (1990) Consistency effects in the generation of past tense morphology. 31st Annual Meeting of the Psychonomic Society, New Orleans.
- 56. Clahsen H, Eisenbeiss S, Sonnenstuhl I (1997) Morphological structure and the processing of inflected words. Theoretical Linguistics 23: 201–249. doi: 10.1515/thli.1918.104.22.168
- 57. Penke M, Krause M (2002) German noun plurals: A challenge to the dual-mechanism model. Brain and Language 81: 303–311. doi: 10.1006/brln.2001.2526
- 58. Clahsen H, Hadler M, Weyerts H (2004) Speeded production of inflected words in children and adults. Journal of Child Language 31: 687–712. doi: 10.1017/s0305000904006506
- 59. Royle P, Jarema G, Kehayia E (2003) Verb reading in developmental language impairment. Brain and Language 87: 311–322. doi: 10.1016/s0093-934x(03)00110-x
- 60. Bien H, Baayen RH, Levelt WJM (2011) Frequency effects in the production of Dutch deverbal adjectives and inflected verbs. Language and Cognitive Processes 26: 683–715. doi: 10.1080/01690965.2010.511475
- 61. Sereno JA, Jongman A (1997) Processing of English inflectional morphology. Memory and Cognition 25: 425–437. doi: 10.3758/bf03201119
- 62. Westermann G, Kovic V, Ruh N (2008) Mechanisms of verb inflections - Regular vs. irregular or easy vs. hard. In: Love BC, McRae K, Sloutsky VM, Proceedings of the 30th Annual Conference of the Cognitive Science Society. Austin, TX: Cognitive Science Society. 739–744.
- 63. Bertram R, Laine M, Harald Baayen R, Schreuder R, Hyona J (2000) Affixal homonymy triggers full-form storage, even with inflected words, even in a morphologically rich language. Cognition 74: B13–25. doi: 10.1016/s0010-0277(99)00068-2
- 64. Balling LW, Baayen RH (2008) Morphological effects in auditory word recognition: Evidence from Danish. Language and Cognitive Processes 23: 1159–1190. doi: 10.1080/01690960802201010
- 65. van der Lely HKJ, Ullman MT (2001) Past tense morphology in specifically language impaired and normally developing children. Language and Cognitive Processes 16: 177–217. doi: 10.1080/01690960042000076
- 66. Royle P (2007) Variable effects of morphology and frequency on inflection patterns in French preschoolers. The Mental Lexicon 2: 103–125. doi: 10.1075/ml.2.1.07roy
- 67. Matthews DE, Theakston AL (2006) Errors of omission in English-speaking children's production of plurals and the past tense: The effects of frequency, phonology, and competition. Cognitive Science 30: 1027–1052. doi: 10.1207/s15516709cog0000_66
- 68. Ambridge B (2010) Children's judgments of regular and irregular novel past-tense forms: new data on the English past-tense debate. Developmental Psychology 46: 1497–1504. doi: 10.1037/a0020668
- 69. Dabrowska E, Szczerbinski M (2006) Polish children's productivity with case marking: The role of regularity, type frequency, and phonological diversity. Journal of Child Language 33: 559–597. doi: 10.1017/s0305000906007471
- 70. Kidd E, Lum JAG (2008) Sex differences in past tense overregularization. Developmental Science 11: 882–889. doi: 10.1111/j.1467-7687.2008.00744.x
- 71. MacWhinney B (1978) Processing a first langauge: The acquisition of morphophonology. Monographs of the Society for Research in Child Development 43: 123. doi: 10.2307/1166047
- 72. Marchman VA (1997) Children's productivity in the English past tense: The role of frequency, phonology, and neighborhood structure. Cognitive Science 21: 283–304. doi: 10.1207/s15516709cog2103_2
- 73. Cohen J (1983) The cost of dichotomization. Applied Psychological Measurement 7: 249–253. doi: 10.1177/014662168300700301
- 74. Cohen J, Cohen P, West SG, Aiken LS (2003) Applied Multiple regression/correlation analysis for the behavioral sciences. Mahwah, NJ: Lawrence Erlbaum Associates, Inc. 703.
- 75. Oldfield RC (1971) The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 9: 97–113. doi: 10.1016/0028-3932(71)90067-4
- 76. Wechsler D (2005) Wechsler Individual Achievement Test 2nd Edition (WIAT II). 2nd ed. London: The Psychological Corp.
- 77. Walenski M, Mostofsky SH, Ullman MT (2007) Speeded processing of grammar and tool knowledge in Tourette's syndrome. Neuropsychologia 45: 2447–2460. doi: 10.1016/j.neuropsychologia.2007.04.001
- 78. Church K (1988) A stochastic parts program and noun phrase parser for unrestricted text. Proceedings of the Second Conference on Applied Natural Language Processing Austin, TX: 136–143.
- 79. Francis N, Kucera H (1982) Frequency analysis of English usage: Lexicon and grammar. Boston MA: Houghton Mifflin.
- 80. Ma W, Golinkoff RM, Hirsh-Pasek K, McDonough C, Tardif T (2009) Imagine that! Imageability predicts verb learning in Chinese children. Journal of Child Language 36: 405–423. doi: 10.1017/s0305000908009008
- 81. Quené H, van den Burgh H (2008) Examples of mixed-effects modeling with crossed random effects and with binomial data. Journal of Memory and Language 59: 413–425. doi: 10.1016/j.jml.2008.02.002
- 82. West BT, Welch KB, Galecki AT (2007) Linear mixed models: A practical guide using statistical software. Boca Raton, FL Chapman & Hall/CRC.
- 83. Duthie JK, Nippold MA, Billow JL, Mansfield TC (2008) Mental imagery of concrete proverbs: A developmental study of children, adolescents, and adults. Applied Psycholinguistics 29: 151–173. doi: 10.1017/s0142716408080077
- 84. Kosslyn SM, Bower GH (1974) The role of imagery in sentence memory: A developmental study. Child Development 45: 30–38. doi: 10.2307/1127746
- 85. Bleses D, Vach W, Slott M, Wehberg S, Thomsen P, et al. (2008) The Danish Communicative Developmental Inventories: validity and main developmental trends. Journal of Child Language 35: 651–669. doi: 10.1017/s0305000907008574
- 86. Bornstein MH, Hahn C-S, Haynes OM (2004) Specific and general language performance across early childhood: Stability and gender considerations. First Language 24: 267–304. doi: 10.1177/0142723704045681
- 87. Feldman HM, Dollaghan CA, Campbell TF, Kurs-Lasky M, Janosky JE, et al. (2000) Measurement properties of the MacArthur communicative development inventories at ages one and two years. Child Development 71: 310–322. doi: 10.1111/1467-8624.00146
- 88. Fenson L, Dale PS, Reznick JS, Bates E, Thal DJ, et al. (1994) Variability in early communicative development. Monographs of the society for research in child development 59.
- 89. Galsworthy M, Dionne G, Dale P, Plomin R (2000) Sex differences in early verbal and non-verbal cognitive development. Developmental Science 3: 206–215. doi: 10.1111/1467-7687.00114
- 90. Hanlon HW, Thatcher RW, Cline MJ (1999) Gender differences in the development of EEG coherence in normal children. Developmental Neuropsychology 16: 479–506. doi: 10.1207/s15326942dn1603_27
- 91. Lenroot RK, Gogtay N, Greenstein DK, Wells EM, Wallace GL, et al. (2007) Sexual dimorphism of brain developmental trajectories during childhood and adolescence. NeuroImage 36: 1065–1073. doi: 10.1016/j.neuroimage.2007.03.053
- 92. Babcock L, Stowe J, Maloof C, Brovetto C, Ullman MT (2012) The storage and composition of inflected forms in adult-learned second language: A study of the influence of length of residence, age of arrival, sex, and other factors. Bilingualism: Language and Cognition 15: 820–840. doi: 10.1017/s1366728912000053
- 93. Linn MC, Petersen AC (1985) Emergence and characterization of sex differences in spatial ability: a meta-analysis. Child Development 56: 1479–1498. doi: 10.2307/1130467
- 94. Kerns KA, Berenbaum SA (1991) Sex differences in spatial ability in children. Behav Genet 21: 383–396. doi: 10.1007/bf01065974
- 95. Ullman MT (2001) The declarative/procedural model of lexicon and grammar. Journal of Psycholinguistic Research 30: 37–69. doi: 10.1017/s1366728901000220
- 96. Smolik F (2013) Noun imageability facilitates the acquisition of plurals: Survival analyses of plural emergence in chidlren. Journal of Psycholinguistics Research 1–16.
- 97. Brown R (1957) Linguistic determinism and parts of speech. Journal of Abnormal and Social Psychology 55: 1–5. doi: 10.1037/h0041199
- 98. Gilhooly KJ, Logie RH (1980) Age-of-acquisition, imagery, concreteness, familarity, and ambiguity measures for 1,944 words. Behavior Research Methods and Instrumentation 12: 395–427. doi: 10.3758/bf03201693
- 99. McDonough C, Song L, Hirsh-Pasek K, Golinkoff RM, Lannon R (2011) An image is worth a thousand words: Why nouns tend to dominate verbs in early word learning. Developmental Science 14: 181–189. doi: 10.1111/j.1467-7687.2010.00968.x
- 100. Schwanenflugel PJ (1991) Why are abstract concepts hard to understand? In: Schwanenflugel PJ, The Psychology of Word Meanings. Hillsdale, NJ: Erlbaum. 223–250.
- 101. Dabrowska E (2008) The effects of frequency and neighbourhood density on adult speakers' productivity with Polish case inflections: An empirical test of usage-based approaches to morphology. Journal of Memory and Language 58: 931–952. doi: 10.1016/j.jml.2007.11.005
- 102. Baddeley AD, Hitch G (1974) Working Memory. In: Bower GA, The Psychology of Learning and Motivation. New York: Academic Press. 47–89.
- 103. Caplan D, Rochon E, Waters GS (1992) Articulatory and phonological determinants of word length effects in span tasks. Journal of Experimental Psychology 45: 177–192. doi: 10.1080/14640749208401323
- 104. Levelt WJ, Roelofs A, Meyer AS (1999) A theory of lexical access in speech production. Behavioral and Brain Sciences discussion 22: : 1-38; 38–75.
- 105. Kessler B, Treiman R, Mullennix J (2002) Phonetic Biases in Voice Key Response Time Measurements. J Mem Lang 47: 145–171. doi: 10.1006/jmla.2001.2835
- 106. Bird H, Lambon R, Seidenberg MS, McClelland JL, Patterson K (2003) Deficits in phonology and past tense morphology: What's the connection? Journal of Memory and Language 48: 502–526. doi: 10.1016/s0749-596x(02)00538-7
- 107. Baayen RH, Moscoso del Prado MF (2005) Semantic density and past-tense formation in three Germanic languages. Language 81: 666–698. doi: 10.1353/lan.2005.0112
- 108. Fellbaum CE (1998) Wordnet: An electronic database. Cambridge, MA: MIT Press.
- 109. Miller GA (1990) Wordnet: An on-line lexical database. International Journal of Lexicography 3: 235–312. doi: 10.1093/ijl/3.4.235