Abstract:
Learning the past tense of English verbs --- a seemingly minor aspect of language acquisition --- has generated heated debates since 1986, and has become a landmark task for testing the adequacy of cognitive modeling. Several artificial neural networks (ANNs) have been implemented, and a challenge for better symbolic models has been posed. In this paper, we present a general-purpose Symbolic Pattern Associator (SPA) based upon the decision-tree learning algorithm ID3. We conduct extensive head-to-head comparisons on the generalization ability between ANN models and the SPA under different representations. We conclude that the SPA generalizes the past tense of unseen verbs better than ANN models by a wide margin, and we offer insights as to why this should be the case. We also discuss a new default strategy for decision-tree learning algorithms. 1. Introduction Learning the past tense of English verbs, a seemingly minor aspect of language acquisition, has generated heated debates since...
Citations
|
3356
|
C4.5: Programs for Machine Learning
– Quinlan
- 1993
|
|
2526
|
Induction of decision trees
– Quinlan
- 1986
|
|
508
|
Neural networks and the bias/variance dilemma
– Geman, Bienenstock, et al.
- 1992
|
|
429
|
Connectionism and cognitive architecture: A critical analysis
– Fodor
- 1988
|
|
257
|
On learning the past tense of English verbs
– Rumelhart
- 1986
|
|
189
|
On language and connectionism: Analysis of a parallel distributed processing model of language acquisition
– Pinker, Prince
- 1988
|
|
97
|
Rules of language
– Pinker
- 1991
|
|
92
|
Symbolic and neural learning algorithms: An experimental comparison
– Shavlik, Mooney, et al.
- 1991
|
|
85
|
U-shaped learning and frequency effects in a multi-layered perceptron: Implications for child language acquisition
– Plunkett, Marchman
- 1991
|
|
78
|
Statistical Aspects of Neural Networks
– Ripley
- 1993
|
|
74
|
The CHILDES project: Tools for analyzing talk
– MacWhinney
- 2000
|
|
68
|
Error-correcting output codes: a general method for improving multiclass inductive learning programs
– Dietterich, Bakiri
- 1991
|
|
52
|
Generalizations of regular and irregular morphological patterns
– Prasada
- 1993
|
|
47
|
A Comparative Study of ID3 and Backpropagation for English Text-to-speech Mapping
– Dietterich, Hild, et al.
- 1990
|
|
38
|
Answering the connectionist challenge: A symbolic model of learning the past tense of English verbs
– Ling
- 1993
|
|
35
|
The relation between linguistic structure and associative theories of language learning: A constructive critique of some connectionist learning models
– Lachter, Bever
- 1988
|
|
10
|
Implementations are not conceptualizations: Revising the verb model
– MacWhinney, Leinbach
- 1991
|
|
6
|
Connections and symbols: closing the gap
– MacWhinney
- 1993
|
|
3
|
Beyond rules and exceptions: A connectionist modeling approach to inflectional morphology
– Daugherty
- 1993
|
|
3
|
U-shaped learning and frequency e ects in a multilayered perceptron: Implications for child language acquisition
– Plunkett
- 1991
|
|
2
|
Using a recurrent net to learn the past tense
– Cottrell
- 1991
|
|
1
|
Comparison of symbolic, statistical and neural network classifiers
– Feng, King, et al.
- 1992
|
|
1
|
Learning the Past Tense: Symbolic vs Connectionist Models
– Ling, Cherwenka
- 1993
|