Results 1 - 10
of
11
An Activation-Based Model of Sentence Processing as Skilled Memory Retrieval
, 2005
"... We present a detailed process theory of the moment-by-moment working-memory retrievals and associated control structure that subserve sentence comprehension. The theory is derived from the application of independently motivated principles of memory and cognitive skill to the specialized task of sent ..."
Abstract
-
Cited by 41 (6 self)
- Add to MetaCart
We present a detailed process theory of the moment-by-moment working-memory retrievals and associated control structure that subserve sentence comprehension. The theory is derived from the application of independently motivated principles of memory and cognitive skill to the specialized task of sentence parsing. The resulting theory construes sentence processing as a series of skilled associative memory retrievals modulated by similarity-based interference and fluctuating activation. The cognitive principles are formalized in computational form in the Adaptive Control of Thought–Rational (ACT–R) architecture, and our process model is realized in ACT–R. We present the results of 6 sets of simulations: 5 simulation sets provide quantitative accounts of the effects of length and structural interference on both unambiguous and garden-path structures. A final simulation set provides a graded taxonomy of double center embeddings ranging from relatively easy to extremely difficult. The explanation of center-embedding difficulty is a novel one that derives from the model’s complete reliance on discriminating retrieval cues in the absence of an explicit representation of serial order information. All fits were obtained with only 1 free scaling parameter fixed across the simulations; all other parameters were ACT–R defaults. The modeling results support the hypothesis that fluctuating activation and similarity-based interference are the key factors shaping working memory in sentence processing. We contrast the theory and empirical predictions with several related accounts of sentence-processing complexity.
Argument-head distance and processing complexity: Explaining both locality and anti-locality effects
, 2005
"... Although proximity between arguments and verbs (locality) is a relatively robust determinant of sentenceprocessing di#culty (Hawkins, 1998, 2001; Gibson, 2000), increasing argument-verb distance can also facilitate processing (Konieczny, 2000). We present two self-paced reading (SPR) experiments inv ..."
Abstract
-
Cited by 11 (4 self)
- Add to MetaCart
Although proximity between arguments and verbs (locality) is a relatively robust determinant of sentenceprocessing di#culty (Hawkins, 1998, 2001; Gibson, 2000), increasing argument-verb distance can also facilitate processing (Konieczny, 2000). We present two self-paced reading (SPR) experiments involving Hindi that provide further evidence of anti-locality, and a third SPR experiment which suggests that similarity-based interference can attenuate this distance-based facilitation. A unified explanation of interference, locality and anti-locality e#ects is proposed via an independently motivated theory of activation decay and retrieval interference (Anderson et al., 2004). 1
Disfluencies, language comprehension, and Tree Adjoining Grammars
- COGNITIVE SCIENCE
, 2004
"... Disfluencies include editing terms such as uh and um as well as repeats and revisions. Little is known about how disfluencies are processed, and there has been next to no research focused on the way that disfluencies affect structure-building operations during comprehension. We review major findings ..."
Abstract
-
Cited by 2 (0 self)
- Add to MetaCart
Disfluencies include editing terms such as uh and um as well as repeats and revisions. Little is known about how disfluencies are processed, and there has been next to no research focused on the way that disfluencies affect structure-building operations during comprehension. We review major findings from both computational linguistics and psycholinguistics, and then we summarize the results of our own work which centers on how the parser behaves when it encounters a disfluency. We describe some new research showing that information associated with misarticulated verbs lingers, and which adds to the large body of data on the critical influence of verb argument structures on sentence comprehension. The paper also presents a model of disfluency processing. The parser uses a Tree Adjoining Grammar to build phrase structure. In this approach, filled and unfilled pauses affect the timing of Substitution operations. Repairs and corrections are handled by a mechanism we term “Overlay, ” which allows the parser to overwrite an undesired tree with the appropriate, correct tree. This model of disfluency processing highlights the need for the parser to sometimes coordinate the mechanisms that perform garden-path reanalysis with those that do disfluency repair. The research program as a whole demonstrates that it is possible to study disfluencies systematically and to learn how the parser handles filler material and mistakes. It also showcases the power of Tree Adjoining Grammars, a formalism developed by Aravind Joshi which has yielded results in many different areas of linguistics and cognitive science.
Processing Polarity: How the ungrammatical intrudes on the grammatical
"... A central question in online human sentence comprehension is: how are linguistic relations established between different parts of a sentence? Previous work has shown that this dependency resolution process can be computationally expensive, but the underlying reasons for this are still unclear. We a ..."
Abstract
-
Cited by 2 (1 self)
- Add to MetaCart
A central question in online human sentence comprehension is: how are linguistic relations established between different parts of a sentence? Previous work has shown that this dependency resolution process can be computationally expensive, but the underlying reasons for this are still unclear. We argue that dependency resolution is mediated by cue-based retrieval, constrained by independently motivated working memory principles defined in a cognitive architecture (ACT-R). To demonstrate this, we investigate an unusual instance of dependency resolution, the processing of negative and positive polarity items, and confirm a surprising prediction of the cue-based retrieval model: partial cue-matches—which constitute a kind of similarity-based interference—can give rise to the intrusion of ungrammatical retrieval candidates, leading to both processing slow-downs and even errors of judgment that take the form of illusions of grammaticality in patently ungrammatical structures. A notable achievement is that good quantitative fits are achieved without adjusting the key model parameters.
Parallel processing and sentence comprehension difficulty
, 2010
"... Eye fixation durations during normal reading correlate with processing difficulty but the specific cognitive mechanisms reflected in these measures are not well understood. This study finds support in German readers’ eye fixations for two distinct difficulty metrics: surprisal, which reflects the ch ..."
Abstract
-
Cited by 1 (0 self)
- Add to MetaCart
Eye fixation durations during normal reading correlate with processing difficulty but the specific cognitive mechanisms reflected in these measures are not well understood. This study finds support in German readers’ eye fixations for two distinct difficulty metrics: surprisal, which reflects the change in probabilities across syntactic analyses as new words are integrated, and retrieval, which quantifies comprehension difficulty in terms of working memory constraints. We examine the predictions of both metrics using a family of dependency parsers indexed by an upper limit on the number of candidate syntactic analyses they retain at successive words. Surprisal models all fixation measures and regression probability. By contrast, retrieval does not model any measure in serial processing. As more candidate analyses are considered in parallel at each word, retrieval can account for the same measures as surprisal. This pattern suggests an important role for ranked parallelism in theories of sentence comprehension.
0278-7393/04/$12.00 DOI: 10.1037/0278-7393.30.2.431 Evidence for Self-Organized Sentence Processing: Digging-In Effects
"... Dynamical, self-organizing models of sentence processing predict “digging-in ” effects: The more committed the parser becomes to a wrong syntactic choice, the harder it is to reanalyze. Experiment 1 replicates previous grammaticality judgment studies (F. Ferreira & J. M. Henderson, 1991b, 1993), rev ..."
Abstract
- Add to MetaCart
Dynamical, self-organizing models of sentence processing predict “digging-in ” effects: The more committed the parser becomes to a wrong syntactic choice, the harder it is to reanalyze. Experiment 1 replicates previous grammaticality judgment studies (F. Ferreira & J. M. Henderson, 1991b, 1993), revealing a deleterious effect of lengthening the ambiguous region of a garden-path sentence. The authors interpret this result as a digging-in effect. Experiment 2 finds a corresponding effect on reading times. Experiment 3 finds that making 2 wrong attachments is worse than making 1. Non-self-organizing models require multiple stipulations to predict both kinds of effects. The authors show that, under an appropriately formulated self-organizing account, both results stem from self-reinforcement of node and link activations, a feature that is needed independently. An implemented model is given. Whitney Tabor and Sean Hutchins, Department of Psychology, University of Connecticut. Thanks to Fernanda Ferreira for providing many insightful comments as well as materials that formed the basis of the stimuli, Leonard Katz, Maryellen MacDonald, and Michael K. Tanenhaus for insightful comments,
A Content-addressable Pointer Mechanism Underlies Comprehension of Verb-Phrase Ellipsis
, 2006
"... Interpreting a verb-phrase ellipsis (VP ellipsis) requires accessing an antecedent in memory, and then integrating a representation of this antecedent into the local context. This problem was investigated in 4 speed-accuracy trade-off and 2 eye-tracking experiments. To investigate whether the antece ..."
Abstract
- Add to MetaCart
Interpreting a verb-phrase ellipsis (VP ellipsis) requires accessing an antecedent in memory, and then integrating a representation of this antecedent into the local context. This problem was investigated in 4 speed-accuracy trade-off and 2 eye-tracking experiments. To investigate whether the antecedent for a VP ellipsis is accessed with a search or direct-access retrieval process, Experiments 1 and 2 measured the affect of the distance between an ellipsis and its antecedent on the speed and accuracy of comprehension. Accuracy was lower with longer distances, indicating that interpolated material reduced the quality of retrieved information about the antecedent. However, contra a search process, distance did not affect the speed of interpreting ellipsis. This pattern suggests that antecedent representations are content-addressable and retrieved with a direct-access process. To determine whether interpreting ellipsis involves copying antecedent information into the ellipsis site, Experiments 3-6 manipulated the length and complexity of the antecedent. Some types of antecedent complexity—particularly, the number of discourse entities in the antecedent—lowered accuracy. However, neither antecedent length nor complexity affected the speed of interpreting the ellipsis. This pattern is inconsistent with a copy operation, and it suggests that ellipsis interpretation may involve a pointer to extant structures in memory.
In search of on-line locality effects 1 Running head: IN SEARCH OF ON-LINE LOCALITY EFFECTS In Search of On-line Locality Effects in Sentence Comprehension
"... Many comprehension theories assert that increasing the distance between elements (e.g., a verb and an NP argument) participating in a linguistic relation increases the difficulty of establishing that relation during on-line comprehension. Such locality effects are expected to inflate reading times, ..."
Abstract
- Add to MetaCart
Many comprehension theories assert that increasing the distance between elements (e.g., a verb and an NP argument) participating in a linguistic relation increases the difficulty of establishing that relation during on-line comprehension. Such locality effects are expected to inflate reading times, and are thought to reveal properties and limitations of the short-term memory system that supports comprehension. Despite their theoretical importance and putative ubiquity, however, existing evidence for on-line locality effects is quite narrow linguistically and methodologically: it is restricted almost exclusively to self-paced reading (SPR) of complex structures involving a particular class of movement relations in which the observed effects may arise from other factors. We present four experiments (two self-paced reading and two-eyetracking experiments) demonstrating locality effects in establishing subject-verb dependencies in simple materials that are read quickly and easily. These locality effects are observable in the earliest possible eye-movement measures. The combined results of all four experiments also support a specific hypothesis concerning the source of long reading times in prior SPR measures of
The source ambiguity problem: Distinguishing
"... the effects of grammar and processing on acceptability judgments ..."
Featural Analysis and Short-term Memory Retrieval in On-Line Parsing: Evidence for Syntactic, but Not Phonological, Similarity-Based Interference *
"... This paper investigates mechanisms of short-term memory involved in human sentence processing, focusing on how short-term memory functions are realized and constrained in establishing certain linguistic dependencies. We specifically examine a cue-based retrieval approach to short-term memory (Lewis ..."
Abstract
- Add to MetaCart
This paper investigates mechanisms of short-term memory involved in human sentence processing, focusing on how short-term memory functions are realized and constrained in establishing certain linguistic dependencies. We specifically examine a cue-based retrieval approach to short-term memory (Lewis et al. 2005, 2006) which assumes that a

