Results 1 - 10
of
26
Distributed representations, simple recurrent networks, and grammatical structure
- Machine Learning
, 1991
"... Abstract. In this paper three problems for a connectionist account of language are considered: 1. What is the nature of linguistic representations? 2. How can complex structural relationships such as constituent structure be represented? 3. How can the apparently open-ended nature of language be acc ..."
Abstract
-
Cited by 251 (14 self)
- Add to MetaCart
Abstract. In this paper three problems for a connectionist account of language are considered: 1. What is the nature of linguistic representations? 2. How can complex structural relationships such as constituent structure be represented? 3. How can the apparently open-ended nature of language be accommodated by a fixed-resource system? Using a prediction task, a simple recurrent network (SRN) is trained on multiclausal sentences which contain multiply-embedded relative clauses. Principal component analysis of the hidden unit activation patterns reveals that the network solves the task by developing complex distributed representations which encode the relevant grammatical relations and hierarchical constituent structure. Differences between the SRN state representations and the more traditional pushdown store are discussed in the final section.
A Probabilistic Constraints Approach To Language Acquisition And Processing
, 1989
"... This article provides an overview of a probabilistic constraints framework for thinking about language acquisition and processing. The generative approach attempts to characterize knowledge of language (i.e., competence grammar) and then asks how this knowledge is acquired and used. Our approach is ..."
Abstract
-
Cited by 37 (3 self)
- Add to MetaCart
This article provides an overview of a probabilistic constraints framework for thinking about language acquisition and processing. The generative approach attempts to characterize knowledge of language (i.e., competence grammar) and then asks how this knowledge is acquired and used. Our approach is performance oriented: the goal is to explain how people comprehend and produce utterances and how children acquire this skill. Use of language involves exploiting multiple probabilistic constraints over various types of linguistic and nonlinguistic information. Acquisition is the process of accumulating this information, which begins in infancy. The constraint satisfaction processes that are central to language use are the same as the bootstrapping processes that provide entry to language for the child. Framing questions about acquisition in terms of models of adult performance unifies the two topics under a set of common principles and has important consequences for arguments concerning lan...
Learning and the Emergence of Coordinated Communication
, 1997
"... this paper is on procedures whereby new (e.g., juvenile) members of a population could learn to communicate with the other members by observing their communicative behavior. Two apparently distinct issues are relevant to the evaluation of such learning procedures. First, the procedure must enable th ..."
Abstract
-
Cited by 28 (1 self)
- Add to MetaCart
this paper is on procedures whereby new (e.g., juvenile) members of a population could learn to communicate with the other members by observing their communicative behavior. Two apparently distinct issues are relevant to the evaluation of such learning procedures. First, the procedure must enable the new members to accurately acquire the communication system of the population, even though their observations may be limited, noisy, or otherwise misleading. Second, the learning procedure used by its new members will affect the population's communication system over time. The use of a particular procedure might result in the population's communication increasing in coordination, ultimately yielding a nearly optimally coordinated system. If a learning procedure were to satisfy both criteria, it could explain how learned communication systems are maintained over time, as well as how they are established in the first place.
Graded semantic and phonological similarity effects in priming: Evidence for a distributed connectionist approach to morphology
- IN BENJABALLAH, S./DRESSLER
, 2000
"... Complex words consist of morphemic subunits that can recombine to form other words. Thus midnight is standardly analyzed as consisting of the prefix mid- and stem night, which also occur in words such as midstream and nightly. A considerable body of empirical and theoretical research suggests that ..."
Abstract
-
Cited by 10 (0 self)
- Add to MetaCart
Complex words consist of morphemic subunits that can recombine to form other words. Thus midnight is standardly analyzed as consisting of the prefix mid- and stem night, which also occur in words such as midstream and nightly. A considerable body of empirical and theoretical research suggests that morphological structure governs the representation of words in memory and that many words are decomposed into morphological components in processing. We investigated an alternative approach in which morphology arises from the interaction of semantic, phonological, and orthographic codes. Five cross-modal lexical decision experiments show that the magnitude of priming (e.g., for pairs such as teacher-teach) is affected by the degree of semantic and phonological overlap between words. Crucially, items that are only moderately similar produce intermediate facilitation effects (e.g., latelylate) . This pattern is observed both for words standardly treated as morphologically related (e.g., teacher-teach) and for morphologically unrelated words that exhibit similar degrees of semantic and phonological overlap (e.g., snarl-sneer). The results can be understood in terms of connectionist models employing distributed representations rather than discrete morphemes. Graded semantic and phonological similarity effects in priming: Evidence for a distributed connectionist approach to morphology One of the fundamental problems in the study of language is to characterize knowledge of words and how this knowledge is used in comprehension and production. The focus of the present article is on derivational morphology, the aspect of lexical knowledge concerning the structure and formation of complex words. Words such as baker and talking appear to consist of components, traditionally called m...
Semantic and Syntactic Forces in Noun Phrase Production
, 2002
"... A series of three experiments investigated semantic and syntactic effects in the production of Adjective+Noun phrases in Dutch. Bilinguals (Dutch native speakers) were presented with English nouns and were asked to produce an Adjective+Noun phrase in Dutch which included the translation of the noun. ..."
Abstract
-
Cited by 6 (3 self)
- Add to MetaCart
A series of three experiments investigated semantic and syntactic effects in the production of Adjective+Noun phrases in Dutch. Bilinguals (Dutch native speakers) were presented with English nouns and were asked to produce an Adjective+Noun phrase in Dutch which included the translation of the noun. In two experiments, we blocked items by either semantic category or grammatical gender.We found that participants performed the task slower when the target nouns were of the same semantic category than when they were from different categories; and faster when they were of the same grammatical gender than when they were of different gender. In a final experiment, both manipulations were crossed in order to both replicate the previous experiments and to test for interactions between the two effects. The results of the first two experiments were replicated, and crucially no interaction was found. These findings are compatible with models of lexical retrieval in production in which, first lexico-semantic and lexico-syntactic information are separable; second the flow of activation between the two is feedforward.
Evolutionary Theory Meets Cognitive Psychology: A More Selective Perspective
- Mind and Language
, 1998
"... Abstract: L. Cosmides and J. Tooby, leaders in the field of evolutionary psychology, have claimed that an evolutionary perspective toward psychology requires both that psychologists conceive of psychological processes as domain specific and that psychologists view all adaptive behavior as the produc ..."
Abstract
-
Cited by 5 (0 self)
- Add to MetaCart
Abstract: L. Cosmides and J. Tooby, leaders in the field of evolutionary psychology, have claimed that an evolutionary perspective toward psychology requires both that psychologists conceive of psychological processes as domain specific and that psychologists view all adaptive behavior as the product of cognition. In fact, we argue, an evolutionary perspective commits psychology to neither of these positions. The real value of evolutionary theory for psychology, we contend, lies in the heuristic role it plays in determining the function of psychological mechanisms and in the depth it contributes to explanations of why psychological processes have the properties they do. Quite unexpectedly, cognitive psychologists find their field intimately connected to a whole new intellectual landscape that had previously seemed remote, unfamiliar, and all but irrelevant. Yet the proliferating connections tying together the cognitive and evolutionary communities promise to transform both fields, with each supplying necessary principles, methods, and a species of rigor that
The role of grammatical gender and semantics in German word production. Accepted for publication
- Journal of Experimental Psychology: Learning, Memory and Cognition
, 2003
"... Semantic substitution errors (e.g., saying “arm ” when “leg ” is intended) are among the most common types of errors occurring during spontaneous speech. It has been shown that grammatical gender of German target nouns is preserved in the errors (E. Marx, 1999). In 3 experiments, the authors explore ..."
Abstract
-
Cited by 4 (2 self)
- Add to MetaCart
Semantic substitution errors (e.g., saying “arm ” when “leg ” is intended) are among the most common types of errors occurring during spontaneous speech. It has been shown that grammatical gender of German target nouns is preserved in the errors (E. Marx, 1999). In 3 experiments, the authors explored different accounts of the grammatical gender preservation effect in German. In all experiments, semantic substitution errors were induced using a continuous naming paradigm. In Experiment 1, it was found that gender preservation disappeared when speakers produced bare nouns. Gender preservation was found when speakers produced phrases with determiners marked for gender (Experiment 2) but not when the produced determiners were not marked for gender (Experiment 3). These results are discussed in the context of models of lexical retrieval during production. Speaking involves the retrieval of lexical representations that correspond to our intentions and the development of a syntactically and morphophonologically well-formed frame for the sentence to be uttered. The development of such a frame is, in part, guided by syntactic information specific to each word, for example, its grammatical category, subcategorization requirements of verbs, and, for
The interplay of meaning, sound, and syntax in sentence production
- Psychological Bulletin
, 2002
"... A discussion of modularity in language production processes, with special emphasis on processes for retrieving words and building syntactic structures for a to-be-uttered sentence, is presented. The authors’ 1st goal was to assess the extent to which information processing is encapsulated between di ..."
Abstract
-
Cited by 4 (1 self)
- Add to MetaCart
A discussion of modularity in language production processes, with special emphasis on processes for retrieving words and building syntactic structures for a to-be-uttered sentence, is presented. The authors’ 1st goal was to assess the extent to which information processing is encapsulated between different processing stages. In particular, they assessed whether the input from one processing stage to the next is minimal and whether the flow of information in the system is strictly unidirectional. On the basis of the reviewed evidence, they conclude that both assumptions have to be revised. Their 2nd goal was to propose an alternative framework that does not assume strict encapsulation but that maintains multiple levels of integration for production. During the past 20 years a “great divide ” (as Boland & Cutler, 1996, p. 309, labeled it) has characterized the psycholinguistic world: Can the processes engaged during comprehension and production of language be conceived of as modular or not? Whereas a number of influential theories that do not assume a modular system have been put forward in the comprehension domain (e.g., MacDonald, Pearlmutter, & Seidenberg, 1994; Tabor
A Unified Model
"... There are three obvious differences between first and second language learners. First, infants who are learning language are also engaged in learning about how the world works. In contrast, second language learners already have a full understanding of the world and human society. Second, infants are ..."
Abstract
-
Cited by 3 (1 self)
- Add to MetaCart
There are three obvious differences between first and second language learners. First, infants who are learning language are also engaged in learning about how the world works. In contrast, second language learners already have a full understanding of the world and human society. Second, infants are able to rely on a highly malleable brain that has not yet been committed to other tasks (MacWhinney, Feldman, Sacco, & Valdes-Perez, 2000). In contrast, second language learners have to deal with a brain that has already been committed in various ways to the task of processing the first language. Third, infants can rely on an intense system of social support from their caregivers (Snow, 1999). In contrast, second language learners are often heavily involved in social and business commitments in their first language that distract them from interactions in the new language. Together, these three differences might suggest that it would make little sense to try to develop a unified model of first and second language acquisition. In fact, many researchers have decided that the two processes are so different that they account for them with totally separate theories. For example, Krashen (1994) sees L1 learning as involving “acquisition” and L2 learning as based instead on “learning.” Others (Bley-Vroman, Felix, & Ioup, 1988; Clahsen &
Towards a Cognitive Linguistic Approach to Language Comprehension
, 1992
"... This thesis develops a cognitive linguistic approach to language comprehension. The cognitive approach differs from traditional linguistic approaches in that linguistic description is seen as an integral part of the description of cognition, and that the object of description is the nature of concep ..."
Abstract
-
Cited by 2 (0 self)
- Add to MetaCart
This thesis develops a cognitive linguistic approach to language comprehension. The cognitive approach differs from traditional linguistic approaches in that linguistic description is seen as an integral part of the description of cognition, and that the object of description is the nature of conceptual structures, the processes which relate these conceptual structures, and the effect of context upon these processes. As a cognitive description within cognitive science, a computational approach is adopted: language comprehension is described in terms of two modules, a linguistic processing module and a discourse processing module. Within these modules, conceptual structures and processes are given a uniform characterization: structures are characterized as partial objects which are extended by processes into (potentially) less partial objects. In the linguistic processing module, linguistic expressions are characterized as signs which combine as head and modifier. The conceptual structu...

