## On the Applicability of Neural Network and Machine Learning Methodologies to Natural Language Processing (1995)

### Cached

### Download Links

Citations: | 8 - 3 self |

### BibTeX

@MISC{Lawrence95onthe,

author = {Steve Lawrence and C. Lee Giles and Sandiway Fong},

title = {On the Applicability of Neural Network and Machine Learning Methodologies to Natural Language Processing},

year = {1995}

}

### OpenURL

### Abstract

We examine the inductive inference of a complex grammar - specifically, we consider the task of training a model to classify natural language sentences as grammatical or ungrammatical, thereby exhibiting the same kind of discriminatory power provided by the Principles and Parameters linguistic framework, or Government-and-Binding theory. We investigate the following models: feed-forward neural networks, Fransconi-Gori-Soda and Back-Tsoi locally recurrent networks, Elman, Narendra & Parthasarathy, and Williams & Zipser recurrent networks, Euclidean and edit-distance nearest-neighbors, simulated annealing, and decision trees. The feed-forward neural networks and non-neural network machine learning models are included primarily for comparison. We address the question: How can a neural network, with its distributed nature and gradient descent based iterative calculations, possess linguistic capability which is traditionally handled with symbolic computation and recursive processes? Initial...