Evolving Readings List for Ling 889B, Spring 2000
Evolving Readings List for Ling 889B, Spring 2000
Computational Models of Language Processing
These readings are not in any particular order, nor is this
necessarily the final list! See the schedule
of topics for what we're actually covering in class.
- Core readings on sentence analysis
- G. A. Miller and N. Chomsky, Finitary Models of
Language Users, in R. Luce, R. Bush, and E. Galanter,
eds., Handbook of Mathematical Psychology, Ch 13, New
York: Wiley, 1963.
- P. N. Johnson-Laird, Mental Models: Towards a
Cognitive Science of Language, Inference, and Consciousness,
Harvard University Press, 1983; chapter on parsing.
- W. A. Woods, "Transition network grammars for natural
language analysis", CACM 3(10), 1970, 591-606.
Reprinted in B. Grosz, K. Sparck Jones, and
B. Webber, Readings in Natural Language Processing,
Morgan Kaufmann, 1986.
- Parsing and constraints on processing
- S. Abney and M. Johnson, Memory requirements and local
ambiguities of parsing strategies, Journal of Psycholinguistic
Research, 20(3), pp. 233-250, 1991. (For discussion
also see Philip Resnik,
Left-Corner Parsing and Psychological
Plausibility, Proceedings of the Fourteenth
International Conference on Computational Linguistics
(COLING '92), Nantes, France, 1992.)
- Mitch Marcus, "A computational account of some
constraints on language", Theoretical Issues in
Natural Language Processing-2, D. Waltz, ed.,
236-246, Urbana-Champaign: Association for
Computational Linguistics, 1978.
Reprinted in B. Grosz, K. Sparck Jones, and
B. Webber, Readings in Natural Language Processing,
Morgan Kaufmann, 1986.
- R. Berwick and A. Weinberg, The Grammatical Basis of
Linguistic Performance: Language Use and Acquisition,
MIT Press, 1984. Chapter on subjacency.
- J. D. Fodor, Deterministic parsing and subjacency,
Language and Cognitive Processes 1(1), pp. 3-42, 1985.
- S. Pulman, Grammars, parsers, and memory limitations.
Language and Cognitive Processes 1(3), 197-225, 1986.
- S. Shieber, Sentence Disambiguation by a Shift-Reduce
Parsing Technique, Proc. of the 8th IJCAI,
699-703, 1983.
- Steven Abney, Parsing by Chunks, in R. Berwick, S. Abney, and
C. Tenny, eds., Principle Based Parsing, Kluwer, 1991.
- Probabilistic models
- S. Abney, Statistical Methods and Linguistics, in
J. Klavans and P. Resnik, eds., The Balancing Act:
Combining Symbolic and Statistical Approaches to
Language, MIT Press, 1996.
- Jurafsky, Daniel (1996). A Probabilistic Model of Lexical
and Syntactic Access and Disambiguation. Cognitive Science
20, 137-194.
- Philip Resnik, ``Selectional Constraints: An
Information-Theoretic Model and its Computational Realization,''
Cognition, 61:127-159, November 1996.
- More models of sentence processing
- Ted Gibson, Linguistic complexity: locality of syntactic
dependencies, Cognition 68, 1-76, 1998.
- Ted Gibson and Neal Perlmutter, Constraints on sentence comprehension,
Trends in Cognitive Sciences 2(7), 262-268, 1998.
- Whitney Tabor & Michael K. Tanenhaus. 1999. Dynamical Models
of Sentence Processing. Cognitive Science 23:4.
- Brad Pritchett
- Connectionist models: one debate
- D. Rumelhart, B. Widrow, and M. Lehr, The basic
ideas in neural networks, CACM 37(3), March 1994, 87-92.
- Rumelhart, D. and J. McClelland. 1986. On learning the past tenses of
English Verbs. Chapter 24 of Goldman, Alvin (ed) "Readings in
Philosophy and Cognitive Science", excerpted from D. Rumelhart, D. and
J. McClelland. 1986. "On learning the past tenses of English verbs,"
in J. McClelland, D. Rumelhart, and the PDP Research Group, "Parallel
distributed processing", vol 2 (1986). Cambridge, MA: MIT
Press.
- Steven Pinker, Words and Rules: the ingredients of language,
Weidenfeld and Nicolson, 1999. Chapter 4, "In Single Combat".
- Connectionist models: another debate
- J. Elman, Learning and Development in neural
networks: the importance of starting small,
Cognition 48, 71-99, 1993.
- D. Rohde and D. Plaut, Language acquisition in the
absence of explicit negative evidence: how imporant
is starting small? Cognition, 72, 67-109, 1999.
- G. Marcus, Language acquisition in the
absence of explicit negative evidence: can simple
recurrent networks obviate the need for domain
specific learning devices? Cognition 73(3), 293-296, 1999.
- D. Rohde and D. Plaut, Simple recurrent networks can
distinguish non-occurring from ungrammatical
sentences given appropriate task structure: reply to
Marcus, Cognition 73(3), 297-300, 1999.
- Connectionist models: other perspectives
- Mark Steedman, Connectionist Sentence Processing in
Perspective, Cognitive Science 23, pp. 615-634, 1999.
(postscript for Draft 2.1, May 1999)
- L. Shastri and V. Ajjanagadde, From simple associations to
systematic reasoning, Behavioral and Brain Sciences 16(3),
417--494, 1993. (postscript)
- S. Stevenson
- Memory
- Seidenberg, M. and James L. McClelland. 1989. A Distributed,
Developmental Model of Word Recognition and Naming. Psych
Review 96:4 523-568.
- H. Haarman, M. Just, and P. Carpenter, Aphasic sentence
comprehension as a resource deficit: a computational approach,
Brain and Language 59, pp. 76-120, 1997.
- Thomas Landauer, Memory without Organization: Properties of a
Model with Random Storage and Undirected Retrieval,
Cognitive Psychology 7, pp. 495--531, 1975.
- Acquisition
- Gold (1967): formal learnability and poverty of the stimulus
- Landauer, T. K. and Dumais, S. T. 1996. A solution to
Plato's problem: the Latent Semantic Analysis theory of
acquisition, induction and representation of
knowledge. Psychological Review, 104, 211-240.
- S. Kapur, Some applications of formal learning theory to
natural language acquisition, in B. Lust et al., eds., Syntactic
theory and first language acquisition: crosslinguistic
perspectives (vol. II), Erlbaum.
- R. Frank and S. Kapur, On the use of Triggers in Parameter
Setting, Linguistic Inquiry, 27(4), pp. 623-660, 1996.
- R. Frank: Syntactic Locality and Tree Adjoining Grammar: Grammatical,
Acquisition and Processing Perspectives, Doctoral Dissertation,
Computer and Information Science, University of Pennsylvania,
1992.
- R. Clark, The Selection of Syntactic Knowledge.
Return to the course home page.