Modeling Structure‐Building in the Brain With CCG Parsing and Large Language Models

Cognitive Science 47 (7):e13312 (2023)
  Copy   BIBTEX

Abstract

To model behavioral and neural correlates of language comprehension in naturalistic environments, researchers have turned to broad‐coverage tools from natural‐language processing and machine learning. Where syntactic structure is explicitly modeled, prior work has relied predominantly on context‐free grammars (CFGs), yet such formalisms are not sufficiently expressive for human languages. Combinatory categorial grammars (CCGs) are sufficiently expressive directly compositional models of grammar with flexible constituency that affords incremental interpretation. In this work, we evaluate whether a more expressive CCG provides a better model than a CFG for human neural signals collected with functional magnetic resonance imaging (fMRI) while participants listen to an audiobook story. We further test between variants of CCG that differ in how they handle optional adjuncts. These evaluations are carried out against a baseline that includes estimates of next‐word predictability from a transformer neural network language model. Such a comparison reveals unique contributions of CCG structure‐building predominantly in the left posterior temporal lobe: CCG‐derived measures offer a superior fit to neural signals compared to those derived from a CFG. These effects are spatially distinct from bilateral superior temporal effects that are unique to predictability. Neural effects for structure‐building are thus separable from predictability during naturalistic listening, and those effects are best characterized by a grammar whose expressive power is motivated on independent linguistic grounds.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 91,438

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Two Models of Minimalist, Incremental Syntactic Analysis.Edward P. Stabler - 2013 - Topics in Cognitive Science 5 (3):611-633.
Grammars with parsing dynamics: A new perspective on alignment.Ruth Kempson - 2004 - Behavioral and Brain Sciences 27 (2):202-203.
Analyzing the brain.Peter Gouras - 2000 - Behavioral and Brain Sciences 23 (4):540-541.
Evolutionary Schema of Modeling Based on Genetic Algorithms.Paweł Stacewicz - 2015 - Studies in Logic, Grammar and Rhetoric 40 (1):219-239.

Analytics

Added to PP
2023-07-08

Downloads
10 (#1,176,324)

6 months
5 (#632,346)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Mark Steedman
University of Edinburgh