The leading hypothesis concerning the “reuse” or “recycling” of neural circuits builds on the assumption that evolution might prefer the redeployment of established circuits over the development of new ones. What conception of cognitive architecture can survive the evidence for this hypothesis? In particular, what sorts of “modules” are compatible with this evidence? I argue that the only likely candidates will, in effect, be the columns which Vernon Mountcastle originally hypothesized some 60 years ago, and which form part of the (...) well-known columnar hypothesis in neuroscience—systems that cannot handle gross cognitive functions as distinct from strictly exiguous subfunctions. This is in stark contrast to the modules postulated by much of cognitive psychology, cognitive neuropsychology, and evolutionary psychology. And yet the fate of this revised notion is unclear. The main issue confronting it is the effect of the neural network context on local function. At some point the effects of context are so strong that the degree of specialization required for modularity is not able to be met. Still, despite indications from neuroimaging that peripheral and central systems deploy shared circuitry, some skills clearly do seem to display modularization and autonomy. This article: provides an in-depth analytical and historical review of the fortunes of modular thinking in cognitive science; offers a systematic calibration of brain regions in terms of degrees of functional specificity and robustness; and suggests another way of accounting for the partially encapsulated character of expertise and other highly practiced skills without having to resort to domain-specific modules. (shrink)

Neural plasticity has been invoked as a powerful argument against nativism. However, there is a line of argument, which is well exemplified by Pinker and more recently by Laurence and Margolis The conceptual mind: new directions in the study of concepts, MIT, Cambridge, 2015) with respect to concept nativism, according to which even extreme cases of plasticity show important innate constraints, so that one should rather speak of “constrained plasticity”. According to this view, cortical areas are not really equipotential, they (...) perform instead different kinds of computation, follow essentially different learning rules, or have a fixed internal structure acting as a filter for specific categories of inputs. We intend to analyze this argument, in the light of a review of current neuroscientific literature on plasticity. Our conclusion is that Laurence and Margolis are right in their appeal to innate constraints on connectivity—a thesis that is nowadays welcome to both nativists and non-nativists —but there is little support for their claim of further innate differentiation between and within cortical areas. As we will show, there is instead strong evidence that the cortex is characterized by the indefinite repetition of substantially identical computational units, giving rise in any of its portions to Hebbian, input-dependent plasticity. Although this is entirely compatible with the existence of innate constraints on the brain’s connectivity, the cerebral cortex architecture based on a multiplicity of maps correlating with one another has important computational consequences, a point that has been underestimated by traditional connectionist approaches. (shrink)

In artificial intelligence, recent research has demonstrated the remarkable potential of Deep Convolutional Neural Networks (DCNNs), which seem to exceed state-of-the-art performance in new domains weekly, especially on the sorts of very difficult perceptual discrimination tasks that skeptics thought would remain beyond the reach of artificial intelligence. However, it has proven difficult to explain why DCNNs perform so well. In philosophy of mind, empiricists have long suggested that complex cognition is based on information derived from sensory experience, often appealing to (...) a faculty of abstraction. Rationalists have frequently complained, however, that empiricists never adequately explained how this faculty of abstraction actually works. In this paper, I tie these two questions together, to the mutual benefit of both disciplines. I argue that the architectural features that distinguish DCNNs from earlier neural networks allow them to implement a form of hierarchical processing that I call “transformational abstraction”. Transformational abstraction iteratively converts sensory-based representations of category exemplars into new formats that are increasingly tolerant to “nuisance variation” in input. Reflecting upon the way that DCNNs leverage a combination of linear and non-linear processing to efficiently accomplish this feat allows us to understand how the brain is capable of bi-directional travel between exemplars and abstractions, addressing longstanding problems in empiricist philosophy of mind. I end by considering the prospects for future research on DCNNs, arguing that rather than simply implementing 80s connectionism with more brute-force computation, transformational abstraction counts as a qualitatively distinct form of processing ripe with philosophical and psychological significance, because it is significantly better suited to depict the generic mechanism responsible for this important kind of psychological processing in the brain. (shrink)

Deep learning is currently the most prominent and widely successful method in artificial intelligence. Despite having played an active role in earlier artificial intelligence and neural network research, philosophers have been largely silent on this technology so far. This is remarkable, given that deep learning neural networks have blown past predicted upper limits on artificial intelligence performance—recognizing complex objects in natural photographs and defeating world champions in strategy games as complex as Go and chess—yet there remains no universally accepted explanation (...) as to why they work so well. This article provides an introduction to these networks as well as an opinionated guidebook on the philosophical significance of their structure and achievements. It argues that deep learning neural networks differ importantly in their structure and mathematical properties from the shallower neural networks that were the subject of so much philosophical reflection in the 1980s and 1990s. The article then explores several different explanations for their success and ends by proposing three areas of inquiry that would benefit from future engagement by philosophers of mind and science. (shrink)

This review discusses recent work on foundational questions about concepts. The first of these questions is whether concepts are context-independent bodies of knowledge, or context-dependent constructs, created on the fly. The second question is whether concepts are abstract, amodal representations, or whether they are embedded within the sensory-motor system. I discuss these two questions in light of empirical data from psychology and neuroscience, as well as theoretical considerations, and examine their implications for theories of concepts.

The topic of this dissertation is the nature of linguistic competence, the capacity to understand and produce sentences of natural language. I defend the empiricist account of linguistic competence embedded in the connectionist cognitive science. This strand of cognitive science has been opposed to the traditional symbolic cognitive science, coupled with transformational-generative grammar, which was committed to nativism due to the view that human cognition, including language capacity, should be construed in terms of symbolic representations and hardwired rules. Similarly, linguistic (...) competence in this framework was regarded as being innate, rule-governed, domain-specific, and fundamentally different from performance, i.e., idiosyncrasies and factors governing linguistic behavior. I analyze state-of-the-art connectionist, deep learning models of natural language processing, most notably large language models, to see what they can tell us about linguistic competence. Deep learning is a statistical technique for the classification of patterns through which artificial intelligence researchers train artificial neural networks containing multiple layers that crunch a gargantuan amount of textual and/or visual data. I argue that these models suggest that linguistic competence should be construed as stochastic, pattern-based, and stemming from domain-general mechanisms. Moreover, I distinguish syntactic from semantic competence, and I show for each the ramifications of the endorsement of a connectionist research program as opposed to the traditional symbolic cognitive science and transformational-generative grammar. I provide a unifying front, consisting of usage-based theories, a construction grammar approach, and an embodied approach to cognition to show that the more multimodal and diverse models are in terms of architectural features and training data, the stronger the case is for the connectionist linguistic competence. I also propose to discard the competence vs. performance distinction as theoretically inferior so that a novel and integrative account of linguistic competence originating in connectionism and empiricism that I propose and defend in the dissertation could be put forward in scientific and philosophical literature. (shrink)