This paper presents an implemented computational model of word acquisition which learns directly from raw multimodal sensory input. Set in an information theoretic framework, the model acquires a lexicon by finding and statistically modeling consistent cross‐modal structure. The model has been implemented in a system using novel speech processing, computer vision, and machine learning algorithms. In evaluations the model successfully performed speech segmentation, word discovery and visual categorization from spontaneous infant‐directed speech paired with video images of single objects. These results (...) demonstrate the possibility of using state‐of‐the‐art techniques from sensory pattern recognition and machine learning to implement cognitive models which can process raw sensor data without the need for human transcription or labeling. (shrink)

A basic claim of the embodiment framework is that all psychological processes are influenced by body morphology, sensory systems, motor systems, and emotions. As such, the framework holds the promise of providing a unifying perspective for psychological research. This article begins with a sketch of several arguments, from evolution to philosophy, as to why the embodiment framework is a good bet. These arguments are followed by a review of approaches to embodiment, including those from cognitive linguistics, perceptual symbol theory, and (...) action-based theories. Finally, examples are provided for how a unifying perspective might work for cognition (including language and memory), cognitive and social development, social psychology, neuroscience, clinical psychology, and psychology applied to education. (shrink)

To describe phenomena that occur at different time scales, computational models of the brain must incorporate different levels of abstraction. At time scales of approximately 1/3 of a second, orienting movements of the body play a crucial role in cognition and form a useful computational level embodiment level,” the constraints of the physical system determine the nature of cognitive operations. The key synergy is that at time scales of about 1/3 of a second, the natural sequentiality of body movements can (...) be matched to the natural computational economies of sequential decision systems through a system of implicit reference called deictic in which pointing movements are used to bind objects in the world to cognitive programs. This target article focuses on how deictic bindings make it possible to perform natural tasks. Deictic computation provides a mechanism for representing the essential features that link external sensory data with internal cognitive programs and motor actions. One of the central features of cognition, working memory, can be related to moment-by-moment dispositions of body features such as eye movements and hand movements. (shrink)

In this book, Newell makes the case for unified theories by setting forth a candidate.