According to “actionism” (Noë 2010), perception constitutively depends on implicit knowledge of the way sensory stimulations vary as a consequence of the perceiver’s self-movement. My aim in this contribution is to develop an alternative conception of the role of action in perception present in the work of Gareth Evans using resources provided by Ruth Millikan’s biosemantic theory of mental representation.

Neuropsychological findings used to motivate the "two visual systems" hypothesis have been taken to endanger a pair of widely accepted claims about spatial representation in conscious visual experience. The first is the claim that visual experience represents 3-D space around the perceiver using an egocentric frame of reference. The second is the claim that there is a constitutive link between the spatial contents of visual experience and the perceiver's bodily actions. In this paper, I review and assess (...) three main sources of evidence for the two visual systems hypothesis. I argue that the best interpretation of the evidence is in fact consistent with both claims. I conclude with some brief remarks on the relation between visual consciousness and rational agency. (shrink)

Action is a means of acquiring perceptual information about the environment. Turning around, for example, alters your spatial relations to surrounding objects and, hence, which of their properties you visually perceive. Moving your hand over an object’s surface enables you to feel its shape, temperature, and texture. Sniffing and walking around a room enables you to track down the source of an unpleasant smell. Active or passive movements of the body can also generate useful sources of perceptual information (...) (Gibson 1966, 1979). The pattern of optic flow in the retinal image produced by forward locomotion, for example, contains information about the direction in which you are heading, while motion parallax is a “cue” used by the visual system to estimate the relative distances of objects in your field of view. In these uncontroversial ways and others, perception is instrumentally dependent on action. According to an explanatory framework that Susan Hurley (1998) dubs the “Input-Output Picture”, the dependence of perception on action is purely instrumental: "Movement can alter sensory inputs and so result in different perceptions… changes in output are merely a means to changes in input, on which perception depends directly" (1998: 342). -/- The action-based theories of perception, reviewed in this entry, challenge the Input-Output Picture. They maintain that perception can also depend in a noninstrumental or constitutive way on action (or, more generally, on capacities for object-directed motor control). This position has taken many different forms in the history of philosophy and psychology. Most action-based theories of perception in the last 300 years, however, have looked to action in order to explain how vision, in particular, acquires either all or some of its spatial representational content. Accordingly, these are the theories on which we shall focus here. -/- We begin in Section 1 by discussing George Berkeley’s Towards a New Theory of Vision (1709), the historical locus classicus of action-based theories of perception, and one of the most influential texts on vision ever written. Berkeley argues that the basic or “proper” deliverance of vision is not an arrangement of voluminous objects in three-dimensional space, but rather a two-dimensional manifold of light and color. We then turn to a discussion of Lotze, Helmholtz, and the local sign doctrine. The “local signs” were felt cues for the mind to know what sort of spatial content to imbue visual experience with. For Lotze, these cues were “inflowing” kinaesthetic feelings that result from actually moving the eyes, while, for Helmholtz, they were “outflowing” motor commands sent to move the eyes. -/- In Section 2, we discuss sensorimotor contingency theories, which became prominent in the 20thcentury. These views maintain that an ability to predict the sensory consequences of self-initiated actions is necessary for perception. Among the motivations for this family of theories is the problem of visual direction constancy—why do objects appear to be stationary even though the locations on the retina to which they reflect light change with every eye movement?—as well as experiments on adaptation to optical rearrangement devices (ORDs) and sensory substitution. -/- Section 3 examines two other important 20th century theories. According to what we shall call the motor component theory, efference copies generated in the oculomotor system and/or proprioceptive feedback from eye-movements are used together with incoming sensory inputs to determine the spatial attributes of perceived objects. Efferent readiness theories, by contrast, look to the particular ways in which perceptual states prepare the observer to move and act in relation to the environment. The modest readiness theory, as we shall call it, claims that the way an object’s spatial attributes are represented in visual experience can be modulated by one or another form of covert action planning. The bold readiness theory argues for the stronger claim that perception just is covert readiness for action. -/- In Section 4, we move to the disposition theory, most influentially articulated by Gareth Evans (1982, 1985), but more recently defended by Rick Grush (2000, 2007). Evans’ theory is, at its core, very similar to the bold efferent readiness theory. There are some notable differences, though. Evans’ account is more finely articulated in some philosophical respects. It also does not posit a reduction of perception to behavioral dispositions, but rather posits that certain complicated relations between perceptual input and behavioral provide spatial content. Grush proposes a very specific theory that is like Evans’ in that it does not posit a reduction, but unlike Evans’ view, does not put behavioral dispositions and sensory input on an undifferentiated footing. (shrink)

This article presents an approach to understanding human spatial competence that focuses on the representations and processes of spatial cognition and how they are integrated with cognition more generally. The foundational theoretical argument for this research is that spatial information processing is central to cognition more generally, in the sense that it is brought to bear ubiquitously to improve the adaptivity and effectiveness of perception, cognitive processing, and motor action. We describe research spanning multiple levels of (...) complexity to understand both the detailed mechanisms of spatial cognition, and how they are utilized in complex, naturalistic tasks. In the process, we discuss the critical role of cognitive architectures in developing a consistent account that spans this breadth, and we note some areas in which the current version of a popular architecture, ACT-R, may need to be augmented. Finally, we suggest a framework for understanding the representations and processes of spatial competence and their role in human cognition generally. (shrink)

Evidence for a dichotomy between the planning of an action and its on-line control in humans is reviewed. This evidence suggests that planning and control each serve a specialized purpose utilizing distinct visual representations. Evidence from behavioral studies suggests that planning is influenced by a large array of visual and cognitive information, whereas control is influenced solely by the spatial characteristics of the target, including such things as its size, shape, orientation, and so forth. Evidence from brain imaging (...) and neuropsychology suggests that planning and control are subserved by separate visual centers in the posterior parietal lobes, each constituting part of a larger network for planning and control. Planning appears to rely on phylogenetically newer regions in the inferior parietal lobe, along with the frontal lobes and basal ganglia, whereas control appears to rely on older regions in the superior parietal lobe, along with the cerebellum. Key Words: action; apraxia; control; illusions; optic ataxia; PET; planning; reaching;. (shrink)

Often, sensory input underdetermines perception. One such example is the perception of illusory contours. In illusory contour perception, the content of the percept includes the presence of a contour that is absent from the informational content of the sensation. (By “sensation” I mean merely information-bearing events at the transducer level. I intend no further commitment such as the identification of sensations with qualia.) I call instances of perception underdetermined by sensation “underdetermined perception.” The perception of illusory contours is just one (...) kind of underdetermined perception. The focus of this chapter is another kind of underdetermined perception: what I shall call "active perception". Active perception occurs in cases in which the percept, while underdetermined by sensation, is determined by a combination of sensation and action. The phenomenon of active perception has been used by several to argue against the positing of representations in explanations of sensory experience, either by arguing that no representations need be posited or that far fewer than previously thought need be posited. Such views include, but are not limited to those of Gibson (1966, 1986), Churchland. (shrink)

In this paper, I critically assess the enactive account of visual perception recently defended by Alva Noë (2004). I argue inter alia that the enactive account falsely identifies an object’s apparent shape with its 2D perspectival shape; that it mistakenly assimilates visual shape perception and volumetric object recognition; and that it seriously misrepresents the constitutive role of bodily action in visual awareness. I argue further that noticing an object’s perspectival shape involves a hybrid experience combining both perceptual and imaginative (...) elements—an act of what I call ‘make‐perceive’. (shrink)

We are highly tuned to each other's visual attention. Perceiving the eye or hand movements of another person can influence the timing of a saccade or the reach of our own. However, the explanation for such spatial orienting in interpersonal contexts remains disputed. Is it due to the social appearance of the cue—a hand or an eye—or due to its social relevance—a cue that is connected to another person with attentional and intentional states? We developed an interpersonal version of (...) the Posner spatial cueing paradigm. Participants saw a cue and detected a target at the same or a different location, while interacting with an unseen partner. Participants were led to believe that the cue was either connected to the gaze location of their partner or was generated randomly by a computer (Experiment 1), and that their partner had higher or lower social rank while engaged in the same or a different task (Experiment 2). We found that spatial cue‐target compatibility effects were greater when the cue related to a partner's gaze. This effect was amplified by the partner's social rank, but only when participants believed their partner was engaged in the same task. Taken together, this is strong evidence in support of the idea that spatial orienting is interpersonally attuned to the social relevance of the cue—whether the cue is connected to another person, who this person is, and what this person is doing—and does not exclusively rely on the social appearance of the cue. Visual attention is not only guided by the physical salience of one's environment but also by the mental representation of its social relevance. (shrink)

Abstract: When I throw a ball at you, do you see it as catch-able? Do we perceive objects as edible, climbable or Q-able in general? One could argue that it is just a manner of speaking to say so: we do not really see an object as edible, we only infer on the basis of its other properties that it is. I argue that whether or not an object is edible or climbable is indeed represented perceptually: we see objects as (...) edible, and do not just believe that they are. My argument proceeds in two steps. First, I argue that in order to perform an action Q with respect to an object, we need to represent this object as Q-able and, second, I argue that we represent objects as having these properties perceptually. (shrink)

Ferdinand Pöhlmann argues that a sense of one’s own basic abilities to move is a constitutive condition on the ability to perceive the world spatially. This constitutive relation explains why egocentric spatial representation is to be regarded as a kind of self-representation. In arguing for these claims, conceptual as well as empirical questions are discussed and an overview of accounts that take action as a constitutive condition on spatial representation is given. The picture that (...) emerges is linked to the phenomenological (Scheler) as well as to the analytic (Evans) tradition in the Philosophy of Mind.​. (shrink)

This article distinguishes three archetypal ways of articulating spatial cognition: (1) via metric representation of objective geometry, (2) via somatosensory constitution of the peripersonal environment, and (3) via pragmatic comprehension of the finalistic sense of action. The last one is documented by neuroscientific studies concerning mirror neurons. Bio-robotic experiments implementing mirror functions confirm the constitutive role of goal-oriented actions in spatial processes.

Cognitive science is experiencing a pragmatic turn away from the traditional representation-centered framework toward a view that focuses on understanding cognition as "enactive." This enactive view holds that cognition does not produce models of the world but rather subserves action as it is grounded in sensorimotor skills. In this volume, experts from cognitive science, neuroscience, psychology, robotics, and philosophy of mind assess the foundations and implications of a novel action-oriented view of cognition. Their contributions and supporting (...) experimental evidence show that an enactive approach to cognitive science enables strong conceptual advances, and the chapters explore key concepts for this new model of cognition. The contributors discuss the implications of an enactive approach for cognitive development; action-oriented models of cognitive processing; action-oriented understandings of consciousness and experience; and the accompanying paradigm shifts in the fields of philosophy, brain science, robotics, and psychology. ContributorsMoshe Bar, Lawrence W. Barsalov, Olaf Blanke, Jeannette Bohg, Martin V. Butz, Peter F. Dominey, Andreas K. Engel, Judith M. Ford, Karl J. Friston, Chris D. Frith, Shaun Gallagher, Antonia Hamilton, Tobias Heed, Cecilia Heyes, Elisabeth Hill, Matej Hoffmann, Jakob Hohwy, Bernhard Hommel, Atsushi Iriki, Pierre Jacob, Henrik Jörntell, Jürgen Jost, James Kilner, Günther Knoblich, Peter König, Danica Kragic, Miriam Kyselo, Alexander Maye, Marek McGann, Richard Menary, Thomas Metzinger, Ezequiel Morsella, Saskia Nagel, Kevin J. O'Regan, Pierre-Yves Oudeyer, Giovanni Pezzulo, Tony J. Prescott, Wolfgang Prinz, Friedemann Pulvermüller, Robert Rupert, Marti Sanchez-Fibla, Andrew Schwartz, Anil K. Seth, Vicky Southgate, Antonella Tramacere, John K. Tsotsos, Paul F. M. J. Verschure, Gabriella Vigliocco, Gottfried Vosgerau. (shrink)

Contemporary scientific and philosophical literature on perception often focuses on the relationship between perception and action, emphasizing the ways in which perception can be understood as geared towards action or ‘action-oriented’. In this paper I provide a framework within which to classify approaches to action-oriented perception, and I highlight important differences between the distinct approaches. I show how talk of perception as action-oriented can be applied to the evolutionary history of perception, neural (...) or psychological perceptual mechanisms, the semantic content or phenomenal character of perceptual states, or to the metaphysical nature of perception. I argue that there are no straightforward inferences from one kind of action-oriented perception to another. Using this framework and its insights, I then explore the notion of action-oriented perceptual representation which plays a key role in some approaches to embodied cognitive science. I argue that the concept of action-oriented representation proposed by Clark and Wheeler is less straightforward than it might seem, because it seems to require both that the mechanisms of perceptual representation are action-oriented and that the content of these perceptual representations are action-oriented. Given that neither of these claims can be derived from the other, proponents of action-oriented representation owe us separate justification for each claim. I will argue that such justifications are not forthcoming in the literature, and that attempts to reconstruct them run into trouble: the sorts of arguments offered for the representational mechanisms being action-oriented seem to undermine the sorts of arguments offered for the representational content being action-oriented, and vice-versa. (shrink)

In response to an impasse, articulated in the late 1980s, the cognitive capacities of ordinary people assumed central place in contemporary critical social theory. The participants’ perspective gained precedence over scientific standards branded as external. The notion of cognition, however, went unchallenged. This article continues the move away from external standards, and discusses two models of critique, which differ based on their underlying notions of cognition. The representational model builds on cognitive content, misrecognition and normativity; three features which are illustrated (...) with positions adopted by prominent exponents of critical social theory. An alternative understanding relies on action-oriented disclosure and the participants’ basic familiarity with the social world. On this reading, what clashes with unequal structures is skilful coping, rather than representations and normative standards. The action-oriented approach may overcome the dilemma of understanding both the impact and the possible transcendence of unequal structures, although it cannot ultimately replace representational critique. (shrink)

In response to an impasse, articulated in the late 1980s, the cognitive capacities of ordinary people assumed central place in contemporary critical social theory. The participants’ perspective gained precedence over scientific standards branded as external. The notion of cognition, however, went unchallenged. This article continues the move away from external standards, and discusses two models of critique, which differ based on their underlying notions of cognition. The representational model builds on cognitive content, misrecognition and normativity; three features which are illustrated (...) with positions adopted by prominent exponents of critical social theory. An alternative understanding relies on action-oriented disclosure and the participants’ basic familiarity with the social world. On this reading, what clashes with unequal structures is skilful coping, rather than representations and normative standards. The action-oriented approach may overcome the dilemma of understanding both the impact and the possible transcendence of unequal structures, although it cannot ultimately replace representational critique. (shrink)

C. I. Lewis' action-oriented notion of cognition is consistent with a minimally representational picture of mind. I aim to show why. Toward this end, I explore some of the tensions between Lewis' theory of knowledge and his theory of mind. At face value, the former renders the latter implausible. Among other problems, no agent could act if she were required to entertain the myriad beliefs that Lewis claims figures in the guidance of action. But rather than abandon (...) Lewis' story, I attempt to rehabilitate it. Rehabilitation is possible, I argue, because Lewis isn't claiming that his epistemology describes actual justificatory practices, but rather what an agent could do; the social character of concepts [and meaning] considerably reduces the need for appealing to internal concepts when explaining why an agent does what she does; and among his paradigm cases of cognitive behavior are paradigm cases of nonreflective action. Here's the rub: not only do such actions account for most of our behavior [as Lewis himself notes], nonreflective actions, though cognitive, don't require conceptualization. (shrink)

Despite the subjective experience of a continuous and coherent external world, we will argue that the perception and categorisation of visual space is constrained by the spatial resolution of the sensory systems but also and above all, by the pre-reflective representations of the body in action. Recent empirical data in cognitive neurosciences will be presented that suggest that multidimensional categorisation of perceptual space depends on body representations at both an experiential and a functional level. Results will also be (...) resumed that show that representations of the body in action are pre-reflective in nature as only some aspects of the pre-reflective states can be consciously experienced. Finally, a neuro-cognitive model based on the integration of afferent and efferent information will be described, which suggests that action simulation and associated predicted sensory consequences may represent the underlying principle that enables pre-reflective representations of the body for space categorisation and selection for action. (shrink)

The aim of this article is to critically examine what I call Action-Centric Theories of Representation (ACToRs). I include in this category theories of representation that (1) reject construing representation in terms of a relation that holds between representation itself (the representational vehicle) and what is represented, and instead (2) try to bring the function that representations play for cognitive systems to the center stage. Roughly speaking, according to proponents of ACToRs, what makes a (...) class='Hi'>representation (that is, what is constitutive of it being a representation) is its being functionally involved in preselecting or guiding the actions of cognitive systems. I intend to argue that while definitely valuable, ACToRs are underconstrained and thus not entirely satisfying, since there exist structures that would count as representations according to ACToRs, but which do not play functional roles that could be nontrivially or in an explanatorily valuable way classified as representing something for a cognitive system. I outline a remedy for this theoretical situation by postulating that a fully satisfying theory of representation in cognitive science should have two factors; i.e., it should combine the pragmatic, action-oriented aspect present in ACToRs with an element that emphasizes the importance of the relation holding between a representational vehicle and what is represented. (shrink)

The Action-sentence Compatibility Effect is often taken as supporting the fundamental role of the motor system in understanding sentences that describe actions. This effect would be related to an internal “simulation,” i.e., the reactivation of past perceptual and motor experiences. However, it is not easy to establish whether this simulation predominantly involves spatial imagery or motor anticipation. In the classical ACE experiments, where a real motor response is required, the direction and motor representations are mixed. In order to (...) disentangle spatial and motor aspects involved in the ACE, we performed six experiments in different conditions, where the motor component was always reduced, asking participants to judge the sensibility of sentences by moving a mouse, thus requiring a purely spatial representation, compatible with nonmotor interpretations. In addition, our experiments had the purpose of taking into account the possible confusion of effects of practice and of compatibility. Also, in contrast to the usual paradigm, we included no-transfer filler sentences in the analysis. The ACE was not found in any experiment, a result that failed to support the idea that the ACE could be related to a simulation where spatial aspects rather than motor ones prevail. Strong practice effects were always found and were carved out from results. A surprising effect was that no-transfer sentences were processed much slower than others, perhaps revealing a sort of participants’ awareness of the structure of stimuli, i.e., their finding that some of them involved motion and others did not. The relevance of these outcomes for the embodiment theory is discussed. (shrink)

This paper concerns how motor actions are neurally represented and coded. Action planning and motor preparation can be studied using a specific type of representational activity, motor imagery. A close functional equivalence between motor imagery and motor preparation is suggested by the positive effects of imagining movements on motor learning, the similarity between the neural structures involved, and the similar physiological correlates observed in both imaging and preparing. The content of motor representations can be inferred from motor images at (...) a macroscopic level, based on global aspects of the action and the motor rules and constraints which predict the spatial path and kinematics of movements. A more microscopic neural account calls for a representation of object-oriented action. Object attributes are processed in different neural pathways depending on the kind of task the subject is performing. During object-oriented action, a pragmatic representation is activated in which object affordances are transformed into specific motor schemas. Animal as well as human clinical data implicate the posterior parietal and premotor cortical areas in schema instantiation. A mechanism is proposed that is able to encode the desired goal of the action and is applicable to different levels of representational organization. (shrink)

The fundamental cognitive problem for active organisms is to decide what to do next in a changing environment. In this article, we analyze motor and action control in computational models that utilize reinforcement learning (RL) algorithms. In reinforcement learning, action control is governed by an action selection policy that maximizes the expected future reward in light of a predictive world model. In this paper we argue that RL provides a way to explicate the so-called action-oriented (...) views of cognitive systems in representational terms. (shrink)

We examined how social cues and representational ones jointly shape people's spatial memory representations and their subsequent descriptions. In 24 pairs, Directors studied an array with a symmetrical structure while either knowing their Matcher's subsequent viewpoint or not. During the subsequent description of the array, the array's intrinsic structure was aligned with the Director, the Matcher, or neither partner. According to memory tests preceding descriptions, Directors who had studied the array while aligned with its structure were more likely to (...) use its orientation as an organizing direction. Directors who had studied the array while misaligned with its structure used its orientation more frequently as an organizing orientation when knowing that the Matcher would be aligned with it, but used their own viewpoint more frequently as an organizing direction when not knowing the Matcher's viewpoint. Directors also adapted their descriptions strategically, using more egocentric expressions when aligned with the intrinsic structure and more partner-centered expressions when their Matchers were the ones aligned with the structure, even when this information wasn't available in advance. These findings suggest that speakers are guided by converging social and representational cues to adapt flexibly the organization of their memories and the perspectives of their descriptions. (shrink)

The purpose of this article is to start a dialogue between the so-called autopoietic enactivism and the semiotic pragmatism of C. S. Peirce, in order to re-examine both action and representation under a Peircean light. The focus lays on autopoietic enactivism because this approach offers a wider theoretical scope to cognition based on the continuity of life and mind, embodiment, dynamic and non-linear interaction between a system and its environment which are compatible ideas with Peirce’s semiotic pragmatism. The (...) term ‘pragmatic’ has been introduced in cognitive science to reinforce the idea that cognition is a form of practice and to help action-oriented viewpoints to escape representationalism. In this paper, I shall try to demonstrate that Peirce’s semiotic pragmatism can be a meaningful methodological path to guide a reconciliation between not only anti-Cartesianism and representation but also representation and action. In order to accomplish this purpose, Peirce’s account to action, habit, thought and mind will be addressed through some of the guiding principles of his semiotic—sign and sign action. What follows is the re-examining of the problem of representation—as refuted by autopoietic enactivism—under the light of Peirce’s semiotic pragmatism. (shrink)

The complexities of bodily experience are outlined; its spatial phenomenology is specified as the explanatory target. The mereological structure of body representation is discussed; it is claimed that global spatial representations of the body are not necessary, as structural features of the actual body can be exploited in partial internal representation. The spatial structure of bodily experience is discussed; a structural affordance theory is introduced; it is claimed that bodily experience and subpersonal representation have (...) action-orientated content; and that egocentric terms continue to make sense in application to bodily experience. (shrink)

This paper develops a novel interpretation of Kant's argument from incongruent counterparts to the effect that the representations of space and time are intuitions rather than concepts. When properly understood, the argument anticipates the contemporary position whereby the meaning of indexicals cannot be captured by descriptive contents.

In sensorimotor integration, representation involves an anticipatory model of the action to be performed. This model integrates efferent signals (motor commands), its reafferent consequences (sensory consequences of an organism’s own motor action), and other afferences (sensory signals) originated by stimuli independent of the action performed. Representation, a form of internal modeling, is invoked to explain the fact that behavior oriented to the achievement of future goals is relatively independent from the immediate environment. Internal modeling (...) explains how a cognitive system achieves its goals despite variations in the environment with insufficient and noisy sensory–perceptual data. In a self that acts intentionally on the environment, knowledge is dependent upon the necessity to guide actions directed toward an aim. The self-inner model, a representation of internal and external environments (including reafferent and afferent messages) and also of the behavior plans and desirable future states (aims) and efferent intentions (motor planning and motor command messages), is intrinsically linked to a thinking capacity, which is supposed to emerge from the binding of multiple influences. Thinking emerges when higher behavior strategies are considered possible and capable of leading to aims or the fulfillment of intentions. In this model, symbolization processes are projective and anticipatory and, in this way, beyond present referents. Symbolization occurs linked to action planning, command, and regulation in mental simulation. Meaning is related to an inner sense of a self that acts over the environment. (shrink)

More and more cities develop urban food strategies to guide their efforts and practices towards more sustainable food systems. An emerging theme shaping these food policy endeavours, especially prominent in North and South America, concerns the enhancement of social justice within food systems. To operationalise this theme in a European urban food governance context we adopt Nancy Fraser’s three-dimensional theory of justice: economic redistribution, cultural recognition and political representation. In this paper, we discuss the findings of an exploratory document (...) analysis of the social justice-oriented ambitions, motivations, current practices and policy trajectories articulated in sixteen European UFSs. We reflect on the food-related resource allocations, value patterns and decision rules these cities propose to alter and the target groups they propose to support, empower or include. Overall, we find that UFSs make little explicit reference to social justice and justice-oriented food concepts, such as food security, food justice, food democracy and food sovereignty. Nevertheless, the identified resources, services and target groups indicate that the three dimensions of Fraser are at the heart of many of the measures described. We argue that implicit, fragmentary and unspecified adoption of social justice in European UFSs is problematic, as it may hold back public consciousness, debate and collective action regarding food system inequalities and may be easily disregarded in policy budgeting, implementation and evaluation trajectories. As a path forward, we present our plans for the RE-ADJUSTool that would enable UFS stakeholders to reflect on how their UFS can incorporate social justice and who to involve in this pursuit. (shrink)

According to radical enactivists, cognitive sciences should abandon the representational framework. Perceptuomotor cognition and action control are often provided as paradigmatic examples of nonrepresentational cognitive phenomena. In this article, we illustrate how motor and action control are studied in research that uses reinforcement learning algorithms. Crucially, this approach can be given a representational interpretation. Hence, reinforcement learning provides a way to explicate action-oriented views of cognitive systems in a representational way.

Humans' spatial representations enable navigation and reaching to targets above the ground plane, even without direct perceptual support. Such abilities are inconsistent with an impoverished representation of the third dimension. Features that differentiate humans from most terrestrial animals, including raised eye height and arms dedicated to manipulation rather than locomotion, have led to robust metric representations of volumetric space.

Describing actions entails that relations between objects are discovered. A pervasively neural account of this process requires that fundamental problems are solved: the neural pointer problem, the binding problem, and the problem of generating discrete processing steps from time-continuous neural processes. We present a prototypical solution to these problems in a neural dynamic model that comprises dynamic neural fields holding representations close to sensorimotor surfaces as well as dynamic neural nodes holding discrete, language-like representations. Making the connection between these two (...) types of representations enables the model to describe actions as well as to perceptually ground movement phrases—all based on real visual input. We demonstrate how the dynamic neural processes autonomously generate the processing steps required to describe or ground object-oriented actions. By solving the fundamental problems of neural pointing, binding, and emergent discrete processing, the model may be a first but critical step toward a systematic neural processing account of higher cognition. (shrink)

Qualitative reasoning about space and time - a reasoning at the human level - promises to become a fundamental aspect of future systems that will accompany us in daily activity. The aim of Spatial and Temporal Reasoning is to give a picture of current research in this area focusing on both representational and computational issues. The picture emphasizes some major lines of development in this multifaceted, constantly growing area. The material in the book also shows some common ground and (...) a novel combination of spatial and temporal aspects of qualitative reasoning. Part I presents the overall scene. The chapter by Laure Vieu is on the state of the art in spatial representation and reasoning, and that by Alfonso Gerevini gives a similar survey on research in temporal reasoning. The specific contributions to these areas are then grouped in the two main parts. In Part II, Roberto Casati and Achille Varzi examine the ontological status of spatial entities; Anthony Cohn, Brandon Bennett, John Gooday, and Nicholas Gotts present a detailed theory of reasoning with qualitative relations about regions; Andrew Frank discusses the spatial needs of geographical information systems; and Annette Herskovits focuses on the linguistic expression of spatial relations. In Part III, James Allen and George Ferguson describe an interval temporal logic for the representation of actions and events; Drew McDermott presents an efficient way of predicting the outcome of plan execution; and Erik Sandewall introduces a semantics based on transitions for assessing theories of action and change. In Part IV, Antony Galton's chapter stands clearly between the two areas of space and time and outlines the main coordinates of an integrated approach. (shrink)

I examine the following question: Do actions require representations that are intrinsic to the action itself? Recent work by Mark Rowlands, Michael Wheeler, and Andy Clark suggests that actions may require a minimal form of representation. I argue that the various concepts of minimal representation on offer do not apply to action per se and that a non‐representationalist account that focuses on dynamic systems of self‐organizing continuous reciprocal causation at the sub‐personal level is superior. I further (...) recommend a scientific pragmatism regarding the concept of representation. (shrink)

The Morris water maze has been put forward in the philosophy of neuroscience as an example of an experimental arrangement that may be used to delineate the cognitive faculty of spatial memory (e.g., Craver and Darden, Theory and method in the neurosciences, University of Pittsburgh Press, Pittsburgh, 2001; Craver, Explaining the brain: Mechanisms and the mosaic unity of neuroscience, Oxford University Press, Oxford, 2007). However, in the experimental and review literature on the water maze throughout the history of its (...) use, we encounter numerous responses to the question of “what” phenomenon it circumscribes ranging from cognitive functions (e.g., “spatial learning”, “spatial navigation”), to representational changes (e.g., “cognitive map formation”) to terms that appear to refer exclusively to observable changes in behavior (e.g., “water maze performance”). To date philosophical analyses of the water maze have not been directed at sorting out what phenomenon the device delineates nor the sources of the different answers to the question of what. I undertake both of these tasks in this paper. I begin with an analysis of Morris’s first published research study using the water maze and demonstrate that he emerged from it with an experimental learning paradigm that at best circumscribed a discrete set of observable changes in behavior. However, it delineated neither a discrete set of representational changes nor a discrete cognitive function. I cite this in combination with a reductionist-oriented research agenda in cellular and molecular neurobiology dating back to the 1980s as two sources of the lack of consistency across the history of the experimental and review literature as to what is under study in the water maze. (shrink)

Philosophical considerations as well as several recent studies from neurophysiology, neuropsychology, and psychophysics converged in showing that the peripersonal space is structured in a body-centred manner and represented through integrated sensory inputs. Multisensory representations may deserve the function of coding peripersonal space for avoiding or interacting with objects. Neuropsychological evidence is reviewed for dynamic interactions between space representations and action execution, as revealed by the behavioural effects that the use of a tool, as a physical extension of the reachable (...) space, produces on visual–tactile extinction. In particular, tool-use transiently modifies action space representation in a functionally effective way. The possibility is discussed that the investigation of multisensory space representations for action provides an empirical way to consider in its specificity pre-reflexive self-consciousness by considering the intertwining of self-relatedness and object-directness of spatial experience shaped by multisensory and sensorimotor integrations. (shrink)

The classic notion of an egocentric frame of reference cannot be easily applied to bodily space, given the difficulties in providing a centre of such frame as well as axes on which one could compute distances and directions . Yet, Smith tries to rehabilitate the egocentric account of bodily frame by switching from an anatomical definition of egocentricity to a more functional definition . Here I will review some empirical evidence that shows that one cannot ground bodily experiences in (...) class='Hi'>action. There is more than one type of bodily spatial representations, and only one of them is linked to actions. How then to account for bodily spatial content? What is encoded in the spatial content and how? I will provide a tentative account based on two types of spatial content, namely, coordinate body space and categorical body space. (shrink)

According to proponents of the sensorimotor contingency theory of perception (Hurley & Noë 2003, Noë 2004, O’Regan 2011), active control of camera movement is necessary for the emergence of distal attribution in tactile-visual sensory substitution (TVSS) because it enables the subject to acquire knowledge of the way stimulation in the substituting modality varies as a function of self-initiated, bodily action. This chapter, by contrast, approaches distal attribution as a solution to a causal inference problem faced by the subject’s perceptual (...) systems. Given all of the available endogenous and exogenous evidence available to those systems, what is the most probable source of stimulation in the substituting modality? From this perspective, active control over the camera’s movements matters for rather different reasons. Most importantly, it generates proprioceptive and efference-copy based information about the camera’s body-relative position necessary to make use of the spatial cues present in the stimulation that the subject receives for purposes of egocentric object localization. (shrink)

Spatial language is an important predictor of spatial skills and might be inspired by peer interaction and goal-oriented building behaviors during block play. The present study investigated the frequency, type and level of children’s spatial language during block play and their associations with the level of block play by observing 228 young children in classrooms equipped with unit blocks and allowing free play on a daily basis. The findings showed that during block play, young children used (...) more words about spatial locations, deictic terms, dimensions, and shapes and fewer words about spatial features or properties and spatial orientations or transformations. Spatial locations were used most frequently, and young children tended to use vertical location words to represent the corresponding location. Most young children used gestures in conjunction with spatial deictic terms. Among shape words, tetragon words were frequently used, and the representation of spatial shapes showed alternatives, collective tendencies and gender differences. The use of spatial language during the play process had a significant positive correlation with age, the construction structure, and form of block building. (shrink)

In this commentary, we discuss Tom Cochrane’s theory of emotions. Cochrane offers an appealingly unified account of valent representations, ranging from simple responses to complex representations within a mechanistic framework. This offers some guidance as to how we might conceive of emotions as simple action-guiding responses in infants and animals, as well as context-sensitive evaluative states. While Cochrane argues for the centrality of bodily feelings, he does not consider his approach to be embodied in the narrower sense. We question (...) his reasons and suggest to think of emotions as embodied action-oriented representations. We, furthermore, suggest developing the approach with regard to the multiple roles that social norms play, and delve further into the nuanced relationship between bodily self-regulation and the formative influence of social norms on emotions. (shrink)

This paper outlines some key issues that arise when agency and temporality are considered jointly, from the perspective of psychology, cognitive neuroscience, phenomenology, and action theory. I address the difference between time simpliciter and time as represented as it figures in phenomena like intentional binding, goal-oriented action plans, emulation systems, and ‘temporal agency’. An examination of Husserl’s account of time consciousness highlights difficulties in generalizing his account to include a substantive notion of agency, a weakness inherited by (...) explanatory projects like neurophenomenology. I conclude by sketching a project analogous to the projects in neurophenomenology, based on Thompson’s naïve action theory. (shrink)

In this study, we explored the time and space relationship according to two different spatial codings, namely, the left/right extension and the reachability of stimulus along a near/far dimension. Four experiments were carried out in which healthy participants performed the time and spatial bisection tasks in near/far space, before and after short or long tool-use training. Stimuli were prebisected horizontal lines of different temporal durations in which the midpoint was manipulated according to the Muller-Lyer illusion. The perceptual illusory (...) effects emerged in spatial but not temporal judgments. We revealed that temporal and spatial representations dynamically change according to the action potentialities of an individual: temporal duration was perceived as shorter and the perceived line’s midpoint was shifted to the left in far than in near space. Crucially, this dissociation disappeared following a long but not short tool-use training. Finally, we observed age-related differences in spatial attention which may be crucial in building the memory temporal standard to categorize durations. (shrink)

This article presents research into human mental spatial reasoning with orientation knowledge. In particular, we look at reasoning problems about cardinal directions that possess multiple valid solutions , at human preferences for some of these solutions, and at representational and procedural factors that lead to such preferences. The article presents, first, a discussion of existing, related conceptual and computational approaches; second, results of empirical research into the solution preferences that human reasoners actually have; and, third, a novel computational model (...) that relies on a parsimonious and flexible spatio-analogical knowledge representation structure to robustly reproduce the behavior observed with human reasoners. (shrink)

Hemispatial neglect in imagery implies a spatially organised representation. Reaction times in memory for arrays of locations from shifted viewpoints indicate processes analogous to actual bodily movement through space. Behavioral data indicate a privileged role for this process in memory. A proposed spatial mechanism makes contact with direct recordings of the representations of location and orientation in the mammalian brain.

Previous studies have shown that language contributes to humans' ability to orient using landmarks and shapes their use of frames of reference for memory. However, the role of environmental experience in shaping spatial cognition has not been investigated. This study addresses such a possibility by examining the use of FoRs in a nonverbal spatial memory task among residents of an Andean community in Peru. Participants consisted of 97 individuals from Ancash Quechua-speaking households who spoke Quechua and/or Spanish and (...) varied considerably with respect to the extent of their experience in the surrounding landscape. The results demonstrated that environmental experience was the only factor significantly related to the preference for allocentric FoRs. The study thus shows that environmental experience can play a role alongside language in shaping habits of spatial representation, and it suggests a new direction of inquiry into the relationships among language, thought, and experience. (shrink)

One of the central tasks for naturalistic theories of representation is to say what it takes for something to be a representation, and some leading theories have been criticised for being too liberal. Prominent discussions of this problem have proposed a producer-oriented solution; it is argued that representations must be produced by systems employing perceptual constancy mechanisms. However, representations may be produced by simple transducers if they are consumed in the right way. It is characteristic of representations (...) to be consumed by systems which are capable of independent action. This paper defends this claim; discusses more precise, naturalistic formulations; and shows how it can illuminate the explanatory payoffs which science achieves by appealing to representation. (shrink)

Distributed Cognition and Integrational Linguistics have much in common. Both approaches see communicative activity and intelligent behaviour in general as strongly con- text-dependent and action-oriented, and brains as permeated by history. But there is some ten- sion between the two frameworks on three important issues. The majority of theorists of distributed cognition want to maintain some notions of mental representation and computa- tion, and to seek generalizations and patterns in the various ways in which creatures like us (...) couple with technologies, media, and other agents; many also want to offer explanations at subpersonal levels which may undercut the autonomy of personal-level accounts. In contrast, dominant views in integrational linguistics reject all invocation of representation, resist the explanatory search for similarity across contexts and moments, and see linguistics as a lay dis- cipline which should not offer explanations in terms alien to ordinary agents. On each of these issues, I argue that integrationists could move closer to the distributed cognition frame- work without losing the most important aspects of their view: integrationist criticisms of mainstream or classical theories can be respected while alliances with revised cognitivist views about representation, context, and explanation are developed. Ó 2004 Elsevier Ltd. All rights reserved. (shrink)

I consider two threats to the idea that on-line intelligent behaviour (the production of fluid and adaptable responses to ongoing sensory input) must or should be explained by appeal to neurally located representations. The first of these threats occurs when extra-neural factors account for the kind of behavioural richness and flexibility normally associated with representation-based control. I show how this anti-representational challenge can be met, if we apply the thought that, to be a representational system, an action-oriented (...) neural system must not only be the source of at least some of the observed behavioural richness and flexibility, it must also feature two architectural traits, namely arbitrariness and homuncularity. Unfortunately, however, this solution opens the door to our second threat to representation. The homuncularity condition will not be met by any system in which the causal contribution of each component is massively context-sensitive and variable over time. I end by discussing the empirical bet that biological nervous systems will not exhibit this style of causation. (shrink)

Most historians of science eagerly acknowledge that the early modern period witnessed a shift from a prevailing Aristotelian, spherical, centered conception of space to a prevailing Cartesian, rectilinear, oriented spatial framework. Indeed, this shift underlay many of the important advances for which the period is celebrated. However, historians have failed to engage the general conceptual shift, focusing instead on the particular explanatory developments that resulted. This historical lacuna can be attributed to a historiographical problem: the lack of an (...) adequate unit of analysis by which to investigate the conceptual change. Here, a philosophical argument is made for representations of space as an appropriate category of historical investigation, and methods of textual interrogation are suggested to this end. Finally, two examples, taken from Aristotle and Newton, demonstrate the feasibility and importance of this project. (shrink)

Spatial attention and eye-movements are tightly coupled, but the precise nature of this coupling is controversial. The influential but controversial Premotor theory of attention makes four specific predictions about the relationship between motor preparation and spatial attention. Firstly, spatial attention and motor preparation use the same neural substrates. Secondly, spatial attention is functionally equivalent to planning goal directed actions such as eye-movements (i.e. planning an action is both necessary and sufficient for a shift of (...) class='Hi'>spatial attention). Thirdly, planning a goal directed action with any effector system is sufficient to trigger a shift of spatial attention. Fourthly, the eye-movement system has a privileged role in orienting visual spatial attention. This article reviews empirical studies that have tested these predictions. Contrary to predictions one and two there is evidence of anatomical and functional dissociations between endogenous spatial attention and motor preparation. However, there is compelling evidence that exogenous attention is reliant on activation of the oculomotor system. With respect to the third prediction, there is correlational evidence that spatial attention is directed to the endpoint of goal-directed actions but no direct evidence that this attention shift is dependent on motor preparation. The few studies to have directly tested the fourth prediction have produced conflicting results, so the extent to which the oculomotor system has a privileged role in spatial attention remains unclear. Overall, the evidence is not consistent with the view that spatial attention is functionally equivalent to motor preparation so the Premotor theory should be rejected, although a limited version of the Premotor theory in which only exogenous attention is dependent on motor preparation may still be tenable. A plausible alternative account is that activity in the motor system contributes to biased competition between different sensory representations with the winner of the competition becoming the attended item. (shrink)