When a piece of fruit is in a bowl, and the bowl is on a table, we appreciate not only the individual objects and their features, but also the relations containment and support, which abstract away from the particular objects involved. Independent representation of roles (e.g., containers vs. supporters) and “fillers” of those roles (e.g., bowls vs. cups, tables vs. chairs) is a core principle of language and higherlevel reasoning. But does such role-filler independence also arise in automatic visual processing? (...) Here, we show that it does, by exploring a surprising error that such independence can produce. In four experiments, participants saw a stream of images containing different objects arranged in forcedynamic relations — e.g., a phone contained in a basket, a marker resting on a garbage can, or a knife sitting in a cup. Participants had to respond to a single target image (e.g., a phone in a basket) within a stream of distractors presented under time constraints. Surprisingly, even though participants completed this task quickly and accurately, they false-alarmed more often to images matching the target’s relational category than to those that did not — even when those images involved completely different objects. In other words, participants searching for a phone in a basket were more likely to mistakenly respond to a knife in a cup than to a marker on a garbage can. Follow-up experiments ruled out strategic responses and also controlled for various confounding image features. We suggest that visual processing represents relations abstractly, in ways that separate roles from fillers. (shrink)

Critics of appraisal theory have difficulty accepting appraisal (with its constructive flavor) as an automatic process, and hence as a potential cause of most emotions. In response, some appraisal theorists have argued that appraisal was never meant as a causal process but as a constituent of emotional experience. Others have argued that appraisal is a causal process, but that it can be either rule-based or associative, and that the associative variant can be automatic. This article first proposes empirically investigating whether (...) rule-based appraisal can also be automatic and then proposes investigating the automatic nature of constructive (instead of rule-based) appraisal because the distinction between rule-based and associative is problematic. Finally, it discusses experiments that support the view that constructive appraisal can be automatic. (shrink)

The origin of colour categories and their relationship to colour perception have been the prime example for testing the influence of language on perception and thought and more generally for investigating the biological, ecological and cultural determination of human cognition. These themes are central to a broad range of disciplines, including vision research, neuroscience, cognitive psychology, developmental science, cultural anthropology, linguistics, computer science, and philosophy. Unfortunately, though, it has been tacitly taken for granted that the conceptual assumptions and methodological practices (...) from the dawn of empirical research on colour categorisation are the gold standard for current colour category research. Here, we show that these assumptions and practices are obsolete and flawed and have led to four fundamental and widespread misconceptions about colour categorisation: 1.) that colour perception is inherently categorical; 2.) that English Basic Colour Terms correspond to universal categories that are the end point of a fixed evolutionary sequence; 3.) that the prototypes of English basic colour terms are perceptually salient and qualify as focal colours; and 4.) that colour category research essentially revolves around the universalism-realism debate. State-of-the-art research on colour categorisation provides new, more sophisticated approaches and allows for rectifying those four statements. At the same time, some of the questions underlying those statements are not convincingly answered yet and constitute major challenges to future research. The critical considerations on colour categorisation may be transferred to research on other kinds of perceptual categorisation to inspire new, more general research questions. (shrink)

This paper forges links between early analytic philosophy and the posits of semiotics. I show that there are some striking and potentially quite important, but perhaps unrecognized, connections between three key concepts in Wittgenstein’s middle and later philosophy, namely, complex, rule-following, and language games. This reveals the existence of a conceptual continuity between Wittgenstein’s “early” and “later” philosophy that can be applied to the analysis of the iterability of representation in computer-generated images. Methodologically, this paper clarifies to at least some (...) degree, the nature, progress and promise of an approach to doing philosophy and semiotics from a modally modest perspective that sees in the intellectual products of humanities, and not in unreflective empiricism, the future of scientific development. This hybrid, non-reductionist approach shows, among other things, that semiotic processes are encoded by specific types of complexes in computer-generated images that display iterability in time and space. (shrink)

We argue that existing learning algorithms are often poorly equipped to solve problems involving a certain type of important and widespread regularity that we call “type-2 regularity.” The solution in these cases is to trade achieved representation against computational search. We investigate several ways in which such a trade-off may be pursued including simple incremental learning, modular connectionism, and the developmental hypothesis of “representational redescription.”.

Starting with the hypothesis that analogical reasoning consists of a search of semantic space, we used eye-tracking to study the time course of information integration in adults in various formats of analogies. The two main questions we asked were whether adults would follow the same search strategies for different types of analogical problems and levels of complexity and how they would adapt their search to the difficulty of the task. We compared these results to predictions from the literature. Machine learning (...) techniques, in particular support vector machines (SVMs), processed the data to find out which sets of transitions best predicted the output of a trial (error or correct) or the type of analogy (simple or complex). Results revealed common search patterns, but with local adaptations to the specifics of each type of problem, both in terms of looking-time durations and the number and types of saccades. In general, participants organized their search around source-domain relations that they generalized to the target domain. However, somewhat surprisingly, over the course of the entire trial, their search included, not only semantically related distractors, but also unrelated distractors, depending on the difficulty of the trial. An SVM analysis revealed which types of transitions are able to discriminate between analogy tasks. We discuss these results in light of existing models of analogical reasoning. (shrink)

Shepard has argued that a universal law should govern generalization across different domains of perception and cognition, as well as across organisms from different species or even different planets. Starting with some basic assumptions about natural kinds, he derived an exponential decay function as the form of the universal generalization gradient, which accords strikingly well with a wide range of empirical data. However, his original formulation applied only to the ideal case of generalization from a single encountered stimulus to a (...) single novel stimulus, and for stimuli that can be represented as points in a continuous metric psychological space. Here we recast Shepard's theory in a more general Bayesian framework and show how this naturally extends his approach to the more realistic situation of generalizing from multiple consequential stimuli with arbitrary representational structure. Our framework also subsumes a version of Tversky's set-theoretic model of similarity, which is conventionally thought of as the primary alternative to Shepard's continuous metric space model of similarity and generalization. This unification allows us not only to draw deep parallels between the set-theoretic and spatial approaches, but also to significantly advance the explanatory power of set-theoretic models. Key Words: additive clustering; Bayesian inference; categorization; concept learning; contrast model; features; generalization; psychological space; similarity. (shrink)

People categorize objects slowly when visual input is highly impoverished instead of optimal. While bottom-up models may explain a decision with optimal input, perceptual hypothesis testing (PHT) theories implicate top-down processes with impoverished input. Brain mechanisms and the time course of PHT are largely unknown. This event-related potential study used a neuroimaging paradigm that implicated prefrontal cortex in top-down modulation of occipitotemporal cortex. Subjects categorized more impoverished and less impoverished real and pseudo objects. PHT theories predict larger impoverishment effects for (...) real than pseudo objects because top-down processes modulate knowledge only for real objects, but different PHT variants predict different timing. Consistent with parietal-prefrontal PHT variants, around 250 ms, the earliest impoverished real object interaction started on an N3 complex, which reflects interactive cortical activity for object cognition. N3 impoverishment effects localized to both prefrontal and occipitotemporal cortex for real objects only. The N3 also showed knowledge effects by 230 ms that localized to occipitotemporal cortex. Later effects reflected (a) word meaning in temporal cortex during the N400, (b) internal evaluation of prior decision and memory processes and secondary higher-order memory involving anterotemporal parts of a default mode network during posterior positivity (P600), and (c) response related activity in posterior cingulate during an anterior slow wave (SW) after 700 ms. Finally, response activity in supplementary motor area during a posterior SW after 900 ms showed impoverishment effects that correlated with RTs. Convergent evidence from studies of vision, memory, and mental imagery which reflects purely top-down inputs, indicates that the N3 reflects the critical top-down processes of PHT. A hybrid multiple-state interactive, PHT and decision theory best explains the visual constancy of object cognition. (shrink)

Detecting that two images are different is faster for highly dissimilar images than for highly similar images. Paradoxically, we showed that the reverse occurs when people are asked to describe how two images differ—that is, to state a difference between two images. Following structure-mapping theory, we propose that this disassociation arises from the multistage nature of the comparison process. Detecting that two images are different can be done in the initial (local-matching) stage, but only for pairs with low overlap; thus, (...) “different” responses are faster for low-similarity than for high-similarity pairs. In contrast, identifying a specific difference generally requires a full structural alignment of the two images, and this alignment process is faster for high-similarity pairs. We described four experiments that demonstrate this dissociation and show that the results can be simulated using the Structure-Mapping Engine. These results pose a significant challenge for nonstructural accounts of similarity comparison and suggest that structural alignment processes play a significant role in visual comparison. (shrink)

The distinction between rules and similarity is central to our understanding of much of cognitive psychology. Two aspects of existing research have motivated the present work. First, in different cognitive psychology areas we typically see different conceptions of rules and similarity; for example, rules in language appear to be of a different kind compared to rules in categorization. Second, rules processes are typically modeled as separate from similarity ones; for example, in a learning experiment, rules and similarity influences would be (...) described on the basis of separate models. In the present article, I assume that the rules versus similarity distinction can be understood in the same way in learning, reasoning, categorization, and language, and that a unified model for rules and similarity is appropriate. A rules process is considered to be a similarity one where only a single or a small subset of an object's properties are involved. Hence, rules and overall similarity operations are extremes in a single continuum of similarity operations. It is argued that this viewpoint allows adequate coverage of theory and empirical findings in learning, reasoning, categorization, and language, and also a reassessment of the objectives in research on rules versus similarity. Key Words: categorization; cognitive explanation; language; learning; reasoning; rules; similarity. (shrink)

We address the problem of predicting how people will spontaneously divide into groups a set of novel items. This is a process akin to perceptual organization. We therefore employ the simplicity principle from perceptual organization to propose a simplicity model of unconstrained spontaneous grouping. The simplicity model predicts that people would prefer the categories for a set of novel items that provide the simplest encoding of these items. Classification predictions are derived from the model without information either about the number (...) of categories sought or information about the distributional properties of the objects to be classified. These features of the simplicity model distinguish it from other models in unsupervised categorization (where, for example, the number of categories sought is determined via a free parameter), and we discuss how these computational differences are related to differences in modeling objectives. The predictions of the simplicity model are validated in four experiments. We also discuss the significance of simplicity in cognitive modeling more generally. (shrink)

Decades of psychological research have been aimed at modeling how people learn features and categories. The empirical validation of these theories is often based on artificial stimuli with simple representations. Recently, deep neural networks have reached or surpassed human accuracy on tasks such as identifying objects in natural images. These networks learn representations of real‐world stimuli that can potentially be leveraged to capture psychological representations. We find that state‐of‐the‐art object classification networks provide surprisingly accurate predictions of human similarity judgments for (...) natural images, but they fail to capture some of the structure represented by people. We show that a simple transformation that corrects these discrepancies can be obtained through convex optimization. We use the resulting representations to predict the difficulty of learning novel categories of natural images. Our results extend the scope of psychological experiments and computational modeling by enabling tractable use of large natural stimulus sets. (shrink)

To explain how abstract concepts are grounded in sensory-motor experiences, several theories have been proposed. I will discuss two of these proposals, Conceptual Metaphor Theory and Situated Cognition, and argue why they do not fully explain grounding. A central idea in Conceptual Metaphor Theory is that image schemas ground abstract concepts in concrete experiences. Image schemas might themselves be abstractions, however, and therefore do not solve the grounding problem. Moreover, image schemas are too simple to explain the full richness of (...) abstract concepts. Situated cognition might provide such richness. Research in our laboratory, however, has shown that even for concrete concepts, sensory-motor grounding is task dependent. Therefore, it is questionable whether abstract concepts can be significantly grounded in sensory-motor processing. (shrink)

Events have beginnings, ends, and often overlap in time. A major question is how perceivers come to parse a stream of multimodal information into meaningful units and how different event boundaries may vary event processing. This work investigates the roles of these three types of event boundaries in constructing event temporal relations. Predictions were made based on how people would err according to the beginning state, end state, and overlap heuristic hypotheses. Participants viewed animated events that include all the logical (...) possibilities of event temporal relations, and then made temporal relation judgments. The results showed that people make use of the overlap between events and take into account the ends and beginnings, but they weight ends more than beginnings. Neural network simulations showed a self‐organized distinction when learning temporal relations between events with overlap versus those without. (shrink)

Measuring perceived similarity is an important issue in visual perception of faces, since a measure of the perceived similarity between faces may be used to investigate fundamental tasks like face categorization and recognition. Despite its fundamental role, measuring perceived similarity between faces is not trivial from both a theoretical and methodological point of view. In this paper we present theoretical arguments that undermine the method currently most used to measure perceived similarity between faces in visual perception, and we propose an (...) alternative method. We finally compare the two methods and find some empirical evidence that the proposed method can provide a more reliable evaluation of the perceived similarity between faces. (shrink)

Humans are poorer at identifying smells and communicating about them, compared to othersensory domains. They also cannot easily organise odour sensations in a general conceptual space like with colours. We challenge the conclusion that there is no olfactory conceptual map at all. Instead we propose a new framework, with local conceptual spaces.

Humans are poorer at identifying smells and communicating about them, compared to other sensory domains. They also cannot easily organize odor sensations in a general conceptual space, where geometric distance could represent how similar or different all odors are. These two generalities are more or less accepted by psychologists, and they are often seen as connected: If there is no conceptual space for odors, then olfactory identification should indeed be poor. We propose here an important revision to this conclusion: We (...) believe that the claim that there is no odor space is true only if by odor space, one means a conceptual space representing all possible odor sensations, in the paradigmatic sense used for instance for color. However, in a less paradigmatic sense, local conceptual spaces representing a given subset of odors do exist. Thus the absence of a global odor space does not warrant the conclusion that there is no olfactory conceptual map at all. Here we show how a localist account provides a new interpretation of experts and cross‐cultural categorization studies: Rather than being exceptions to the poor olfactory identification and communication usually seen elsewhere, experts and cross‐cultural categorization are here taken to corroborate the existence of local conceptual spaces. (shrink)

In two eye-tracking studies we investigated the influence of Mandarin numeral classifiers – a grammatical category in the language – on online overt attention. Mandarin speakers were presented with simple sentences through headphones while their eye-movements to objects presented on a computer screen were monitored. The crucial question is what participants look at while listening to a pre-specified target noun. If classifier categories influence Mandarin speakers' general conceptual processing, then on hearing the target noun they should look at objects that (...) are members of the same classifier category – even when the classifier is not explicitly present. The data show that when participants heard a classifier they shifted overt attention significantly more to classifiermatch objects than to distractor objects, but when the classifier was not explicitly presented in speech, overt attention to classifier-match objects and distractor objects did not differ. This suggests that although classifier distinctions do influence eye-gaze behavior, they do so only during linguistic processing of that distinction and not in moment-to-moment general conceptual processing. (shrink)

A similarity space is a hyperspace in which the dimensions represent various dimensions on which objects may differ. The similarity space theory of concepts is the thesis that concepts are regions of similarity spaces that are somehow realized in the brain. Proponents of such a theory of concepts include Paul Churchland and Peter Gärdenfors. This paper argues that the similarity space theory of concepts is mistaken because regions of similarity spaces cannot serve as the components of judgments. It emerges that (...) although similarity spaces cannot model concepts, they may model a kind of nonconceptual representation. (shrink)

Cognitive Penetration holds that cognitive states and processes, specifically propositional attitudes (e.g., beliefs), sometimes directly impact features of perceptual experiences (e.g., the coloring of an object). In contrast, more traditional views hold that propositional attitudes do not directly impact perceptual experiences, but rather are only involved in interpreting or judging these experiences. Understandably, Cognitive Penetration is controversial and has been criticized on both theoretical and empirical grounds. I focus on defending it from the latter kind of objection and in doing (...) so, highlight important features of Cognitive Penetration mechanisms and effects. I first sketch promising criteria for Cognitive Penetration and then address widespread Replication and Demonstration worries about purported instances of it. Next, I present one of the most compelling Cognitive Penetration studies and address specific objections against it and others. I demonstrate that each of these objections misunderstands important features of either Cognitive Penetration mechanisms or the specific studies to which they are applied. Ultimately, I conclude that multiple key studies are not undermined by these objections and con- tinue to provide support for Cognitive Penetration. Correcting these misunderstandings bolsters empirical support for Cognitive Penetration and contributes to a better understand- ing of the mechanisms involved in perceptual processing. (shrink)

Cognitive Penetration holds that cognitive states and processes, specifically propositional attitudes (e.g., beliefs), sometimes directly impact features of perceptual experiences (e.g., the coloring of an object). In contrast, more traditional views hold that propositional attitudes do not directly impact perceptual experiences, but rather are only involved in interpreting or judging these experiences. Understandably, Cognitive Penetration is controversial and has been criticized on both theoretical and empirical grounds. I focus on defending it from the latter kind of objection and in doing (...) so, highlight important features of Cognitive Penetration mechanisms and effects. I first sketch promising criteria for Cognitive Penetration and then address widespread Replication and Demonstration worries about purported instances of it. Next, I present one of the most compelling Cognitive Penetration studies and address specific objections against it and others. I demonstrate that each of these objections misunderstands important features of either Cognitive Penetration mechanisms or the specific studies to which they are applied. Ultimately, I conclude that multiple key studies are not undermined by these objections and continue to provide support for Cognitive Penetration. Correcting these misunderstandings bolsters empirical support for Cognitive Penetration and contributes to a better understanding of the mechanisms involved in perceptual processing. (shrink)

Evidence from aphasia is considered that leads to a distinction between abstract and concrete thought processes and hence for a distinction between rules and similarity. It is argued that perceptual classification is inherently a rule-following procedure and these rules are unable to be followed when a patient has difficulty with name comprehension and retrieval.