We argue that existing learning algorithms are often poorly equipped to solve problems involving a certain type of important and widespread regularity that we call “type-2 regularity.” The solution in these cases is to trade achieved representation against computational search. We investigate several ways in which such a trade-off may be pursued including simple incremental learning, modular connectionism, and the developmental hypothesis of “representational redescription.”.

According to one productive and influential approach to cognition, categorization, object recognition, and higher level cognitive processes operate on a set of fixed features, which are the output of lower level perceptual processes. In many situations, however, it is the higher level cognitive process being executed that influences the lower level features that are created. Rather than viewing the repertoire of features as being fixed by low-level processes, we present a theory in which people create features to subserve the representation (...) and categorization of objects. Two types of category learning should be distinguished. Fixed space category learning occurs when new categorizations are representable with the available feature set. Flexible space category learning occurs when new categorizations cannot be represented with the features available. Whether fixed or flexible, learning depends on the featural contrasts and similarities between the new category to be represented and the individual's existing concepts. Fixed feature approaches face one of two problems with tasks that call for new features: If the fixed features are fairly high level and directly useful for categorization, then they will not be flexible enough to represent all objects that might be relevant for a new task. If the fixed features are small, subsymbolic fragments (such as pixels), then regularities at the level of the functional features required to accomplish categorizations will not be captured by these primitives. We present evidence of flexible perceptual changes arising from category learning and theoretical arguments for the importance of this flexibility. We describe conditions that promote feature creation and argue against interpreting them in terms of fixed features. Finally, we discuss the implications of functional features for object categorization, conceptual development, chunking, constructive induction, and formal models of dimensionality reduction. Key Words: concept learning; conceptual development; features; perceptual learning; stimulus encoding. (shrink)

I argue that Machery stacks the deck against hybrid theories of concepts by relying on an unduly restrictive understanding of coordination between concept parts. Once a less restrictive notion of coordination is introduced, the empirical case for hybrid theories of concepts becomes stronger, and the appeal of concept eliminativism weaker.

Infants have been described as 'statistical learners' capable of extracting structure (such as words) from patterned input (such as language). Here, we investigated whether prior knowledge influences how infants track transitional probabilities in word segmentation tasks. Are infants biased by prior experience when engaging in sequential statistical learning? In a laboratory simulation of learning across time, we exposed 9- and 10-month-old infants to a list of either disyllabic or trisyllabic nonsense words, followed by a pause-free speech stream composed of a (...) different set of disyllabic or trisyllabic nonsense words. Listening times revealed successful segmentation of words from fluent speech only when words were uniformly disyllabic or trisyllabic throughout both phases of the experiment. Hearing trisyllabic words during the pre-exposure phase derailed infants' abilities to segment speech into disyllabic words, and vice versa. We conclude that prior knowledge about word length equips infants with perceptual expectations that facilitate efficient processing of subsequent language input. (shrink)

People feel they understand complex phenomena with far greater precision, coherence, and depth than they really do; they are subject to an illusion—an illusion of explanatory depth. The illusion is far stronger for explanatory knowledge than many other kinds of knowledge, such as that for facts, procedures or narratives. The illusion for explanatory knowledge is most robust where the environment supports real‐time explanations with visible mechanisms. We demonstrate the illusion of depth with explanatory knowledge in Studies 1–6. Then we show (...) differences in overconfidence about knowledge across different knowledge domains in Studies 7–10. Finally, we explore the mechanisms behind the initial confidence and behind overconfidence in Studies 11 and 12, and discuss the implications of our findings for the roles of intuitive theories in concepts and cognition. (shrink)

A theory of categorization is presented in which knowledge of causal relationships between category features is represented in terms of asymmetric and probabilistic causal mechanisms. According to causal‐model theory, objects are classified as category members to the extent they are likely to have been generated or produced by those mechanisms. The empirical results confirmed that participants rated exemplars good category members to the extent their features manifested the expectations that causal knowledge induces, such as correlations between feature pairs that are (...) directly connected by causal relationships. These expectations also included sensitivity to higher‐order feature interactions that emerge from the asymmetries inherent in causal relationships. Quantitative fits of causal‐model theory were superior to those obtained with extensions to traditional similarity‐based models that represent causal knowledge either as higher‐order relational features or “prior exemplars” stored in memory. (shrink)

The distinction between rules and similarity is central to our understanding of much of cognitive psychology. Two aspects of existing research have motivated the present work. First, in different cognitive psychology areas we typically see different conceptions of rules and similarity; for example, rules in language appear to be of a different kind compared to rules in categorization. Second, rules processes are typically modeled as separate from similarity ones; for example, in a learning experiment, rules and similarity influences would be (...) described on the basis of separate models. In the present article, I assume that the rules versus similarity distinction can be understood in the same way in learning, reasoning, categorization, and language, and that a unified model for rules and similarity is appropriate. A rules process is considered to be a similarity one where only a single or a small subset of an object's properties are involved. Hence, rules and overall similarity operations are extremes in a single continuum of similarity operations. It is argued that this viewpoint allows adequate coverage of theory and empirical findings in learning, reasoning, categorization, and language, and also a reassessment of the objectives in research on rules versus similarity. Key Words: categorization; cognitive explanation; language; learning; reasoning; rules; similarity. (shrink)

Each of our theories of mental representation provides some insight into how the mind works. However, these insights often seem incompatible, as the debates between symbolic, dynamical, emergentist, sub-symbolic, and grounded approaches to cognition attest. Mental representations—whatever they are—must share many features with each of our theories of representation, and yet there are few hypotheses about how a synthesis could be possible. Here, I develop a theory of the underpinnings of symbolic cognition that shows how sub-symbolic dynamics may give rise (...) to higher-level cognitive representations of structures, systems of knowledge, and algorithmic processes. This theory implements a version of conceptual role semantics by positing an internal universal representation language in which learners may create mental models to capture dynamics they observe in the world. The theory formalizes one account of how truly novel conceptual content may arise, allowing us to explain how even elementary logical and computational operations may be learned from a more primitive basis. I provide an implementation that learns to represent a variety of structures, including logic, number, kinship trees, regular languages, context-free languages, domains of theories like magnetism, dominance hierarchies, list structures, quantification, and computational primitives like repetition, reversal, and recursion. This account is based on simple discrete dynamical processes that could be implemented in a variety of different physical or biological systems. In particular, I describe how the required dynamics can be directly implemented in a connectionist framework. The resulting theory provides an “assembly language” for cognition, where high-level theories of symbolic computation can be implemented in simple dynamics that themselves could be encoded in biologically plausible systems. (shrink)

Technological change is widely studied in economic discourse, dominated by an “industrial perspective” in which scientific and engineering advances are categorized by, and analyzed in the context of, industrial classifications. The present study compares this perspective with the alternative approach of studying the effects of scientific advances onproducts (goods and services) in the context of the functions those products serve. Using a function-based classification scheme, data on the economic effects of scientific advances are developed from articles appearing in business journals. (...) These data present a different picture of evolutionary economic change, which may shed additional light on its causality. (shrink)

Research in education and cognitive development suggests that explaining plays a key role in learning and generalization: When learners provide explanations—even to themselves—they learn more effectively and generalize more readily to novel situations. This paper proposes and tests a subsumptive constraints account of this effect. Motivated by philosophical theories of explanation, this account predicts that explaining guides learners to interpret what they are learning in terms of unifying patterns or regularities, which promotes the discovery of broad generalizations. Three experiments provide (...) evidence for the subsumptive constraints account: prompting participants to explain while learning artificial categories promotes the induction of a broad generalization underlying category membership, relative to describing items (Exp. 1), thinking aloud (Exp. 2), or free study (Exp. 3). Although explaining facilitates discovery, Experiment 1 finds that description is more beneficial for learning item details. Experiment 2 additionally suggests that explaining anomalous observations may play a special role in belief revision. The findings provide insight into explanation’s role in discovery and generalization. (shrink)

In this paper we argue that it is often adaptive to use one's background beliefs when interpreting information that, from a normative point of view, is incomplete. In both of the experiments reported here participants were presented with an item possessing two features and were asked to judge, in the light of some evidence concerning the features, to which of two categories it was more likely that the item belonged. It was found that when participants received evidence relevant to just (...) one of these hypothesised categories they used their background beliefs to interpret this information. In Experiment 2, on the other hand, participants behaved in a broadly Bayesian manner when the evidence they received constituted a completed likelihood ratio. We discuss the circumstances under which participants, when making their judgements, consider the alternative hypothesis. We conclude with a discussion of the implications of our results for an understanding of hypothesis testing, belief revision, and categorisation. (shrink)

Evidence from aphasia is considered that leads to a distinction between abstract and concrete thought processes and hence for a distinction between rules and similarity. It is argued that perceptual classification is inherently a rule-following procedure and these rules are unable to be followed when a patient has difficulty with name comprehension and retrieval.

Some regularities enjoy only an attenuated existence in a body of training data. These are regularities whose statistical visibility depends on some systematic recoding of the data. The space of possible recodings is, however, infinitely large – it is the space of applicable Turing machines. As a result, mappings that pivot on such attenuated regularities cannot, in general, be found by brute-force search. The class of problems that present such mappings we call the class of “type-2 problems.” Type-1 problems, by (...) contrast, present tractable problems of search insofar as the relevant regularities can be found by sampling the input data as originally coded. Type-2 problems, we suggest, present neither rare nor pathological cases. They are rife in biologically realistic settings and in domains ranging from simple animat behaviors to language acquisition. Not only are such problems rife – they are standardly solved! This presents a puzzle. How, given the statistical intractability of these type-2 cases, does nature turn the trick? One answer, which we do not pursue, is to suppose that evolution gifts us with exactly the right set of recoding biases so as to reduce specific type-2 problems to type-1 mappings. Such a heavy-duty nativism is no doubt sometimes plausible. But we believe there are other, more general mechanisms also at work. Such mechanisms provide general strategies for managing problems of type-2 complexity. Several such mechanisms are investigated. At the heart of each is a fundamental ploy – namely, the maximal exploitation of states of representation already achieved by prior, simpler learning so as to reduce the amount of subsequent computational search. Such exploitation both characterizes and helps make unitary sense of a diverse range of mechanisms. These include simple incremental learning, modular connectionism, and the developmental hypothesis of “representational redescription”. In addition, the most distinctive features of human cognition – language and culture – may themselves be viewed as adaptations enabling this representation/computation trade-off to be pursued on an even grander scale. (shrink)

This paper provides evidence for a contrastive account of explanation that is motivated by pragmatic theories that recognize the contribution that context makes to the interpretation of a prompt for explanation. This study replicates the primary findings of previous work in explanation-based category learning, extending that work by illustrating the critical role of the context in this type of learning. Participants interacted with items from two categories either by describing the items or explaining their category membership. We manipulated the feature (...) overlap between the categories and examined both the explanations generated and acquired knowledge of the categories. Explanations for membership in a given category were influenced by the unprompted contrast category, indicating an important role for contrastive processing in the generation of explanations. The influence of the contrast category was similarly seen in the transfer performance of the participants. (shrink)

According to Hubert Dreyfus’s famous claim that expertise is fundamentally “mindless,” experts in any domain perform most effectively when their activity is automatic and unmediated by concepts or cognitive processes like attention and memory. While several scholars have recently challenged the plausibility of Dreyfus’s “mindless” account of expertise for explaining a wide range of expert activities, there has been little consideration of the one form of expertise which might be most amenable to Dreyfus’s account – namely, perceptual expertise. Indeed, Dreyfus’s (...) account of expert coping is ultimately an account of perceptual expertise, in that an expert’s intuitive situational responses are thought to rely on a sophisticated repertoire of perceptual skills. In this paper, I examine the feedforward model of sensory processing that Dreyfus uses to illustrate the perceptual underpinnings of expert action, and consider its resonance with psychological research that characterizes perceptual expertise as being automatic, holistic, pre-attentive, and non-cognitive in nature. However, citing competing empirical research, I argue instead that Dreyfus’s model of perceptual expertise cannot adequately explain the integral roles of attention, memory, and conceptual knowledge in expert object recognition. I conclude that the Dreyfusian model of perceptual expertise fails – the perceptual repertoire of skills that grounds expert object recognition is not operative in isolation from the expert’s conceptual repertoire. (shrink)

A substantial body of evidence shows that people tend to rely too heavily on explanations when trying to justify an opinion. Some research suggests these errors may arise from an inability to distinguish between explanations and the evidence that bears upon them. We examine an alternative account, that many people do distinguish between explanations and evidence, but rely more heavily on unsubstantiated explanations when evidence is scarce or absent. We examine the philosophical and psychological distinctions between explanation and evidence, and (...) show that participants use explanations as a substitute for missing evidence. Experiment 1 replicates the results of other researchers, but further shows that participants generate more evidence when they are not constrained by their lack of data. Merely mentioning a source of data can alter both their evaluation (Experiment 2) and their production (Experiment 3) of explanations and evidence. In Experiment 4, we show that participants can explicitly consider the availability of evidence and other pragmatic factors when evaluating arguments. Finally, we consider the implications of using explanations to replace missing evidence as a strategy in argument. (shrink)

A substantial body of evidence shows that people tend to rely too heavily on explanations when trying to justify an opinion. Some research suggests these errors may arise from an inability to distinguish between explanations and the evidence that bears upon them. We examine an alternative account, that many people do distinguish between explanations and evidence, but rely more heavily on unsubstantiated explanations when evidence is scarce or absent. We examine the philosophical and psychological distinctions between explanation and evidence, and (...) show that participants use explanations as a substitute for missing evidence. Experiment 1 replicates the results of other researchers, but further shows that participants generate more evidence when they are not constrained by their lack of data. Merely mentioning a source of data can alter both their evaluation (Experiment 2) and their production (Experiment 3) of explanations and evidence. In Experiment 4, we show that participants can explicitly consider the availability of evidence and other pragmatic factors when evaluating arguments. Finally, we consider the implications of using explanations to replace missing evidence as a strategy in argument. (shrink)

This paper describes a cross-cultural research project on the relation between how people conceptualize nature and how they act in it. Mental models of nature differ dramatically among and within populations living in the same area and engaged in more or less the same activities. This has novel implications for environmental decision making and management, including dealing with commons problems. Our research also offers a distinct perspective on models of culture, and a unified approach to the study of culture and (...) cognition. We argue that cultural transmission and formation does not consist primarily in shared rules or norms, but in complex distributions of causally-connected representations across minds in interaction with the environment. The cultural stability and diversity of these representations often derives from rich, biologically-prepared mental mechanisms that limit variation to readily transmissible psychological forms. This framework addresses a series of methodological issues, such as the limitations of conceiving culture to be a well-defined system or bounded entity, an independent variable, or an internalized component of minds. (shrink)

This paper reports a psychological study of human categorization that looked at the procedures used by expert scientists when dealing with puzzling items. Five professional botanists were asked to specify a category from a set of positive and negative instances. The target category in the study was defined by a feature that was unusual, hence situations of uncertainty and puzzlement were generated. Subjects were asked to think aloud while solving the tasks, and their verbal reports were analyzed. A number of (...) problem solving strategies were identified, and subsequently integrated in a model of knowledge‐guided inductive categorization. Our model proposes that expert knowledge influences the subjects' reasoning in more complex ways than suggested by earlier investigations of scientific reasoning. As in previous studies, domain knowledge influenced our subjects' hypothesis generation and testing; but, additionally, it played a central role when subjects revised their hypotheses. (shrink)