Inductive reasoning is a fundamental and complex aspect of human intelligence. In particular, how do subjects, given a set of particular examples, generate general descriptions of the rules governing that set? We present a biologically plausible method for accomplishing this task and implement it in a spiking neuron model. We demonstrate the success of this model by applying it to the problem domain of Raven's Progressive Matrices, a widely used tool in the field of intelligence testing. The (...) class='Hi'>model is able to generate the rules necessary to correctly solve Raven's items, as well as recreate many of the experimental effects observed in human subjects. (shrink)

Computational modeling of the brain holds great promise as a bridge from brain to behavior. To fulfill this promise, however, it is not enough for models to be 'biologically plausible': models must be structurally accurate. Here, we analyze what this entails for so-called psychobiological models, models that address behavior as well as brain function in some detail. Structural accuracy may be supported by (1) a model's a priori plausibility, which comes from a reliance on evidence-based assumptions, (2) fitting existing (...) data, and (3) the derivation of new predictions. All three sources of support require modelers to be explicit about the ontology of the model, and require the existence of data constraining the modeling. For situations in which such data are only sparsely available, we suggest a new approach. If several models are constructed that together form a hierarchy of models, higher-level models can be constrained by lower-level models, and low-level models can be constrained by behavioral features of the higher-level models. Modeling the same substrate at different levels of representation, as proposed here, thus has benefits that exceed the merits of each model in the hierarchy on its own. (shrink)

Cognitive function certainly poses the biggest challenge for computational neuroscience. As we argue, past efforts to build neural models of cognition (the target article included) had too narrow a focus on implementing rule-based language processing. The problem with these models is that they sacrifice the advantages of connectionism rather than building on them. Recent and more promising approaches for modeling cognition build on the mathematical properties of distributed neural representations. These approaches truly exploit the key advantages of connectionism, (...) that is, the high representational power of distributed neural codes and similarity-based pattern recognition. The architectures for cognitive computing that emerge from these approaches are neural associative memories endowed with additional mapping operations to handle invariances and to form reduced representations of combinatorial structures. (shrink)

Ozone is one of the pollutants with most negative effects on human health and in general on the biosphere. Many data-acquisition networks collect data about ozone values in both urban and background areas. Usually, these data are incomplete or corrupt and the imputation of the missing values is a priority in order to obtain complete datasets, solving the uncertainty and vagueness of existing problems to manage complexity. In the present paper, multiple-regression techniques and Artificial Neural Network models are applied (...) to approximate the absent ozone values from five explanatory variables containing air-quality information. To compare the different imputation methods, real-life data from six data-acquisition stations from the region of Castilla y León are gathered in different ways and then analyzed. The results obtained in the estimation of the missing values by applying these techniques and models are compared, analyzing the possible causes of the given response. (shrink)

Plamondon & Alimi (P&A) have unified much data on speed/accuracy trade-offs during reaching movements using a delta-lognormal form factor that describes notably neuromuscular systems. Their approach raises questions about whether a large number of systems is needed, whether they are linear, and whether the results disclose the neural design principles that control reaching behaviors. The authors admit that (sect. 6, para. 4).

I agree with Quartz & Sejnowski's points, which are familiar to many scientists. A number of models with the sought-after properties, however, are overlooked, while models without them are highlighted. I will review nonstationary learning, links between development and learning, locality, stability, learning throughout life, hypothesis testing that models the learner's problem domain, and active dendritic processes.

Natural languages can express some logical propositions that humans are able to understand. We illustrate this fact with a famous text that Conan Doyle attributed to Holmes: “It is an old maxim of mine that when you have excluded the impossible, whatever remains, however improbable, must be the truth”. This is a subtle logical statement usually felt as an evident true. The problem we are trying to solve is the cognitive reason for such a feeling. We postulate here that we (...) accept Holmes’ maxim as true because our adult brains are equipped with neural modules that perform naturally modal logical computations. (shrink)

This paper proposes a theory of how conscious emotional experience is produced by the brain as the result of many interacting brain areas coordinated in working memory. These brain areas integrate perceptions of bodily states of an organism with cognitive appraisals of its current situation. Emotions are neural processes that represent the overall cognitive and somatic state of the organism. Conscious experience arises when neural representations achieve high activation as part of working memory. This theory explains numerous phenomena (...) concerning emotional consciousness, including differentiation, integration, intensity, valence, and change. Ó 2007 Elsevier Inc. All rights reserved. (shrink)

The ability to improve in speed and accuracy as a result of repeating some task is an important hallmark of intelligent biological systems. Although gradual behavioral improvements from practice have been modeled in spiking neural networks, few such models have attempted to explain cognitive development of a task as complex as addition. In this work, we model the progression from a counting-based strategy for addition to a recall-based strategy. The model consists of two networks working in parallel: (...) a slower basal ganglia loop and a faster cortical network. The slow network methodically computes the count from one digit given another, corresponding to the addition of two digits, whereas the fast network gradually “memorizes” the output from the slow network. The faster network eventually learns how to add the same digits that initially drove the behavior of the slower network. Performance of this model is demonstrated by simulating a fully spiking neural network that includes basal ganglia, thalamus, and various cortical areas. Consequently, the model incorporates various neuroanatomical data, in terms of brain areas used for calculation and makes psychologically testable predictions related to frequency of rehearsal. Furthermore, the model replicates developmental progression through addition strategies in terms of reaction times and accuracy, and naturally explains observed symptoms of dyscalculia. (shrink)

A neurally plausible model of how the process of visually perceiving a letter in the context of a word is learned, and how such processing occurs in adults is proposed. The model consists of a collection of abstract letter feature detector neurons and their interconnections. The model also includes a learning rule that specifies how these interconnections evolve with experience. The interconnections between neurons can be interpreted as representing the spatially redundant, sequentially redundant, and transgraphemic information in (...) letter string displays. Anderson, Silverstein, Ritz, and Jones's (1977) “Brain‐State‐in‐a‐Box” (BSB) neural mechanism is then used to implement the proposed model. The resulting system makes explicit qualitative predictions using both letter recognition accuracy and reaction time as dependent measures. In particular, the model offers an integrated explanation of some experiments involving manipulations of orthographic regularity, masking, case alternations, and experience with words. The similarities and differences between the model and models proposed by Adams (1979) and McClelland and Rumelhart (1981) are also discussed. (shrink)

As the demand for explainable deep learning grows in the evaluation of language technologies, the value of a principled grounding for those explanations grows as well. Here we study the state-of-the-art in explanation for neural models for natural-language processing (NLP) tasks from the viewpoint of philosophy of science. We focus on recent evaluation work that finds brittleness in explanations obtained through attention mechanisms.We harness philosophical accounts of explanation to suggest broader conclusions from these studies. From this analysis, we assert (...) the impossibility of causal explanations from attention layers over text data. We then introduce NLP researchers to contemporary philosophy of science theories that allow robust yet non-causal reasoning in explanation, giving computer scientists a vocabulary for future research. (shrink)

The detection and categorization of animate motions is a crucial task underlying social interaction and perceptual decision making. Neural representations of perceived animate objects are partially located in the primate cortical region STS, which is a region that receives convergent input from intermediate-level form and motion representations. Populations of STS cells exist which are selectively responsive to specific animated motion sequences, such as walkers. It is still unclear how and to what extent form and motion information contribute to the (...) generation of such representations and what kind of mechanisms are involved in the learning processes. The article develops a cortical model architecture for the unsupervised learning of animated motion sequence representations. We demonstrate how the model automatically selects significant motion patterns as well as meaningful static form prototypes characterized by a high degree of articulation. Such key poses are selectively reinforced during learning through a cross talk between the motion and form processing streams. Furthermore, we show how sequence-selective representations are learned in STS by fusing static form and motion input from the segregated bottom-up driving input streams. Cells in STS, in turn, feed their activities recurrently to their input sites along top-down signal pathways. We show how such learned feedback connections enable predictions about future input as anticipation generated by sequence-selective STS cells. Network simulations demonstrate the computational capacity of the proposed model by reproducing several experimental findings from neurosciences and by accounting for recent behavioral data. (shrink)

In this single-blind within-subject study, autonomic and EEG variables were compared during 10-min, order-balanced eyes-closed rest and Transcendental Meditation (TM) sessions. TM sessions were distinguished by (1) lower breath rates, (2) lower skin conductance levels, (3) higher respiratory sinus arrhythmia levels, and (4) higher alpha anterior-posterior and frontal EEG coherence. Alpha power was not significantly different between conditions. These results were seen in the first minute and were maintained throughout the 10-min sessions. TM practice appears to (1) lead to a (...) state fundamentally different than eyes-closed rest; (2) result in a cascade of events in the central and autonomic nervous systems, leading to a rapid change in state (within a minute) that was maintained throughout the TM session; and (3) be best distinguished from other conditions through autonomic and EEG alpha coherence patterns rather than alpha power. Two neural networks that may mediate these effects are suggested. The rapid shift in physiological functioning within the first minute might be mediated by a ''neural switch'' in prefrontal areas inhibiting activity in specific and nonspecific thalamocortical circuits. The resulting ''restfully alert'' state might be sustained by a basal ganglia-corticothalamic threshold regulation mechanism automatically maintaining lower levels of cortical excitability. (shrink)

This paper proposes several recurrent neural network-based models for recognizing requisite and effectuation parts in Legal Texts. Firstly, we propose a modification of BiLSTM-CRF model that allows the use of external features to improve the performance of deep learning models in case large annotated corpora are not available. However, this model can only recognize RE parts which are not overlapped. Secondly, we propose two approaches for recognizing overlapping RE parts including the cascading approach which uses the sequence (...) of BiLSTM-CRF models and the unified model approach with the multilayer BiLSTM-CRF model and the multilayer BiLSTM-MLP-CRF model. Experimental results on two Japan law RRE datasets demonstrated advantages of our proposed models. For the Japanese National Pension Law dataset, our approaches obtained an \ score of 93.27% and exhibited a significant improvement compared to previous approaches. For the Japan Civil Code RRE dataset which is written in English, our approaches produced an \ score of 78.24% in recognizing RE parts that exhibited a significant improvement over strong baselines. In addition, using external features and in-domain pre-trained word embeddings also improved the performance of RRE systems. (shrink)

How does the human brain link relational concepts to perceptual experience? For example, a speaker may say “the cup to the left of the computer” to direct the listener's attention to one of two cups on a desk. We provide a neural dynamic account for both perceptual grounding, in which relational concepts enable the attentional selection of objects in the visual array, and for the generation of descriptions of the visual array using relational concepts. In the model, activation (...) in neural populations evolves dynamically under the influence of both inputs and strong interaction as formalized in dynamic field theory. Relational concepts are modeled as patterns of connectivity to perceptual representations. These generalize across the visual array through active coordinate transforms that center the representation of target objects in potential reference objects. How the model perceptually grounds or generates relational descriptions is probed in 104 simulations that systematically vary the spatial and movement relations employed, the number of feature dimensions used, and the number of matching and nonmatching objects. We explain how sequences of decisions emerge from the time‐ and state‐continuous neural dynamics, how relational hypotheses are generated and either accepted or rejected, followed by the selection of new objects or the generation of new relational hypotheses. Its neural realism distinguishes the model from information processing accounts, its capacity to autonomously generate sequences of processing steps distinguishes it from deep neural network accounts. The model points toward a neural dynamic theory of higher cognition. (shrink)

In a recent paper, Kaplan (Synthese 183:339–373, 2011) takes up the task of extending Craver’s (Explaining the brain, 2007) mechanistic account of explanation in neuroscience to the new territory of computational neuroscience. He presents the model to mechanism mapping (3M) criterion as a condition for a model’s explanatory adequacy. This mechanistic approach is intended to replace earlier accounts which posited a level of computational analysis conceived as distinct and autonomous from underlying mechanistic details. In this paper I discuss (...) work in computational neuroscience that creates difficulties for the mechanist project. Carandini and Heeger (Nat Rev Neurosci 13:51–62, 2012) propose that many neural response properties can be understood in terms of canonical neural computations. These are “standard computational modules that apply the same fundamental operations in a variety of contexts.” Importantly, these computations can have numerous biophysical realisations, and so straightforward examination of the mechanisms underlying these computations carries little explanatory weight. Through a comparison between this modelling approach and minimal models in other branches of science, I argue that computational neuroscience frequently employs a distinct explanatory style, namely, efficient coding explanation. Such explanations cannot be assimilated into the mechanistic framework but do bear interesting similarities with evolutionary and optimality explanations elsewhere in biology. (shrink)

Describing actions entails that relations between objects are discovered. A pervasively neural account of this process requires that fundamental problems are solved: the neural pointer problem, the binding problem, and the problem of generating discrete processing steps from time-continuous neural processes. We present a prototypical solution to these problems in a neural dynamic model that comprises dynamic neural fields holding representations close to sensorimotor surfaces as well as dynamic neural nodes holding discrete, language-like (...) representations. Making the connection between these two types of representations enables the model to describe actions as well as to perceptually ground movement phrases—all based on real visual input. We demonstrate how the dynamic neural processes autonomously generate the processing steps required to describe or ground object-oriented actions. By solving the fundamental problems of neural pointing, binding, and emergent discrete processing, the model may be a first but critical step toward a systematic neural processing account of higher cognition. (shrink)

We propose a neural model of multiattribute-decision processes, based on an attractor neural network with dynamic thresholds. The model may be viewed as a generalization of the elimination by aspects model, whereby simultaneous selection of several aspects is allowed. Depending on the amount of synaptic inhibition, various kinds of scanning strategies may be performed, leading in some cases to vacillations among the alternatives. The model predicts that decisions of a longer time duration exhibit a (...) lower violation of the simple scalability law, as opposed to shorter decisions. Furthermore, the model is suggested as a general attribute-based decision module. Accordingly, various decision strategies are manifested depending on the module's parameters. (shrink)

Deep neural networks (DNNs) have had extraordinary successes in classifying photographic images of objects and are often described as the best models of biological vision. This conclusion is largely based on three sets of findings: (1) DNNs are more accurate than any other model in classifying images taken from various datasets, (2) DNNs do the best job in predicting the pattern of human errors in classifying objects taken from various behavioral datasets, and (3) DNNs do the best job (...) in predicting brain signals in response to images taken from various brain datasets (e.g., single cell responses or fMRI data). However, these behavioral and brain datasets do not test hypotheses regarding what features are contributing to good predictions and we show that the predictions may be mediated by DNNs that share little overlap with biological vision. More problematically, we show that DNNs account for almost no results from psychological research. This contradicts the common claim that DNNs are good, let alone the best, models of human object recognition. We argue that theorists interested in developing biologically plausible models of human vision need to direct their attention to explaining psychological findings. More generally, theorists need to build models that explain the results of experiments that manipulate independent variables designed to test hypotheses rather than compete on making the best predictions. We conclude by briefly summarizing various promising modeling approaches that focus on psychological data. (shrink)

Proponents of neuroeconomics often argue that better knowledge of the human neural architecture enables economists to improve standard models of choice. In their view, these improvements provide compelling reasons to use neural findings in constructing and evaluating economic models. In a recent article, I criticized this view by pointing to the trade-offs between the modeling desiderata valued by neuroeconomists and other economists, respectively. The present article complements my earlier critique by focusing on three modeling desiderata that figure prominently (...) in economic and neuroeconomic modeling. For each desideratum, I examine findings that neuroeconomists deem to be especially relevant for economists and argue that neuroeconomists have failed to substantiate their calls to use these findings in constructing and evaluating economic models. In doing so, I identify methodological and evidential constraints that will continue to hinder neuroeconomists’ attempts to improve such models. Moreover, I draw on the literature on scientific modeling to advance the ongoing philosophical discussion regarding the prospects of interdisciplinary models of choice. (shrink)

The neural coding metaphor is so ubiquitous that we tend to forget its metaphorical nature. What do we mean when we assert that neurons encode and decode? What kind of causal and representational model of the brain does the metaphor entail? What lies beneath the neural coding metaphor, I argue, is a bureaucratic model of the brain.

Reviews the contribution of neural network models in psychiatry and psychopathology, including diagnosis, pharmacotherapy and psychotherapy.

The purpose of this study is to train an artificial neural network model for predicting student failure in the academic leveling course of the Escuela Politécnica Nacional of Ecuador, based on academic and socioeconomic information. For this, 1308 higher education students participated, 69.0% of whom failed the academic leveling course; besides, 93.7% of the students self-identified as mestizo, 83.9% came from the province of Pichincha, and 92.4% belonged to general population. As a first approximation, a neural network (...) model was trained with twelve variables containing students’ academic and socioeconomic information. Then, a dimensionality reduction process was performed from which a new neural network was modeled. This dimension reduced model was trained with the variables application score, vulnerability index, regime, gender, and population segment, which were the five variables that explained more than 80% of the first model. The classification accuracy of the dimension reduced model was 0.745, while precision and recall were 0.883 and 0.778, respectively. The area under ROC curve was 0.791. This model could be used as a guide to lead intervention policies so that the failure rate in the academic leveling course would decrease. (shrink)

Formal models of argumentation have been investigated in several areas, from multi-agent systems and artificial intelligence (AI) to decision making, philosophy and law. In artificial intelligence, logic-based models have been the standard for the representation of argumentative reasoning. More recently, the standard logic-based models have been shown equivalent to standard connectionist models. This has created a new line of research where (i) neural networks can be used as a parallel computational model for argumentation and (ii) neural networks (...) can be used to combine argumentation, quantitative reasoning and statistical learning. At the same time, non-standard logic models of argumentation started to emerge. In this paper, we propose a connectionist cognitive model of argumentation that accounts for both standard and non-standard forms of argumentation. The model is shown to be an adequate framework for dealing with standard and non-standard argumentation, including joint-attacks, argument support, ordered attacks, disjunctive attacks, meta-level attacks, self-defeating attacks, argument accrual and uncertainty. We show that the neural cognitive approach offers an adequate way of modelling all of these different aspects of argumentation. We have applied the framework to the modelling of a public prosecution charging decision as part of a real legal decision making case study containing many of the above aspects of argumentation. The results show that the model can be a useful tool in the analysis of legal decision making, including the analysis of what-if questions and the analysis of alternative conclusions. The approach opens up two new perspectives in the short-term: the use of neural networks for computing prevailing arguments efficiently through the propagation in parallel of neuronal activations, and the use of the same networks to evolve the structure of the argumentation network through learning (e.g. to learn the strength of arguments from data). (shrink)

Presents a review of all the main aspects of work on learning and plasticity in behaviour and neural mechanisms in the chick, together with related topics such as the development of behaviour and lateralization of function.

The subject matter of this book is the mental lexicon, that is, the way in which the form and meaning of words is stored by speakers of specific languages. This book attempts to narrow the gap between the results of experimental neurology and the concerns of theoretical linguistics in the area of lexical semantics. The prime goal as regards linguistic theory is to show how matters of lexical organization can be analysed and discussed within a neurologically informed framework that is (...) both adaptable and constrained. It combines the perspectives of distributed network modelling and linguistic semantics, and draws upon the accruing evidence from neuroimaging studies as regards the cortical regions involved. It engages with a number of controversial current issues in both disciplines. The book is intended as a tool for linguists interested in psychological adequacy and the latest advances in cognitive science. It provides a principled means of distinguishing those semantic features required by a mental lexicon that have a direct bearing on grammar from those that do not. It will appeal to researchers in neurolinguistics and lexical semantics."--p. 4 of cover. (shrink)