Reinforcement learning approaches to cognitive modeling represent task acquisition as learning to choose the sequence of steps that accomplishes the task while maximizing a reward. However, an apparently unrecognized problem for modelers is choosing when, what, and how much to reward; that is, when (the moment: end of trial, subtask, or some other interval of task performance), what (the objective function: e.g., performance time or performance accuracy), and how much (the magnitude: with binary, categorical, or continuous values). In (...) this article, we explore the problem space of these three parameters in the context of a task whose completion entails some combination of 36 state–action pairs, where all intermediate states (i.e., after the initial state and prior to the end state) represent progressive but partial completion of the task. Different choices produce profoundly different learning paths and outcomes, with the strongest effect for moment. Unfortunately, there is little discussion in the literature of the effect of such choices. This absence is disappointing, as the choice of when, what, and how much needs to be made by a modeler for every learning model. (shrink)

Although conditioned suppression has face validity as a technique for assessing resistance to change of operant behaviour, it is not discussed by Nevin & Grace. However, application of their approach to the results of a conditioned suppression study that varied food deprivation and reinforcement magnitude produces paradoxical results.

The perceived strength of darkness enhancement in the centre of surfaces surrounded or not surrounded by illusory contours was investigated as a function of proximity of the constituent elements of the display and their angular size. Magnitude estimation was used to measure the perception of the darkness phenomenon in white-on-grey stimuli. Darkness enhancement was perceived in both types of the stimuli used, but more strongly in the presence of illusory contours. In both cases, perceived darkness enhancement increased with increasing (...) proximity of the constituent parts of the display and with their angular size. These results suggest that the occurrence of darkness (or brightness) enhancement phenomena in the centre of the displays is not directly related to illusory contours, which only reinforce the subjective surface brightness/darkness. (shrink)

This paper presents a gamified motor imagery brain-computer interface (MI-BCI) training in immersive virtual reality. Aim of the proposed training method is to increase engagement, attention, and motivation in co-adaptive event-driven MI-BCI training. This was achieved using gamification, progressive increase of the training pace, and virtual reality design reinforcing the body ownership transfer (embodiment) into the avatar. From the 20 healthy participants performing 6 runs of 2-class MI-BCI training (left/right hand), 19 were trained for a basic level of MI-BCI operation, (...) with average peak accuracy in the session equal to 75.84\%. This confirms the proposed training method succeeded in improvement of the MI-BCI skills; moreover, participants were leaving the session in high positive affect. Although the performance was not directly correlated to the degree of embodiment, subjective magnitude of the body ownership transfer illusion correlated with the abilities to modulate the sensorimotor rhythm. (shrink)

Daniel Kahneman was not the first to suggest that attention and effort are closely associated, but his 1973 book Attention and Effort, which claimed that attention can be identified with effort, cemented the association as a research paradigm in the cognitive sciences. Since then, the paradigm has rarely been questioned and appears to have set the research agenda so that it is self-reinforcing. In this article, we retrace Kahneman's argument to understand its strengths and weaknesses. The central notion of effort (...) is not clearly defined in the book, so we proceed by constructing the most secure inferences we can from Kahneman's argument regarding effort: it is cognitive, objective, metabolic expenditure, and it is attention. Continuing, we find from Kahneman's argument that effort-attention must be a special case of sympathetic dominance of the autonomic nervous system that is also an increase in metabolic activity in the brain that has crossed a threshold of magnitude. We then weigh this conception of effort against evidence in Kahneman's book and against more recent evidence, finding that it does not warrant the conclusion that effort can be equated with attention. In support of an alternative perspective, we briefly review diverse studies of behavior, physiology and neuroscience on attention and effort, including meditation and studies of the LC-NE system, where we find evidence for the following: 1) Attention seems to be associated not with the utilization of metabolic resources per se but with the readying of metabolic resources in the form of adaptive gain modulation. This occurs under sympathetic dominance and can be experienced as effortful. 2) Attention can also occur under parasympathetic dominance, in which case it is likely experienced as effortless. (shrink)

Throughout the literature on Cultural Evolutionary Theory attention is drawn to the existence and significance of an analogy between biological phenomena and socio-cultural phenomena. Mesoudi seems to argue that it is the accuracy of the analogy, and the magnitude of accurate instances of this analogy at work, which provides warrant for an evolutionary approach to the study of socio-cultural phenomena, and, thus, for CET. An implication of this is that if there is evidence to suggest that the analogy is (...) not accurate, or that there aren’t many cases where it is accurate, this would constitute evidence to reject an evolutionary approach to the study of socio-cultural phenomena. As such, opponents of CET raise objections highlighting the weakness of the biology-culture analogy. These objections, in turn, have standard replies in the literature that serve to reinforce the realism of the biology-culture analogy. Curiously, this situation would appear to support a position in the philosophy of social science called “Ontology Matters”. It is the view that social ontology can contribute to the empirical success of the social sciences by providing an accurate account of what there is in the domain of the social world which can be used to generate better explanations and/or predictions of social phenomena. If ontology matters, in this sense, perhaps this can help to clarify and resolve the dispute regarding the realism of the biology-culture analogy. In turn, perhaps this can help us determine what warrant there is for CET. However, I think this situation is indicative of severe confusion and misunderstanding as to the significance of the biology-culture analogy. This confusion is caused by inattention to two things. First, the useful distinction between it’s methodological, epistemological, and ontological significance. Second, the abstract nature of Darwinian evolution by natural selection. By drawing attention to these two things, I hope to take the sting out of, and deflate the significance of, disputes regarding the accuracy of the analogy, for both proponents and opponents of CET, as well as to bring into contact a classical dispute in the philosophy of social science with some relevant aspects of theoretical biology. (shrink)

Behavioral momentum theory has evolved within the realm of operant conditioning. The thought-provoking momentum metaphor equates the strength of an operant response with its resistance to change and preference (i.e., choice) for that response over other available responses. Whereas baseline response rate (velocity in the metaphor) is assumed to be largely influenced by the response-reinforcer contingency, resistance to change and preference are assumed to reflect an intervening variable called behavioral mass, which is determined primarily by the stimulus-reinforcer relationship. This invites (...) the question of how well the momentum metaphor applies to the stimulus-reinforcer relationships of traditional Pavlovian paradigms. Presumably, a correspondence exists between behavioral mass and the notion of associative strength in the associative learning literature. Although response rate has little meaning in the trialwise structure of classical (i.e., Pavlovian) conditioning, response probability or magnitude might be regarded metaphorically as velocity. Momentum theory suggests that resistance to change (e.g., extinction) is a better indicator of associative strength than is response probability or magnitude. Therefore, variables that strengthen Pavlovian learning should influence resistance to extinction of conditioned responding in a similar manner. Moreover, it is important to assess momentum theory outside of strictly operant paradigms, particularly because in clinical settings many common disorders (e.g., phobias) and their therapies (e.g., cue exposure) are thought to be classically conditioned. (shrink)

Existing models of strategic decision making typically assume that only the attributes of the currently played game need be considered when reaching a decision. The results presented in this article demonstrate that the so-called “cooperativeness” of the previously played prisoner’s dilemma games influence choices and predictions in the current prisoner’s dilemma game, which suggests that games are not considered independently. These effects involved reinforcement-based assimilation to the previous choices and also a perceptual contrast of the present game with preceding (...) games, depending on the range and the rank of their cooperativeness. A. Parducci’s (1965) range frequency theory and H. Helson’s (1964) adaptation level theory are plausible theories of relative judgment of magnitude information, which could provide an account of these context effects. (shrink)

Knowledge of specific instances of melioration does not imply knowledge of the variables controlling behavior. Drug self-administration has been successfully analyzed in terms of standard variables such as the immediacy and magnitude of the drug reinforcer. An appeal to melioration may not be necessary.

I consider a situation in which workers have present-biased preferences and tend to procrastinate their tasks, but underestimate the degree of self-control problems that they will face in the future. Brocas and Carrillo show that a form of competition always mitigates delay in a setting where agents are perfectly aware of their future self-control problems. However, I show that the introduction of the competition considered in their paper does not necessarily mitigate delay in a setting where agents underestimate the (...) class='Hi'>magnitude of their future self-control problems. The intuition is that competition reinforces their belief that they will complete earlier, which undermines their incentive to complete now. This result holds even when there is only one worker who severely underestimates the degree of his or her future self-control problem, suggesting that the mere existence of a single “irrational” agent can undermine the overall performance of organizations. Moreover, the intuition behind my result implies that, to mitigate procrastination, it is important to design schemes in which workers believe that they will not complete early in the future, e.g., reducing competition over time, increasing cost over time, or even enforcing no work day tomorrow. (shrink)

Empirical discussions of mental representation appeal to a wide variety of representational kinds. Some of these kinds, such as the sentential representations underlying language use and the pictorial representations of visual imagery, are thoroughly familiar to philosophers. Others have received almost no philosophical attention at all. Included in this latter category are analogue magnitude representations, which enable a wide range of organisms to primitively represent spatial, temporal, numerical, and related magnitudes. This article aims to introduce analogue magnitude representations (...) to a philosophical audience by rehearsing empirical evidence for their existence and analysing their format, their content, and the computations they support. 1 Background1.1 Evidence of analogue magnitude representations1.2 Weber’s law1.3 Scepticism about analogue magnitude representations2 Format2.1 Carey’s analogy2.2 Neural realization2.3 Analogue representation2.4 Analogue magnitude representation components3 Content3.1 Do analogue magnitude representations have representational content?3.2 What do analogue magnitude representations represent?3.3 What content types do analogue magnitude representations have?4 Computations4.1 Arithmetic computation4.2 Practical deliberation5 Conclusion. (shrink)

In a recent paper by Casasanto and Pitt (2019), the authors addressed a debate regarding the role of order and magnitude in SNARC and SNARC‐like effects. Their position is that all these effects can be explained by order, while magnitude could only account for a subset of evidence. Although we agree that order can probably explain the majority of these effects, in this commentary we argue that magnitude is still relevant, since there is evidence that cannot be (...) explained based on ordinality alone. We argue that SNARC‐like effects can occur for magnitudes not clearly characterized by overlearned ordinality and that magnitude can prevail on order, when the two are pitted against each other. Finally, we propose that different interpretations of the role of order and magnitude depend on the interaction of stimulus properties and task demands. (shrink)

I am going to argue for a robust realism about magnitudes, as irreducible elements in our ontology. This realistic attitude, I will argue, gives a better metaphysics than the alternatives. It suggests some new options in the philosophy of science. It also provides the materials for a better account of the mind’s relation to the world, in particular its perceptual relations.

ABSTRACT W.L. Craig has argued that the universe has a beginning because (1) the infinitude of the past entails the existence of actual infinite multitudes of past intervals of time, and (2) the existence of actual infinite multitudes is impossible. Puryear has rejected (1) and argued that what the infinitude of the past entails is only the existence of an actual infinite magnitude of past time. But this does not preclude the infinitude of the past, Puryear claims, because there (...) can be no justification for the claim that actual infinite magnitudes are impossible. I argue, against Puryear, that there can be such a justification. I claim, nevertheless, that, for reasons entirely different from Puryear’s, the finitude of the past cannot be established based either on the impossibility of actual infinite multitudes or on the impossibility of actual infinite magnitudes. My arguments in this paper draw on insights from al-Kindī and Avicenna. (shrink)

In recent work, Christopher Peacocke has argued for a kind of realism (or anti-reductionism) about magnitudes such as temperature and spatial distance. Peacocke’s argument is that magnitudes are an ineliminable commitment of scientific and everyday explanations (including high-level explanations), and that they are the natural candidates for semantic values of our ordinary magnitude talk, and for contents of our mental states. I critique these arguments, in particular focusing on whether the realist has a satisfactory account of how high-level (...) class='Hi'>magnitude facts are grounded in lower-level facts. I argue that a less realist (i.e., more reductionist approach) is preferable, or at least viable. I also aim to substantially clarify what is at stake in the debate. (shrink)

Analog representations come in different types. One distinction is between those representations that have parts that are themselves representations and those that do not (i.e., those for which the Parts Principle is true and those for which it is not). I offer a unified account of analog representation, showing what all types have in common. This account clarifies when the Parts Principle applies and when it does not, thereby illuminating why the Parts Principle is less interesting than one might have (...) thought. Understanding analog representation instead requires understanding the kinds of magnitudes used in a particular representation, and the kinds of variation possible within a representational scheme. (shrink)

Quantities are naturally viewed as functions, whose arguments may be construed as situations, events, objects, etc. We explore the question of the range of these functions: should it be construed as the real numbers (or some subset thereof)? This is Carnap's view. It has attractive features, specifically, what Carnap views as ontological economy. Or should the range of a quantity be a set of magnitudes? This may have been Helmholtz's view, and it, too, has attractive features. It reveals the close (...) connection between measurement and natural law, it makes dimensional analysis intelligible, and explains the concern of scientists and engineers with units in equations. It leaves the philosophical problem of the relation between the structure of magnitudes and the structure of the reals. What explains it? And is it always the same? We will argue that on the whole, construing the values of quantities as magnitudes has some advantages, and that (as Helmholtz seems to suggest in "Numbering and Measuring from an Epistemological Viewpoint") the relation between magnitudes and real numbers can be based on foundational similarities of structure. (shrink)

W.L. Craig has argued that the universe has a beginning because (1) the infinitude of the past entails the existence of actual infinite multitudes of past intervals of time, and (2) the existence of actual infinite multitudes is impossible. Puryear has rejected (1) and argued that what the infinitude of the past entails is only the existence of an actual infinite magnitude of past time. But this does not preclude the infinitude of the past, Puryear claims, because there can (...) be no justification for the claim that actual infinite magnitudes are impossible. I argue, against Puryear, that there can be such a justification. I claim, nevertheless, that, for reasons entirely different from Puryear’s, the finitude of the past cannot be established based either on the impossibility of actual infinite multitudes or on the impossibility of actual infinite magnitudes. My arguments in this paper draw on insights from al-Kindī and Avicenna. (shrink)