The broad spectrum revolution brought greater dependence on skill and knowledge, and more demanding, often social, choices. We adopt Sterelny's account of how cooperative foraging paid the costs associated with longer dependency, and transformed the problem of skill learning. Scaffolded learning can facilitate cognitive control including suppression, whereas scaffolded exchange and trade, including inter-temporal exchange, can help develop resolve.

In a dynamic world, mechanisms allowing prediction of future situations can provide a selective advantage. We suggest that memory systems differ in the degree of flexibility they offer for anticipatory behavior and put forward a corresponding taxonomy of prospection. The adaptive advantage of any memory system can only lie in what it contributes for future survival. The most flexible is episodic memory, which we suggest is part of a more general faculty of mental time travel that allows us not only (...) to go back in time, but also to foresee, plan, and shape virtually any specific future event. We review comparative studies and find that, in spite of increased research in the area, there is as yet no convincing evidence for mental time travel in nonhuman animals. We submit that mental time travel is not an encapsulated cognitive system, but instead comprises several subsidiary mechanisms. A theater metaphor serves as an analogy for the kind of mechanisms required for effective mental time travel. We propose that future research should consider these mechanisms in addition to direct evidence of future-directed action. We maintain that the emergence of mental time travel in evolution was a crucial step towards our current success. (shrink)

Several studies on time preference have found time inconsistency in both gain and loss preferences. However, the relationship between the two within the same person remains unclear; that is, does an individual who demonstrates time inconsistency for gain outcomes do so for losses as well? This paper reports on individuals’ time inconsistency for gains and losses in a laboratory setting. To obtain a precise comparison of individuals’ time inconsistency for gains and losses, we used Rohde’s “DI -index” :1700–1716, 2018) and (...) measured the level of time inconsistency, rather than merely identifying whether TI was present. This index represents how strongly a person exhibits present bias, and easily extends to the comparison between gain and loss preferences within the same person. Further, it allows the experiment to test for so-called future bias, which has been a focus area in recent time inconsistency literature. It is elicited through a non-parametric method, which avoids any specification errors in the analysis. Our findings are as follows: first, we found future bias in preferences for not only gains but also losses, and we confirmed that this tendency is consistent with previous findings on preferences for gains. Second, a positive correlation between time inconsistency for gains and losses was found at the individual level. Indeed, we could not find a significant difference between the two in most cases. (shrink)

Models of intertemporal choice draw on three evaluation rules, which we compare in the restricted domain of choices between smaller sooner and larger later monetary outcomes. The hyperbolic discounting model proposes an alternative-based rule, in which options are evaluated separately. The interval discounting model proposes a hybrid rule, in which the outcomes are evaluated separately, but the delays to those outcomes are evaluated in comparison with one another. The tradeoff model proposes an attribute-based rule, in which both outcomes and delays (...) are evaluated in comparison with one another: People consider both the intervals between the outcomes and the compensations received or paid over those intervals. We compare highly general parametric functional forms of these models by means of a Bayesian analysis, a method of analysis not previously used in intertemporal choice. We find that the hyperbolic discounting model is outperformed by the interval discounting model, which, in turn, is outperformed by the tradeoff model. Our cognitive modeling is among the first to offer quantitative evidence against the conventional view that people make intertemporal choices by discounting the value of future outcomes, and in favor of the view that they directly compare options along the time and outcome attributes. (shrink)

Many situations in human life present choices between (a) narrowly preferred particular alternatives and (b) narrowly less preferred (or aversive) particular alternatives that nevertheless form part of highly preferred abstract behavioral patterns. Such alternatives characterize problems of self-control. For example, at any given moment, a person may accept alcoholic drinks yet also prefer being sober to being drunk over the next few days. Other situations present choices between (a) alternatives beneficial to an individual and (b) alternatives that are less beneficial (...) (or harmful) to the individual that would nevertheless be beneficial if chosen by many individuals. Such alternatives characterize problems of social cooperation; choices of the latter alternative are generally considered to be altruistic. Altruism, like self-control, is a valuable temporally-extended pattern of behavior. Like self-control, altruism may be learned and maintained over an individual's lifetime. It needs no special inherited mechanism. Individual acts of altruism, each of which may be of no benefit (or of possible harm) to the actor, may nevertheless be beneficial when repeated over time. However, because each selfish decision is individually preferred to each altruistic decision, people can benefit from altruistic behavior only when they are committed to an altruistic pattern of acts and refuse to make decisions on a case-by-case basis. (shrink)

Suddendorf & Corballis (S&C) claim that mental time travel has significantly affected human cultural change. This echoes a common criticism of theories of Darwinian cultural evolution: that, whereas evolution is blind, culture is directed by people who can foresee and plan for future events. Here I argue that such a claim is premature, and more rigorous tests of S&C's claim are needed.

Critics of Darwinian cultural evolution frequently assert that whereas biological evolution is blind and undirected, cultural change is directed or guided by people who possess foresight, thereby invalidating any Darwinian analysis of culture. Here I show this argument to be erroneous and unsupported in several respects. First, critics commonly conflate human foresight with supernatural clairvoyance, resulting in the premature rejection of Darwinian cultural evolution on false logical grounds. Second, the presence of foresight is perfectly consistent with Darwinian evolution, and is (...) found in biology, in the form of open, teleonomic processes such as genetically-biased behavioural learning. Finally, empirical evidence from the social sciences suggests that cultural change appears far less guided and directed, and human foresight far less accurate, than is commonly assumed. (shrink)

Why are people interested in money? Specifically, what could be the biological basis for the extraordinary incentive and reinforcing power of money, which seems to be unique to the human species? We identify two ways in which a commodity which is of no biological significance in itself can become a strong motivator. The first is if it is used as a tool, and by a metaphorical extension this is often applied to money: it is used instrumentally, in order to obtain (...) biologically relevant incentives. Second, substances can be strong motivators because they imitate the action of natural incentives but do not produce the fitness gains for which those incentives are instinctively sought. The classic examples of this process are psychoactive drugs, but we argue that the drug concept can also be extended metaphorically to provide an account of money motivation. From a review of theoretical and empirical literature about money, we conclude that (i) there are a number of phenomena that cannot be accounted for by a pure Tool Theory of money motivation; (ii) supplementing Tool Theory with a Drug Theory enables the anomalous phenomena to be explained; and (iii) the human instincts that, according to a Drug Theory, money parasitizes include trading (derived from reciprocal altruism) and object play. (Published Online April 5 2006) Key Words: economic behaviour; evolutionary psychology; giving; incentive; money; motivation; play; reciprocal altruism. (shrink)

ABSTRACT Choice theorists such as George Ainslie and Gene Heyman argue that the drug-seeking behaviour of addicts is best understood in the same terms that explain everyday choices. Everyday choices, they claim, aim to maximise the reward from available incentives. Continuing drug-use is, therefore, what addicts most want given the incentives they are aware of but they will change their behaviour if and when better incentives become available. This model might explain many typical cases of addiction, but there are hard (...) cases that pose a problem. In these hard cases the addicted individual does not cease using drugs in the face of consequences that are so adverse it is implausible that they are unaware of more rewarding paths of action. These cases force the choice theorist into a dilemma: either these addicts? drug use does not count as action and so is best described by a neurobiological model, or reference to ?reward? in these cases means merely ?motivated? and so provides no explanatory power. We propose a different model of motivation that takes self-conception into account. We show how that can better explain the hard cases of addiction and also inform our understanding of recovery and self-control. (shrink)

Rachlin's thought-provoking analysis could be strengthened by greater openness to evolutionary interpretation and the use of the directed attention concept as a component of self-control. His contribution to the understanding of prosocial behavior would also benefit from abandoning the traditional (and excessively restrictive) definition of altruism.

One’s generosity to others declines as a function of social distance, which is known as social discounting. We examined cultural similarities and differences in social discounting and the mediating roles of the two aspects of interdependence (self-expression and distinctiveness of the self) as well as the two aspects of independence (harmony-seeking and rejection avoidance). Using the same procedure that previous researchers used to test North Americans, Study 1 showed that compared to North Americans, Japanese discount more steeply a partner’s outcomes (...) compared to their own future outcomes, whereas the decrease in the subjective value of the partner’s outcomes accelerates less as a function of social distance. To examine the cultural similarities and differences in social discounting in more detail, Study 2 tested Japanese and Germans and found that the hyperbolic with exponent model fitted the participants’ discounting behaviors better than the other models, except for the loss condition in Germans where the utility of the q-exponential model was indicated. Moreover, although the social discounting rate was higher in Japanese than in Germans, the cultural difference was limited to the gain frame. However, the decline in a person’s generosity accelerated less as a function of social distance in Japanese than in Germans. Furthermore, the cultural difference in the social discounting in gains was mediated by the level of harmony-seeking, which was higher in Germans than in Japanese. Implications for individuals’ generosity against the backdrop of cultural characteristics are discussed. (shrink)

The statistics of small samples are often quite different from those of large samples, and this needs to be taken into account in assessing the rationality of human behavior. Specifically, in evaluating human responses to environmental statistics, it is the effective environment that matters; that is, the environment actually experienced by the agent needs to be considered, not simply long‐run frequencies. Significant deviations from long‐run statistics may arise through experiential limitations of the agent that stem from resource constraints and/or information‐processing (...) bounds. The article draws together recent work from a number of areas in judgment and decision making ranging from randomness perception (Hahn & Warren, ), information sampling (Hertwig & Pleskac, ; Kareev et al., ), and consequences of choice for exploration or exploitation (e.g., Denrell, ) to demonstrate how proper consideration of these deviations leads to reevaluation of behaviors that are otherwise deemed irrational. (shrink)

We propose another positive illusion that fits with McKay & Dennett's (M&D's) criteria for adaptive misbeliefs. This illusion is pervasive in adult reasoning but we focus on its prevalence in children's developing theories. It is a strongly held conviction arising from normal functioning of the doxastic system that confers adaptive advantage on the individual.

Preston & de Waal are understandably cautious in applying their model to autism. They emphasise multiple cognitive impairments in autism, including prefrontal-executive, cerebellar-attention, and amygdala-emotion recognition deficits. Further empirical examination of imitation ability in autism may reveal deficits in the neural and cognitive basis of perception-action mapping that have a specific relation to the empathic deficit.

Naive physics beliefs can be systematically mistaken. They provide a useful test-bed because they are common, and also because their existence must rely on some adaptive advantage, within a given context. In the second part of the commentary we also ask questions about when a whole family of misbeliefs should be considered together as a single phenomenon.

An emotional value for money is clearly demonstrable beyond its value for getting goods, but this value need not be ascribed to human preparedness for altruism or play. Emotion is a motivated process, and our temptation to “overgraze” positive emotions selects for emotional patterns that are paced by adequately rare occasions. As a much-competed-for tool, money makes an excellent occasion for emotional reward – a prize with value beyond its tool value – but this is true also of the other (...) facts by which we pace our emotions. (Published Online April 5 2006). (shrink)

Most authors who discuss willpower assume that everyone knows what it is, but our assumptions differ to such an extent that we talk past each other. We agree that willpower is the psychological function that resists temptations – variously known as impulses, addictions, or bad habits; that it operates simultaneously with temptations, without prior commitment; and that use of it is limited by its cost, commonly called effort, as well as by the person's skill at executive functioning. However, accounts are (...) usually not clear about how motivation functions during the application of willpower, or how motivation is related to effort. Some accounts depict willpower as the perceiving or formation of motivational contingencies that outweigh the temptation, and some depict it as a continuous use of mechanisms that interfere with re-weighing the temptation. Some others now suggest that impulse control can bypass motivation altogether, although they refer to this route as habit rather than willpower.It is argued here that willpower should be recognized as either or both of two distinct functions, which can be calledresolveandsuppression. Resolve is based on interpretation of a current choice as a test case for a broader set of future choices, which puts at stake more than the outcome of the current choice. Suppression is inhibiting valuation of (modulating) and/or keeping attention from (filtering) immediate alternatives to a current intention. Perception of current choices as test cases for broader outcomes may result in reliable preference for these outcomes, which is experienced as an effortlesshabit– a successful result of resolve, not an alternative method of self-control. Some possible brain imaging correlates are reviewed. (shrink)

Philosophy and its descendents in the behavioral sciences have traditionally divided incentives into those that are sought and those that are avoided. Positive incentives are held to be both attractive and memorable because of the direct effects of pleasure. Negative incentives are held to be unattractive but still memorable (the problem of pain) because they force unpleasant emotions on an individual by an unmotivated process, either a hardwired response (unconditioned response) or one substituted by association (conditioned response). Negative incentives are (...) divided into those that are always avoided and those that are avoided only by higher mental processes—archetypically the passions, which are also thought of as hardwired or conditioned. Newer dichotomies within the negative have been proposed, hinging on whether a negative incentive is nevertheless sought (“wanted but not liked”) or on an incentive's being negative only because it is confining (the product of “rule worship”). The newer dichotomies have lacked motivational explanations, and there is reason to question conditioning in the motivational mechanism for the older ones.

Both experimental findings and the examination of common experience indicate that even the most aversive experiences, such as pain and panic, do not prevail in reflex fashion, but because of an urge to attend to them. The well-established hyperbolic curve in which prospective rewards are discounted implies a mechanism for such an urge, as well as for the “lower” incentives in the other dichotomies. The properties of these lower incentives are predicted by particular durations of temporary preferences on a continuum that stretches from fractions of a second to years. (shrink)

The models of internal self-control that have recently been proposed by behavioral economists do not depict motivational interaction that occurs while temptation is present. Those models that include willpower at all either envision a faculty with a motivation (“strength”) different from the motives that are weighed in the marketplace of choice, or rely on incompatible goals among diverse brain centers. Both assumptions are questionable, but these models’ biggest problem is that they do not let resolutions withstand re-examination while being challenged (...) by impulsive alternatives. The economists’ models all attempt to make a single equilibrium preference predictable from a person’s prior incentives. This was the original purpose of these models’ hyperboloid (“β–δ”) delay discount functions, which have been widely justified by the assumption that a person’s intertemporal inconsistency (impulsiveness) can be accounted for by the arousal of appetite for visceral rewards. Although arousal is clearly a factor in some cases of intertemporal inconsistency, it cannot be blamed for others, and furthermore does not necessarily imply hyperboloid discounting. The inadequacy of β–δ functions is particularly evident in models of internal self-control. I have reviewed several of these models, and have argued for a return to pure hyperbolic discount function as originally proposed, the relatively high tails of which can motivate a recursive process of self-prediction and thereby the formation of self-enforcing intertemporal contracts. Such a process does not require a separately motivated faculty of will, or incompatible goals among brain centers; but it also does not permit the prediction of unique preferences from prior incentives. (shrink)

Lewis ascribes the stubborn persistence of addictions to habit, itself a normal process that does not imply lack of responsiveness to motivation. However, he suggests that more dynamic processes may be involved, for instance that “our recurrently focused brains inevitably self-organize.” Given hyperbolic delay discounting, a reward-seeking internal marketplace model describes two processes, also normal in themselves, that may give rise to the “deep attachment” to addictive activities that he describes: People learn to interpret current choices as test cases for (...) how they can expect to choose in the future, thus recruiting additional incentive against a universal tendency to temporarily prefer smaller, sooner to larger, later rewards. However, when this incentive is not enough, the same interpretation creates incentive to abandon the failed area, leading to the abstinence violation effect and a localized weak will. Normal human value does not come entirely, or even mainly, from expectation of external rewards, but is generated endogenously in imagination. Hyperbolic discounting provides an account of how we learn to cultivate the hedonic importance of occasions for endogenous reward by building appetite. In this account, expectations of the far future have to be rewarded endogenously if they are be as important as currently rewarded alternatives; and this importance is prone to collapse. Both will and hedonic importance are recursive and thus hard to study by controlled experiment, but do represent modelable, reward-based hypotheses about the dynamic nature of habit. (shrink)

The radical evolutionary step that divides human decision-making from that of nonhumans is the ability to excite the reward process for its own sake, in imagination. Combined with hyperbolic over-valuation of the present, this ability is a potential threat to both the individual's long term survival and the natural selection of high intelligence. Human belief is intrinsically or under-founded, which may or may not be adaptive.

The target article proposes that “counterintuitive beliefs in supernatural agents” are shaped by cognitive factors and survive because they foster empathic concern and counteract existential dread. I argue that they are shaped by motivational forces similar to those that shape our beliefs about other people; that empathic concern is rewarded in a more elementary fashion; and that a major function of these supernatural beliefs may be to provide a more flexible alternative to autonomous willpower in controlling not only dread but (...) also many other unwelcome urges. (shrink)

ABSTRACT The list of proposed addictions has recently grown to include television, videogames, shopping, day trading, kleptomania, and use of the Internet. These activities share with a more established entry, gambling, the property that they require no delivery of a biological stimulus that might be thought to unlock a hardwired brain process. I propose a framework for analyzing that class of incentives that do not depend on the prediction of physically privileged environmental events: people have a great capacity to coin (...) endogenous reward; we learn to cultivate it, and, where it is entrapping, to minimize it, by managing internally generated appetites for it. The basic method of cultivating endogenous reward is to learn cues that predict when best to harvest the reward that has been made possible by the growth of these appetites. This hedonic management occurs in the same motivational marketplace as the instrumental planning that seeks environmental goods in the conventional manner, and presumably obeys the same laws of temporal difference learning; but these laws are no longer limiting. Furthermore, instrumental contingencies often provide the most productive structure for hedonic management as well, for reasons that I discuss; but the needs of hedonic management create incentives both to pursue instrumental goals in a suboptimal manner and to avoid noticing how the hedonic incentive affects this pursuit. The result is the apparent irrationality that is often observed in process addictions. (shrink)

We present a theory of decision by sampling (DbS) in which, in contrast with traditional models, there are no underlying psychoeconomic scales. Instead, we assume that an attribute’s subjective value is constructed from a series of binary, ordinal comparisons to a sample of attribute values drawn from memory and is its rank within the sample. We assume that the sample reflects both the immediate distribution of attribute values from the current decision’s context and also the background, real-world distribution of attribute (...) values. DbS accounts for concave utility functions; losses looming larger than gains; hyperbolic temporal discounting; and the overestimation of small probabilities and the underestimation of large probabilities. Ó 2005 Elsevier Inc. All rights reserved. (shrink)

In this review, I discuss recent advances in philosophical and psychological approaches to self-control. The review is divided in 4 parts, in which I discuss: a) different conceptions of self-control; b) standard methods for studying it; c) some models of how self-control is exercised; and d) the connections between self-control and other relevant psychological constructs. The review was originally commissioned by the John Templeton Foundation to provide an informative overview that would knit together different strands of current debates in the (...) field. It is meant to be useful to well-informed audiences, as well as new-comers to the discussion. (shrink)