How should you decide what to do when you're uncertain about basic normative principles (e.g., Kantianism vs. utilitarianism)? A natural suggestion is to follow some "second-order" norm: e.g., "comply with the first-order norm you regard as most probable" or "maximize expected choiceworthiness". But what if you're uncertain about second-order norms too -- must you then invoke some third-order norm? If so, it seems that any norm-guided response to normative uncertainty is doomed to a vicious regress. In this paper, I aim (...) to rescue second-order norms from this threat of regress. I first elaborate and defend the suggestion some philosophers have entertained that the regress problem forces us to accept normative externalism, the view that at least one norm is incumbent on agents regardless of their beliefs or evidence concerning that norm. But, I then argue, we need not accept externalism about first-order (e.g., moral) norms, thus closing off any question of what an agent should do in light of her normative beliefs. Rather, it is more plausible to ascribe external force to a single, second-order rational norm: the enkratic principle, correctly formulated. This modest form of externalism, I argue, is both intrinsically well-motivated and sufficient to head off the threat of regress. (shrink)

Moral latitude is only ever a matter of coincidence on the most popular decision procedure in the literature on moral uncertainty. In all possible choice situations other than those in which two or more options happen to be tied for maximal expected choiceworthiness, Maximize Expected Choiceworthiness implies that only one possible option is uniquely appropriate. A better theory of appropriateness would be more sensitive to the decision maker’s credence in theories that endorse agent-centred prerogatives. In this paper, we will develop (...) and defend a modified version of this view that allows for agent-centred prerogatives and supererogation as part of its verdicts about appropriateness. (shrink)

Nick Bostrom and others have suggested treating decision-making under moral uncertainty as analogous to parliamentary decision-making. The core suggestion of this “parliamentary approach” is that the competing moral theories function like delegates to the parliament, and that these delegates then make decisions by some combination of bargaining and voting. There seems some reason to hope that such an approach might avoid standard objections to existing approaches (for example, the “maximise expected choiceworthiness” (MEC) and “my favourite theory” approaches). However, the parliamentary (...) approach is so far extremely underspecified, making it largely indeterminate how such a model will in fact behave in the respects that those concerned with moral uncertainty care about. This paper explores one way of making it precise. We treat predicaments of moral uncertainty as analogous to bargaining situations alone (setting aside voting), and apply a version of the Nash solution that is standard in bargaining theory. The resulting model does indeed perform in many of the hoped-for ways. However, so also does a version of MEC that employs a structural approach to intertheoretic comparisons. It seems to us an open question which, regarding this version of MEC and the bargaining-theoretic approach, is superior to the other. We identify the key points on which the two differ. (shrink)

How ought you to evaluate your options if you’re uncertain about which axiology is true? One prominent response is Expected Moral Value Maximisation, the view that under axiological uncertainty, an option is better than another if and only if it has the greater expected moral value across axiologies. EMVM raises two fundamental questions. First, there’s a question about what it should even mean. In particular, it presupposes that we can compare moral value across axiologies. So to even understand EMVM, we (...) need to explain what it is for such comparisons to hold. Second, assuming that we understand it, there’s a question about whether EMVM is true. Since there are many plausible rivals, we need an argument to defend it. In this paper, I’ll introduce a representation theorem for axiological uncertainty to answer these two questions. Roughly, the theorem shows that if all our axiologies satisfy the von Neumann–Morgenstern axioms, and if the facts about which options are better than which in light of your uncertainty also satisfy these axioms as well as a Pareto condition, then these facts have a relevantly unique expected utility representation. If I’m right, this theorem at once affords us a compelling way to understand EMVM—and specifically intertheoretic comparisons—and a systematic argument for its truth. (shrink)

How ought you to evaluate your options if you're uncertain about what's fundamentally valuable? A prominent response is Expected Value Maximisation (EVM)—the view that under axiological uncertainty, an option is better than another if and only if it has the greater expected value across axiologies. But the expected value of an option depends on quantitative probability and value facts, and in particular on value comparisons across axiologies. We need to explain what it is for such facts to hold. Also, EVM (...) is by no means self-evident. We need an argument to defend that it’s true. This book introduces an axiomatic approach to answer these worries. It provides an explication of what EVM means by use of representation theorems: intertheoretic comparisons can be understood in terms of facts about which options are better than which, and mutatis mutandis for intratheoretic comparisons and axiological probabilities. And it provides a systematic argument to the effect that EVM is true: the theory can be vindicated through simple axioms. The result is a formally cogent and philosophically compelling extension of standard decision theory, and original take on the problem of axiological or normative uncertainty. (shrink)

Many people think that if you're uncertain about which moral theory is correct, you ought to maximize the expected choice-worthiness of your actions. This idea presupposes that the strengths of our moral reasons are comparable across theories – for instance, that our reasons to create new people, according to total utilitarianism, can be stronger than our reasons to benefit an existing person, according to a person-affecting view. But how can we make sense of such comparisons? In this article, I introduce (...) a constructivist account of intertheoretic comparisons. On this account, such comparisons don't hold independently of facts about morally uncertain agents. They're simply the result of an ideal deliberation in terms of certain epistemic norms about what you ought to do in light of your uncertainty. If I'm right, this account is metaphysically more parsimonious than some existing proposals, and yet has plausible and strong implications. (shrink)

The distinction between objective and subjective reasons plays an important role in both folk normative thought and many research programs in metaethics. But the relation between objective and subjective reasons is unclear. This paper explores problems related to the unity of objective and subjective reasons for actions and attitudes and then offers a novel objectivist account of subjective reasons.

This essay explores the following position: Ultimate moral principles are a priori truths; hence, it is irrational to assign a non-zero credence to any proposition that is incompatible with these ultimate moral principles ; and this sort of irrationality, if it could have been avoided, is in a sense inexcusable. So—at least if moral relativism is false—in any disagreement about ultimate moral principles, at least one party to the disagreement is inexcusably irrational. This position may seem extreme, but it is (...) argued that it is more plausible than it first appears. (shrink)

Defenders of deontological constraints in normative ethics face a challenge: how should an agent decide what to do when she is uncertain whether some course of action would violate a constraint? The most common response to this challenge has been to defend a threshold principle on which it is subjectively permissible to act iff the agent's credence that her action would be constraint-violating is below some threshold t. But the threshold approach seems arbitrary and unmotivated: what would possibly determine where (...) the threshold should be set, and why should there be any precise threshold at all? Threshold views also seem to violate ought agglomeration, since a pair of actions each of which is below the threshold for acceptable moral risk can, in combination, exceed that threshold. In this paper, I argue that stochastic dominance reasoning can vindicate and lend rigor to the threshold approach: given characteristically deontological assumptions about the moral value of acts, it turns out that morally safe options will stochastically dominate morally risky alternatives when and only when the likelihood that the risky option violates a moral constraint is greater than some precisely definable threshold (in the simplest case, .5). I also show how, in combination with the observation that deontological moral evaluation is relativized to particular choice situations, this approach can overcome the agglomeration problem. This allows the deontologist to give a precise and well-motivated response to the problem of uncertainty. (shrink)

In ‘Normative Uncertainty as a Voting Problem’, William MacAskill argues that positive credence in ordinal-structured or intertheoretically incomparable normative theories does not prevent an agent from rationally accounting for her normative uncertainties in practical deliberation. Rather, such an agent can aggregate the theories in which she has positive credence by methods borrowed from voting theory—specifically, MacAskill suggests, by a kind of weighted Borda count. The appeal to voting methods opens up a promising new avenue for theories of rational choice under (...) normative uncertainty. The Borda rule, however, is open to at least two serious objections. First, it seems implicitly to ‘cardinalize’ ordinal theories, and so does not fully face up to the problem of merely ordinal theories. Second, the Borda rule faces a problem of option individuation. MacAskill attempts to solve this problem by invoking a measure on the set of practical options. But it is unclear that there is any natural way of defining such a measure that will not make the output of the Borda rule implausibly sensitive to irrelevant empirical features of decision-situations. After developing these objections, I suggest an alternative: the McKelvey uncovered set, a Condorcet method that selects all and only the maximal options under a strong pairwise defeat relation. This decision rule has several advantages over Borda and mostly avoids the force of MacAskill’s objection to Condorcet methods in general. (shrink)

In the growing literature on decision-making under moral uncertainty, a number of skeptics have argued that there is an insuperable barrier to rational "hedging" for the risk of moral error, namely the apparent incomparability of moral reasons given by rival theories like Kantianism and utilitarianism. Various general theories of intertheoretic value comparison have been proposed to meet this objection, but each suffers from apparently fatal flaws. In this paper, I propose a more modest approach that aims to identify classes of (...) moral theories that share common principles strong enough to establish bases for intertheoretic comparison. I show that, contra the claims of skeptics, there are often rationally perspicuous grounds for precise, quantitative value comparisons within such classes. In light of this fact, I argue, the existence of some apparent incomparabilities between widely divergent moral theories cannot serve as a general argument against hedging for one's moral uncertainties. (shrink)

ABSTRACT Average utilitarianism and several related axiologies, when paired with the standard expectational theory of decision-making under risk and with reasonable empirical credences, can find their practical prescriptions overwhelmingly determined by the minuscule probability that the agent assigns to solipsism—that is, to the hypothesis that there is only one welfare subject in the world, namely, herself. This either (i) constitutes a reductio of these axiologies, (ii) suggests that they require bespoke decision theories, or (iii) furnishes an unexpected argument for ethical (...) egoism. (shrink)

Most people have the intuition that, when we can save the lives of either a few people in one group or many people in another group, and all other things are equal, we ought to save the group with the most people. However, several philosophers have argued against this intuition, most famously John Taurek, in his article ‘Should the Numbers Count?’ They argue that there is no moral obligation to save the greater number, and that we are permitted to save (...) either the many or the few. I argue in this article that, even if we are almost completely persuaded by these ‘numbers sceptics’, we ought not to just save the few. If the choice is simply between saving the many or the few, we ought to save the many. (shrink)

The aim of this paper is to examine whether it would be advantageous to introduce knowledge norms instead of the currently assumed rational credence norms into the debate about decision making under normative uncertainty. There is reason to think that this could help us better accommodate cases in which agents are rationally highly confident in false moral views. I show how Moss’ view of probabilistic knowledge can be fruitfully employed to develop a decision theory that delivers plausible verdicts in these (...) cases. I also argue that, for this new view to be better than existing alternatives, it must adopt a particular solution to the new evil demon problem, which asks whether agents and their BIV-counterparts are equally justified. In order to get an attractive decision theory for cases of moral uncertainty, we must reject the claim that agents and their BIV-counterparts are equally justified. Moreover, the resulting view must be supplemented with a moral epistemology that explains how it is possible to be rationally morally uncertain. This is especially challenging if we assume that moral truths are knowable a priori. (shrink)

Sometimes it’s not certain which of several mutually exclusive moral views is correct. Like almost everyone, I think that there’s some sense in which what one should do depends on which of these theories is correct, plus the way the world is non-morally. But I also think there’s an important sense in which what one should do depends upon the probabilities of each of these views being correct. Call this second claim “moral uncertaintism”. In this paper, I want to address (...) an argument against moral uncertaintism offered in the pages of this journal by Brian Weatherson, and seconded elsewhere by Brian Hedden, the crucial premises of which are: that acting on moral uncertaintist norms necessarily involves motivation by reasons or rightness as such, and that such motivation is bad. I will argue that and are false, and that at any rate, the quality of an agent’s motivation is not pertinent to the truth or falsity of moral uncertaintism in the way that Weatherson’s and Hedden’s arguments require. (shrink)

We sometimes seem to face fundamental moral uncertainty, i.e., uncertainty about what is morally good or morally right that cannot be reduced to ordinary descriptive uncertainty. This phenomenon raises a puzzle for noncognitivism, according to which moral judgments are desire-like attitudes as opposed to belief-like attitudes. Can a state of moral uncertainty really be a noncognitive state? So far, noncognitivists have not been able to offer a completely satisfactory account. Here, we argue that noncognitivists should exploit the formal analogy between (...) moral uncertainty and moral multi-objective decision problems. Our ‘multi-objective story’ enables noncognitivists to save our moral uncertainty thought and talk by explaining how the underlying phenomenon could be noncognitive. (shrink)

According to ‘Excluders’, descriptive uncertainty – but not normative uncertainty – matters to what we ought to do. Recently, several authors have argued that those wishing to treat normative uncertainty differently from descriptive uncertainty face a dependence problem because one's descriptive uncertainty can depend on one's normative uncertainty. The aim of this paper is to determine whether the phenomenon of dependence poses a decisive problem for Excluders. I argue that existing arguments fail to show this, and that, while stronger ones (...) can be found, Excluders can escape them. (shrink)

Discounting future costs and benefits is often defended on the ground that our descendants will be richer. Simply to treat the future as better off, however, is to commit an ecological fallacy. Even if our descendants are better off when we average across climate change scenarios, this cannot justify discounting costs and benefits in possible states of the world in which they are not. Giving due weight to catastrophe scenarios requires energetic action against climate change.

In this paper, I enter the debate between those who hold that our normative uncertainty matters for what we ought to do, and those who hold that only our descriptive uncertainty matters. I argue that existing views in both camps have unacceptable implications in cases where our descriptive beliefs depend on our normative beliefs. I go on to propose a fix which is available only to those who hold that normative uncertainty matters, ultimately leaving the challenge as a threat to (...) recent skepticism about such views. (shrink)

How should deontologists concerned with the ethics of killing apply their moral theory when we don’t know all the facts relevant to the permissibility of our action? Though the stakes couldn’t be higher, and uncertainty is endemic where killing is concerned, few deontologists have an answer to this question. In this paper I canvass two possibilities: that we should apply a threshold standard, equivalent to the ‘beyond a reasonable doubt’ standard applied for criminal punishment; and that we should fit our (...) deontological ethical theory into the apparatus of decision theory. I show that the first approach faces insurmountable obstacles, while the second holds much more promise for deontologists than they might first have assumed. (shrink)

A popular model of normative decision-making under uncertainty suggests choosing the option with the maximum expected moral choice-worthiness, where the choice-worthiness values from each moral theory, which are assumed commensurable, are weighted by credence and combined. This study adds descriptive uncertainty about the non-moral facts of a situation into the model by treating choice-worthiness as a random variable. When agents face greater descriptive uncertainty, the choice-worthiness random variable will have a greater spread and a larger standard deviation. MEC, as a (...) decision rule, is sensitive only to the expected value of the random variable and not to its standard deviation. For example, MEC is insensitive to cases where an option with a large degree of descriptive uncertainty may have a higher probability of being below some threshold of impermissibility than does an option with less dispersion, even though the latter has a higher expected choice-worthiness. When applied to the same situation, similar moral theories will have statistically correlated choice-worthiness values. This correlation affects the dispersion of the credence-weighted sum of the random variables but not its expected value. Thus, MEC is insensitive to aspects of the normative situation to which a good decision-rule should be sensitive. (shrink)

Harming other people is prima facie wrong. Unless we can be very certain that doing so is justified under the circumstances, we ought not to do it. In this paper, I argue that we ought to dismantle harsh retributivist criminal justice systems for this reason; we cannot be sufficiently certain that the harm is justified. Gregg Caruso, Ben Vilhauer and others have previously argued for the same conclusion; however, my own version sidesteps certain controversial premises of theirs. Harsh retributivist criminal (...) justice can only be morally right if the following three propositions are true: Moral responsibility exists, retributivism is right, and we can find out how much punishment offenders deserve for their crimes. Suppose that we initially assign a high credence to each of the three propositions; I assume for the sake of argument that there are good arguments in support of each. Nevertheless, these arguments ultimately depend on intuitions. Since we have philosophical peers whose intuitions differ from ours, we ought to downgrade our credence in each. However, even slightly less credence in each proposition means far less credence in a conjunction of all three. Since the stakes are high and there are morally safer options for a criminal justice system, we ought to dismantle harsh retributivist ones. (shrink)

In this paper, I argue that the fetishism objection to moral hedging fails. The objection rests on a reasons-responsiveness account of moral worth, according to which an action has moral worth only if the agent is responsive to moral reasons. However, by adopting a plausible theory of non-ideal moral reasons, one can endorse a reasons-responsiveness account of moral worth while maintaining that moral hedging is sometimes an appropriate response to moral uncertainty. Thus, the theory of moral worth upon which the (...) fetishism objection relies does not, in fact, support that objection. (shrink)

A straightforward way to handle moral uncertainty is simply to follow the moral theory in which you have most credence. This approach is known as My Favourite Theory. In this paper, I argue that, in some cases, My Favourite Theory prescribes choices that are, sequentially, worse in expected moral value than the opposite choices according to each moral theory you have any credence in. In addition this, problem generalizes to other approaches that avoid intertheoretic comparisons of value, such as My (...) Favourite Option, the Borda Rule, Variance Normalization, and the Principle of Maximizing Expected Normalized Moral Value. (shrink)

The problem known as Buridan’s Ass says that a hungry donkey equipoised between two identical bales of hay will starve to death. Indecision kills the ass. Some philosophers worry about human analogs. Computer scientists since the 1960s have known about the computer versions of such cases. From what Leslie Lamport calls ‘Buridan’s Principle’—a discrete decision based on a continuous range of input-values cannot be made in a bounded time—it follows that the possibilities for human analogs of Buridan’s Ass are far (...) more wide-ranging and securely provable than has been acknowledged in philosophy. We are never necessarily decisive. This is mathematically provable. I explore four consequences: first, increased interest of the literature’s solutions to Buridan’s Ass; second, a new asymmetry between responsibility for omissions and responsibility for actions; third, clarification of the standard account of akrasia; and, fourth, clarification of the role of credences in normative decision-theory. (shrink)

Metanormativists hold that moral uncertainty can affect how we ought, in some morally authoritative sense, to act. Many metanormativists aim to generalize expected utility theory for normative uncertainty. Such accounts face the “easy problem of intertheoretic comparisons”: the worry that distinct theories’ assessments of choiceworthiness are incomparable. The easy problem may well be resolvable, but another problem looms: while some moral theories assign cardinal degrees of choiceworthiness, other theories’ choiceworthiness assignments are merely ordinal. Expected choiceworthiness over such theories is undefined. (...) Call this the “hard problem of intertheoretic comparisons.” This paper argues that to solve the hard problem, we should model moral theories with imprecise choiceworthiness. Imprecise choiceworthiness assignments can model incomplete cardinal information about choiceworthiness, with precise cardinal choiceworthiness and merely ordinal choiceworthiness as limiting cases. Generalizing familiar decision theories for imprecise choiceworthiness to the case of moral uncertainty generates puzzles, however: natural generalizations seem to require reifying parts of the model that don’t correspond to anything in normative reality. I discuss three ways of addressing this problem: by demystifying the reified elements by using them as promiscuously as possible; by constructing alternative decision theories that don’t require the troublesome elements; and by employing an alternative model of metanormative decision problems, and of moral uncertainty generally. (shrink)

Volume 98, Issue 4, December 2020, Page 747-762.

What should we do when we are not certain about what we morally should do? There is a long history of theorizing about decision-making under empirical uncertainty, but surprisingly little has been written about the moral uncertainty expressed by this question. Only very recently have philosophers started to systematically address the nature of such uncertainty and its impacts on decision-making. This paper addresses the main problems raised by moral uncertainty and critically examines some proposed solutions.

What should a person do when, through no fault of her own, she ends up believing a false moral theory? Some suggest that she should act against what the false theory recommends; others argue that she should follow her rationally held moral beliefs. While the former view better accords with intuitions about cases, the latter one seems to enjoy a critical advantage: It seems better able to render moral requirements ‘followable’ or ‘action-guiding.’ But this tempting thought proves difficult to justify. (...) Indeed, whether it can be justified turns out to depend importantly on the rational status of epistemic akrasia. Furthermore, it can be argued, from premises all parties to the moral ignorance debate should accept, that rational epistemic akrasia is possible. If the argument proves successful, it follows that a person should sometimes act against her rationally held moral convictions. (shrink)

This paper presents a unifying diagnosis of a number of important problems facing existing models of rational choice under moral uncertainty and proposes a remedy. I argue that the problems of (i) severely limited scope, (ii) intertheoretic comparisons, and (iii) 'swamping’ all stem from the way in which values are assigned to options in decision rules such as Maximisation of Expected Choiceworthiness. By assigning values to options under a given moral theory by asking something like ‘how much do I desire (...) this option, supposing this theory is true?’ rather than ‘how much value does this theory assign to this option?’ these problems can be avoided, while the appealing features of these accounts can be preserved. This amendment provides a role for the preferences, desires, or goals of rational agents that is curiously absent from the existing discussion of what individuals rationally ought to do when they are uncertain about what they morally ought to do. (shrink)

Multidimensional concepts are everywhere, and they are important. Examples include moral value, welfare, scientific confirmation, democracy, and biodiversity. How, if at all, can we aggregate the underlying dimensions of a multidimensional concept F to yield verdicts about which things are Fer than which overall? Social choice theory can be used to model and investigate this aggregation problem. Here, we focus on a particularly thorny problem made salient by this social choice-theoretic framework: the underlying dimensions of a given concept might be (...) measurable on different types of scales—e.g., some ordinal and some cardinal. An underappreciated impossibility theorem due to Anna Khmelnitskaya shows that seemingly plausible constraints on aggregation across scale types are inconsistent. This impossibility threatens to render the notion of overall Fness incoherent. We attempt to defuse this threat, arguing that the impossibility depends on an overly restrictive conception of measurement and of how measurement constrains aggregation. Adopting a more flexible—and, we think, more perspicuous—conception of measurement opens an array of possibilities for aggregation across disparate scale types. (shrink)

As well as disagreeing about how much one should donate to charity, moral theories also disagree about where one should donate. In light of this disagreement, how should the morally uncertain philanthropist allocate her donations? In many cases, one intuitively attractive option is for the philanthropist to split her donations across all of the charities that are recommended by moral views in which she has positive credence, with each charity’s share being proportional to her credence in the moral theories that (...) recommend that particular charity. Despite the fact that something like this approach is already being used by real-world philanthropists to distribute billions of dollars of donations, it is not supported by any of the approaches to moral uncertainty that have been proposed thus-far in the philosophical literature. In this paper, we will develop a bargaining-based approach to moral uncertainty that honors the proportionality intuition in favor of splitting one’s donations. We also show how this bargaining-based approach has several further advantages over the best alternative proposals. (shrink)

This thesis is about making decisions when we are uncertain about what will happen, how valuable it will be, and even how to make decisions. Even the most sure-footed amongst us are sometimes uncertain about all three, but surprisingly little attention has been given to the latter two. The three essays that constitute my thesis hope to do a small part in rectifying this problem. The first essay is about the value of finding out how to make decisions. Society spends (...) considerable resources funding people (like me) to research decision-making, so it is natural to wonder whether society is getting a good deal. This question is so shockingly underresearched that bedrock facts are readily discoverable, such as when this kind of information is valuable. My second essay concerns whether we can compare value when we are uncertain about value. Many people are in fact uncertain about value, and how we deal with this uncertainty hinges on these comparisons. I argue that value comparisons are only sometimes possible; I call this weak comparability. This essay is largely a synthesis of the literature, but I also present an argument which begins with a peculiar view of the self: it is as if each of us is a crowd of different people separated by time (but connected by continuity of experience). I’m not the first to endorse this peculiar view of the self, but I am the first to show how it supports the benign view that value is sometimes comparable. We may be uncertain of any decision rules, even those that would tell us how to act when we face uncertainty in decision rules. We may be uncertain of how to decide how to decide how to... And so on. If so, we might have to accept infinitely many decision rules just to make any mundane decision, such as whether to pick up a five-cent piece from the gutter. My third essay addresses this problem of regress. I think all of our decisions are forced: we must decide now or continue to deliberate. Surprisingly, this allows us to avoid the original problem. I call this solution “when forced, do your best”. (shrink)

This paper explores the idea that it is instrumentally valuable to learn normative truths. We consider an argument for "normative hedging" based on this principle, and examine the structure of decision-making under moral uncertainty that arises from it. But it also turns out that the value of normative information is inconsistent with the principle that learning *empirical* truths is instrumentally valuable. We conclude with a brief comment on "metanormative regress.".