The notion of existential catastrophe is increasingly appealed to in discussion of risk management around emerging technologies, but it is not completely clear what this notion amounts to. Here, I provide an opinionated survey of the space of plausibly useful definitions of existential catastrophe. Inter alia, I discuss: whether to define existential catastrophe in ex post or ex ante terms, whether an ex ante definition should be in terms of loss of expected value or loss of potential, and what kind (...) of probabilities should be involved in any appeal to expected value. (shrink)

It's often said that it is impossible to respond to non-evidential considerations in belief-formation, at least not directly and consciously. Many philosophers think that this provides grounds for accepting a normative thesis: typically, some kind of evidentialism about reasons for belief, or what one ought to believe. Some also think it supports thinking that evidentialist norms are constitutive of belief. There are a variety of ways in which one might try to support such theses by appeal to the impossibility-claim. In (...) this paper, I put pressure on these various attempts by raising a simple yet overlooked problem for them. In brief, the problem is that it isn't true that one cannot (directly and consciously) respond, in belief-formation to considerations that don't actually constitute (good) evidence for the proposition under consideration; what is true, at most, is that one cannot (directly and consciously) respond, in belief-formation to considerations that one oneself takes to be evidentially irrelevant to that proposition. While this point is obvious once stated, its significance hasn't been appreciated, or so I'll argue. Once we take full account of it, the standard arguments from the impossibility-claim to evidentialism don't go through. (shrink)

Epistemologists have recently noted a tension between (i) denying access internalism, and (ii) maintaining that rational agents cannot be epistemically akratic, believing claims akin to ‘p, but I shouldn’t believe p’. I bring out the tension, and develop a new way to resolve it. The basic strategy is to say that access internalism is false, but that counterexamples to it are ‘elusive’ in a way that prevents rational agents from suspecting that they themselves are counterexamples to the internalist principles. I (...) argue that this allows us to do justice to the motivations behind both (i) and (ii). And I explain in some detail what a view of evidence that implements this strategy, and makes it independently plausible, might look like. (shrink)

Before the semester begins, a teacher tells his students: “There will be exactly one exam this semester. It will not take place on a day that is an immediate-successor of a day that you are currently in a position to know is not the exam-day”. Both the students and the teacher know – it is common knowledge – that no exam can be given on the first day of the semester. Since the teacher is truthful and reliable, it seems that (...) the students can know that what he says is true. However, in that case, assuming the students can know that they know whatever it is they know (KK) and assuming their knowledge is closed under entailment (closure), the students can reason from what they know to the conclusion that no exam will take place during the semester. This conclusion contradicts what they supposedly know: that there will be an exam. This puzzle, we argue, gives rise to a new consideration for the rejection of KK. We discuss unique features of the argument, especially in comparison to Timothy Williamson's rejection of KK in light of other versions of the surprise exam paradox. (shrink)

The orthodox position in epistemology, for both externalists and internalists, is that a subject in a ‘bad case’—a sceptical scenario—is so epistemically badly off that they cannot know how badly off they are. Ofra Magidor contends that externalists should break ranks on this question, and that doing so is liberating when it comes time to confront a number of central issues in epistemology, including scepticism and the new evil demon problem for process reliabilism. In this reply, I will question whether (...) Magidor’s argument should persuade externalists, whether it really engages with the orthodox view on what subjects in bad cases can know, and whether the dispute is, as Magidor insists, a significant one for contemporary epistemology. (shrink)

Epistemic externalism offers one of the most prominent responses to the sceptical challenge. Externalism has commonly been interpreted as postulating a crucial asymmetry between the actual-world agent and their brain-in-a-vat counterpart: while the actual agent is in a position to know she is not envatted, her biv counterpart is not in a position to know that she is envatted, or in other words, only the former is in a position to know whether or not she is envatted. In this paper, (...) I argue that there is in fact no such asymmetry: assuming epistemic externalism, both the actual world agent and their biv counterpart are in a position to know whether or not they are envatted. After an introduction, I present the main argument. I examine to what extent the argument survives when one accepts additional externalist-friendly commitments: semantic externalism, a sensitivity condition on knowledge, and epistemic contextualism. Finally, I discuss the implications of my conclusion to a variety of debates in epistemology. (shrink)

Sometimes you are unreliable at fulfilling your doxastic plans: for example, if you plan to be fully confident in all truths, probably you will end up being fully confident in some falsehoods by mistake. In some cases, there is information that plays the classical role of evidence—your beliefs are perfectly discriminating with respect to some possible facts about the world—and there is a standard expected‐accuracy‐based justification for planning to conditionalize on this evidence. This planning‐oriented justification extends to some cases where (...) you do not have transparent evidence, in the sense that your beliefs are not perfectly discriminating with respect to any non‐trivial facts. In other cases, accuracy considerations do not tell you to plan to conditionalize on any information at all, but rather to plan to follow a different updating rule. Even in the absence of evidence, accuracy considerations can guide your doxastic plan. (shrink)

Is the fact that our universe contains fine-tuned life evidence that we live in a multiverse? Ian Hacking and Roger White influentially argue that it is not. We approach this question through a systematic framework for self-locating epistemology. As it turns out, leading approaches to self-locating evidence agree that the fact that our own universe contains fine-tuned life indeed confirms the existence of a multiverse. This convergence is no accident: we present two theorems showing that, in this setting, any updating (...) rule that satisfies a few reasonable conditions will have the same feature. The conclusion that fine-tuned life provides evidence for a multiverse is hard to escape. (shrink)

Epistemologists spend a great deal of time thinking about how we should respond to our evidence. They spend far less time thinking about the ways that evidence can be acquired in the first place. This is an oversight. Some ways of acquiring evidence are better than others. Many normative epistemologies struggle to accommodate this fact. In this article I develop one that can and does. I identify a phenomenon – epistemic feedback loops – in which evidence acquisition has gone awry, (...) with the result that even beliefs based on the evidence are irrational. Examples include evidence acquired under the influence of confirmation bias and evidence acquired under the influence of cognitively penetrated experiences caused by implicit bias. I then develop a theoretical framework which enables us to understand why beliefs that are the outputs of epistemic feedback loops are irrational. Finally, I argue that many popular approaches to epistemic normativity may need to be abandoned on the grounds that they cannot comfortably explain feedback loops. The scope of this last claim is broad: it includes almost all contemporary theories of justified/rational belief and of the epistemology of cognitive penetration. (shrink)

Metacognitive mental states are mental states about mental states. For example, I may be uncertain whether my belief is correct. In social discourse, an interlocutor’s metacognitive certainty may constitute evidence about the reliability of their testimony. For example, if a speaker is certain that their belief is correct, then we may take this as evidence in favour of their belief, or its content. This paper argues that, if metacognitive certainty is genuine evidence, then it is disproportionate evidence for extreme beliefs. (...) In support of the argument, we report findings from five studies with different participant samples, designs, and measures. These studies show that, the more extreme an agent’s belief (positive or negative), the more certain they are about it, and vice versa. This relationship might contribute to moralism, virtue signalling, and polarisation, which in turn may be epistemically and morally problematic. Therefore, we caution against taking metacognitive certainty as genuine evidence. (shrink)

The externalist says that your evidence could fail to tell you what evidence you do or not do have. In that case, it could be rational for you to be uncertain about what your evidence is. This is a kind of uncertainty which orthodox Bayesian epistemology has difficulty modeling. For, if externalism is correct, then the orthodox Bayesian learning norms of conditionalization and reflection are inconsistent with each other. I recommend that an externalist Bayesian reject conditionalization. In its stead, I (...) provide a new theory of rational learning for the externalist. I defend this theory by arguing that its advice will be followed by anyone whose learning dispositions maximize expected accuracy. I then explore some of this theory’s consequences for the rationality of epistemic akrasia, peer disagreement, undercutting defeat, and uncertain evidence. (shrink)

A handful of well-known arguments (the 'diachronic Dutch book arguments') rely upon theorems establishing that, in certain circumstances, you are immune from sure monetary loss (you are not 'diachronically Dutch bookable') if and only if you adopt the strategy of conditionalizing (or Jeffrey conditionalizing) on whatever evidence you happen to receive. These theorems require non-trivial assumptions about which evidence you might acquire---in the case of conditionalization, the assumption is that, if you might learn that e, then it is not the (...) case that you might learn something else that is consistent with e. These assumptions may not be relaxed. When they are, not only will non-(Jeffrey) conditionalizers be immune from diachronic Dutch bookability, but (Jeffrey) conditionalizers will themselves be diachronically Dutch bookable. I argue: 1) that there are epistemic situations in which these assumptions are violated; 2) that this reveals a conflict between the premise that susceptibility to sure monetary loss is irrational, on the one hand, and the view that rational belief revision is a function of your prior beliefs and the acquired evidence alone, on the other; and 3) that this inconsistency demonstrates that diachronic Dutch book arguments for (Jeffrey) conditionalization are invalid. (shrink)

Predictable polarization is everywhere: we can often predict how people’s opinions, including our own, will shift over time. Extant theories either neglect the fact that we can predict our own polarization, or explain it through irrational mechanisms. They needn’t. Empirical studies suggest that polarization is predictable when evidence is ambiguous, that is, when the rational response is not obvious. I show how Bayesians should model such ambiguity and then prove that—assuming rational updates are those which obey the value of evidence—ambiguity (...) is necessary and sufficient for the rationality of predictable polarization. The main theoretical result is that there can be a series of such updates, each of which is individually expected to make you more accurate, but which together will predictably polarize you. Polarization results from asymmetric increases in accuracy. This mechanism is not only theoretically possible, but empirically plausible. I argue that cognitive search—searching a cognitively accessible space for a particular item—often yields asymmetrically ambiguous evidence, I present an experiment supporting its polarizing effects, and I use simulations to show how it can explain two of the core causes of polarization: confirmation bias and the group polarization effect. (shrink)

Do people tend to be overconfident? Many think so. They’ve run studies on whether people are calibrated: whether their average confidence in their opinions matches the proportion of those opinions that are true. Under certain conditions, people are systematically ‘over-calibrated’—for example, of the opinions they’re 80% confident in, only 60% are true. From this empirical over-calibration, it’s inferred that people are irrationally overconfident. My question: When and why is this inference warranted? Answering it requires articulating a general connection between being (...) rational and being right—something extant studies have not done. I show how to do so using the notion of deference. This provides a theoretical foundation for calibration research, but also reveals a flaw: the connection between being rational and being right is much weaker than is standardly assumed, since rational people can often be expected to be miscalibrated. Thus we can’t test whether people are overconfident by simply testing whether they are over-calibrated; instead, we must try to predict the rational deviations from calibration, and then compare those predictions to people’s performance. I show how this can be done—and that doing so complicates the interpretation of robust empirical effects. (shrink)

Many have claimed that whenever an investigation might provide evidence for a claim, it might also provide evidence against it. Similarly, many have claimed that your credence should never be on the edge of the range of credences that you think might be rational. Surprisingly, both of these principles imply that you cannot rationally be modest: you cannot be uncertain what the rational opinions are.

Assume that it is your evidence that determines what opinions you should have. I argue that since you should take peer disagreement seriously, evidence must have two features. (1) It must sometimes warrant being modest: uncertain what your evidence warrants, and (thus) uncertain whether you’re rational. (2) But it must always warrant being guided: disposed to treat your evidence as a guide. Surprisingly, it is very difficult to vindicate both (1) and (2). But diagnosing why this is so leads to (...) a proposal—Trust—that is weak enough to allow modesty but strong enough to yield many guiding features. In fact, I claim that Trust is the Goldilocks principle—for it is necessary and sufficient to vindicate the claim that you should always prefer to use free evidence. Upshot: Trust lays the foundations for a theory of disagreement and, more generally, an epistemology that permits self-doubt—a modest epistemology. (shrink)

There are many things—call them ‘experts’—that you should defer to in forming your opinions. The trouble is, many experts are modest: they’re less than certain that they are worthy of deference. When this happens, the standard theories of deference break down: the most popular (“Reflection”-style) principles collapse to inconsistency, while their most popular (“New-Reflection”-style) variants allow you to defer to someone while regarding them as an anti-expert. We propose a middle way: deferring to someone involves preferring to make any decision (...) using their opinions instead of your own. In a slogan, deferring opinions is deferring decisions. Generalizing the proposal of Dorst (2020a), we first formulate a new principle that shows exactly how your opinions must relate to an expert’s for this to be so. We then build off the results of Levinstein (2019) and Campbell-Moore (2020) to show that this principle is also equivalent to the constraint that you must always expect the expert’s estimates to be more accurate than your own. Finally, we characterize the conditions an expert’s opinions must meet to be worthy of deference in this sense, showing how they sit naturally between the too-strong constraints of Reflection and the too-weak constraints of New Reflection. (shrink)

KK is the thesis that if you can know p, you can know that you can know p. Though it’s unpopular, a flurry of considerations has recently emerged in its favour. Here we add fuel to the fire: standard resources allow us to show that any failure of KK will lead to the knowability and assertability of abominable indicative conditionals of the form ‘If I don’t know it, p’. Such conditionals are manifestly not assertable—a fact that KK defenders can easily (...) explain. I survey a variety of KK-denying responses and find them wanting. Those who object to the knowability of such conditionals must either deny the possibility of harmony between knowledge and belief, or deny well-supported connections between conditional and unconditional attitudes. Meanwhile, those who grant knowability owe us an explanation of such conditionals’ unassertability—yet no successful explanations are on offer. Upshot: we have new evidence for KK. (shrink)

In this article, I cast doubt on an apparent truism, namely, that if evidence is available for gathering and use at a negligible cost, then it’s always instrumentally rational for us to gather that evidence and use it for making decisions. Call this ‘value of information’ (VOI). I show that VOI conflicts with two other plausible theses. The first is the view that an agent’s evidence can entail non-trivial propositions about the external world. The second is the view that epistemic (...) rationality requires us to update our credences by conditionalization. These two theses, given some plausible assumptions, make room for rationally biased inquiries where VOI fails. I go on to argue that this is bad news for defenders of VOI. (shrink)

This paper is about a tension between two theses. The first is Value of Evidence: roughly, the thesis that it is always rational for an agent to gather and use cost‐free evidence for making decisions. The second is Rationality of Imprecision: the thesis that an agent can be rationally required to adopt doxastic states that are imprecise, i.e., not representable by a single credence function. While others have noticed this tension, I offer a new diagnosis of it. I show that (...) it arises when an agent with an imprecise doxastic state engages in an unreflective inquiry, an inquiry where they revise their beliefs using an updating rule that doesn't satisfy a weak reflection principle. In such an unreflective inquiry, certain synchronic norms of instrumental rationality can make it instrumentally irrational for an agent to gather and use cost‐free evidence. I then go on to propose a diachronic norm of instrumental rationality that preserves Value of Evidence in unreflective inquiries. This, I suggest, may help us reconcile this thesis with Rationality of Imprecision. (shrink)

If updating with E has the same result across all epistemically possible worlds, then the agent has no uncertainty as to the behavior of the update, and we may call it a transparent update. If an agent is uncertain about the behavior of an update, we may call it opaque. In order to model the uncertainty an agent has about the result of an update, the same update must behave differently across different possible worlds. In this paper, I study opaque (...) updates using a simple system of dynamic epistemic logic suitably modified for that purpose. The paper highlights the connection between opaque updates and the dynamic-epistemic principles Perfect-Recall and No-Miracles. I argue that opaque updates are central to contemporary discussions in epistemology, in particular to externalist theories of knowledge and to the related problem of epistemic bootstrapping, or easy knowledge. Opaque updates allow us to explicitly investigate a dynamic form of uncertainty, using simple and precise logical tools. (shrink)