Epistemic scoring rules are the en vogue tool for justifications of the probability norm and further norms of rational belief formation. They are different in kind and application from statistical scoring rules from which they arose. In the first part of the paper I argue that statistical scoring rules, properly understood, are in principle better suited to justify the probability norm than their epistemic brethren. Furthermore, I give a justification of the probability norm applying statistical scoring (...) rules. In the second part of the paper I give a variety of justifications of norms for rational belief formation employing statistical scoring rules. Furthermore, general properties of statistical scoring rules are investigated. Epistemic scoring rules feature as a useful technical tool for constructing statistical scoring rules. (shrink)

We give necessary and sufficient conditions for a scoring rule to be proper for a quantile if utility is linear, and the distribution is unrestricted. We also give results when the set of distributions is limited, for example, to distributions that have first moments.

De Finetti introduced the concept of coherent previsions and conditional previsions through a gambling argument and through a parallel argument based on a quadratic scoring rule. He shows that the two arguments lead to the same concept of coherence. When dealing with events only, there is a rich class of scoring rules which might be used in place of the quadratic scoring rule. We give conditions under which a general strictly proper scoring (...) rule can replace the quadratic scoring rule while preserving the equivalence of de Finetti’s two arguments. In proving our results, we present a strengthening of the usual minimax theorem. We also present generalizations of de Finetti’s fundamental theorem of prevision to deal with conditional previsions. (shrink)

Epistemic decision theory aims to defend a variety of epistemic norms in terms of their facilitation of epistemic ends. One of the most important components of EpDT is known as a scoring rule. This thesis addresses some problems about scoring rules in EpDT. I consider scoring rules both for precise credences and for imprecise credences. For scoring rules in the context of precise credences, I examine the rationale for requiring a scoring rule to (...) be strictly proper, and argue that no satisfactory justification has been given. I then investigate one possible response to my argument and show the problems with this response. The conclusion is that there is a further need for justifying the requirement that a scoring rule should be strictly proper for precise credences. For scoring rules in the context of imprecise credences, an impossibility result has been established in the literature purporting to show that no strictly proper, continuous and real-valued scoring rule exists. However, a precise statement of the impossibility result requires precise definitions both of strict propriety and of continuity in the context of imprecise credences. Moreover, the result implies that we need to drop one of the three properties - strict propriety, continuity or being real-valued - to have a scoring rule for applying EpDT to imprecise credences. So, firstly, I offer definitions of strict propriety and of continuity and clarify the impossibility result. Then, I investigate what will happen if we drop one of the three properties. I argue that we should drop the property of being real-valued and I offer the general forms of two kinds of strictly proper, continuous and lexicographic scoring rules for imprecise credences. (shrink)

Scoring rules measure the deviation between a forecast, which assigns degrees of confidence to various events, and reality. Strictly proper scoring rules have the property that for any forecast, the mathematical expectation of the score of a forecast p by the lights of p is strictly better than the mathematical expectation of any other forecast q by the lights of p. Forecasts need not satisfy the axioms of the probability calculus, but Predd et al. [9] (...) have shown that given a finite sample space and any strictly proper additive and continuous scoring rule, the score for any forecast that does not satisfy the axioms of probability is strictly dominated by the score for some probabilistically consistent forecast. Recently, this result has been extended to non-additive continuous scoring rules. In this paper, a condition weaker than continuity is given that suffices for the result, and the condition is proved to be optimal. (shrink)

Strictly proper scoring rules have been studied widely in statistical decision theory and recently in experimental economics because of their ability to encourage assessors to honestly provide their true subjective probabilities. In this article, we study the spherical scoring rule by analytically examining some of its properties and providing some new geometric interpretations for this rule. Moreover, we state a theorem which provides an axiomatic characterization for the spherical scoring rule. The objective (...) of this analysis is to provide a better understanding of one of the most commonly available scoring rules, which could aid decision makers in the selection of an appropriate tool for evaluating and assessing probabilistic forecasts. (shrink)

We argue that there is a tension between two monistic claims that are the core of recent work in epistemic consequentialism. The first is a form of monism about epistemic value, commonly known as veritism: accuracy is the sole final objective to be promoted in the epistemic domain. The other is a form of monism about a class of epistemic scoring rules: that is, strictly proper scoring rules are the only legitimate measures of inaccuracy. These two (...) monisms, we argue, are in tension with each other. If only accuracy has final epistemic value, then there are legitimate alternatives to strictly proper scoring rules. Our argument relies on the way scoring rules are used in contexts where accuracy is rewarded, such as education. (shrink)

Levinstein recently presented a challenge to accuracy-first epistemology. He claims that there is no strictly proper, truth-directed, additive, and differentiable scoring rule that recognises the contingency of varying importance, i.e., the fact that an agent might value the inaccuracy of her credences differently at different possible worlds. In my response, I will argue that accuracy-first epistemology can capture the contingency of varying importance while maintaining its commitment to additivity, propriety, truth-directedness, and differentiability. I will construct a (...) scoring rule — a weighted scoring rule — and a global inaccuracy measure that has all four required properties and recognises the contingency of varying importance. I will show that Levinstein’s and my results coexist without contradicting each other. (shrink)

We provide self-contained proof of a theorem relating probabilistic coherence of forecasts to their non-domination by rival forecasts with respect to any proper scoring rule. The theorem recapitulates insights achieved by other investigators, and clarifi es the connection of coherence and proper scoring rules to Bregman divergence.

Jim Joyce argues for two amendments to probabilism. The first is the doctrine that credences are rational, or not, in virtue of their accuracy or “closeness to the truth” (1998). The second is a shift from a numerically precise model of belief to an imprecise model represented by a set of probability functions (2010). We argue that both amendments cannot be satisfied simultaneously. To do so, we employ a (slightly-generalized) impossibility theorem of Seidenfeld, Schervish, and Kadane (2012), who show that (...) there is no strictly proper scoring rule for imprecise probabilities. -/- The question then is what should give way. Joyce, who is well aware of this no-go result, thinks that a quantifiability constraint on epistemic accuracy should be relaxed to accommodate imprecision. We argue instead that another Joycean assumption — called strict immodesty— should be rejected, and we prove a representation theorem that characterizes all “mildly” immodest measures of inaccuracy. (shrink)

Local proper scoring rules provide convenient tools for measuring subjective probabilities. Savage, 783–801, 1971) has shown that the only local proper scoring rule for more than two exclusive events is the logarithmic family. We generalize Savage by relaxing the properness and the domain, and provide simpler proof.

• Coherence1 for previsions of random variables with generalized betting; • Coherence2 for probability forecasts of events with Brier score penalty; • Coherence3 probability forecasts of events with various proper scoring rules.

We use a theorem from M. J. Schervish to explore the relationship between accuracy and practical success. If an agent is pragmatically rational, she will quantify the expected loss of her credence with a strictly proper scoring rule. Which scoring rule is right for her will depend on the sorts of decisions she expects to face. We relate this pragmatic conception of inaccuracy to the purely epistemic one popular among epistemic utility theorists.

Consider an election in which each of the n voters casts a vote consisting of a strict preference ranking of the three candidates A, B, and C. In the limit as n→∞, which scoring rule maximizes, under the assumption of Impartial Anonymous Culture (uniform probability distribution over profiles), the probability that the Condorcet candidate wins the election, given that a Condorcet candidate exists? We produce an analytic solution, which is not the Borda Count. Our result agrees with recent (...) numerical results from two independent studies, and contradicts a published result of Van Newenhizen (Economic Theory 2, 69–83. (1992)). (shrink)

The aim of this paper is to apply the accuracy based approach to epistemology to the case of higher order evidence: evidence that bears on the rationality of one's beliefs. I proceed in two stages. First, I show that the accuracy based framework that is standardly used to motivate rational requirements supports steadfastness—a position according to which higher order evidence should have no impact on one's doxastic attitudes towards first order propositions. The argument for this will require a generalization of (...) an important result by Greaves and Wallace for the claim that conditionalization maximizes expected accuracy. The generalization I provide will, among other things, allow us to apply the result to cases of self-locating evidence. In the second stage, I develop an alternative framework. Very roughly, what distinguishes the traditional approach from the alternative one is that, on the traditional picture, we're interested in evaluating the expected accuracy of conforming to an update procedure. On the alternative picture that I develop, instead of considering how good an update procedure is as a plan to conform to, we consider how good it is as a plan to make. I show how, given the use of strictly proper scoring rules, the alternative picture vindicates calibrationism: a view according to which higher order evidence should have a significant impact on our beliefs. I conclude with some thoughts about why higher order evidence poses a serious challenge for standard ways of thinking about rationality. (shrink)

Scoring rules measure the accuracy or epistemic utility of a credence assignment. A significant literature uses plausible conditions on scoring rules on finite sample spaces to argue for both probabilism—the doctrine that credences ought to satisfy the axioms of probabilism—and for the optimality of Bayesian update as a response to evidence. I prove a number of formal results regarding scoring rules on infinite sample spaces that impact the extension of these arguments to infinite sample spaces. A common (...) condition in the arguments for probabilism and Bayesian update is strict propriety: that according to each probabilistic credence, the expected accuracy of any other credence is worse. Much of the discussion needs to divide depending on whether we require finite or countable additivity of our probabilities. I show that in a number of natural infinite finitely additive cases, there simply do not exist strictly proper scoring rules, and the prospects for arguments for probabilism and Bayesian update are limited. In many natural infinite countably additive cases, on the other hand, there do exist strictly proper scoring rules that are continuous on the probabilities, and which support arguments for Bayesian update, but which do not support arguments for probabilism. There may be more hope for accuracy-based arguments if we drop the assumption that scores are extended-real-valued. I sketch a framework for scoring rules whose values are nets of extended reals, and show the existence of a strictly proper net-valued scoring rules in all infinite cases, both for f.a. and c.a. probabilities. These can be used in an argument for Bayesian update, but it is not at present known what is to be said about probabilism in this case. (shrink)

We review de Finetti’s two coherence criteria for determinate probabilities: coherence1defined in terms of previsions for a set of events that are undominated by the status quo – previsions immune to a sure-loss – and coherence2 defined in terms of forecasts for events undominated in Brier score by a rival forecast. We propose a criterion of IP-coherence2 based on a generalization of Brier score for IP-forecasts that uses 1-sided, lower and upper, probability forecasts. However, whereas Brier score is a (...) class='Hi'>strictly proper scoring rule for eliciting determinate probabilities, we show that there is no real-valuedstrictly proper IP-score. Nonetheless, with respect to either of two decision rules – Γ-maximin or E-admissibility-+-Γ-maximin – we give a lexicographic strictly proper IP-scoring rule that is based on Brier score. (shrink)

Why is it good to be less, rather than more incoherent? Julia Staffel, in her excellent book “Unsettled Thoughts,” answers this question by showing that if your credences are incoherent, then there is some way of nudging them toward coherence that is guaranteed to make them more accurate and reduce the extent to which they are Dutch-bookable. This seems to show that such a nudge toward coherence makes them better fit to play their key epistemic and practical roles: representing the (...) world and guiding action. In this paper, I argue that Staffel’s strategy needs a small tweak. While she identifies appropriate measures of epistemic value, she does not identify appropriate measures of practical value. Staffel measures practical value using Dutchbookability scores. But credences have practical value in virtue of recommending actions that produce as much utility as possible. And while susceptibility to a Dutch book is a surefire sign that one’s credences are needlessly bad at this task, one’s degree of Dutch-bookability is not itself a good measure of how well they recommend practically valuable actions. Strictly proper scoring rules, I argue, are the right tools for measuring both epistemic and practical value. I show that we can rerun Staffel’s strategy swapping in strictly proper scoring rules for Dutch-bookability measures. So long as one’s epistemic scoring rule and practical scoring rule are “sufficiently similar,” there is some way of nudging incoherent credences toward coherence that is guaranteed to yield more of both types of value. (shrink)

This article proposes a new interpretation of mutual information. We examine three extant interpretations of MI by reduction in doubt, by reduction in uncertainty, and by divergence. We argue that the first two are inconsistent with the epistemic value of information assumed in many applications of MI: the greater is the amount of information we acquire, the better is our epistemic position, other things being equal. The third interpretation is consistent with EVI, but it is faced with the problem of (...) measure sensitivity and fails to justify the use of MI in giving definitive answers to questions of information. We propose a fourth interpretation of MI by reduction in expected inaccuracy, where inaccuracy is measured by a strictly proper monotonic scoring rule. It is shown that the answers to questions of information given by MI are definitive whenever this interpretation is appropriate, and that it is appropriate in a wide range of applications with epistemic implications. _1_ Introduction _2_ Formal Analyses of the Three Interpretations _2.1_ Reduction in doubt _2.2_ Reduction in uncertainty _2.3_ Divergence _3_ Inconsistency with Epistemic Value of Information _4_ Problem of Measure Sensitivity _5_ Reduction in Expected Inaccuracy _6_ Resolution of the Problem of Measure Sensitivity _6.1_ Alternative measures of inaccuracy _6.2_ Resolution by strict propriety _6.3_ Range of applications _7_ Global Scoring Rules _8_ Conclusion. (shrink)

Why should a Bayesian bother performing an experiment, one the result of which might well upset his own favored credence function? The Ramsey-Good theorem provides a decision theoretic answer. Provided you base your decision on expected utility, and the the experiment is cost-free, performing the experiment and then choosing has at least as much expected utility as choosing without further ado. Furthermore, doing the experiment is strictly preferable just in case at least one possible outcome of the experiment could (...) alter your choice of options. That is, you should pursue the information just in case it could make a difference to what you do. The problem remains, however, why one should do an experiment when nothing of much practical consequence hangs in the balance. One possibility here is to invoke the pure cognitive utility of states. It is shown that one constraint on cognitive value (what I call cogency) guarantees the value of learning: from a cognitive point of view you are justified in performing an experiment if the outcome of the experiment could make a different to what you think. A bonus of the basic framework is that it provides a new decision theoretic argument for the rationality of conditionalization. (shrink)

Epistemic rationality is typically taken to be immodest at least in this sense: a rational epistemic state should always take itself to be doing at least as well, epistemically and by its own light, than any alternative epistemic state. If epistemic states are probability functions and their alternatives are other probability functions defined over the same collection of proposition, we can capture the relevant sense of immodesty by claiming that epistemic utility functions are (strictly) proper. In this paper (...) I examine what happens if we allow for the alternatives to an epistemic state to include probability functions with different domains. I first prove an impossibility result: on minimal assumptions, I show that there is no way of vindicating strong immodesty principles to the effect that any probability function should take itself to be doing at least as well than any alternative probability function, regardless of its domain. I then consider alternative, weaker generalizations of the traditional immodesty principle and prove some characterization results for some classes of epistemic utility functions satisfying each of the relevant principles. (shrink)

This paper proposes a new interpretation of mutual information (MI). We examine three extant interpretations of MI by reduction in doubt, by reduction in uncertainty, and by divergence. We argue that the first two are inconsistent with the epistemic value of information (EVI) assumed in many applications of MI: the greater is the amount of information we acquire, the better is our epistemic position, other things being equal. The third interpretation is consistent with EVI, but it is faced with the (...) problem of measure sensitivity and fails to justify the use of MI in giving definitive answers to questions of information. We propose a fourth interpretation of MI by reduction in expected inaccuracy, where inaccuracy is measured by a strictly proper monotonic scoring rule. It is shown that the answers to questions of information given by MI are definitive whenever this interpretation is appropriate, and that it is appropriate in a wide range of applications with epistemic implications. (shrink)

This article examines the relationship between online dispute resolution (ODR) and trust. We discuss what trust is, why trust is important, and how trust develops. Our claim is that efforts to implement online dispute resolution on a site or service in a manner that promotes trust need to consider ODR as just one tool in a broader toolbox of trust-building tools and techniques. These techniques are amongst others marketing, education, trust seals, and transparency. By evaluating ODR in its proper (...) context as one component of a larger trust strategy, we can more accurately set expectations for its results and position our projects for success. (shrink)

Shuford, Albert and Massengill proved, a half century ago, that the logarithmic scoring rule is the only proper measure of inaccuracy determined by a differentiable function of probability assigned the actual cell of a scored partition. In spite of this, the log rule has gained less traction in applied disciplines and among formal epistemologists that one might expect. In this paper we show that the differentiability criterion in the Shuford et. al. result is unnecessary and use (...) the resulting simplified characterization of the logarithmic rule to give novel arguments in favor of it. (shrink)

Dummett's objections to the coherence of the strict finitist philosophy of mathematics are thus, at the present time at least, ill-taken. We have so far no definitive treatment of Sorites paradoxes; so no conclusive ground for dismissing Dummett's response — the response of simply writing off a large class of familiar, confidently handled expressions as semantically incoherent. I believe that cannot be the right response, if only because it threatens to open an unacceptable gulf between the insight into his own (...) understanding available to a philosophically reflective speaker and the conclusions available to one confined to observing the former's linguistic practice; for an observer of our linguistic practice could never justifiably arrive at the conclusion that ‘red’, ‘child’, etc., are governed by inconsistent rules. But the Sorites is not the subject of this paper. The points I hope to have made plausible are: that a generalized intuitionist position cannot be so much as formulated and that even a most local intuitionism, argued for the special case of arithmetic, is hard pressed effectively to stabilize and defend itself; that strict finitism remains the natural outcome of the anti-realism which Dummett has propounded by way of support for the intuitionist philosophy of mathematics; that it is powerfully buttressed by the ideas of the latter Wittgenstein on rule-following; and that there is no extant compelling reason to suppose that its involvement with predicates of surveyability calls its coherence into question. The correct philosophical assessment of strict finitism, and its proper mathematical exegesis, remain absolutely open, almost virgin issues. This is not a situation which philosophers of mathematics should tolerate very much longer. (shrink)

It is commonly assumed that when we assign different credences to a proposition, a perfect compromise between our opinions simply ‘splits the difference’ between our credences. I introduce and defend an alternative account, namely that a perfect compromise maximizes the average of the expected epistemic values that we each assign to alternative credences in the disputed proposition. I compare the compromise strategy I introduce with the traditional strategy of compromising by splitting the difference, and I argue that my strategy is (...) a reasonable characterization of epistemic compromise. (shrink)

This essay, as will become obvious, owes a huge debt to Mark Kelman, particularly to his article “Interpretative Construction in the Substantive Criminal Law.” That debt is one of both concept and content. There is rich irony in my aping Kelman's deconstructionist enterprise, for I do not share his enthusiasm for either the “insights” or the political agenda of the Critical Legal Studies movement. I do not believe that either the law in general or the criminal law in particular is (...) radically indeterminate, rife with internal contradictions, or an expression of the interests of a dominant economic class. And although, like Kelman, I believe that the freedom/determinism, act/character, and rule/principle dichotomies must ultimately be dealt with in order to have a completely satisfactory account of criminal law, I also believe that these dichotomies loom just as large in other areas of law and in normative theory generally. They are problems for Crits as well as for liberal-legalists. In any event, my intentions in undertaking this deconstructionist enterprise are modestly reformist, not revolutionary. I do not intend to shift any paradigms, but to work with well-established ones. I will assume that criminal law seeks to accomplish some blend of retributive response to and deterrence of culpable choices, choices to defy moral norms that are also legal norms. I will also assume that a culpable choice is one that reflects negatively on the values held by the chooser. Beyond these quite modest assumptions, I need not and will not venture in this paper, realizing, of course, that much has and can be written about the proper aims of punishment and the proper account of culpability. (shrink)

As far as logic is concerned, the conclusion of Michael Dummett's manifestability argument is that intuitionistic logic, as first developed by Heyting, satisfies the semantic requirements of antirealism. The argument may be roughly sketched as follows: since we cannot manifest a grasp of possibly justification-transcendent truth conditions, we must countenance conditions which are such that, at least in principle and by the very nature of the case, we are able to recognize that they are satisfied whenever they are. Intuitionistic logic (...) satisfies the semantic requirement that we should either eschew the notion of truth altogether and replace it by provability in principle, or constrain it by provability in principle (Dummett [1973] 1978). (Handout: 1-5). Some philosophers have argued that the traditional antirealist desideratum of decidability in principle is too weak, so that semantic antirealism properly construed must be committed to effective decidability. As such, it either leads to strict finitism (Wright [1982] 1993) [Handout: 6] or to a much stronger kind of logical revisionism than the one considered by intuitionists (whether or not they accept the manifestability argument): substructural logics, and in particular linear logics, rather than intuitionistic logic, satisfy the semantic requirements of strict antirealism (Dubucs and Marion 2004) [Handout: 8-9]. I shall develop two different kinds of replies. The first is concerned with the notion of meaning per se and looks to strict finitism directly, although not on the ground that it would provide a correct way of dealing with Soritic-type paradoxes (the original and primary focus of discussion in Wright [1982] 1993). The second is concerned with the justification of structural and logical rules in a natural deduction system à la Gentzen. It will deal in particular with the criticism of the structural rules of Weakening and Contraction [Handout: 10 and 11]. The first kind of reply, which Dummett has partially taken into consideration, is that if we jettison the effectively vs. in principle distinction, as applied to manifestability-type arguments, we end up with an unsatisfactory explanation of how the meaning of statements covering the practically unsurveyable or pro tempora undecided cases is fixed. The idea is that if we have a method which may be used over some small range, we have determined a way of applying the method everywhere in principle and that this is enough as far as fixing meaning is concerned. Decidability in principle is just what we need with respect to manifestation of grasp of meaning. In this perspective, antirealism shouldn't be strict and manifestability-type arguments need not be applied as far as the strict finitist would want to [Handout: 7]. It follows that there is no reason to think that practical feasibility should be built in assertibility conditions and proofs be construed dynamically as acts in the strict antirealist's acception of that term [Handout: 8]. I shall then look at one radical antirealist principle disqualifying structural rules, namely Token Preservation, arguing against Bonnay and Cozic's criticisms of Dubucs and Marion (Bonnay and Cozic 3 2007) that some conceptual support may be provided for Token Preservation, which doesn't rely on a causal misreading of the turnstile [Handout: 13, 14]. I shall then assess the merits and limits of radical antirealism and the logic of feasible proofs with respect to the original Dummettian argument in favour of semantic antirealism (provided it has indeed revisionist implications for logic), whether the radical antirealist merely stipulates what human feasibility amounts to, or dispenses with structural rules in order to argue in favour of a curb on the epistemic idealizations they unwarrantedly embed. It will be noted here that there is a great difference, conceptually speaking, between the rejection of classical logic via the curbing of the epistemic idealizations embedded in structural rules, and the rejection of classical logic via the criticism of the introduction and elimination rules which fix the meaning of the classical constants. The kind of logical revisionism envisaged by intuitionists from Heyting on is in many respects stronger than the one envisaged by advocates of linear logic, should they ground their arguments on an endorsement of strict antirealism. The crucial case of excluded middle is telling. Because of the splitting of the constants in linear logic (Handout: 12], two distinct laws of excluded middle may be formulated (Handout: 15), but the traditional arguments of Brouwer and Heyting against the classical law yield a stronger revision than the substructural revision with its admission of these two (very) weak versions of the law. (Project: a clearer conception is needed of how the introduction and elimination rules for the logical connectives in the intuitionistic calculus depend on the structural rules which the radical antirealist wishes to reject.). (shrink)

In attempting to form rational personal probabilities by direct inference, it is usually assumed that one should prefer frequency information concerning more specific reference classes. While the preceding assumption is intuitively plausible, little energy has been expended in explaining why it should be accepted. In the present article, I address this omission by showing that, among the principled policies that may be used in setting one’s personal probabilities, the policy of making direct inferences with a preference for frequency information for (...) more specific reference classes yields personal probabilities whose accuracy is optimal, according to all proper scoring rules, in situations where all of the relevant frequency information is point-valued. Assuming that frequency information for narrower reference classes is preferred, when the relevant frequency statements are point-valued, a dilemma arises when choosing whether to make a direct inference based upon relatively precise-valued frequency information for a broad reference class, R, or upon relatively imprecise-valued frequency information for a more specific reference class, R*. I address such cases, by showing that it is often possible to make a precise-valued frequency judgment regarding R* based on precise-valued frequency information for R, using standard principles of direct inference. Having made such a frequency judgment, the dilemma of choosing between and is removed, and one may proceed by using the precise-valued frequency estimate for the more specific reference class as a premise for direct inference. (shrink)

In a three-candidate election, a scoring rule s (s in [0,1]) assigns 1, s, and 0 points (respectively) to each first, second and third place in the individual preference rankings. The Condorcet efficiency of a scoring rule is defined as the conditional probability that this rule selects the winner in accordance with Condorcet criteria (three Condorcet criteria are considered in the paper). We are interested in the following question: What rule s has the greatest (...) Condorcet efficiency? After recalling the known answer to this question, we investigate the impact of social homogeneity on the optimal value of ?. One of the most salient results we obtain is that the optimality of the Borda rule (s=1/2) holds only if the voters act in an independent way. (shrink)

In a three-candidate election, a scoring rule λ, λ∈[0,1], assigns 1,λ and 0 points (respectively) to each first, second and third place in the individual preference rankings. The Condorcet efficiency of a scoring rule is defined as the conditional probability that this rule selects the winner in accordance with Condorcet criteria (three Condorcet criteria are considered in the paper). We are interested in the following question: What rule λ has the greatest Condorcet efficiency? After (...) recalling the known answer to this question, we investigate the impact of social homogeneity on the optimal value of λ. One of the most salient results we obtain is that the optimality of the Borda rule (λ=1/2) holds only if the voters act in an independent way. (shrink)

The relevance of cognitive penetration has been pointed out concerning three fields within philosophy: philosophy of science, philosophy of mind, and epistemology. This paper argues that this phenomenon is also relevant to the philosophy of language. First, I will defend that there are situations where ethical, social, or cultural rules can affect our taste perceptions. This influence can cause speakers to utter conflicting contents that lead them to disagree and, subsequently, to negotiate the circumstances of application of the taste predicates (...) they have used to describe or express their taste perceptions. Then, to account for the proper dynamics of these cases, I will develop a theoretical framework build upon two elements: the Lewisian idea of the score of a conversation, and Richard’s taxonomy of the different attitudes speakers can have in taste disagreements. In a nutshell, I will argue that speakers can accommodate these conflicting contents as exceptions to the rule that determines the circumstances of application of taste predicates.Keywords: Cognitive penetration, Common ground, Circumstances of application, Accommodation, Exceptions, Score of the conversation, Taste predicates. (shrink)

In many voting systems, voters’ preferences on a set of candidates are represented by linear orderings. In this context, scoring rules are well-known procedures to aggregate the preferences of the voters. Under these rules, each candidate obtains a fixed number of points, sk\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$s_k$$\end{document}, each time he/she is ranked k\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$k$$\end{document}th by one voter and the candidates are ordered according to the total number (...) of points they receive. In order to identify the best scoring rule to use in each situation, we need to know which properties are met by each of these procedures. Although some properties have been analyzed extensively, there are other properties that have not been studied for all scoring rules. In this paper, we consider two desirable social choice properties, the Pareto-optimality and the immunity to the absolute loser paradox, and establish characterizations of the scoring rules that satisfy each of these specific axioms. Moreover, we also provide a proof of a result given by Saari and Barney, where the scoring rules meeting reversal symmetry are characterized. From the results of characterization, we establish some relationships among these properties. Finally, we give a characterization of the scoring rules satisfying the three properties. (shrink)

As the ongoing literature on the paradoxes of the Lottery and the Preface reminds us, the nature of the relation between probability and rational acceptability remains far from settled. This article provides a novel perspective on the matter by exploiting a recently noted structural parallel with the problem of judgment aggregation. After offering a number of general desiderata on the relation between finite probability models and sets of accepted sentences in a Boolean sentential language, it is noted that a number (...) of these constraints will be satisfied if and only if acceptable sentences are true under all valuations in a distinguished non-empty set W. Drawing inspiration from distance-based aggregation procedures, various scoring rule based membership conditions for W are discussed and a possible point of contact with ranking theory is considered. The paper closes with various suggestions for further research. (shrink)

ABSTRACTSuppose that beliefs come in degrees. How should we then measure the accuracy of these degrees of belief? Scoring rules are usually thought to be the mathematical tool appropriate for this job. But there are many scoring rules, which lead to different ordinal accuracy rankings. Recently, Fallis and Lewis [2016] have given an argument that, if sound, rules out many popular scoring rules, including the Brier score, as genuine measures of accuracy. I respond to this argument, in (...) part by noting that the argument fails to account for verisimilitude—that certain false hypotheses might be closer to the truth than other false hypotheses are. Oddie [forthcoming], however, has argued that no member of a very wide class of scoring rules can appropriately handle verisimilitude. I explain how to respond to Oddie's argument, and I recommend a class of weighted scoring rules that, I argue, genuinely measure accuracy while escaping the arguments of Fallis and Lewis as well as Oddie. (shrink)

In practice, scoring rules elicit good probability estimates from individuals, while betting markets elicit good consensus estimates from groups. Market scoring rules combine these features, eliciting estimates from individuals or groups, with groups costing no more than individuals. Regarding a bet on one event given another event, only logarithmic versions preserve the probability of the given event. Logarithmic versions also preserve the conditional probabilities of other events, and so preserve conditional independence relations. Given logarithmic rules that elicit relative (...) probabilities of base event pairs, it costs no more to elicit estimates on all combinations of these base events. (shrink)

Can there be good reasons for judging one set of probabilistic assertions more reliable than a second? There are many candidates for measuring "goodness" of probabilistic forecasts. Here, I focus on one such aspirant: calibration. Calibration requires an alignment of announced probabilities and observed relative frequency, e.g., 50 percent of forecasts made with the announced probability of.5 occur, 70 percent of forecasts made with probability.7 occur, etc. To summarize the conclusions: (i) Surveys designed to display calibration curves, from which a (...) recalibration is to be calculated, are useless without due consideration for the interconnections between questions (forecasts) in the survey. (ii) Subject to feedback, calibration in the long run is otiose. It gives no ground for validating one coherent opinion over another as each coherent forecaster is (almost) sure of his own long-run calibration. (iii) Calibration in the short run is an inducement to hedge forecasts. A calibration score, in the short run, is improper. It gives the forecaster reason to feign violation of total evidence by enticing him to use the more predictable frequencies in a larger finite reference class than that directly relevant. (shrink)

This paper studies a ranking rule of the following type axiomatically: each voter places k candidates into n categories with ranks from n to 1 attached to these categories, the candidate(s) with the highest aggregate score is (are) the winner(s). We show that it is characterized by a monotonicity condition and a multi-stage cancellation property.

In practice, scoring rules elicit good probability estimates from individuals, while betting markets elicit good consensus estimates from groups. Market scoring rules combine these features, eliciting estimates from individuals or groups, with groups costing no more than individuals. Regarding a bet on one event given another event, only logarithmic versions preserve the probability of the given event. Logarithmic versions also preserve the conditional probabilities of other events, and so preserve conditional independence relations. Given logarithmic rules that elicit relative (...) probabilities of base event pairs, it costs no more to elicit estimates on all combinations of these base events. (shrink)

Dutch Book Arguments. B is susceptibility to sure monetary loss (in a certain betting set-up), and F is the formal role played by non-Pr b’s in the DBT and the Converse DBT. Representation Theorem Arguments. B is having preferences that violate some of Savage’s axioms (and/or being unrepresentable as an expected utility maximizer), and F is the formal role played by non-Pr b’s in the RT.

- In decision theory, an agent is deciding how to value a gamble that results in different outcomes in different states. Each outcome gets a utility value for the agent.

Several different Bayesian models of epistemic utilities (see, e. g., [37], [24], [40], [46]) have been used to explain why it is rational for scientists to perform experiments. In this paper, I argue that a model-suggested independently by Patrick Maher [40] and Graham Oddie [46]-that assigns epistemic utility to degrees of belief in hypotheses provides the most comprehensive explanation. This is because this proper scoring rule (PSR) model captures a wider range of scientifically acceptable attitudes toward epistemic (...) risk than the other Bayesian models that have been proposed. I also argue, however, that even the PSR model places unreasonably tight restrictions on a scientist's attitude toward epistemic risk. As a result, such Bayesian models of epistemic utilities fail as normative accounts-not just as descriptive accounts (see, e. g., [31], [14])-of scientific inquiry. (shrink)

This explains how to smoothly integrate booked orders with a combinatorial market maker, all for the general case of bets on E[x|A] for arbitrary random variables x and sets A.