We resolve a useful formulation of the question how a statistician can coherently incorporate the information in a consulted expert’s probability assessment for an event into a personal posterior probability assertion. Using a framework that recognises the total information available as composed of units available only to each of them along with units available to both, we show: that a sufficient statistic for all the information available to both the expert and the statistician is the product of their odds ratios (...) in favour of the event; that the geometric mean of their two probabilities specifies a contour of pairs of assertions in the unit-square that yield the same posterior probability; that the information-combining function is parameterised by an unknown probability for the event conditioned only on the unspecified information common to both the statistician and the expert; and that an assessable mixing distribution over this unspecified probability allows an integrable mixture distribution to represent a computable posterior probability. The exact results allow the identification of the subclass of coherent probabilities that are externally Bayesian operators. This subclass is equivalent to the class of combining functions that honour the principles of uniformity and compromise. (shrink)

Recent discussion of the calibration of probability assessments is related to the earlier influential attitudes of Fréchet. The limiting frequency criterion of good calibration is criticised as being of no relevance to the evaluation of the probability of any event. An operational definition of good calibration is proposed which treats calibration properties as characteristics of the assessor's entire body of opinion, not of opinion about some particular event or events. In these terms a result is shown which says that every (...) coherent opinion distribution is well-calibrated. Scoring rule representations as calibration plus refinement scores are discussed. It is proposed that a subjectivist could well attribute particular bad experiences to 'luck', and must balance this sense of luck with a sense of the inadequacy of his/her own knowledge when evaluating previous knowledge and experience. (shrink)