Measurement outcomes are frequently used as evidence in favor of or against medical and surgical interventions, health policies, and system designs. Indeed, in the medical and health services research literature, outcomes are the currency of policy debate and decision making. Yet in the philosophy of science and philosophy of medicine, the measures used in evidence-based medicine (EBM) are rarely discussed. Rather, the focus here is almost exclusively on study design and hierarchies of evidence. This concentration on the methodology of study (...) design has meant that for practical purposes the measures used in randomized controlled trials, observational studies, audits, and so forth, appear as a “black box.” Yet as I argue in the first part of this article, an engagement with measurement can improve our understanding of EBM and the quality of our evidence. In the second part of the article, I develop such an engagement with one aspect of measurement, namely, the validity of patient-reported outcome measures. Here, I illustrate some of the complexity that is required to improve the validity of these measures and hence the validity of our study outcomes, that is, evidence. The concentration in philosophy of science on study design over measurement methodology perhaps reveals the interest that many philosophers of medicine have in causation, but there is more to the production of high-quality scientific evidence than securing the causal inference. (shrink)

Quality improvement mechanisms increasingly use outcome measures to evaluate health care providers. This move toward outcome measures is a radical departure from the traditional focus on process measures. More radical still is the proposal to shift from relatively simple and proximal measures of outcome, such as mortality, to complex outcomes, such as quality of life. While the practical, scientific, and ethical issues associated with the use of outcomes such as mortality and morbidity to compare health care providers have been well (...) rehearsed, the specific concerns associated with the use of quality of life measures in quality of care research have received little attention. As with much research on quality of life there is a tendency to assume that the disadvantages are outweighed by the general virtue of “listening” to patients. In this paper we disagree with this assumption and argue that quality of life is a process, not an outcome. (shrink)

Philosophers and others have questioned whether or not expertise in morality is possible. This debate is not only theoretical, but also affects the perceived legitimacy of clinical ethicists. One argument against moral expertise is that in a pluralistic society with competing moral theories no one can claim expertise regarding what another ought morally to do. There are simply too many reasonable moral values and intuitions that affect theory choice and its application; expertise is epistemically uniform. In this article, we discuss (...) how similar concerns have recently threatened to undermine expertise in medicine and science. In contrast, we argue that the application of values is needed to exercise medical, scientific, and moral expertise. As long as these values are made explicit, worries about a pretense to authority in the context of a liberal democracy are ill-conceived. In conclusion, we argue for an expertise that is epistemically diverse. (shrink)

Since the 1970’s epidemiological measures focusing on “health-related quality of life” or simply “quality of life” have figured increasingly as endpoints in clinical trials. Before the 1970’s these measures were known, generically, as performance measures or health status measures. Relabeled as “quality of life measures” they were first used in cancer trials. In the early 2000’s they were relabeled again as “patient-reported outcome measures” or PROMs, in their service to the FDA to support drug labeling claims. To the limited degree (...) that the philosophical literature addresses these measures, it tends to associate them with two major theories of well-being: subjective well-being and the capabilities approach. In this paper, I argue that philosophers ought to treat quality of life measures/proms as a distinct from these theories. I argue that quality of life/proms serve healthcare as vehicles for patient-centered care and this has important consequences for how we theorize these measures. To this end, two requirements set them apart from measures of subjective well-being and the capabilities approach: quality of life/proms need to be patient-directed and inclusive. (shrink)

There has been much philosophical interest regarding the ‘hierarchy of evidence’ used to determine which study designs are of most value for reporting on questions of effectiveness, prognosis, and so on. There has been much less philosophical interest in the choice of outcome measures with which the results of, say, an RCT or a cohort study are presented. In this paper, we examine the FDA’s recently published guidelines for assessing the psychometric adequacy of patient-reported outcome measures. We focus on their (...) recommendations for demonstrating content validity and also for how researchers should weigh up the sum of psychometric evidence when choosing these measures. We argue that questions regarding judgment and understanding meaning of these measures should play a more central role in determining their adequacy. (shrink)

Patient-reported outcome measures (PROMs) are increasingly used to assess multiple facets of healthcare, including effectiveness, side effects of treatment, symptoms, health care needs, quality of care, and the evaluation of health care options. There are thousands of these measures and yet there is very little discussion of their theoretical underpinnings. In her 2008 Presidential address to the Society for Quality of Life Research (ISOQoL), Professor Donna Lamping challenged researchers to grapple with the theoretical issues that arise from these measures. In (...) this paper, I attempt to do so by arguing for an analogy between PROMs and Hans-Georg Gadamer’s logic of question and answer. While researchers readily admit that the constructs involved in PROMs are imperfectly understood and lack a gold standard, they often ignore the consequences of this fact. Gadamer’s work on questions and their importance to philosophical hermeneutics helps to show that the questions researchers ask about such constructs are also imperfectly understood. I argue that these questions should not be standardized, and I instead propose a theoretical framework that understands PROMs as posing genuine questions to respondents—questions that are open to reinterpretation. (shrink)

The use of quality of life (QOL) outcomes in clinical trials is increasing as a number of practical, ethical, methodological, and regulatory reasons for their use have become apparent. It is important, then, that QOL measurements and differences between QOL scores be readily interpretable. We study interpretation in two contexts: when determining QOL and when basing decisions on QOL differences. We consider both clinical situations involving individual patients and research contexts, e.g., randomized clinical trials, involving groups of patients. We note (...) the ethical importance of such understanding: proper interpretation and communication facilitate health care decision making. Communication that facilitates interpretation is of moral significance since better communication can attenuate ethical problems and inform choices. Much of what is communication worthy about QOL assessments is determined by the particular QOL instrument used in the assessment and how it is administered. In practice, these choices will be driven by the purpose of the assessment, but, it is argued, to maximize understanding, we should combine the information garnered from traditional standardized QOL instruments, from individualized QOL assessments, and from a recently proposed dialogic paradigm, where QOL is determined by shared conversation regarding the interpretation of texts. And, while some studies can surely succeed using abbreviated methods of administration (e.g., postal surveys may suffice for certain purposes), we will focus on methods of administration involving interviewer–respondent interaction. We suggest that during the QOL elicitation process, interviewer and respondent should engage in a two-way conversation in order to achieve a shared understanding of the “answers” to QOL “questions” and, finally, to reach a shared interpretation of the individual’s QOL. (shrink)

I examine the dynamics of measure development using two case studies: temperature, and health-related quality of life. I argue, following Bas van Fraassen and Leah McClimans that in each case these dynamics have a hermeneutic structure. Measure development is plagued by epistemic circularity, as is the task of interpreting a text, and similar strategies can be used in both measure development and hermeneutics to overcome that circularity. I show that Hans Georg Gadamer’s philosophical hermeneutics in particular are an effective lens (...) through which to examine the development of the temperature standard as described by Hasok Chang. Despite similar grounding in hermeneutics, I note an important difference between measure development for temperature and for health-related quality of life. Namely, while the meaning of temperature can be standardized, the meaning of health-related quality of life cannot. This standardization of meaning for the temperature concept represents a limit to the analogy with hermeneutics. Finally, I argue that the indeterminacy we find in health-related quality of life measurement is a result not only of analogy with the hermeneutic task, but of full-fledged participation in it. (shrink)