Scientists aim to remediate artifacts in their experimental datasets. However, the remediation of one artifact can result in another. Why might this happen, and what does this consequence tell us about how we should account for artifacts and their control? In this paper, I explore a case in functional neuroimaging where remediation appears to have caused this problem. I argue that remediation amounts to a change to an experimental arrangement. These changes need not be surgical, and the arrangement need not (...) satisfy the criterion of causal modularity. Thus, remediation can affect more than just the factor responsible for the artifact. However, if researchers can determine the consequences of their remediation, they can make adjustments that control for the present artifact as well as for previously controlled ones. Current philosophical accounts of artifacts and the factors responsible for them cannot adequately address this issue, as they do not account for what is needed for artifact remediation (and specifically correction). I support my argument by paralleling it with ongoing concerns regarding the transparency of complex computational systems, as near future remediation across the experimental life sciences will likely make greater use of AI tools to correct for artifacts. (shrink)

This paper critiques the new mechanistic explanatory program on grounds that, even when applied to the kinds of examples that it was originally designed to treat, it does not distinguish correct explanations from those that blunder. First, I offer a systematization of the explanatory account, one according to which explanations are mechanistic models that satisfy three desiderata: they must 1) represent causal relations, 2) describe the proper parts, and 3) depict the system at the right ‘level.’ Second, I argue that (...) even the most developed attempts to fulfill these desiderata fall short by failing to appropriately constrain explanatorily apt mechanistic models. -/- *This paper used to be called "The Emperor's New Mechanisms". (shrink)

When scientists seek further confirmation of their results, they often attempt to duplicate the results using diverse means. To the extent that they are successful in doing so, their results are said to be robust. This paper investigates the logic of such "robustness analysis" [RA]. The most important and challenging question an account of RA can answer is what sense of evidential diversity is involved in RAs. I argue that prevailing formal explications of such diversity are unsatisfactory. I propose a (...) unified, explanatory account of diversity in RAs. The resulting account is, I argue, truer to actual cases of RA in science; moreover, this account affords us a helpful, new foothold on the logic undergirding RAs. (shrink)

Willard van Orman Quine once said that he had a preference for a desert ontology. This was in an earlier day when concerns with logical structure and ontological simplicity reigned supreme. Ontological genocide was practiced upon whole classes of upper-level or ‘derivative’ entities in the name of elegance, and we were secure in the belief that one strayed irremediably into the realm of conceptual confusion and possible error the further one got from ontic fundamentalism. In those days, one paid more (...) attention to generic worries about possible errors than to actual errors derived from distancing oneself too far from the nitty-gritty details of actual theory, actual inferences from actual data, the actual conditions under which we posited and detected entities, calibrated and ‘burned in’ instruments, identified and rejected artifacts, debugged programs and procedures, explained the mechanisms behind regularities, judged correlations to be spurious, and in general, to the real complexities and richness of actual scientific practice. (shrink)

In psychiatry, pharmacological drugs play an important experimental role in attempts to identify the neurobiological causes of mental disorders. Besides being developed in applied contexts as potential treatments for patients with mental disorders, pharmacological drugs play a crucial role in research contexts as experimental instruments that facilitate the formulation and revision of neurobiological theories of psychopathology. This paper examines the various epistemic functions that pharmacological drugs serve in the discovery, refinement, testing, and elaboration of neurobiological theories of mental disorders. I (...) articulate this thesis with reference to the history of antipsychotic drugs and the evolution of the dopamine hypothesis of schizophrenia in the second half of the twentieth century. I argue that interventions with psychiatric patients through the medium of antipsychotic drugs provide researchers with information and evidence about the neurobiological causes of schizophrenia. This analysis highlights the importance of pharmacological drugs as research tools in the generation of psychiatric knowledge and the dynamic relationship between practical and theoretical contexts in psychiatry. (shrink)

Consensus conferences are social techniques which involve bringing together a group of scientific experts, and sometimes also non-experts, in order to increase the public role in science and related policy, to amalgamate diverse and often contradictory evidence for a hypothesis of interest, and to achieve scientific consensus or at least the appearance of consensus among scientists. For consensus conferences that set out to amalgamate evidence, I propose three desiderata: Inclusivity, Constraint, and Evidential Complexity. Two examples suggest that consensus conferences can (...) readily satisfy Inclusivity and Evidential Complexity, but consensus conferences do not as easily satisfy Constraint. I end by discussing the relation between social inclusivity and the three desiderata. (shrink)

Robustness is a common platitude: hypotheses are better supported with evidence generated by multiple techniques that rely on different background assumptions. Robustness has been put to numerous epistemic tasks, including the demarcation of artifacts from real entities, countering the “experimenter’s regress,” and resolving evidential discordance. Despite the frequency of appeals to robustness, the notion itself has received scant critique. Arguments based on robustness can give incorrect conclusions. More worrying is that although robustness may be valuable in ideal evidential circumstances (i.e., (...) when evidence is concordant), often when a variety of evidence is available from multiple techniques, the evidence is discordant. †To contact the author, please write to: Jacob Stegenga, Department of Philosophy, University of California, San Diego, 9500 Gilman Drive, La Jolla, CA 92093; e‐mail: [email protected]. (shrink)

Many philosophers have claimed that evidence for a theory is better when multiple independent tests yield the same result, i.e., when experimental results are robust. Little has been said about the grounds on which such a claim rests, however. The present essay presents an analysis of the evidential value of robustness that rests on the fallibility of assumptions about the reliability of testing procedures and a distinction between the strength of evidence and the security of an evidence claim. Robustness can (...) enhance the security of an evidence claim either by providing what I call second-order evidence, or by providing back-up evidence for a hypothesis. (shrink)

This article examines a metaphilosophical issue, namely existing disagreements in philosophy of science about the significance of using multiple means of determination in scientific practice. We argue that this disagreement can, in part, be resolved by separating different questions that can be asked about the use of multiple means of determination, including the following: what can be concluded from the convergence of data or the convergence of claims about phenomena? Are the conclusions drawn from the convergence of data and of (...) statements about phenomena of special importance to the debate about realism and antirealism? Do inferences based on multiple means of determination have stronger epistemic force than inferences that are secured in other ways? Is the epistemic goal of deploying multiple means of determination well entrenched within the scientific community? Most of these questions can be discussed both in a formal and in an empirical perspective. If the differences in perspective are taken into account, some disagreements can be easily resolved. In part, however, the disagreements reflect historiographical challenges that are very difficult, if not impossible to meet. (shrink)

ABSTRACT When scientists seek further confirmation of their results, they often attempt to duplicate the results using diverse means. To the extent that they are successful in doing so, their results are said to be ‘robust’. This article investigates the logic of such ‘robustness analysis’. The most important and challenging question an account of RA can answer is what sense of evidential diversity is involved in RAs. I argue that prevailing formal explications of such diversity are unsatisfactory. I propose a (...) unified, explanatory account of diversity in RAs. The resulting account is, I argue, truer to actual cases of RA in science; moreover, this account affords us a helpful new foothold on the logic undergirding RAs. 1Robustness Analysis in Science 2RA Diversity and Independence 2.1Unconditional probabilistic independence 2.2Reliability independence 2.3Confirmational and conditional independence 2.4Partial independence? 3Robustness Analysis as Explanatory Reasoning 3.1Explanatorily discriminating means of detection 3.2The logic of robustness analysis 3.2.1Mutually exclusive competitors 3.2.2Consistent epistemic competitors 4Conclusion Appendix. (shrink)

This essay offers some reflections on the recent history of the disputes about the relation between history and philosophy of science (HPS) and the merits and prospects of HPS as an intellectual endeavor. As everyone knows, the issue was hotly debated in the 1960s and 1970s. That was the hey-day of the slogan "history without philosophy of science is blind, philosophy without history of science is empty" as well as of the many variations on the theme of HPS as a (...) "marriage of convenience," "intimate relation," or "marriage for the sake of reason." There was a flurry of interest in the early 1990s, as evidenced by sections in the 1992 and 1994 issues of PSA, entitled: "Do the History of Science and the Philosophy of .. (shrink)

In a 1993 paper, I argued that empirical treatments of the epistemologyused by scientists in experimental work are too abstract in practice tocounter relativist efforts to explain the outcome of scientificcontroversies by reference to sociological forces. This was because, atthe rarefied level at which the methodology of scientists is treated byphilosophers, multiple mutually inconsistent instantiations of theprinciples described by philosophers are employed by contestingscientists. These multiple construals change within a scientificcommunity over short time frames, and these different versions ofscientific methodology (...) can determine the outcome of a controversy. Iillustrated with a comparatively detailed analysis of the methodologyused by biologists debating the existence of an entity called thebacterial mesosome between the mid-1950s and the mid-1970s. This 1993piece has drawn several critiques in the philosophical literature. Inthis present piece I respond to these critiques and argue that they failto address the core argument of the original paper, and I reflectfurther on the methodologies of philosophers of science pursuingempirical or `naturalistic' epistemology. (shrink)

There is currently a gap in our understanding of how figures produced by mechanical imaging techniques play evidential roles: several studies based on close examination of scientific practice show that imaging techniques do not yield data whose significance can simply be read off the image. If image-making technology is not a simple matter of nature re-presenting itself to us in a legible way, just how do the images produced provide support for scientific claims? In this article I will first show (...) that there is a distinct question about the semiotics of mechanically produced images that has not yet been answered. I show that my account of visual representations can do so, and I argue that the role of convention involved in my account is compatible with the view that visual representations produced through mechanized imaging techniques can play genuine evidential roles in scientific reasoning. (shrink)

An analysis is presented of published methods that have been used by experimenters to justify the reliability of the theory of invasion of microorganisms into cultured cells. The results show that, to demonstrate this invasion, many experimenters used two or more methods that were based on independent technical and theoretical principles, and by doing so improved the reliability of the theory. Subsequently I compare this strategy of 'multiple derivability' with other strategies, discussed in the literature in relation to the mesosome, (...) a bacterial organelle that had been detected with the electron microsope, but which appeared later to be an artifact. I propose that different strategies have been applied in this problem, and multiple derivability may have been the decisive one. Finally I discuss the idea that multiple derivability may help to anchor theories in a larger network of theories. (shrink)

A notion of experimental series is developed, in which experiments or experimental sets are connected through experimental suggestions arising from previous experimental outcomes. To that end, the justification of Howard Temin’s DNA provirus hypothesis is examined. The hypothesis originated with evidence from two exploratory experimental sets on an oncogenic virus and was substantiated by including evidence from three additional experimental sets. Collectively these sets comprise an experimental series and the accumulative evidence from the series was adequate to justify the hypothesis (...) by persuading the virology community of its veracity. The notion of crucial experiment is also discussed in terms of experimental series. (shrink)

A notion of experimental series is developed, in which experiments or experimental sets are connected through experimental suggestions arising from previous experimental outcomes. To that end, the justification of Howard Temin's DNA provirus hypothesis is examined. The hypothesis originated with evidence from two exploratory experimental sets on an oncogenic virus and was substantiated by including evidence from three additional experimental sets. Collectively these sets comprise an experimental series and the accumulative evidence from the series was adequate to justify the hypothesis (...) by persuading the virology community of its veracity. The notion of crucial experiment is also discussed in terms of experimental series. (shrink)

Robert Hudson’s book is a contribution to the recent debate on robustness analysis in scientific practice, with a specific focus on the empirical sciences. In this context, robustness analysis is defined as a way to increase the probability of a certain hypothesis by showing that the same result is obtained from several, alternative methods. The rationale underlying this practice is that it would be highly unlikely if different, independent means of observation provided the same wrong outcome.We do not believe in (...) miracles; hence, the probability of the initial hypothesis being true increases if the same result occurs across conditions.Simple as this notion sounds, according to Hudson, the various attempts that have been offered in the literature to formalize it have proved to be unsuccessful. Hudson’s skeptical argument is formulated at the outset of the book and illustrated throughout by means of several episodes from the recent history of science, mainly from physics and biology. Met .. (shrink)

This discussion centers on two desiderata: the role of measurement in information-gathering and physical interaction in scientific practice. By taking inspiration from van Fraassen’s view, we present a methodological account of perspectival measurement that addresses empirical practice where there is complex intervention, disagreeing results, and limited theory. The specific aim of our account is to provide a methodological prescription for developing measurement processes in the context of limited theory. The account should be useful to philosophers of science, who are interested (...) in the intersection between representation and intervention; scientists, who are interested in methodological suggestions for theory-development and reliability; and interdisciplinary researchers, who are interested in the intersections between the pandemic, built environments, and social processes. We apply the process-view of measurement to COVID-19, specifically, measuring replication in the SARS-CoV-2 virus. The aim is to show that our account tracks key elements—manipulation/intervention, independence, invariance, and theory-development—by organizing unfolding measurement processes. Additionally, we use our account to make prescriptive suggestions for measurement practice in the COVID-19 context by discussing the need to broaden measurement perspective on interaction, manipulation, and production. (shrink)

In experimental settings, scientists often “make” new things, in which case the aim is to intervene in order to produce experimental objects and processes—characterized as ‘effects’. In this discussion, I illuminate an important performative function in measurement and experimentation in general: intervention-based experimental production (IEP). I argue that even though the goal of IEP is the production of new effects, it can be informative for causal details in scientific representations. Specifically, IEP can be informative about causal relations in: regularities under (...) study; ‘intervention systems’, which are measurement/experimental systems; and new technological systems. (shrink)

In experimental settings, scientists often “make” new things, in which case the aim is to intervene in order to produce experimental objects and processes—characterized as ‘effects’. In this discussion, I illuminate an important performative function in measurement and experimentation in general: intervention-based experimental production. I argue that even though the goal of IEP is the production of new effects, it can be informative for causal details in scientific representations. Specifically, IEP can be informative about causal relations in: regularities under study; (...) ‘intervention systems’, which are measurement/experimental systems; and new technological systems. (shrink)

In the philosophical literature concerning scientific experimentation, the notion of robustness has been solely discussed in relation to experimental results. In this paper, I propose a novel sense of experimental robustness that applies to experimental procedures. I call the foregoing sense of robustness procedure robustness and characterize it as the capacity of an experimental procedure to maintain its intended function invariant during the experimental process despite possible variations in its inputs. I argue that PR is a precondition for what I (...) call result robustness, which refers to the traditional sense of experimental robustness, namely the existence of convergent experimental results obtained through different and independent means of detection. Furthermore, I argue, PR and RR constitute useful experimental strategies in the context of high-energy physics experiments, but these strategies are not without limitations. (shrink)

The goal of this paper is to defend the claim that there is such a thing as direct perception, where by ‘direct perception’ I mean perception unmediated by theorizing or concepts. The basis for my defense is a general philosophic perspective which I call ‘empiricist philosophy’. In brief, empiricist philosophy (as I have defined it) is untenable without the occurrence of direct perception. It is untenable without direct perception because, otherwise, one can't escape the hermeneutic circle, as this phrase is (...) used in van Fraassen (1980). The bulk of the paper is devoted to defending my belief in direct perception against various objections that can be posed against it. I discuss various anticipations of my view found in the literature, eventually focusing on Ian Hacking's related conception of `entity realism' (Hacking 1983). Hacking has been criticized by a number of philosophers and my plan is to respond to these criticisms on behalf of entity realism (or more precisely on behalf of the claim that direct perception is a reality) and to then respond to other possible criticisms that can be launched against direct perception. (shrink)

The concordance of results that are “robust” across multiple scientific modalities is widely considered to play a critical role in the epistemology of science. But what should we make of those cases where such multimodal evidence is discordant? Jacob Stegenga has recently argued that robustness is “worse than useless” in these cases, suggesting that “different kinds of evidence cannot be combined in a coherent way.” In this article I respond to this critique and illustrate the critical methodological role that robustness (...) plays as an aim of scientific inquiry. (shrink)

Throughout his career David Hull has sought to bring the philosophy of science into closer contact with science and especially with biological science (Hull 1969, 1997b). This effort has taken many forms. Sometimes it has meant ‘either explaining basic biology to philosophers or explaining basic philosophy to biologists’ (Hull 1996, p. 77). The first of these tasks, simple as it sounds, has been responsible for revolutionary changes. It is well known that traditional philosophy of science, modeled as it was on (...) theoretical physics, proved inadequate when philosophers turned their attention to biological science. Biological examples have driven major revisions of accounts of reduction (Hull 1974; Schaffner 1993, Ch. 9), laws of nature (Beatty et al. 1997), theories (Lloyd 1988) and natural kinds (Wilson 1999, Part III). Nor is explaining basic philosophy to biologists a task to be looked down upon. It is useful, not because philosophy has all the answers, but because scientists must think about how to do science, that is doing philosophy of science and scientists frequently reinvent philosophical views with known flaws. Early in his career Hull found biological systematists in the grip of a crude operationalism about scientific concepts and said so in the pages of Systematic Zoology (Hull 1968). For the next thirty years, as biologists debated the nature of species and the correct principles of classification, Hull added a philosophical note at the same congresses and in the same journals (Hull 1970, 1976, 1980, 1997a, 1999). (shrink)

When a technique purports to provide information that is not available to the unaided senses, it is natural to think that the only way to validate that technique is by appealing to a theory of the processes that lead from the object of study to the raw data. In fact, scientists have a variety of strategies for validating their techniques. Those strategies can yield multiple independent arguments that support the validity of the technique. Thus, it is possible to produce a (...) robust body of data with a single technique. I illustrate and support these claims with a historical case study. *Received September 2009; revised October 2009. †To contact the author, please write to: Department of History and Philosophy of Science, 1017 Cathedral of Learning, University of Pittsburgh, Pittsburgh, PA 15260; e‐mail: [email protected]. (shrink)

The last two decades have seen a rising interest in (a) the notion of a scientific phenomenon as distinct from theories and data, and (b) the intricacies of experimentally producing and stabilizing phenomena. This paper develops an analysis of the stabilization of phenomena that integrates two aspects that have largely been treated separately in the literature: one concerns the skills required for empirical work; the other concerns the strategies by which claims about phenomena are validated. I argue that in order (...) to make sense of the process of stabilization, we need to distinguish between two types of phenomena: phenomena as patterns in the data ( surface regularities ) and phenomena as underlying (or hidden ) regularities. I show that the epistemic relationships that data bear to each of these types of phenomena are different: Data patterns are instantiated by individual data, whereas underlying regularities are indicated by individual data, insofar as they instantiate a data pattern. Drawing on an example from memory research, I argue that neither of these two kinds of phenomenon can be stabilized in isolation. I conclude that what is stabilized when phenomena are stabilized is the fit between surface regularities and hidden regularities. (shrink)

Robustness is often presented as a guideline for distinguishing the true or real from mere appearances or artifacts. Most of recent discussions of robustness have focused on the kind of derivational robustness analysis introduced by Levins, while the related but distinct idea of robustness as multiple accessibility, defended by Wimsatt, has received less attention. In this paper, I argue that the latter kind of robustness, when properly understood, can provide justification for ontological commitments. The idea is that we are justified (...) in believing that things studied by science are real insofar as we have robust evidence for them. I develop and analyze this idea in detail, and based on concrete examples show that it plays an important role in science. Finally, I demonstrate how robustness can be used to clarify the debate on scientific realism and to formulate new arguments. (shrink)

The dominant neuroscientific theory of spatial memory is, like many theories in neuroscience, a multilevel description of a mechanism. The theory links the activities of molecules, cells, brain regions, and whole organisms into an integrated sketch of an explanation for the ability of organisms to navigate novel environments. Here I develop a taxonomy of interlevel experimental strategies for integrating the levels in such multilevel mechanisms. These experimental strategies include activation strategies, interference strategies, and additive strategies. These strategies are mutually reinforcing, (...) providing a kind of interlevel and intratheoretic robustness that has not previously been recognized. (shrink)

The French physicist Jean Baptiste Perrin is widely credited with providing the conclusive argument for atomism. The most well-known part of Perrin’s argument is his description of thirteen different procedures for determining Avogadro’s number (N)–the number of atoms, ions, and molecules contained in a gram-atom, gram-ion, and gram-mole of a substance, respectively. Because of its success in ending the atomism debates Perrin’s argument has been the focus of much philosophical interest. The various philosophers, however, have reached different conclusions, not only (...) about the argument’s general rationale but also the role that the multiple determination of N played in it. This paper emphasizes the historical development of Perrin’s experimental work in order to understand the role that the multiple determination of molecular magnitudes played in his argument for molecular reality. It claims that Perrin used the multiple determination strategy to put forward an exceptionally strong no-coincidence argument to argue for both the correctness of the values for the molecular magnitudes determined and the validity of the auxiliary assumptions upon which the different determinations were based. The historicist approach also allows the identification of the elements responsible for the epistemic strength of Perrin’s no-coincidence argument. (shrink)

This article explores Michael Faraday’s “Historical Sketch of Electro‐Magnetism” as a fruitful source for understanding the epistemic significance of experimentation. In this work Faraday provides a catalog of the numerous experimental and theoretical developments in the early history of electromagnetism. He also describes methods that enable experimentalists to dissociate experimental results from the theoretical commitments generating their research. An analysis of the methods articulated in this sketch is instructive for confronting epistemological worries about the theory‐dependence of experimentation. †To contact the (...) author, please write to: 10289 Saint Katherine Lane, Saint Ann, MO 63074; e‐mail: [email protected]. (shrink)

Economists reason causally. Like many other scientists, they aim at formulating justified causal claims about their object of study. This thesis contributes to our understanding of how causal reasoning proceeds in economics. By using the research on the causes of unemployment as a case study, three questions are adressed. What are the meanings of causal claims? How can a causal claim be adequately supported by evidence? How are causal beliefs affected by incoming facts? In the process of answering these semantic, (...) epistemic and dynamical questions, the richness of causal reasoning in economics is brought to the foreground. In the part on semantics, it is argued that the meaning of causal generalizations in policy-oriented economics is best captured by using the concept of ‘inferential relation’ rather than the one of ‘referential relation’. This part contributes to develop an inferentialist semantics by distinguishing among types of inferential relations. In the part on epistemology, it is argued that justification in sciences like economics often relies, and ought to rely, on evidential variety―i.e. the combination of evidence from multiple sources. An interpretation of independence among evidential sources is offered: two evidential sources are fully independent if and only if the reasons why they would be unreliable do not overlap. It is then shown that the variety-of-evidence thesis does not hold under extreme circumstances. The part on dynamics focuses on deviant-case study. A storyline is provided for what deviant-case study aims at and how it proceeds in what is characterized as an ‘eclectic science’. (shrink)

Philosophers of science turned to historical case studies in part in response to Thomas Kuhn's insistence that such studies can transform the philosophy of science. In this issue Joseph Pitt argues that the power of case studies to instruct us about scientific methodology and epistemology depends on prior philosophical commitments, without which case studies are not philosophically useful. Here I reply to Pitt, demonstrating that case studies, properly deployed, illustrate styles of scientific work and modes of argumentation that are not (...) well handled by currently standard philosophical analyses. I illustrate these claims with exemplary findings from case studies dealing with exploratory experimentation and with interdisciplinary cooperation across sciences to yield multiple independent means of access to theoretical entities. The latter cases provide examples of ways that scientists support claims about theoretical entities that are not available in work performed within a single discipline. They also illustrate means of correcting systematic biases that stem from the commitments of each discipline taken separately. These findings illustrate the transformative power of case study methods, allow us to escape from the horns of Pitt's "dilemma of case studies," and vindicate some of the post-Kuhn uses to which case studies have been put. (shrink)

This article sketches the main features of traditional philosophical models of evidence, indicating idealizations in such models that it regards as doing more harm than good. It then proceeds to elaborate on an alternative model of evidence that is functionalist, complex, dynamic, and contextual, a view the author calls dynamic evidential functionalism (DEF). This alternative builds on insights from philosophy of scientific practice, Kuhnian philosophy of science, pragmatist epistemology, philosophy of experimentation, and functionalist philosophy of mind. Along the way, the (...) article raises concerns about the total evidence condition, requirements of certainty or incorrigibility on evidence, and accounts that restrict the type of things that can serve as evidence (to, for example, sense data, facts about particulars). DEF can also help us see the special value of novel predictions and experiments as evidence, as well as help us think about how to critically evaluate the putative evidence to determine whether it is evidence. (shrink)

Multidisciplinary models aggregating ‘lower-level’ biological and ‘higher-level’ psychological and social determinants of a phenomenon raise a puzzle. How is the interaction between the physical, the psychological and the social conceptualized and explained? Using biopsychosocial models of pain as an illustration, I argue that these models are in fact level-neutral compilations of empirical findings about correlated and causally relevant factors, and as such they neither assume, nor entail a conceptual or ontological stratification into levels of description, explanation or reality. If inter-level (...) causation is deemed problematic or if debates about the superiority of a particular level of description or explanation arise, these issues are fueled by considerations other than empirical findings. (shrink)

Multidisciplinary models aggregating ‘lower-level’ biological and ‘higher-level’ psychological and social determinants of a phenomenon raise a puzzle. How is the interaction between the physical, the psychological and the social conceptualized and explained? Using biopsychosocial models of pain as an illustration, I argue that these models are in fact level-neutral compilations of empirical findings about correlated and causally relevant factors, and as such they neither assume, nor entail a conceptual or ontological stratification into levels of description, explanation or reality. If inter-level (...) causation is deemed problematic or if debates about the superiority of a particular level of description or explanation arise, these issues are fueled by considerations other than empirical findings. (shrink)

In the 1950s–60s biochemists searched intensively for a series of high-energy molecules in the cell. Although we now believe that these molecules do not exist, biochemists claimed to have isolated or identified them on at least sixteen occasions. The episode parallels the familiar eighteenth-century case of phlogiston, in illustrating how error is not simply the loss of facts but, instead, must be actively constructed. In addition, the debates surrounding each case demonstrate how revolutionary-scale disagreement is sometimes resolved by differentiating or (...) partitioning empirical domains, rather than by replacement of one theory by another. (shrink)

It is a widely shared view among philosophers of science that the theory-dependence (or theory-ladenness) of observations is worrying, because it can bias empirical tests in favour of the tested theories. These doubts are taken to be dispelled if an observation is influenced by a theory independent of the tested theory and thus circularity is avoided, while (partially) circular tests are taken to require special attention. Contrary to this consensus, it is argued that the epistemic value of theory-dependent tests has (...) nothing to do with the circularity or non-circularity of the test, but is instead based on the minimal empiricality and reliability of observations. Since theory-dependence does not in general prevent observations fulfilling these requirements, it should not be regarded as a phenomenon that is basically detrimental, but as neutral with respect to successful scientific knowledge gathering. (shrink)

In robustness analysis, hypotheses are supported to the extent that a result proves robust, and a result is robust to the extent that we detect it in diverse ways. But what precise sense of diversity is at work here? In this paper, I show that the formal explications of evidential diversity most often appealed to in work on robustness – which all draw in one way or another on probabilistic independence – fail to shed light on the notion of diversity (...) relevant to robustness analysis. I close by briefly outlining a promising alternative approach inspired by Horwich’s (1982) eliminative account of evidential diversity. (shrink)

Policy-makers face an uncertain world. One way of getting a handle on decision-making in such an environment is to rely on evidence. Despite the recent increase in post-fact figures in politics, evidence-based policymaking takes centre stage in policy-setting institutions. Often, however, policy-makers face large volumes of evidence from different sources. Robustness analysis can, prima facie, handle this evidential diversity. Roughly, a hypothesis is supported by robust evidence if the different evidential sources are in agreement. In this thesis, I strengthen the (...) case for the use of robustness analysis in evidence-based policymaking by answering open research questions about this inference technique. First, I argue that existing taxonomies miss a fruitful category of robustness reasoning, that is predictive stability. Second, I claim that derivational robustness analysis – the investigation of whether the results of different models are in agreement – can yield interesting insights even if not the entire relevant model space is covered by available models or if the model results are only partially in agreement. Third, I claim that expert knowledge is necessary to address questions that arise when one applies measurement robustness analysis – the investigation into whether multiple means of measurement yield the same result. Finally, I argue that, in situations where evidence from different measurements is not in agreement, it can be advisable to no longer take all of the evidence into account. This can be done in a rationally defensible way by choosing the most adequate theory or model underlying parts of the evidence set. I discuss examples from climate, medical, and economic policy-making to establish my claims. (shrink)

In the first half of this dissertation, I develop a heuristic methodology for analyzing scientific solutions to the problem of underdetermination. Heuristics are rough-and-ready procedures used by scientists to construct models, design experiments, interpret evidence, etc. But as powerful as they are, heuristics are also error-prone. Therefore, I argue that they key to prudently using a heuristic is the articulation of meta-heuristics---guidelines to the kinds of problems for which a heuristic is well- or ill-suited. Given that heuristics will introduce certain (...) errors into our scientific investigations, I emphasize the importance of a particular category of meta-heuristics involving the search for robust evidence. Robustness is understood to be the epistemic virtue bestowed by agreement amongst multiple modes of determination. The more modes we have at our disposal, and the more these confirm the same result, the more confident can we be that a result is not a mere artifact of some heuristic simplification. Through an analysis of case-studies in the philosophy of biology and clinical trials, I develop a principled method for modeling and evaluating heuristics and robustness claims in a qualitative problem space. The second half of the dissertation deploys the heuristic methodology to address ethical and epistemological issues in the science of clinical trials. To that end, I develop a network model for the problem space of clinical research, capable of representing the various kinds of experiments, epistemic relationships, and ethical justifications intrinsic to the domain. I then apply this model to ongoing research with the antibacterial agent, moxifloxacin, for the treatment of tuberculosis, tracking its development from initially successful and promising in vitro and animal studies to its disappointing and discordant performance across five human efficacy trials. Given this failure to find a robust result with moxifloxacin across animal and human studies, what should researchers now do? While my final analysis of this case does not definitively answer that question, I demonstrate how my methodology, unlike a statistical meta-analysis, helps to clarify the directions for further research. (shrink)

In biomedical measurement, biomarkers are used to achieve reliable prediction of, and useful causal information about patient outcomes while minimizing complexity of measurement, resources, and invasiveness. A biomarker is an assayable metric that discloses the status of a biological process of interest, be it normative, pathophysiological, or in response to intervention. The greatest utility from biomarkers comes from their ability to help clinicians (and researchers) make and evaluate clinical decisions. In this paper we discuss a specific methodological use of clinical (...) biomarkers in pharmacological measurement: Some biomarkers, called ‘surrogate markers’, are used to substitute for a clinically meaningful endpoint corresponding to events and their penultimate risk factors. We confront the reliability of clinical biomarkers that are used to gather information about clinically meaningful endpoints. Our aim is to present a systematic methodology for assessing the reliability of multiple surrogate markers (and biomarkers in general). To do this we draw upon the robustness analysis literature in the philosophy of science and the empirical use of clinical biomarkers. After introducing robustness analysis we present two problems with biomarkers in relation to reliability. Next, we propose an intervention-based robustness methodology for organizing the reliability of biomarkers in general. We propose three relevant conditions for a robust methodology for biomarkers: (R1) Intervention-based demonstration of partial independence of modes: In biomarkers partial independence can be demonstrated through exogenous interventions that modify a process some number of “steps” removed from each of the markers. (R2) Comparison of diverging and converging results across biomarkers: By systematically comparing partially-independent biomarkers we can track under what conditions markers fail to converge in results, and under which conditions they successfully converge. (R3) Information within the context of theory: Through a systematic cross-comparison of the markers we can make causal conclusions as well as eliminate competing theories. We apply our robust methodology to currently developing Alzheimer’s research to show its usefulness for making causal conclusions. (shrink)