Despite the fact that reproduction of experiments by peers has traditionally been regarded as of the utmost importance in enabling the intersubjectivity of scientific practice, reproductions may yield discordant results and deciding which result should be favored may not be an easy task. According to Harry Collins, experimental disagreement is resolved by the action of social, political and economic factors, but not by means of epistemic and scientific, or so-called internal reasons. His motivation for such a claim is the presence (...) of an infinite regress at the core of experimental activity that, according to him, cannot be stopped with scientific resources alone: the experimenters’ regress. The goal of this... (shrink)

The historical debate on representation in cognitive science and neuroscience construes representations as theoretical posits and discusses the degree to which we have reason to posit them. We reject the premise of that debate. We argue that experimental neuroscientists routinely observe and manipulate neural representations in their laboratory. Therefore, neural representations are as real as neurons, action potentials, or any other well-established entities in our ontology.

Debiasing procedures are experimental methods aimed at correcting errors arising from the cognitive biases of the experimenter. We discuss two of these methods, the predesignation rule and randomization, showing to what extent they are open to the experimenter’s regress: there is no metarule to prove that, after implementing the procedure, the experimental data are actually free from biases. We claim that, from a contractarian perspective, these procedures are nonetheless defensible since they provide a warrant of the impartiality of the experiment: (...) we only need proof that the result has not been intentionally manipulated for prima facie acceptance. (shrink)

Consensus conferences are social techniques which involve bringing together a group of scientific experts, and sometimes also non-experts, in order to increase the public role in science and related policy, to amalgamate diverse and often contradictory evidence for a hypothesis of interest, and to achieve scientific consensus or at least the appearance of consensus among scientists. For consensus conferences that set out to amalgamate evidence, I propose three desiderata: Inclusivity, Constraint, and Evidential Complexity. Two examples suggest that consensus conferences can (...) readily satisfy Inclusivity and Evidential Complexity, but consensus conferences do not as easily satisfy Constraint. I end by discussing the relation between social inclusivity and the three desiderata. (shrink)

Robustness is a common platitude: hypotheses are better supported with evidence generated by multiple techniques that rely on different background assumptions. Robustness has been put to numerous epistemic tasks, including the demarcation of artifacts from real entities, countering the “experimenter’s regress,” and resolving evidential discordance. Despite the frequency of appeals to robustness, the notion itself has received scant critique. Arguments based on robustness can give incorrect conclusions. More worrying is that although robustness may be valuable in ideal evidential circumstances (i.e., (...) when evidence is concordant), often when a variety of evidence is available from multiple techniques, the evidence is discordant. †To contact the author, please write to: Jacob Stegenga, Department of Philosophy, University of California, San Diego, 9500 Gilman Drive, La Jolla, CA 92093; e‐mail: [email protected]. (shrink)

I describe two traditions of philosophical accounts of evidence: one characterizes the notion in terms of signs of success, the other characterizes the notion in terms of conditions of success. The best examples of the former rely on the probability calculus, and have the virtues of generality and theoretical simplicity. The best examples of the latter describe the features of evidence which scientists appeal to in practice, which include general features of methods, such as quality and relevance, and general features (...) of evidence, such as patterns in data, concordance with other evidence, and believability of the evidence. Two infamous episodes from biomedical research help to illustrate these features. Philosophical characterization of these latter features—conditions of success—has the virtue of potential relevance to, and descriptive accuracy of, practices of experimental scientists. (shrink)

Some accounts of evidence regard it as an objective relationship holding between data and hypotheses, perhaps mediated by a testing procedure. Mayo’s error-statistical theory of evidence is an example of such an approach. Such a view leaves open the question of when an epistemic agent is justified in drawing an inference from such data to a hypothesis. Using Mayo’s account as an illustration, I propose a framework for addressing the justification question via a relativized notion, which I designate security , (...) meant to conceptualize practices aimed at the justification of inferences from evidence. I then show how the notion of security can be put to use by showing how two quite different theoretical approaches to model criticism in statistics can both be viewed as strategies for securing claims about statistical evidence. (shrink)

: This paper explores the calibration of laboratory models in population genetics as an experimental strategy for justifying experimental results and claims based upon them following Franklin (1986, 1990) and Rudge (1996, 1998). The analysis provided undermines Coyne et al.'s (1997) critique of Wade and Goodnight's (1991) experimental study of Wright's (1931, 1932) Shifting Balance Theory. The essay concludes by further demonstrating how this analysis bears on Diamond's (1986) claims regarding the weakness of laboratory experiments as evidence, and further how (...) the calibration strategy fits within Lloyd's (1987, 1988) account of the confirmation of ecological and evolutionary models. (shrink)

In this paper, I discuss the discovery of the DNA structure by Francis Crick and James Watson, which has provoked a large historical literature but has yet not found entry into philosophical debates. I want to redress this imbalance. In contrast to the available historical literature, a strong emphasis will be placed upon analysing the roles played by theory, model, and evidence and the relationship between them. In particular, I am going to discuss not only Crick and Watson's well-known model (...) and Franklin's x-ray diffraction pictures (the evidence) but also the less well known theory of helical diffraction, which was absolutely crucial to Crick and Watson's discovery. The insights into this groundbreaking historical episode will have consequences for the ‘new’ received view of scientific models and their function and relationship to theory and world. The received view, dominated by works by Cartwright and Morgan and Morrison ([1999]), rather than trying to put forth a ‘theory of models’, is interested in questions to do with (i) the function of models in scientific practice and (ii) the construction of models. In regard to (i), the received view locates the model (as an idealized, simplified version of the real system under investigation) between theory and the world and sees the model as allowing the application of the former to the latter. As to (ii) Cartwright has argued for a phenomenologically driven view and Morgan and Morrison ([1999]) for the ‘autonomy’ of models in the construction process: models are determined neither by theory nor by the world. The present case study of the discovery of the DNA structure strongly challenges both (i) and (ii). In contrast to claim (i) of the received view, it was not Crick and Watson's model but rather the helical diffraction theory which served a mediating purpose between the model and the x-ray diffraction pictures. In particular, Cartwright's take on (ii) is refuted by a comparison of Franklin's bottom-up approach with Crick and Watson's top-down approach in constructing the model. The former led to difficulties, which only a strong confidence in the structure incorporated in the model could circumvent. How to Get to the Structure 1.1 X-ray diffraction and its synthesis 1.2 Model building and Pauling's panache 1.3 The structure of proteins 1.3.1 A failed inference to the best explanation 1.3.2 The misleading 5.1 Å spot in proteins and how to get rid of it 1.3.3 Derived predictions from Pauling's alpha-helix of protein molecules The CCV Theory of Helical X-Ray Diffraction 2.1 The role of the CCV theory in the discovery of the DNA structure Killing the Helix 3.1 Appreciating all evidence—in vain Conclusion Epilogue: Chargaff's Ratios CiteULike Connotea Del.icio.us What's this? (shrink)

In a widely received paper on theory choice, Kuhn made three central claims. First, as a matter of empirical fact, different theories tend to score differently with regard to what Kuhn considered to be the standard set of theoretical virtues, i.e., empirical accuracy, internal and external consistency, scope, simplicity, and fertility. Whereas some theories will for instance be more empirically accurate than others, other theories will have greater external coherence with our background theories. Second, hardly ever does a theory’s being (...) virtuous in one particular respect legitimize a choice for that theory—not even when that virtue is empirical accuracy. Third, following from the first two .. (shrink)

: For philosophers of science interested in elucidating the social character of science, an important question concerns the manner in which and degree to which the objectivity of scientific knowledge is socially constituted. We address this broad question by focusing specifically on philosophical theories of evidence. To get at the social character of evidence, we take an interdisciplinary approach informed by categories from argumentation studies. We then test these categories by exploring their applicability to a case study from high-energy physics. (...) Our central claim is that normative philosophy of science must move beyond abstract theories of justification, confirmation, or evidence conceived impersonally and incorporate a theoretical perspective that includes dialogical elements, either as adjuncts to impersonal theories of evidence or as intrinsic to the cogency of scientific argumentation. (shrink)

Allan Franklin has identified a number of strategies that scientists use to build confidence in experimental results. This paper shows that Franklin's strategies have direct analogues in the context of computer simulation and then suggests that one of his strategies—the so-called 'Sherlock Holmes' strategy—deserves a privileged place within the epistemologies of experiment and simulation. In particular, it is argued that while the successful application of even several of Franklin's other strategies (or their analogues in simulation) may not be sufficient for (...) justified belief in results, the successful application of a slightly elaborated version of the Sherlock Holmes strategy is sufficient. (shrink)

Many philosophers have worried about what philosophy is. Often they have looked for answers by considering what it is that philosophers do. Given the diversity of topics and methods found in philosophy, however, we propose a different approach. In this article we consider the philosophical temperament, asking an alternative question: what are philosophers like? Our answer is that one important aspect of the philosophical temperament is that philosophers are especially reflective: they are less likely than their peers to embrace what (...) seems obvious without questioning it. This claim is supported by a study of more than 4,000 philosophers and non-philosophers, the results of which indicate that even when we control for overall education level, philosophers tend to be significantly more reflective than their peers. We then illustrate this tendency by considering what we know about the philosophizing of a few prominent philosophers. Recognizing this aspect of the philosophical temperament, it is natural to wonder how philosophers came to be this way: does philosophical training teach reflectivity or do more reflective people tend to gravitate to philosophy? We consider the limitations of our data with respect to this question and suggest that a longitudinal study be conducted. (shrink)

In the philosophical literature concerning scientific experimentation, the notion of robustness has been solely discussed in relation to experimental results. In this paper, I propose a novel sense of experimental robustness that applies to experimental procedures. I call the foregoing sense of robustness procedure robustness and characterize it as the capacity of an experimental procedure to maintain its intended function invariant during the experimental process despite possible variations in its inputs. I argue that PR is a precondition for what I (...) call result robustness, which refers to the traditional sense of experimental robustness, namely the existence of convergent experimental results obtained through different and independent means of detection. Furthermore, I argue, PR and RR constitute useful experimental strategies in the context of high-energy physics experiments, but these strategies are not without limitations. (shrink)

In this paper, I propose an account that accommodates the possibility of experimentation being exploratory in cases where the procedures necessary to plan and perform an experiment are dependent on the theoretical accounts of the phenomena under investigation. The present account suggests that experimental exploration requires the implementation of an exploratory procedure that serves to extend the range of possible outcomes of an experiment, thereby enabling it to pursue its objectives. Furthermore, I argue that the present account subsumes the notion (...) of exploratory experimentation, which is often attributed in the relevant literature to the works of Friedrich Steinle and Richard Burian, as a particular type of experimental exploration carried out in the special cases where no well-formed theoretical framework of the phenomena under investigation exists. I illustrate the present account in the context of the ATLAS experiment at CERN’s Large Hadron Collider, where the long-sought Higgs boson has been discovered in 2012. I argue that the data selection procedure carried out in the ATLAS experiment illustrates an exploratory procedure in the sense suggested by the present account. I point out that this particular data selection procedure is theory-laden in that its implementation is crucially dependent on the theoretical models of high energy particle physics which the ATLAS experiment is aimed to test. However, I argue that the foregoing procedure is not driven by the above-mentioned theoretical models, but rather by a particular data selection strategy. I conclude that the ATLAS experiment illustrates that, contrary to what previous studies have suggested, there are cases of experimentation in which exploration serves to test theoretical predictions and that theory-ladenness plays an essential role in experimentation being exploratory. (shrink)

The 2011 Nobel Prize in Physics was awarded to researchers from the Supernova Cosmology Project and the High-z Supernova Search Team for the discovery of the accelerating expansion of the universe. In this paper, I provide a historical analysis of the supernova cosmology evidence put forward by these teams for the accelerating universe, in terms of an iterative model of scientific progress developed by Hasok Chang in the context of his study of the development of measurement standards. I argue, using (...) the key concept of epistemic iteration, that the iterative model adequately accounts for evidence production in experimental science as well. In order to apply Chang’s model to the experimental evidence for the accelerating universe, I introduce the concept of endorsement as a particular mode of progress, and argue that supernova scientists produced an endorsed measurement system to claim evidence for their discovery. Furthermore, I show that the credibility of the evidence was not based on a particular measurement, rather, what proved to be decisive was the “robust consistency” of many individual results. (shrink)

Theory-ladenness is the view that observation cannot function in an unbiased way in the testing of theories because observational judgments are affected by the theoretical beliefs of the observer. Its more radical cousin, incommensurability, argues that because there is no theory-neutral language, paradigms, or worldviews, cannot be compared because in different paradigms the meaning of observational terms is different, even when the word used is the same. There are both philosophical and practical components to these problems. I argue, using a (...) procedurally-defined, theory-neutral experiment that paradigms are indeed commensurable. The practical problems of theory ladenness include experimental design, failure to interpret observations correctly, possible experimenter bias, and difficulties in data acquisition. I suggest that there are methods to deal with these problems, although sometimes they cannot be dealt with completely. I believe that the philosophical problems of theory-ladenness have been solved, although the practical problems remain. (shrink)

The missing piece of the puzzle: the discovery of the Higgs boson On July 4, 2012 the CMS and ATLAS collaborations at the large hadron collider jointly announced the discovery of a new elementary particle, which resembled the Higgs boson, the last remaining undiscovered piece of the standard model of elementary particles. Both groups claimed to have observed a five-standard-deviation effect above background, the gold standard for discovery in high-energy physics. In this essay I will briefly discuss the how the (...) CMS collaboration performed the experiment and analyzed the data. I will also show the experimental results. (shrink)

: Where there are cases of underdetermination in scientific controversies, such as the case of the molecular clock, scientists may direct the course and terms of dispute by playing off the multidimensional framework of theory evaluation. This is because assessment strategies themselves are underdetermined. Within the framework of assessment, there are a variety of trade-offs between different strategies as well as shifting emphases as specific strategies are given more or less weight in assessment situations. When a strategy is underdetermined, scientists (...) can change the dynamics of a controversy by making assessments using different combinations of evaluation strategies and/or weighting whatever strategies are in play in different ways. Following an underdetermination strategy does not end or resolve a scientific dispute. Consequently, manipulating underdetermination is a feature of controversy dynamics and not controversy closure. (shrink)

Multiple determination is the epistemic strategy of establishing the same result by means of multiple, independent procedures. It is an important strategy praised by both philosophers of science and practicing scientists. Despite the heavy appeal to multiple determination, little analysis has been provided regarding the specific grounds upon which its epistemic virtues rest. This article distinguishes between the various dimensions of multiple determination and shows how they can be used to evaluate the epistemic force of the strategy in particular cases. (...) Distinguishing between the various dimensions helps to resolve the disagreements regarding the relevance and epistemic import of multiple determination for scientific research. It also suggests a fruitful mode of interaction between the philosophy of science and (historical) accounts of scientific practice. (shrink)

This article sketches the main features of traditional philosophical models of evidence, indicating idealizations in such models that it regards as doing more harm than good. It then proceeds to elaborate on an alternative model of evidence that is functionalist, complex, dynamic, and contextual, a view the author calls dynamic evidential functionalism (DEF). This alternative builds on insights from philosophy of scientific practice, Kuhnian philosophy of science, pragmatist epistemology, philosophy of experimentation, and functionalist philosophy of mind. Along the way, the (...) article raises concerns about the total evidence condition, requirements of certainty or incorrigibility on evidence, and accounts that restrict the type of things that can serve as evidence (to, for example, sense data, facts about particulars). DEF can also help us see the special value of novel predictions and experiments as evidence, as well as help us think about how to critically evaluate the putative evidence to determine whether it is evidence. (shrink)

This paper proposes a set of criteria for an appropriate experiment on the issue of the theory ladenness of perception. These criteria are used to select a number of experiments that use: belief-based ambiguous figures, fragmented figures, or memory color. Crucially, the data in experiments of this type are based on the participant’s qualitative visual experience. Across many different types of experimental designs, different types of stimuli, and different types of belief manipulation, these experiments show the impact of belief/theory on (...) visual perception. Using an ecological validity argument, I conclude that attention-based interpretations of these findings are not successful because the relevant epistemological issues only require that we examine final perception, in the sense of visual awareness of the everyday world. Finally, I argue that the epistemological consequences of theory-ladenness can be reduced by using a top-down/bottom-up theoretical framework and by adopting appropriate methodological procedures to data derived from individual observations. (shrink)

Traditionally, empiricism has relied on the specialness of human observation, yet science is rife with sophisticated instrumentation and techniques. The present article advances a conception of empirical evidence applicable to actual scientific practice. I argue that this conception elucidates how the results of scientific research can be repurposed across diverse epistemic contexts: it helps to make sense of how evidence accumulates across theory change, how different evidence can be amalgamated and used jointly, and how the same evidence can be used (...) to constrain competing theories in the service of breaking local underdetermination. (shrink)

The use of multiple means of determination to “triangulate” on the existence and character of a common phenomenon, object, or result has had a long tradition in science but has seldom been a matter of primary focus. As with many traditions, it is traceable to Aristotle, who valued having multiple explanations of a phenomenon, and it may also be involved in his distinction between special objects of sense and common sensibles. It is implicit though not emphasized in the distinction between (...) primary and secondary qualities from Galileo onward. It is arguably one of several conceptions involved in Whewell’s method of the “consilience of inductions” (Laudan 1971) and is to be found in several places in Peirce. (From M. Brewer and B. Collins, eds., (1981); Scientific Inquiry in the Social Sciences (a festschrift for Donald T. Campbell), San Francisco: Jossey-Bass, pp. 123–162.). (shrink)

Philosophical conceptual analysis is an experimental method. Focusing on this helps to justify it from the skepticism of experimental philosophers who follow Weinberg, Nichols & Stich. To explore the experimental aspect of philosophical conceptual analysis, I consider a simpler instance of the same activity: everyday linguistic interpretation. I argue that this, too, is experimental in nature. And in both conceptual analysis and linguistic interpretation, the intuitions considered problematic by experimental philosophers are necessary but epistemically irrelevant. They are like variables introduced (...) into mathematical proofs which drop out before the solution. Or better, they are like the hypotheses that drive science, which do not themselves need to be true. In other words, it does not matter whether or not intuitions are accurate as descriptions of the natural kinds that undergird philosophical concepts; the aims of conceptual analysis can still be met. (shrink)

I contrast two modes of error-elimination relevant to evaluating evidence in accounts that emphasize frequentist reliability. The contrast corresponds to that between the use of of a reliable inference procedure and the critical scrutiny of a procedure with regard to its reliability, in light of what is and is not known about the setting in which the procedure is used. I propose a notion of security as a category of evidential assessment for the latter. In statistical settings, robustness theory and (...) misspecification testing exemplify two distinct strategies for securing statistical inferences. (shrink)