This book addresses key conceptual issues relating to the modern scientific and engineering use of computer simulations. It analyses a broad set of questions, from the nature of computer simulations to their epistemological power, including the many scientific, social and ethics implications of using computer simulations. The book is written in an easily accessible narrative, one that weaves together philosophical questions and scientific technicalities. It will thus appeal equally to all academic scientists, engineers, and researchers in industry interested in questions (...) related to the general practice of computer simulations. (shrink)

There are a variety of topics in the philosophy of science that need to be rethought, in varying degrees, after one pays careful attention to the ways in which computer simulations are used in the sciences. There are a number of conceptual issues internal to the practice of computer simulation that can benefit from the attention of philosophers. This essay surveys some of the recent literature on simulation from the perspective of the philosophy of science and argues that philosophers have (...) a lot to learn by paying closer attention to the practice of simulation. (shrink)

The epistemology of studies addressing questions about historical and prehistorical phenomena is a subject of increasing discussion among philosophers of science. A related field of inquiry that has yet to be connected to this topic is the epistemology of climate science. Branching these areas of research, I show how variety-of-evidence reasoning accounts for scientific inferences about the past by detailing a case study in paleoclimate reconstruction. This analysis aims to clarify the logic of historical inquiry in general and, by focusing (...) on a case study about climate change, it offers an epistemic account of a particular discipline that is of environmental and social importance. (shrink)

We address some of the epistemological challenges highlighted by the Critical Data Studies literature by reference to some of the key debates in the philosophy of science concerning computational modeling and simulation. We provide a brief overview of these debates focusing particularly on what Paul Humphreys calls epistemic opacity. We argue that debates in Critical Data Studies and philosophy of science have neglected the problem of error management and error detection. This is an especially important feature of the epistemology of (...) Big Data. In “Error” section we explain the main characteristics of error detection and correction along with the relationship between error and path complexity in software. In this section we provide an overview of conventional statistical methods for error detection and review their limitations when faced with the high degree of conditionality inherent to modern software systems. (shrink)

Lloyd (2009) contends that climate models are confirmed by various instances of fit between their output and observational data. The present paper argues that what these instances of fit might confirm are not climate models themselves, but rather hypotheses about the adequacy of climate models for particular purposes. This required shift in thinking—from confirming climate models to confirming their adequacy-for-purpose—may sound trivial, but it is shown to complicate the evaluation of climate models considerably, both in principle and in practice.

Allan Franklin has identified a number of strategies that scientists use to build confidence in experimental results. This paper shows that Franklin's strategies have direct analogues in the context of computer simulation and then suggests that one of his strategies—the so-called 'Sherlock Holmes' strategy—deserves a privileged place within the epistemologies of experiment and simulation. In particular, it is argued that while the successful application of even several of Franklin's other strategies (or their analogues in simulation) may not be sufficient for (...) justified belief in results, the successful application of a slightly elaborated version of the Sherlock Holmes strategy is sufficient. (shrink)

A number of recent discussions comparing computer simulation and traditional experimentation have focused on the significance of “materiality.” I challenge several claims emerging from this work and suggest that computer simulation studies are material experiments in a straightforward sense. After discussing some of the implications of this material status for the epistemology of computer simulation, I consider the extent to which materiality (in a particular sense) is important when it comes to making justified inferences about target systems on the basis (...) of experimental results. (shrink)

We argue for a naturalistic account for appraising scientific methods that carries non-trivial normative force. We develop our approach by comparison with Laudan’s (American Philosophical Quarterly 24:19–31, 1987, Philosophy of Science 57:20–33, 1990) “normative naturalism” based on correlating means (various scientific methods) with ends (e.g., reliability). We argue that such a meta-methodology based on means–ends correlations is unreliable and cannot achieve its normative goals. We suggest another approach for meta-methodology based on a conglomeration of tools and strategies (from statistical modeling, (...) experimental design, and related fields) that affords forward looking procedures for learning from error and for controlling error. The resulting “error statistical” appraisal is empirical—methods are appraised by examining their capacities to control error. At the same time, this account is normative, in that the strategies that pass muster are claims about how actually to proceed in given contexts to reach reliable inferences from limited data. (shrink)

Today's climate models are supported in a couple of ways that receive little attention from philosophers or climate scientists. In addition to standard 'model fit', wherein a model's simulation is compared to observational data, there is an additional type of confirmation available through the variety of instances of model fit. When a model performs well at fitting first one variable and then another, the probability of the model under some standard confirmation function, say, likelihood, goes up more than under each (...) individual case of fit alone. Thus, two instances of fit of distinct variables of a global climate model using distinct data sets considered collectively will provide stronger evidence for a model than either one of the instances considered individually. This has consequences for model robustness. Sets of models that produce robust results will, if their assumptions vary enough and they each are observationally sound, provide reasons to endorse common structures found in those models. Finally, independent empirical support for aspects and assumptions of the model provides an additional confirmational virtue for climate models, contrary to what is implied by some current philosophical writing on this topic. (shrink)

climate scientists have been engaged in a decades-long debate over the standing of satellite measurements of the temperature trends of the atmosphere above the surface of the earth. This is especially significant because skeptics of global warming and the greenhouse effect have utilized this debate to spread doubt about global climate models used to predict future states of climate. I use this case from an under-studied science to illustrate two distinct philosophical approaches to the relation among data, scientists, measurement, models, (...) and theory. I argue that distinguishing between 'direct' empiricist and 'complex' empiricist approaches helps us understand and analyze this important scientific episode. I also introduce a complex empiricist account of testing and evaluation, and contrast it with the basic Hypothetico-Deductive approach to the climate models used by the direct empiricists. This more developed complex empiricist apporach will serve philosophy of science well, as computational models become more wide-spread in the sciences. (shrink)

I examine, from Mayo's severe testing perspective, the case found in the Intergovernmental Panel on Climate Change fourth report for the claim that increases in anthropogenic greenhouse gas concentrations caused most of the post-1950 global warming. My examination begins to provide an alternative to standard, probabilistic assessments of OUR FAULT. It also brings out some of the limitations of variety of evidence considerations in assessing this and other hypotheses about the causes of climate change, and illuminates the epistemology of optimal (...) fingerprinting studies. Finally, it shows that some features of Mayo's perspective should be kept in whatever approach is preferred for assessing hypotheses about the causes of climate change. (shrink)

The present paper draws on climate science and the philosophy of science in order to evaluate climate-model-based approaches to assessing climate projections. We analyze the difficulties that arise in such assessment and outline criteria of adequacy for approaches to it. In addition, we offer a critical overview of the approaches used in the IPCC working group one fourth report, including the confidence building, Bayesian and likelihood approaches. Finally, we consider approaches that do not feature in the IPCC reports, including three (...) approaches drawn from the philosophy of science. We find that all available approaches face substantial challenges, with IPCC approaches having as a primary source of difficulty their goal of providing probabilistic assessments. (shrink)

Some philosophers see an analogy between simulation and experiment. But, once we acknowledge some similarities between computer simulations and experiments, can we conclude from them that simulations generate empirical knowledge, as experiments do? In this paper, I argue that the similarities between simulation and experiment give the scientist at most the illusion that she is conducting an experiment, but cannot seriously ground the analogy. However, it does not follow that experiments are always epistemologically superior to simulations. I analyze the cases (...) when simulations and experiments equally yield new empirical knowledge. (shrink)

‘The problem with simulations is that they are doomed to succeed.’ So runs a common criticism of simulations—that they can be used to ‘prove’ anything and are thus of little or no scientific value. While this particular objection represents a minority view, especially among those who work with simulations in a scientific context, it raises a difficult question: what standards should we use to differentiate a simulation that fails from one that succeeds? In this paper we build on a structural (...) analysis of simulation developed in previous work to provide an evaluative account of the variety of ways in which simulations do fail. We expand the structural analysis in terms of the relationship between a simulation and its real-world target emphasizing the important role of aspects intended to correspond and also those specifically intended not to correspond to reality. The result is an outline both of the ways in which simulations can fail and the scientific importance of those various forms of failure. (shrink)

Since the 1980s, several studies of visual perception have persuasively argued that important aspects of human vision are best accounted for not by recourse to inner mental representations but rather through socially observable actions and behaviors (e.g. Lynch 1985, Latour 1986, Lynch 1990, Goodwin 1994, Goodwin 1997, Sharrock & Coulter 1998). While there are clearly physiological mechanisms required for vision, psychological accounts of perception in terms of inner mental representations have been dislodged from their position as the basic term in (...) the interface between human beings and their environment and replaced with terms such as "social practice," and "vernacular intelligibility." The focus for these .. (shrink)

Computer simulations are widely used in current scientific practice, as a tool to obtain information about various phenomena. Scientists accordingly rely on the outputs of computer simulations to make statements about the empirical world. In that sense, simulations seem to enable scientists to acquire empirical knowledge. The aim of this paper is to assess whether computer simulations actually allow for the production of empirical knowledge, and how. It provides an epistemological analysis of present-day empirical science, to which the traditional epistemological (...) categories cannot apply in any simple way. Our strategy consists in acknowledging the complexity of scientific practice, and trying to assess its rationality. Hence, while we are careful not to abstract away from the details of scientific practice, our approach is not strictly descriptive: our goal is to state in what conditions empirical science can rely on computer simulations. In order to do so, we need to adopt a renewed epistemological framework, whose categories would enable us to give a finer-grained, and better-fitted analysis of the rationality of scientific practice. (shrink)

1. Overview and organizing themes 2. Historical Review: Aristotle to Mill 3. Logic of method and critical responses 3.1 Logical constructionism and Operationalism 3.2. H-D as a logic of confirmation 3.3. Popper and falsificationism 3.4 Meta-methodology and the end of method 4. Statistical methods for hypothesis testing 5. Method in Practice 5.1 Creative and exploratory practices 5.2 Computer methods and the ‘third way’ of doing science 6. Discourse on scientific method 6.1 “The scientific method” in science education and as seen (...) by scientists 6.2 Privileged methods and ‘gold standards’ 6.3 Scientific method in the court room 6.4 Deviating practices 7. Conclusion Bibliography Academic Tools Other Internet Resources Related Entries . (shrink)

Conventional accounts of epistemic opacity, particularly those that stem from the definitive work of Paul Humphreys, typically point to limitations on the part of epistemic agents to account for the distinct ways in which systems, such as computational methods and devices, are opaque. They point, for example, to the lack of technical skill on the part of an agent, the failure to meet standards of best practice, or even the nature of an agent as reasons why epistemically relevant elements of (...) a process may be inaccessible. In this paper I argue that there are certain instances of epistemic opacity— particularly in computational methods such a computer simulations and machine learning processes—that do not arise from, are not responsive to, and are therefore not explained by the epistemic limitations of an agent. I call these instances agent-neutral and agent-independent instances of epistemic opacity respectively. As a result, I also argue that conventional accounts of epistemic opacity offer a limited understanding of the full spectrum of kinds and sources of epistemic opacity, particularly of the kind found in computational methods. In particular, as I will show below, the limitations of these accounts are reflected in the way they fail to provide satisfactory explanations when faced with certain instances of opacity. (shrink)