There are a variety of topics in the philosophy of science that need to be rethought, in varying degrees, after one pays careful attention to the ways in which computer simulations are used in the sciences. There are a number of conceptual issues internal to the practice of computer simulation that can benefit from the attention of philosophers. This essay surveys some of the recent literature on simulation from the perspective of the philosophy of science and argues that philosophers have (...) a lot to learn by paying closer attention to the practice of simulation. (shrink)

. In this paper I present two ways in which climate modelers use general circulation models for exploratory purposes. The complexity of Earth’s climate system makes it difficult to predict precisely how lower-order climate dynamics will interact over time to drive higher-order dynamics. The same issues arise for complex models built to simulate climate behavior like the Community Earth Systems Model. I argue that as a result of system complexity, climate modelers use general circulation models to perform model dynamic exploration (...) and climate dynamic exploration. MDE and CDE help climate modelers to better understand the dynamic structure of the general circulation model system and the actual climate system, respectively. (shrink)

We argue that concerns about double-counting -- using the same evidence both to calibrate or tune climate models and also to confirm or verify that the models are adequate --deserve more careful scrutiny in climate modelling circles. It is widely held that double-counting is bad and that separate data must be used for calibration and confirmation. We show that this is far from obviously true, and that climate scientists may be confusing their targets. Our analysis turns on a Bayesian/relative-likelihood approach (...) to incremental confirmation. According to this approach, double-counting is entirely proper. We go on to discuss plausible difficulties with calibrating climate models, and we distinguish more and less ambitious notions of confirmation. Strong claims of confirmation may not, in many cases, be warranted, but it would be a mistake to regard double-counting as the culprit. (shrink)

Using past episodes of climate change as a source of evidence to inform our projections about contemporary climate change requires establishing the extent to which episodes in the deep past are analogous to the current crisis. However, many scientists claim that contemporary rates of climate change (e.g., rates of carbon emissions or temperature change) are unprecedented, including compared to episodes in the deep past. If so, this would limit the utility of paleoclimate analogues. In this paper, I show how a (...) data adjustment procedure called “temporal scaling,” which must be applied to both contemporary and past rate data, complicates the claim that contemporary rates are truly unprecedented. On top of giving actionable recommendations to scientists, this paper advances the philosophical literature concerning the use of models that are known to be somewhat disanalogous to their target systems. (shrink)

This paper argues that the difference between contemporary software intensive scientific practice and more traditional non-software intensive varieties results from the characteristically high conditionality of software. We explain why the path complexity of programs with high conditionality imposes limits on standard error correction techniques and why this matters. While it is possible, in general, to characterize the error distribution in inquiry that does not involve high conditionality, we cannot characterize the error distribution in inquiry that depends on software. Software intensive (...) science presents distinctive error and uncertainty modalities that pose new challenges for the epistemology of science. (shrink)

We argue that concerns about double-counting—using the same evidence both to calibrate or tune climate models and also to confirm or verify that the models are adequate—deserve more careful scrutiny in climate modelling circles. It is widely held that double-counting is bad and that separate data must be used for calibration and confirmation. We show that this is far from obviously true, and that climate scientists may be confusing their targets. Our analysis turns on a Bayesian/relative-likelihood approach to incremental confirmation. (...) According to this approach, double-counting is entirely proper. We go on to discuss plausible difficulties with calibrating climate models, and we distinguish more and less ambitious notions of confirmation. Strong claims of confirmation may not, in many cases, be warranted, but it would be a mistake to regard double-counting as the culprit. 1 Introduction2 Remarks about Models and Adequacy-for-Purpose3 Evidence for Calibration Can Also Yield Comparative Confirmation3.1 Double-counting I3.2 Double-counting II4 Climate Science Examples: Comparative Confirmation in Practice4.1 Confirmation due to better and worse best fits4.2 Confirmation due to more and less plausible forcings values5 Old Evidence6 Doubts about the Relevance of Past Data7 Non-comparative Confirmation and Catch-Alls8 Climate Science Example: Non-comparative Confirmation and Catch-Alls in Practice9 Concluding Remarks. (shrink)

Reports of quantitative experimental results often distinguish between the statistical uncertainty and the systematic uncertainty that characterize measurement outcomes. This article discusses the practice of estimating systematic uncertainty in high-energy physics. The estimation of systematic uncertainty in HEP should be understood as a minimal form of quantitative robustness analysis. The secure evidence framework is used to explain the epistemic significance of robustness analysis. However, the empirical value of a measurement result depends crucially not only on the resulting systematic uncertainty estimate, (...) but on the learning aims for which that result will be used. Important conceptual and practical questions regarding systematic uncertainty assessment call for further investigation. _1_ Introduction _2_ Systematic Uncertainty: The Very Idea _3_ Systematic Uncertainty in High-Energy Physics _4_ Methodological Debates in High-Energy Physics _5_ The Secure Evidence Framework _6_ Systematic Uncertainty Assessment as Robustness Analysis _7_ Security and Sensitivity _8_ Conclusion Appendix. (shrink)

This article identifies conditions under which robust predictive modeling results have special epistemic significance---related to truth, confidence, and security---and considers whether those conditions hold in the context of present-day climate modeling. The findings are disappointing. When today’s climate models agree that an interesting hypothesis about future climate change is true, it cannot be inferred---via the arguments considered here anyway---that the hypothesis is likely to be true or that scientists’ confidence in the hypothesis should be significantly increased or that a claim (...) to have evidence for the hypothesis is now more secure. (shrink)

According to an adequacy-for-purpose view, models should be assessed with respect to their adequacy or fitness for particular purposes. Such a view has been advocated by scientists and philosophers...

This article highlights a use of analogies in science that so far has received relatively little systematic discussion: providing reasons for pursuing a model or theory. Using the development of the liquid drop model as a test case, I critically assess two extant pursuit worthiness accounts: that analogies justify pursuit by supporting plausibility arguments and that analogies can serve as a guide to potential theoretical unification. Neither of these fit the liquid drop model case. Instead, I develop an alternative account, (...) based on the idea that analogies facilitate the transfer of a well-understood modelling strategy to a new domain. 1Introduction2Case Study: The Development of the Liquid Drop Model3Plausibility Accounts 3.1Bartha on plausibility and analogical inference3.2Plausibility and the drop analogy4Analogies as a Guide to Unification5Generative Accounts 5.1Analogy-based modelling strategies5.2Did analogies play a merely generative role?6A New Pursuit Worthiness Account of Analogies 6.1Transferring understanding-with through analogies6.2Understanding-with and the liquid drop model7Conclusion. (shrink)

Like any science marked by high uncertainty, climate science is characterized by a widespread use of expert judgment. In this paper, we first show that, in climate science, expert judgment is used to overcome uncertainty, thus playing a crucial role in the domain and even at times supplanting models. One is left to wonder to what extent it is legitimate to assign expert judgment such a status as an epistemic superiority in the climate context, especially as the production of expert (...) judgment is particularly opaque. To begin answering this question, we highlight the key components of expert judgment. We then argue that the justification for the status and use of expert judgment depends on the competence and the individual subjective features of the expert producing the judgment since expert judgment involves not only the expert's theoretical knowledge and tacit knowledge, but also their intuition and values. This goes against the objective ideal in science and the criteria from social epistemology which largely attempt to remove subjectivity from expertise. (shrink)

The literature on values in science struggles with questions about how to describe and manage the role of values in scientific research. We argue that progress can be made by shifting this literature’s current emphasis. Rather than arguing about how non-epistemic values can or should figure into scientific assessment, we suggest analyzing how scientific assessment can accommodate non-epistemic values. For scientific assessment to do so, it arguably needs to incorporate goals that have been traditionally characterized as non-epistemic. Building on this (...) insight, we show how the adequacy-for-purpose framework recently developed for assessing scientific models can provide a general framework for describing scientific assessment so that it goes beyond purely epistemic considerations. Adopting this framework has significant advantages and opens the possibility of effecting a partial rapprochement between critics and proponents of the value-free ideal. (shrink)

Recent philosophical attention to climate models has highlighted their weaknesses and uncertainties. Here I address the ways that models gain support through observational data. I review examples of model fit, variety of evidence, and independent support for aspects of the models, contrasting my analysis with that of other philosophers. I also investigate model robustness, which often emerges when comparing climate models simulating the same time period or set of conditions. Starting from Michael Weisberg’s analysis of robustness, I conclude that his (...) approach involves a version of reasoning from variety of evidence, enabling this robustness to be a confirmatory virtue.. (shrink)

It is argued in this paper that amalgamating confirmation from various sources is relevantly different from social-choice contexts, and that proving an impossibility theorem for aggregating confirmation measures directs attention to irrelevant issues.

Derivational robustness may increase the degree to which various pieces of evidence indirectly confirm a robust result. There are two ways in which this increase may come about. First, if one can show that a result is robust, and that the various individual models used to derive it also have other confirmed results, these other results may indirectly confirm the robust result. Confirmation derives from the fact that data not known to bear on a result are shown to be relevant (...) when it is shown to be robust. Second, robustness may increase the degree to which the robust result is indirectly confirmed if it increases the weight with which existing evidence indirectly confirms it. This may happen when it strengthens the connection between the core and the robust result by showing that auxiliaries are not responsible for the result. (shrink)

Philosophers of science have offered various accounts of climate model evaluation which have largely centered on model-fit assessment. However, despite the wide-spread prevalence of process-based evaluation in climate science practice, this sort of model evaluation has been undertheorized by philosophers of science. In this paper, I aim to expand this narrow philosophical view of climate model evaluation by providing a philosophical account of process evaluation that is rooted in a close examination of scientific practice. I propose dynamical adequacy as a (...) metric by which scientists test and evaluate models that represent and produce key regional climate processes and features. I argue that process-based evaluation confirms the adequacy of a regional climate model for simulating and predicting future changes of a specific regional climate feature. I offer a case study of how, in practice, scientists establish the reliability of model projections by assessing the dynamical adequacy of such models. I also show how process-based evaluation mitigates some well-known shortcomings of model-fit assessment and supports the adequacy and reliability of climate model projections against philosophical objections, like confirmational holism. Such adequacy is especially important for decision makers who need reliable regional model projections to guide their climate change mitigation and adaptation policies. (shrink)

Scientists and decision makers rely on climate models for predictions concerning future climate change. Traditionally, physical processes that are key to predicting extreme events are either directly represented or indirectly represented. Scientists are now replacing physically based parameterizations with neural networks that do not represent physical processes directly or indirectly. I analyze the epistemic implications of this method and argue that it undermines the reliability of model predictions. I attribute the widespread failure in neural network generalizability to the lack of (...) process representation. The representation of climate processes adds significant and irreducible value to the reliability of climate model predictions. (shrink)

I bring out the limitations of four important views of what the target of useful climate model assessment is. Three of these views are drawn from philosophy. They include the views of Elisabeth Lloyd and Wendy Parker, and an application of Bayesian confirmation theory. The fourth view I criticise is based on the actual practice of climate model assessment. In bringing out the limitations of these four views, I argue that an approach to climate model assessment that neither demands too (...) much of such assessment nor threatens to be unreliable will, in typical cases, have to aim at something other than the confirmation of claims about how the climate system actually is. This means, I suggest, that the Intergovernmental Panel on Climate Change ’s focus on establishing confidence in climate model explanations and predictions is misguided. So too, it means that standard epistemologies of science with pretensions to generality, e.g., Bayesian epistemologies, fail to illuminate the assessment of climate models. I go on to outline a view that neither demands too much nor threatens to be unreliable, a view according to which useful climate model assessment typically aims to show that certain climatic scenarios are real possibilities and, when the scenarios are determined to be real possibilities, partially to determine how remote they are. (shrink)

I examine, from Mayo's severe testing perspective, the case found in the Intergovernmental Panel on Climate Change fourth report for the claim that increases in anthropogenic greenhouse gas concentrations caused most of the post-1950 global warming. My examination begins to provide an alternative to standard, probabilistic assessments of OUR FAULT. It also brings out some of the limitations of variety of evidence considerations in assessing this and other hypotheses about the causes of climate change, and illuminates the epistemology of optimal (...) fingerprinting studies. Finally, it shows that some features of Mayo's perspective should be kept in whatever approach is preferred for assessing hypotheses about the causes of climate change. (shrink)

I examine the warrants we have in light of the empirical successes of a kind of model I call ‘ hybrid models ’, a kind that includes climate models among its members. I argue that these warrants ’ strengths depend on inferential virtues that are not just explanatory virtues, contrary to what would be the case if inference to the best explanation provided the warrants. I also argue that the warrants in question, unlike those IBE provides, guide inferences only to (...) model implications about which there is real uncertainty. My conclusion provides criteria of adequacy for epistemologies of climate and other hybrid models. (shrink)

The present paper draws on climate science and the philosophy of science in order to evaluate climate-model-based approaches to assessing climate projections. We analyze the difficulties that arise in such assessment and outline criteria of adequacy for approaches to it. In addition, we offer a critical overview of the approaches used in the IPCC working group one fourth report, including the confidence building, Bayesian and likelihood approaches. Finally, we consider approaches that do not feature in the IPCC reports, including three (...) approaches drawn from the philosophy of science. We find that all available approaches face substantial challenges, with IPCC approaches having as a primary source of difficulty their goal of providing probabilistic assessments. (shrink)

Robustness concepts are often invoked to manage two obstacles confronting models of ecological systems: complexity and uncertainty. The intuitive idea is that any result derived from many idealized but credible models is thereby made more reliable or is better confirmed. An appropriate basis for this inference has proven elusive. Here, several representations of robustness analysis are vetted, paying particular attention to complex models of ecosystems and the global climate. The claim that robustness is itself confirmatory because robustness analysis employs a (...) Bayesian variety-of-evidence argument is criticized, but recent overwhelming pessimism about robustness may have a silver lining. (shrink)

Empirical agreement is often used as an important criterion when assessing the validity of scientific models. However, it is by no means a sufficient criterion as a model can be so adjusted as to fit available data even though it is based on hypotheses whose plausibility is known to be questionable. Our aim in this paper is to investigate into the uses of empirical agreement within the process of model validation.

The debate between ΛCDM and MOND is often cast in terms of competing gravitational theories. However, recent philosophical discussion suggests that the ΛCDM–MOND debate demonstrates the challenges of multiscale modeling in the context of cosmological scales. I extend this discussion and explore what happens when the debate is thought to be about modeling rather than about theory, offering a model-focused interpretation of the ΛCDM–MOND debate. This analysis shows how a model-focused interpretation of the debate provides a better understanding of challenges (...) asso- ciated with extension to a different scale or domain, which are tied to commitments about explanatory fit. (shrink)

While it is widely acknowledged that science is not “free” of non-epistemic values, there is disagreement about the roles that values can appropriately play. Several have argued that non-epistemic values can play important roles in modeling decisions, particularly in addressing uncertainties ; Risbey 2007; Biddle and Winsberg 2010; Winsberg : 111-137, 2012); van der Sluijs 359-389, 2012). On the other hand, such values can lead to bias ; Bray ; Oreskes and Conway 2010). Thus, it is important to identify when (...) it is legitimate to appeal to non-epistemic values in modeling decisions. An approach is defended here whereby such value judgments are legitimate when they promote democratically endorsed epistemological and social aims of research. This framework accounts for why it is legitimate to appeal to non-epistemic values in a range of modeling decisions, while addressing concerns that the presence of such values will lead to bias or give scientists disproportionate power in deciding what values ought to be endorsed. (shrink)

For computer simulation models to usefully inform climate risk management, uncertainties in model projections must be explored and characterized. Because doing so requires running the model many ti...

When attendant to the agency of models and the general context in which they perform, climate models can be seen as instrumental policy tools that may be evaluated in terms of their adequacy for purpose. In contrast, when analysed independently of their real-world usage for informing decision-making, the tendency can be to prioritise their representative role rather than their instrumental role. This paper takes as a case study the development of the UK Climate Projections 2009 in relation to its probabilistic (...) treatment of uncertainties and the implications of this approach for adaptation decision-making. It is considered that the move towards ensemble-based probabilistic climate projections has the benefit of encouraging organisations to reshape their adaptation strategies and decisions towards a risk-based approach, where they are confronted definitively with climate modelling uncertainties and drawn towards a more nuanced understanding of how climate impacts could affect their operations. This is further illustrated through the example of the built environment sector, where it can be seen that the probabilistic approach may be of limited salience for the urban heat island in the absence of a corresponding effort towards a more place-based analysis of climate vulnerabilities. Therefore, further assessment of the adequacy-for-purpose of climate models might also consider the usability of climate projections at the urban scale. (shrink)

Cognitive values like simplicity, broad scope, and easy handling are properties of a scientific representation that result from the idealization which is involved in the construction of a representation. These properties may facilitate the application of epistemic values to credibility assessments, which provides a rationale for assigning an auxiliary function to cognitive values. In this paper, I defend a further rationale for cognitive values which consists in the assessment of the usefulness of a representation. Usefulness includes the relevance of a (...) representation regarding the investigation of a given problem and its practicability for the users. This rationale builds on the claim that any evaluation of scientific representations should pursue two aims: providing information about their credibility and providing information about their usefulness. Cognitive values relating to the usefulness of a representation and epistemic values relating to its credibility both perform a first-order function. Cognitive values are abstract, and several values with first-order functions may conflict in their application. Thus, in order for cognitive values to account for the sort of problem that is to be investigated by means of a representation, they need to be appropriately specified and weighed. Comprehensiveness, complexity, high resolution, and easy handling, for instance, may be required in a first-order function for model-based prediction of regional climate impacts but not for explaining how the global climate system works. Specifying and weighing cognitive and epistemic values relative to a given problem is a legitimate second-order function of social values. (shrink)

Many climate scientists have made claims that may suggest that evidence used in tuning or calibrating a climate model cannot be used to evaluate the model. By contrast, the philosophers Katie Steele and Charlotte Werndl have argued that, at least within the context of Bayesian confirmation theory, tuning is simply an instance of hypothesis testing. In this paper I argue for a weak predictivism and in support of a nuanced reading of climate scientists’ concerns about tuning: there are cases, model-tuning (...) among them, in which predictive successes are more highly confirmatory of a model than accommodation of evidence. (shrink)

This contribution provides an assessment of the epistemological role of scientific models. The prevalent view that all scientific models are representations of the world is rejected. This view points to a unified way of resolving epistemic issues for scientific models. The emerging consensus in philosophy of science that models have many different epistemic roles in science is presented and defended.

Criticism is a staple of the scientific enterprise and of the social epistemology of science. Philosophical discussions of criticism have traditionally focused on its roles in relation to objectivity, confirmation, and theory choice. However, attention to criticism and to criticizability should also inform our thinking about scientific pursuits: the allocation of resources with the aim of developing scientific tools and ideas. In this paper, we offer an account of scientific pursuitworthiness which takes criticizability as its starting point. We call this (...) the apokritic model of pursuit. Its core ideas are that pursuits are practices governed by norms for asking and answering questions, and that criticism arises from the breach of these norms. We illustrate and advertise our approach using examples from institutional grant review, neuroscience, and sociology. We show that the apokritic model can unify several indices of criticizability, that it can account for the importance of criticizing pursuits in scientific practice, and that it can offer ameliorative advice to erstwhile pursuers. (shrink)

Over the last twenty-five years, climate scientists working on the attribution of climate change to humans have developed increasingly sophisticated statistical models in a process that can be understood as a kind of calibration: the gradual changes to the statistical models employed in attribution studies served as iterative revisions to a measurement(-like) procedure motivated primarily by the aim of neutralizing particularly troublesome sources of error or uncertainty. This practice is in keeping with recent work on the evaluation of models more (...) generally that views models as tools for particular tasks: what drives the process is the desire for models that provide more reliable grounds for inference rather than accuracy to the underlying mechanisms of data-generation. (shrink)

I develop an account of productive surprise as an epistemic virtue of scientific investigations which does not turn on psychology alone. On my account, a scientific investigation is potentially productively surprising when results can conflict with epistemic expectations, those expectations pertain to a wide set of subjects. I argue that there are two sources of such surprise in science. One source, often identified with experiments, involves bringing our theoretical ideas in contact with new empirical observations. Another, often identified with simulations, (...) involves articulating and bringing together different parts of our knowledge. Both experiments and simulations, then, can surprise. (shrink)

Many accounts of scientific modeling conceive of models as fictions: scientists interact with models in ways analogous to various aesthetic objects. Fictionalists follow most other accounts of modeling by taking them to be revelatory of the actual world in virtue of bearing some resemblance relation to a target system. While such fictionalist accounts capture crucial aspects of modelling practice, they are ill-suited to some design and engineering contexts. Here, models sometimes serve to underwrite design projects whereby real-world targets are constructed. (...) In such circumstances, it is unclear what the model is supposed to resemble. Further, while fictionalists often require that models qua models have their content in virtue of construal or interpretation, in some engineering and design contexts success-conditions do not require such content—all that is required is that the model generates the required outputs. I take these points to motivate a view which accommodates fictionalism, but is broader. I articulate and defend an account of models as tools: specifically, material objects which are put to particular uses in particular contexts. (shrink)

The paper discusses modelling uncertainties in climate models and how they can be addressed based on physical principles as well as based on how the models perform in light of empirical data. We ar...

Climate models don’t give us probabilistic forecasts. To interpret their results, alternatively, as serious possibilities seems problematic inasmuch as climate models rely on contrary-to-fact assumptions: why should we consider their implications as possible if their assumptions are known to be false? The paper explores a way to address this possibilistic challenge. It introduces the concepts of a perfect and of an imperfect credible world, and discusses whether climate models can be interpreted as imperfect credible worlds. That would allow one to (...) use models for possibilistic prediction and salvage widespread scientific practice. (shrink)

The paper discusses Bayesian convergence when the truth is excluded from the analysis by means of a simple coin-tossing example. In the fair-balance paradox a fair coin is tossed repeatedly. A Bayesian agent, however, holds the a priori view that the coin is either biased towards heads or towards tails. As a result the truth is ignored by the agent. In this scenario the Bayesian approach tends to confirm a false model as the data size goes to infinity. I argue (...) that the fair-balance paradox reveals an unattractive feature of the Bayesian approach to scientific inference and explore a modification of the paradox. (shrink)