Robustness in Science

I show how omissions lead to robustness and can justify distortions, and I give inferentially relevant explications of abstraction and idealization. Abstraction is explicated as the omission of all and only those claims that use a specific vocabulary; idealization is explicated as the distortion of only those claims that use a specific vocabulary. With these explications, abstraction can justify idealization. As examples of how abstraction justifies idealization and leads to robustness, I discuss Beauchamp and Childress's four principles of biomedical ethics (...) and the qualitative treatment of the Schrödinger equation. (shrink)

Building on Nozick's invariantism about objectivity, I propose to define scientific objectivity in terms of counterfactual independence. I will argue that such a counterfactual independence account is (a) able to overcome the decisive shortcomings of Nozick's original invariantism and (b) applicable to three paradigmatic kinds of scientific objectivity (that is, objectivity as replication, objectivity as robustness, and objectivity as Mertonian universalism).

Many policy decisions take input from collections of scientific models. Such decisions face significant and often poorly understood uncertainty. We rework the so-called confidence approach to tackl...

There is a widely shared belief that the higher-level sciences can provide better explanations than lower-level sciences. But there is little agreement about exactly why this is so. It is often suggested that higher-level explanations are better because they omit details. I will argue instead that the preference for higher-level explanations is just a special case of our general preference for informative, logically strong, beliefs. I argue that our preference for informative beliefs entirely accounts for why higher-level explanations are sometimes (...) better—and sometimes worse—than lower-level explanations. The result is a step in the direction of the unity of science hypothesis. 1Introduction2Background: Is Omitting Details an Explanatory Virtue? 2.1Anti-reductionist arguments2.2Reductionist argument2.3Logical strength3Bases, Links and Logical Strength4Functionalism and Fodor’s Argument5Two Generalizations6Should the Base Really Be Maximally Strong?7Anti-reductionist Arguments Regarding the Base8Should the Antecedent of the Link Really Be Maximally Weak? (shrink)

The French physicist Jean Baptiste Perrin is widely credited with providing the conclusive argument for atomism. The most well-known part of Perrin’s argument is his description of thirteen different procedures for determining Avogadro’s number (N)–the number of atoms, ions, and molecules contained in a gram-atom, gram-ion, and gram-mole of a substance, respectively. Because of its success in ending the atomism debates Perrin’s argument has been the focus of much philosophical interest. The various philosophers, however, have reached different conclusions, not only (...) about the argument’s general rationale but also the role that the multiple determination of N played in it. This paper emphasizes the historical development of Perrin’s experimental work in order to understand the role that the multiple determination of molecular magnitudes played in his argument for molecular reality. It claims that Perrin used the multiple determination strategy to put forward an exceptionally strong no-coincidence argument to argue for both the correctness of the values for the molecular magnitudes determined and the validity of the auxiliary assumptions upon which the different determinations were based. The historicist approach also allows the identification of the elements responsible for the epistemic strength of Perrin’s no-coincidence argument. (shrink)

This essay proposes a reductive account of robust macro-regularities. On the view proposed, regularities can earn their elite scientific status by featuring in good summaries of restricted regions in the space of physical possibilities: our “modal neighborhoods.” I argue that this view vindicates “nomic foundationalism”, while doing justice to the practice of invoking physically contingent generalizations in higher-level explanations. Moreover, the view suggests an explanation for the particular significance of robust macro-regularities: we rely on summaries of our modal neighborhoods when (...) reasoning hypothetically about “agentially accessible” possibilities. (shrink)

In biomedical measurement, biomarkers are used to achieve reliable prediction of, and useful causal information about patient outcomes while minimizing complexity of measurement, resources, and invasiveness. A biomarker is an assayable metric that discloses the status of a biological process of interest, be it normative, pathophysiological, or in response to intervention. The greatest utility from biomarkers comes from their ability to help clinicians (and researchers) make and evaluate clinical decisions. In this paper we discuss a specific methodological use of clinical (...) biomarkers in pharmacological measurement: Some biomarkers, called ‘surrogate markers’, are used to substitute for a clinically meaningful endpoint corresponding to events and their penultimate risk factors. We confront the reliability of clinical biomarkers that are used to gather information about clinically meaningful endpoints. Our aim is to present a systematic methodology for assessing the reliability of multiple surrogate markers (and biomarkers in general). To do this we draw upon the robustness analysis literature in the philosophy of science and the empirical use of clinical biomarkers. After introducing robustness analysis we present two problems with biomarkers in relation to reliability. Next, we propose an intervention-based robustness methodology for organizing the reliability of biomarkers in general. We propose three relevant conditions for a robust methodology for biomarkers: (R1) Intervention-based demonstration of partial independence of modes: In biomarkers partial independence can be demonstrated through exogenous interventions that modify a process some number of “steps” removed from each of the markers. (R2) Comparison of diverging and converging results across biomarkers: By systematically comparing partially-independent biomarkers we can track under what conditions markers fail to converge in results, and under which conditions they successfully converge. (R3) Information within the context of theory: Through a systematic cross-comparison of the markers we can make causal conclusions as well as eliminate competing theories. We apply our robust methodology to currently developing Alzheimer’s research to show its usefulness for making causal conclusions. (shrink)

La comunidad científica debe acordar cuál es la información esencial que hay que comunicar al retirar un artículo.

Retractions play an important role in research communication by highlighting and explaining how research projects have failed and thereby preventing these mistakes from being repeated. However, the process of retraction and the data it produces is often sparse or incomplete. Drawing on evidence from 2046 retraction records, Quan-Hoang Vuong discusses the emerging trends this data highlights and argues for the need to enforce reporting standards for retractions, as a means of de-stigmatising retraction and rewarding practising integrity in the scholarly record.

Social scientists use many different methods, and there are often substantial disagreements about which method is appropriate for a given research question. In response to this uncertainty about the relative merits of different methods, W. E. B. Du Bois advocated for and applied “methodological triangulation”. This is to use multiple methods simultaneously in the belief that, where one is uncertain about the reliability of any given method, if multiple methods yield the same answer that answer is confirmed more strongly than (...) it could have been by any single method. Against this, methodological purists believe that one should choose a single appropriate method and stick with it. Using tools from voting theory, we show Du Boisian methodological triangulation to be more likely to yield the correct answer than purism, assuming the scientist is subject to some degree of diffidence about the relative merits of the various methods. This holds even when in fact only one of the methods is appropriate for the given research question. (shrink)

The aim of this dissertation is to comprehensively study various robustness arguments proposed in the literature from Levins to Lloyd as well as the opposition offered to them and pose enquiry into the degree of epistemic virtue that they provide to the model prediction results with respect to climate science and modeling. Another critical issue that this dissertation strives to examine is that of the actual epistemic notion that is operational when scientists and philosophers appeal to robustness. In attempting to (...) explicate this idea, the discussion turns to arguments provided by Schupbach who completely rejects probabilistic independence in favour of explanatory reasoning, Stegenga and Menon who still see some value in probabilistic independence, and Winsberg who takes applies Schupbach’s to climate science, going beyond models to involve multi-modal evidence. After an exhaustive discussion on these arguments, this dissertation attempts to provide a thorough and updated notion of robustness in climate modeling and climate science. (shrink)

Traditionally, in the literature on robustness analysis objects are classified as genuine phenomena (natural objects, events, and processes) or artifacts (results produced in error). But much of biological measurement requires the manipulation of local experimental conditions in order to produce new effects. These types of intervention-based regularities are neither natural objects nor artifacts; characterizing them as either fails adequately to address key ontological properties as well as their role in scientific practice. It is argued that a new classification, based on (...) methodological considerations, can be useful in order to characterize experimental productions. Experimentally-useful context-sensitive objects are referred to as ‘artefacts’. To show how the new classification works and why it is instructive for scientific practice, two case studies are discussed. First, the puzzle of arsenic-consuming living organisms is analyzed, where under a set of specific experimental conditions a given organism was found to replace phosphorous with arsenic in its DNA. Second, ecological epigenetic measurement is discussed to show the complexity of variant effects in the context of lab, field, and computer measurements. It is argued that the line between artifacts and artefacts is fluid because theoretical, experimental, and practical considerations vary. (shrink)

This paper proposes a state-feedback controller using the linear matrix inequality approach for the robust position control of a 1-DoF, periodically forced, impact mechanical oscillator subject to asymmetric two-sided rigid end-stops. The periodic forcing input is considered as a persistent external disturbance. The motion of the impacting oscillator is modeled by an impulsive hybrid dynamics. Thus, the control problem of the impact oscillator is recast as a problem of the robust control of such disturbed impulsive hybrid system. To synthesize stability (...) conditions, we introduce the S-procedure and the Finsler lemmas by only considering the region within which the state evolves. We show that the stability conditions are first expressed in terms of bilinear matrix inequalities. Using some technical lemmas, we convert these BMIs into LMIs. Finally, some numerical results and simulations are given. We show the effectiveness of the designed state-feedback controller in the robust stabilization of the position of the impact mechanical oscillator under the disturbance. (shrink)

The meaning of objectivity in any specific setting reflects historically situated understandings of both science and self. Recently, various scientific fields have confronted growing mistrust about the replicability of findings, and statistical techniques have been deployed to articulate a “crisis of false positives.” In response, epistemic activists have invoked a decidedly economic understanding of scientists’ selves. This has prompted a scientific social movement of proposed reforms, including regulating disclosure of “backstage” research details and enhancing incentives for replication. We theorize that (...) together, these events represent the emergence of a new formulation of objectivity. Statistical objectivity assesses the integrity of research literatures in the results observed in collections of studies rather than the methodological details of individual studies and thus positions meta-analysis as the ultimate arbiter of scientific objectivity. Statistical objectivity presents a challenge to scientific communities and raises new questions for sociological theory about tensions between quantification and expertise. (shrink)

ABSTRACT There is a new argument form within theoretical biology. This form takes as input competing explanatory models; it yields as output the conclusion that one of these models is more plausible than the others. The driving force for this argument form is an analysis showing that one model exhibits more parametric robustness than its competitors. This article examines these inferences to the more robust explanation, analysing them as variants of inference to the best explanation. The article defines parametric robustness (...) and distinguishes it from more familiar kinds of robustness. The article also argues that parametric robustness is an explanatory virtue not subsumed by more familiar explanatory virtues, and that the plausibility verdicts in the conclusions of inferences to the more robust explanations are best interpreted as guidance for research activity, rather than claims about likely truth. 1Introducing Inference to the More Robust Explanation 2Inference to the More Robust Explanation in the Study of Apoptosis 2.1Regulating apoptosis 2.2Competing models and evidential indecision 2.3Measuring robustness 2.4Robustness as a guide to plausibility 2.5Varieties of robustness 3Inference to the More Robust Explanation as Inference to the Best Explanation 3.1The structure of inference to the best explanation 3.2Parametric robustness as an explanatory virtue rather than an explanandum 3.3Relation of parametric robustness to other explanatory virtues 4Epistemological Significance of Inference to the More Robust Explanation 4.1Plausibility in practice 4.2Plausibility in principle 5Conclusion. (shrink)

There are at least twelve major virtues of good theories: evidential accuracy, causal adequacy, explanatory depth, internal consistency, internal coherence, universal coherence, beauty, simplicity, unification, durability, fruitfulness, and applicability. These virtues are best classified into four classes: evidential, coherential, aesthetic, and diachronic. Each virtue class contains at least three virtues that sequentially follow a repeating pattern of progressive disclosure and expansion. Systematizing the theoretical virtues in this manner clarifies each virtue and suggests how they might have a coordinated and cumulative (...) role in theory formation and evaluation across the disciplines—with allowance for discipline specific modification. An informal and flexible logic of theory choice is in the making here. Evidential accuracy, according to my systematization, is not a largely isolated trait of good theories, as some have made it out to be. Rather, it bears multifaceted relationships, constituting significant epistemic entanglements, with other theoretical virtues. (shrink)

This paper presents a novel fractional-order PID controller tuning strategy based on Bode’s optimal loop shaping which is commonly used for LTI feedback systems. Firstly, the controller parameters are achieved based on flat phase property and Bode’s optimal reference model, so that the controlled system is robust to gain variations and can achieve desirable transient performance according to various control requirements. Then, robustness analysis of the controlled system is carried out to support the results. Furthermore, the parameter setting is analyzed (...) to demonstrate the superiority of the proposed controller. At last, some simulation examples are shown to verify the accuracy and usefulness of the proposed control strategy. The proposed fractional-order PID controller does not have any restriction on the controlled plant, so it can be widely applied on both integer-order and fractional-order systems. (shrink)

Replicability and reproducibility of computational models has been somewhat understudied by “the replication movement.” In this paper, we draw on methodological studies into the replicability of psychological experiments and on the mechanistic account of explanation to analyze the functions of model replications and model reproductions in computational neuroscience. We contend that model replicability, or independent researchers' ability to obtain the same output using original code and data, and model reproducibility, or independent researchers' ability to recreate a model without original code, (...) serve different functions and fail for different reasons. This means that measures designed to improve model replicability may not enhance (and, in some cases, may actually damage) model reproducibility. We claim that although both are undesirable, low model reproducibility poses more of a threat to long-term scientific progress than low model replicability. In our opinion, low model reproducibility stems mostly from authors' omitting to provide crucial information in scientific papers and we stress that sharing all computer code and data is not a solution. Reports of computational studies should remain selective and include all and only relevant bits of code. (shrink)

In this paper, we engage with the question of the normative content of the resilience concept. The issues are approached in two consecutive steps. First, we proceed from a narrow construal of the resilience concept – as the ability of a system to absorb a disturbance – and show that under an analysis of normative concepts as evaluative concepts resilience comes out as descriptive. In the second part of the paper, we argue that (1) for systems of interest (primarily social (...) systems or system with a social component) we seem to have options with respect to how they are described and (2) that this matters for what is to be taken as a sign of resilience as opposed to a sign of the lack of resilience for such systems. We discuss the implications of this for how the concept should be applied in practice and suggest that users of the resilience concept face a choice between versions of the concept that are either ontologically or normatively charged. (shrink)

In the last decade, robustness has been extensively mentioned and discussed in biology as well as in the philosophy of the life sciences. Nevertheless, from both fields, someone has affirmed that this debate has resulted in more semantic confusion than in semantic clearness. Starting from this claim, we wish to offer a sort of prima facie map of the different usages of the term. In this manner we would intend to predispose a sort of “semantic platform” which could be exploited (...) by those who wish to discuss or simply use it. We do this by starting from a core distinction between the robustness of representations, which is a philosophy of science issue, and the representations of robustness, which instead pertains to science. We illustrate our proposal with examples from biology, physics and mathematics. (shrink)

Inference to the Best Explanation (IBE) is widely criticized for being an unreliable form of ampliative inference – partly because the explanatory hypotheses we have considered at a given time may all be false, and partly because there is an asymmetry between the comparative judgment on which an IBE is based and the absolute verdict that IBE is meant to license. In this paper, I present a further reason to doubt the epistemic merits of IBE and argue that it motivates (...) moving to an inferential pattern in which IBE emerges as a degenerate limiting case. Since this inferential pattern is structurally similar to an argumentative strategy known as Inferential Robustness Analysis (IRA), it effectively combines the most attractive features of IBE and IRA into a unified approach to non-deductive inference. (shrink)

In the philosophy of science and epistemology literature, robustness analysis has become an umbrella term that refers to a variety of strategies. One of the main purposes of this paper is to argue that different strategies rely on different criteria for justifications. More specifically, I will claim that: i) robustness analysis differs from de-idealization even though the two concepts have often been conflated in the literature; ii) the comparison of different model frameworks requires different justifications than the comparison of models (...) that differ only for the assumption under test; iii) the replacement of specific assumptions with different ones can encounter specific difficulties in scientific practice. These claims will be supported by a case study in population ecology and a case study in geographical economics. (shrink)

A theory’s fertility is one of the standard theoretical virtues. But how is it to be construed? In current philosophical discourse, particularly in the realism debate, theoretical fertility is usually understood in terms of novel success: a theory is fertile if it manages to make successful novel predictions. Another, more permissible, notion of fertility can be found in the work of Ernan McMullin. This kind of fertility, McMullin claims, gives us just as strong grounds for realism. My paper critically assesses (...) McMullin’s notion of fertility and its realist rationale. It concludes that McMullin’s preferred example, namely the fertile development of the Bohr-Sommerfeld model of the atom, does not support McMullin’s argument for realism. Although the implications for the realism debate are as of yet unclear, the case study offers some important methodological lessons. (shrink)

Robustness arguments hold that hypotheses are more likely to be true when they are confirmed by diverse kinds of evidence. Robustness arguments require the confirming evidence to be independent. We identify two kinds of independence appealed to in robustness arguments: ontic independence —when the multiple lines of evidence depend on different materials, assumptions, or theories—and probabilistic independence. Many assume that OI is sufficient for a robustness argument to be warranted. However, we argue that, as typically construed, OI is not a (...) sufficient independence condition for warranting robustness arguments. We show that OI evidence can collectively confirm a hypothesis to a lower degree than individual lines of evidence, contrary to the standard assumption undergirding usual robustness arguments. We employ Bayesian networks to represent the ideal empirical scenario for a robustness argument and a variety of ways in which empirical scenarios can fall short of this ideal. (shrink)

I offer a new argument for the elimination of ‘beliefs’ from cognitive science based on Wimsatt’s concept of robustness and a related concept of fragility. Theoretical entities are robust if multiple independent means of measurement produce invariant results in detecting them. Theoretical entities are fragile when multiple independent means of detecting them produce highly variant results. I argue that sufficiently fragile theoretical entities do not exist. Recent studies in psychology show radical variance between what self-report and non-verbal behaviour indicate about (...) participants’ beliefs. This is evidence that ‘belief’ is fragile, and is thus a strong candidate for elimination. 1 Introduction2 Robustness and Fragility2.1 A historical example of robustness2.2 Fragility and elimination3 The Received View4 Evidence for the Fragility of Belief4.1 Contamination and fragility4.2 Implicit association tests and fragility5 Attempts to Preserve the Belief Category for Cognitive Science5.1 Beliefs and aliefs5.2 Contradictory beliefs5.3 In-between beliefs and the unity assumption5.4 Belief sub-classes5.5 Self-deception6 Alternative Mental States7 Conclusion. (shrink)

It is often argued that inferential role semantics (IRS) entails semantic holism as long as theorists fail to answer the question about which inferences, among the many, are meaning-constitutive. Since analyticity, as truth in virtue of meaning, is a widely dismissed notion in indicating which inferences determine meaning, it seems that holism follows. Semantic holism is often understood as facing problems with the stability of content and many usual explanations of communication. Thus, we should choose between giving up IRS, to (...) avoid these holistic entailments, and defending holism against this charge, to rescue IRS. I try to pursue the second goal by analyzing certain patterns of counterfactual reasoning. Wilfrid Sellars and Robert Brandom claim that, to defend IRS, content-constitutive inferences are those counterfactually robust. While it is difficult to assess the goodness of such a view, it nonetheless entails that counterfactually non-robust inferences (which I call “modally ruled out inferences”) are not content-constitutive. If this is true, and if we take certain remarks about the grasp of concepts on board, there is a way to restrict the scope of the holism entailed by IRS to the extent of reshaping problems with the stability of content. (shrink)

Empirical multiple determination (multiple determination, for short) is the epistemic strategy of establishing the same result by means of multiple and independent procedures. It is an important epistemic strategy praised by both philosophers of science and practicing scientists. Commentators from different contexts have referred to multiple determination as one of the main strategies that researchers use to establish the reliability of their results. Multiple determination has been used to address a variety of problems that arise because of the fallibility of (...) experimental procedures. It is generally believed that being able to establish the same result (or provide evidence for a hypothesis of interest) by means of different and independent procedures is somewhat ‘‘better’’ than doing the same by a single procedure. Despite the heavy appeal to the multiple determination strategy, however, not much philosophical analysis has been provided regarding the grounds on which its epistemic desirability and virtues rest. Not much has been said regarding the structure and rationale underlying arguments which rely on multiple determination, and there is no general agreement regarding the epistemological import of these arguments. In my dissertation, I address these issues. More specifically, my dissertation: a. Provides a conceptual clarification of the epistemic strategy of multiple determination by making evident its differences, in both structure and epistemic import, from other notions and epistemic strategies from which it is often not distinguished in the literature such as robustness, consilience of inductions, variety of evidence, etc. b. Traces the historical and philosophical roots of multiple determination in the 19th century philosophical discussions and scientific developments. Especially, it makes the claim that the emergence of empirical multiple determination as a distinctive epistemic strategy emerged as a response to the scientific and philosophical difficulties facing the atomic and molecular hypotheses of matter and, more generally, the study of unobservable entities, in the end of the 19th century. c. Provides a general conceptual framework for understanding the structure and epistemic import of arguments that rely on the application of the multiple determination strategy in actual scientific research. d. The distinctive feature of my dissertation is that it examines its subject matter from a temporal perspective, by paying close attention to the historical emergence and development of the multiple determination strategy. As such, it also considers the implications of the debates regarding the structure and epistemic import of multiple determination for the relationship between history of science and philosophy of science. (shrink)

Robustness is often presented as a guideline for distinguishing the true or real from mere appearances or artifacts. Most of recent discussions of robustness have focused on the kind of derivational robustness analysis introduced by Levins, while the related but distinct idea of robustness as multiple accessibility, defended by Wimsatt, has received less attention. In this paper, I argue that the latter kind of robustness, when properly understood, can provide justification for ontological commitments. The idea is that we are justified (...) in believing that things studied by science are real insofar as we have robust evidence for them. I develop and analyze this idea in detail, and based on concrete examples show that it plays an important role in science. Finally, I demonstrate how robustness can be used to clarify the debate on scientific realism and to formulate new arguments. (shrink)

The concordance of results that are “robust” across multiple scientific modalities is widely considered to play a critical role in the epistemology of science. But what should we make of those cases where such multimodal evidence is discordant? Jacob Stegenga has recently argued that robustness is “worse than useless” in these cases, suggesting that “different kinds of evidence cannot be combined in a coherent way.” In this article I respond to this critique and illustrate the critical methodological role that robustness (...) plays as an aim of scientific inquiry. (shrink)

Proponents of evidence-based medicine have argued convincingly for applying this scientific method to medicine. However, the current methodological framework of the EBM movement has recently been called into question, especially in epidemiology and the philosophy of science. The debate has focused on whether the methodology of randomized controlled trials provides the best evidence available. This paper attempts to shift the focus of the debate by arguing that clinical reasoning involves a patchwork of evidential approaches and that the emphasis on evidence (...) hierarchies of methodology fails to lend credence to the common practice of corroboration in medicine. I argue that the strength of evidence lies in the evidence itself, and not the methodology used to obtain that evidence. Ultimately, when it comes to evaluating the effectiveness of medical interventions, it is the evidence obtained from the methodology rather than the methodology that should establish the strength of the evidence. (shrink)

This paper summarizes (in German) recent tendencies in the philosophy of the life sciences.

In Seeing Things, Robert Hudson assesses a common way of arguing about observation reports called "robustness reasoning." Robustness reasoning claims that an observation report is more likely to be true if the report is produced by multiple, independent sources. Seeing Things argues that robustness reasoning lacks the special value it is often claimed to have. Hudson exposes key flaws in various popular philosophical defenses of robustness reasoning. This philosophical critique of robustness is extended by recounting five episodes in the history (...) of science (from experimental microbiology, atomic theory, astrophysics, and astronomy) where robustness reasoning is — or could be claimed to have been — used. Hudson goes on to show that none of these episodes do in fact exhibit robustness reasoning. In this way, the significance of robustness reasoning is rebutted on both philosophical and historical grounds. But the book does more than critique robustness reasoning. It also develops a better defense of the informative value of observation reports. The book concludes by relating insights into the failure of robustness reasoning to a popular approach to scientific realism called "(theoretical) preservationism." Hudson argues that those who defend this approach to realism commit similar errors to those who advocate robustness reasoning. In turn, a new form of realism is formulated and defended. Called "methodological preservationism," it recognizes the fundamental value of naked-eye observation to scientists — and the rest of us. (shrink)

The issue of common method variance and bias in Indonesia still has not gained much attention; even the terminology is less popular, except among psychometric enthusiasts and experts. In fact, the potential for common method variance and bias infiltrating in research results is very high, especially in studies that use a single method, a single source, and concurrent design, which are highly favored by psychological lecturers and researchers in Indonesia. This paper is a critical review, exposing the debate and serious (...) impact regarding common method variance and bias, as well as procedures for detecting, addressing and correcting its effects. The author hoped this paper contributes in filling the gap in the literature, especially in Psychology Research Methodology text books in the Indonesian language, so that psychological researches in Indonesia continue to increase their quality and to have their better place in international publications. (shrink)

The aim of this paper is to develop ideas about robustness analyses. I introduce a form of robustness analysis that I call sufficient parameter robustness, which has been neglected in the literature. I claim that sufficient parameter robustness is different from derivational robustness, the focus of previous research. My purpose is not only to suggest a new taxonomy of robustness, but also to argue that previous authors have concentrated on a narrow sense of robustness analysis, which they have inadequately distinguished (...) from other investigations of models such as sensitivity analysis. (shrink)

Odenbaugh and Alexandrova provide a challenging critique of the epistemic benefits of robustness analysis, singling out for particular criticism the account we articulated in Kuorikoski et al.. Odenbaugh and Alexandrova offer two arguments against the confirmatory value of robustness analysis: robust theorems cannot specify causal mechanisms and models are rarely independent in the way required by robustness analysis. We address Odenbaugh and Alexandrova’s criticisms in order to clarify some of our original arguments and to shed further light on the properties (...) of robustness analysis and its epistemic rationale. (shrink)

In this essay, which was his presidential address to the Philosophy of Science Association, Ernan McMullin argued that the watershed between “classic” philosophy of science and the “new” philosophy of science can best be understood by analyzing the change in our perception of the role played by values in science. He begins with some general remarks about the nature of value, goes on to explore some of the historical sources for the claim that judgement in science is value‐laden, and concludes (...) by reflecting on the implications of this claim for traditional views of the objectivity of scientific knowledge‐claims. (shrink)

Featuring contributions from the world’s leading experts on the subject and based partly on several detailed case studies, this volume is the first comprehensive analysis of the scientific notion of robustness as well as of the general ...

Precaution is a relevant and much-invoked value in environmental risk analysis, as witnessed by the ongoing vivid discussion about the precautionary principle (PP). This article argues (i) against purely decision-theoretic explications of PP; (ii) that the construction, evaluation, and use of scientific models falls under the scope of PP; and (iii) that epistemic and decision-theoretic robustness are essential for precautionary policy making. These claims are elaborated and defended by means of case studies from climate science and conservation biology.

The use of multiple means of determination to “triangulate” on the existence and character of a common phenomenon, object, or result has had a long tradition in science but has seldom been a matter of primary focus. As with many traditions, it is traceable to Aristotle, who valued having multiple explanations of a phenomenon, and it may also be involved in his distinction between special objects of sense and common sensibles. It is implicit though not emphasized in the distinction between (...) primary and secondary qualities from Galileo onward. It is arguably one of several conceptions involved in Whewell’s method of the “consilience of inductions” (Laudan 1971) and is to be found in several places in Peirce. (From M. Brewer and B. Collins, eds., (1981); Scientific Inquiry in the Social Sciences (a festschrift for Donald T. Campbell), San Francisco: Jossey-Bass, pp. 123–162.). (shrink)

This review of Wimsatt’s book Re-engineering Philosophy for Limited Beings focuses on analysing his use of robustness, a central theme in the book. I outline a family of three distinct conceptions of robustness that appear in the book, and look at the different roles they play. I briefly examine what underwrites robustness, and suggest that further work is needed to clarify both the structure of robustness and the relation between it various conceptions.

The last two decades have seen a rising interest in (a) the notion of a scientific phenomenon as distinct from theories and data, and (b) the intricacies of experimentally producing and stabilizing phenomena. This paper develops an analysis of the stabilization of phenomena that integrates two aspects that have largely been treated separately in the literature: one concerns the skills required for empirical work; the other concerns the strategies by which claims about phenomena are validated. I argue that in order (...) to make sense of the process of stabilization, we need to distinguish between two types of phenomena: phenomena as patterns in the data ( surface regularities ) and phenomena as underlying (or hidden ) regularities. I show that the epistemic relationships that data bear to each of these types of phenomena are different: Data patterns are instantiated by individual data, whereas underlying regularities are indicated by individual data, insofar as they instantiate a data pattern. Drawing on an example from memory research, I argue that neither of these two kinds of phenomenon can be stabilized in isolation. I conclude that what is stabilized when phenomena are stabilized is the fit between surface regularities and hidden regularities. (shrink)

This paper distinguishes between causal isolation robustness analysis and independent determination robustness analysis and suggests that the triangulation of the results of different epistemic means or activities serves different functions in them. Circadian clock research is presented as a case of causal isolation robustness analysis: in this field researchers made use of the notion of robustness to isolate the assumed mechanism behind the circadian rhythm. However, in contrast to the earlier philosophical case studies on causal isolation robustness analysis (Weisberg and (...) Reisman in Philos Sci 75:106–131, 2008 ; Kuorikoski et al. in Br J Philos Sci 61:541–567, 2010 ), robustness analysis in the circadian clock research did not remain in the level of mathematical modeling, but it combined it with experimentation on model organisms and a new type of model, a synthetic model. (shrink)

Scientific research is almost always conducted by communities of scientists of varying size and complexity. Such communities are effective, in part, because they divide their cognitive labor: not every scientist works on the same project. Philip Kitcher and Michael Strevens have pioneered efforts to understand this division of cognitive labor by proposing models of how scientists make decisions about which project to work on. For such models to be useful, they must be simple enough for us to understand their dynamics, (...) but faithful enough to reality that we can use them to analyze real scientific communities. To satisfy the first requirement, we must employ idealizations to simplify the model. The second requirement demands that these idealizations not be so extreme that we lose the ability to describe real-world phenomena. This paper investigates the status of the assumptions that Kitcher and Strevens make in their models, by first inquiring whether they are reasonable representations of reality, and then by checking the models' robustness against weakenings of these assumptions. To do this, we first argue against the reality of the assumptions, and then develop a series of agent-based simulations to systematically test their effects on model outcomes. We find that the models are not robust against weakenings of these idealizations. In fact we find that under certain conditions, this can lead to the model predicting outcomes that are qualitatively opposite of the original model outcomes. (shrink)

Theoretical biology and economics are remarkably similar in their reliance on mathematical models, which attempt to represent real world systems using many idealized assumptions. They are also similar in placing a great emphasis on derivational robustness of modeling results. Recently philosophers of biology and economics have argued that robustness analysis can be a method for confirmation of claims about causal mechanisms, despite the significant reliance of these models on patently false assumptions. We argue that the power of robustness analysis has (...) been greatly exaggerated. It is best regarded as a method of discovery rather than confirmation. (shrink)