Measurement in Science

The standard interpretation of cognitive reflection tests assumes that correct responses are reflective and lured responses are unreflective. However, prior process-tracing of mathematical reflection tests has cast doubt on this interpretation. In two studies (N = 201), we deployed a validated think-aloud protocol in-person and online to test how this assumption is satisfied by the new, validated, less familiar, and less mathematical verbal Cognitive Reflection Test (vCRT). Importantly, thinking aloud did not disrupt test performance compared to a control group. Moreover, (...) verbalized thoughts in both studies revealed that most (but not all) correct responses involved reflection and that most (but not all) lured responses lacked reflection. These data suggest that the vCRT usually satisfies the standard interpretation of the reflection tests (albeit not without exceptions) and that the vCRT can be a good measure of the construct theorized by the two-factor explication of ‘reflection’ (as deliberate and conscious). (shrink)

It is sometimes said that simulation can serve as epistemic substitute for experimentation. Such a claim might be suggested by the fast-spreading use of computer simulation to investigate phenomena not accessible to experimentation (in astrophysics, ecology, economics, climatology, etc.). But what does that mean? The paper starts with a clarification of the terms of the issue and then focuses on two powerful arguments for the view that simulation and experimentation are ‘epistemically on a par’. One is based on the claim (...) that, in experimentation, no less than in simulation, it is not the system under study that is manipulated but a system that ‘stands-in’ for it. The other one highlights the pervasive use of models in experimentation. It will be argued that these arguments, as compelling as they might seem, are each based on a mistaken interpretation of experimentation and that, far from simulation and experimentation being epistemically on a par, they do not have the same epistemic function, do not produce the same kind of epistemic results. (shrink)

This note contains a corrective and a generalization of results by Borsboom et al. (2008), based on Heesen and Romeijn (2019). It highlights the relevance of insights from psychometrics beyond the context of psychological testing.

It is an open question whether well-being ought to primarily be understood as a temporal concept or whether it only makes sense to talk about a person’s well-being over their whole lifetime. In this article, I argue that how this principled philosophical disagreement is settled does not have substantive practical implications for well-being science and well-being policy. Trying to measure lifetime well-being directly is extremely challenging as well as unhelpful for guiding well-being public policy, while temporal well-being is both an (...) adequate indirect measure of lifetime well-being, and an adequate focus for the purposes of improving well-being through public policy. Consequently, even if what we ought to care about is lifetime well-being, we should use temporal measures of well-being and focus on temporal well-being policies. (shrink)

There is a widely held view on measurement inferences, that goes back to Stevens’s ([1946]) theory of measurement scales and ‘permissible statistics’. This view defends the following prohibition: you should not make inferences from averages taken with ordinal scales (versus quantitative scales: interval or ratio). This prohibition is general—it applies to all ordinal scales—and it is sometimes endorsed without qualification. Adhering to it dramatically limits the research that the social and biomedical sciences can conduct. I provide a Bayesian analysis of (...) this inferential problem, determining when measurements from ordinal scales can be used to confirm hypotheses about relative group averages. The prohibition, I conclude, cannot be upheld, even in a qualified sense. The beliefs needed to make average comparisons are less demanding than those appropriate for quantitative scales. I illustrate with the alleged paradigm ordinal scale, Mohs’ scale of mineral hardness, arguing that the literature has mischaracterized it. (shrink)

To study consciousness, scientists need to determine when participants are conscious and when they are not. They do so with consciousness detection procedures. A recurring skeptical argument against those procedures is that they cannot be calibrated: there is no way to make sure that detection outcomes are accurate. In this article, I address two main skeptical arguments purporting to show that consciousness scientists cannot calibrate detection procedures. I conclude that there is nothing wrong with calibration in consciousness science.

‘Visualisations play an important role in science’, this seems to be an uncontroversial statement today. Scientists not only use visual representations as means to communicate their research results in publications or talks, but also often as surrogates for their objects of interest during the process of research. Thus, we can make a distinction between two contexts of usage here, namely the explanatory and the exploratory context. The focus of this paper is on the latter one. Obviously, using visualisations as surrogates (...) for their objects of depiction presupposes the assumption that the former can tell us something relevant about the latter. Thus, a particular referential relation between object and image has to be assumed that can transfer the relevant information. Furthermore, as science is a collaborative enterprise – a social activity – this information has to be intersubjectively accessible and stable. Nonetheless, philosophers of science still quarrel about the epistemic and ontological status of such visualisations. After all, they are means to visualise theoretical entities, such as the Higgs Boson, i.e. entities that are principally not observable with the unaided eye. Especially the significant reliance on information technology devices to access this world of the unobservable provokes a lot of suspicion with regard to the referential status of such visualisations. In this sense, quite a few philosophers adopt social constructivism as an explanatory hypothesis. A particular image is constructed with the aid of instruments and theoretical assumptions; hence it does not refer to an entity outside this system. In this paper, I will critically analyse this assumption and try to argue for an alternative point of view. (shrink)

Philosophers and metrologists have refuted the view that measurement’s epistemic privilege in scientific practice is explained by its theory-neutrality. Rather, they now explicitly appeal to the role that theories play in measurement. I formulate a challenge for this view: scientists sometimes ascribe epistemic privilege to measurements even if they lack a shared theory about their target quantity, which I illustrate through a case study from early geodesy. Drawing on that case, I argue that the epistemic privilege of measurement precedes shared (...) background theory and is better explained by its pre-theoretic function in enabling a distinctive kind of inquiry. (shrink)

When it originated in the late 19th century, psychometrics was a field with both a scientific and a social mission: psychometrics provided new methods for research into individual differences, and at the same time, these psychometric instruments were considered a means to create a new social order. In contrast, contemporary psychometrics - due to its highly technical nature and its limited involvement in substantive psychological research - has created the impression of being a value-free discipline. In this article, we develop (...) a contrasting characterization of contemporary psychometrics as a value-laden discipline. We expose four such values: that individual differences are quantitative (rather than qualitative), that measurement should be objective in a specific sense, that test items should be fair, and that utility of a model is more important than its truth. Our goal is not to criticize psychometrics for employing these values, but rather to bring them into the open and to show that these values are not inevitable and are in need of systematic evaluation. (shrink)

Geographic Information Science (GIS) is an interdisciplinary science aiming to detect and visually represent patterns in spatial data. GIS is used by businesses to determine where to open new stores and by conservation biologists to identify field study locations with relatively little anthropogenic influence. Products of GIS include topographic and thematic maps of the Earth’s surface, climate maps, and spatially referenced demographic graphs and charts. In addition to its social, political, and economic importance, GIS is of intrinsic philosophical interest due (...) to its methodological richness and because it is an instructive analogue to other sciences. This chapter works towards a philosophy of GIS and cartography, or PGISC. In particular, it examines practices of classifying geographic space, objects, and relations. By focusing on the use of natural kinds in data modeling and map generalization practices, I show how the making and using of kinds is contextual, fallible, plural, and purposive. (shrink)

This paper examines the role existence plays in measurement validity. I argue that existing popular theories of measurement and of validity follow a correspondence framework, which starts by assuming that an entity exists in the real world with certain properties that allow it to be measurable. Drawing on literature from the sociology of measurement, I show that the correspondence framework faces several theoretical and practical challenges. I suggested the validity-first framework of measurement, which starts with a practice-based validation process as (...) the basis for a measurement theory, and only posits objective existence when it is scientifically useful to do so. (shrink)

In the 1780s Kant’s critique of rational cosmology clearly identified the limits of theoretical cosmology in agreement with the doctrine of transcendental idealism of space and time. However, what seems to be less explored, and remains still a desideratum for the literature, is a thorough investigation of the implications of transcendental philosophy for Kant’s view of cosmology in the 1790s. This contribution fills this gap by investigating Kant’s view of teleology and measurement in the Critique of Judgment, exploring their implications (...) for Kant’s late view of cosmology. Considering the historical and scientific context in which Kant developed his reflections motivates my proposal to read Kant’s late view of the universe in terms of “functional cosmology.” -/- . (shrink)

Our understanding of implicit bias and how to measure it has yet to be settled. Various debates between cognitive scientists are unresolved. Moreover, the public’s understanding of implicit bias tests continues to lag behind cognitive scientists’. These discrepancies pose potential problems. After all, a great deal of implicit bias research has been publicly funded. Further, implicit bias tests continue to feature in discourse about public- and private-sector policies surrounding discrimination, inequality, and even the purpose of science. We aim to do (...) our part by reconstructing some of the recent arguments in ordinary language and then revealing some of the operative norms or values that are often hidden beneath the surface of these arguments. This may help the public learn more about the science of implicit bias. It may also help both laypeople and scientists reflect on the values, interests, and stakeholders involved in establishing, justifying, and communicating scientific research. (shrink)

Policies that require male-female sex comparisons in all areas of biomedical research conflict with the goal of improving health outcomes through context-sensitive individualization of medical care. Sex, like race, requires a rigorous, contextual approach in precision medicine. A “sex contextualist” approach to gender-inclusive medicine better aligns with this aim.

Review: J. E. Wolff. The metaphysics of quantity. New York: Oxford University Press, 2020. 240 pp, $72.00 HB.

Craniology – the practice of inferring intelligence differences from the measurement of human skulls – survived the dismissal of phrenology and remained a widely popular research program until the end of the nineteenth century. From the 1970s, historians and sociologists of science extensively focused on the explicit and implicit socio-cultural biases invalidating the evidence and claims that craniology produced. Building on this literature, I reassess the history of craniological practice from a different but complementary perspective that relies on recent developments (...) in the epistemology of measurement. More precisely, I identify two aspects of the measurement culture of nineteenth-century craniologists that are crucial to understand the lack of validity of craniological inference: their neglect of the problem of coordination for their presupposed quantification of intelligence and their narrow view of calibration. Based on my analysis, I claim that these methodological shortcomings amplified the impact of the socio-cultural biases of craniologists, which had a pervasive role in their evidential use of measurement. Finally, my argument shows how the epistemology of measurement perspective can offer useful tools in debates concerning the use of biological evidence to foster social discourse and for analyzing the relationship between theory, evidence, and measurement. (shrink)

Kant’s denial that psychology is a properly so-called natural science, owing to the lack of application of mathematics to inner sense, has garnered a great deal of attention from scholars. Although the interpretations of this claim are diverse, commentators by and large fail to ground their views on an account of Kant’s conception of applied mathematics. In this article, I develop such an account, according to which the application of mathematics to a natural science requires both a mathematical representation and (...) a metaphysical validation for the positive use of this representation to achieve a priori knowledge about nature. The second condition—that of metaphysical validation—has been overlooked in the literature. I show that psychology’s falling short of natural scientific propriety consists not in our lacking sufficient mathematical tools for the representation of inner states, according to Kant. After all, we can represent the mere temporality of inner states with the line and their intensities with numbers. Rather, the problem is that metaphysics does not validate the further use of such mathematical entities for the achievement of a priori knowledge about inner phenomena. (shrink)

This article examines the historical construction of depression over about a hundred years, employing the social life of methods as an explanatory framework. Specifically, it considers how emerging methodologies in the measurement of psychological constructs contributed to changes in epistemological approaches to mental illness and created the conditions of possibility for major shifts in the construction of depression. While depression was once seen as a feature of psychotic personality, measurement technologies made it possible for it to be reconstructed as changeable (...) and treatable. Different types of scaling techniques (Likert versus dichotomous scales) enabled the separation of depressive personality from reactive depression, paving the way for measuring the severity and intensity of emotions. Techniques to test sensitivity to change provided a means of demonstrating the efficacy of new psychoactive drug treatments. Later, more advanced techniques of precision scaling enabled the management of a new measurement problem, clinician unreliability, associated with the growing number of professionals involved in mental health care. Through statistical management of unreliability, the construct of depression has dramatically reduced over this period from hundreds of questionnaire items to potentially just two. Exploring the history of depression through this lens produces an alternative narrative to those that have emerged as a result of medicalisation and the actions of individuals and pressure groups. (shrink)

Derived measurements involve problems of coordination. Conducting them often requires detailed theoretical assumptions about their target, while such assumptions can lack sources of evidence that are independent from these very measurements. In this paper, I defend two claims about problems of coordination. I motivate both by a novel case study on a central measurement problem in the history of physical geodesy: the determination of the earth's ellipticity. First, I argue that the severity of problems of coordination varies according to scientists' (...) predictive and experimental control over perturbations of the measurement process. Second, I identify a methodology by which scientists can solve hard problems of coordination and gradually increase their predictive control over perturbations. I dub this methodology ‘operational pluralism’ since it is driven by the introduction of alternative measurement operations that involve different physical indicators. (shrink)

This paper critically explores Timothy Williamson’s view of evidence, and it does so in light of the problem of epistemic luck. Williamson’s view of evidence is, of course, a crucially important aspect of his novel and influential “knowledge-first” epistemological project. Notoriously, one crucial thesis of this project is that one’s evidence is equivalent to what one knows. This has come to be known as the E = K thesis. This paper specifically addresses Williamson’s knowledge-first epistemology and the E = K (...) thesis in the context of anti-luck epistemology and the idea that knowledge is factive. Williamson’s views on these matters are worth investigating in some detail because he subscribes to a well-worked out anti-luck view of knowledge that incorporates what is perhaps the most common anti-luck condition. But this paper is also of more general importance because the critique of Williamson’s views on these matters reveals some important things about the nature of evidence and evidence is one of the most fundamental concepts in epistemology. (shrink)

What does it mean to have “strong beliefs”? My thesis is that it can mean two very different things. That is, there are two distinct psychological features to which “strong belief” can refer, and these often come apart. I call the first feature epistemic confidence and the second identity centrality. They are conceptually distinct and, if we take ethnographies of religion seriously, distinct in fact as well. If that’s true, it’s methodologically important for the psychological sciences to have measures that (...) tease them apart. In this paper, I critique some measures that are currently in use and propose some strategies for developing measurement tools that track the distinction in question. (shrink)

This afterword to Species and Beyond provides some reflections on species, with special attention to what I think the most significant developments have been in the thinking of biologists and philosophers working on species over the past 25 years, as well as some bad jokes.

Thick concepts, namely those concepts that describe and evaluate simultaneously, present a challenge to science. Since science does not have a monopoly on value judgments, what is responsible research involving such concepts? Using measurement of wellbeing as an example, we first present the options open to researchers wishing to study phenomena denoted by such concepts. We argue that while it is possible to treat these concepts as technical terms, or to make the relevant value judgment in-house, the responsible thing to (...) do, especially in the context of public policy, is to make this value judgment through a legitimate political process that includes all the stakeholders of this research. We then develop a participatory model of measurement based on the ideal of co-production. To show that this model is feasible and realistic, we illustrate it with a case study of co-production of a concept of thriving conducted by the authors in collaboration with a UK anti-poverty charity Turn2us. (shrink)

Presentists argue that only the present is real. In this paper, I ask what duration the present has on a presentist’s account. While several answers are available, each of them requires the adoption of a measure and, with that adoption, additional work must be done to define the present. Whether presentists conclude that a reductionist account of duration is acceptable, that duration is not an applicable concept for their notion of the present, that the present has a duration of zero, (...) or that that the present has a duration, a more robust account of the present is required. I suggest that some of the most difficult questions about duration can be avoided at the cost of no longer viewing presentism as a theory about time, but rather as a theory about existence. In the conclusion, I suggest an interpretation of presentism that allows it to endorse the view that time is nothing more than the measure of change. (shrink)

Individuals of many animal species are said to have a personality. It has been shown that some individuals are bolder than other individuals of the same species, or more sociable or more aggressive. In this paper, we analyse what it means to say that an animal has a personality. We clarify what an animal personality is, that is, its ontology, and how different personality concepts relate to each other, and we examine how personality traits are identified in biological practice. Our (...) analysis shows that biologists often study specific personality traits, such as boldness, sociability or aggressiveness, rather than personalities in general. We claim that personality traits are best understood as dispositions and that they are operationally defined in terms of certain sets of behaviours, which are studied in specific experimental set-ups. Furthermore, we develop an integrative philosophical account that specifies and formalises three criteria for identifying personality traits, which are used in biological practice. For an individual animal to have a personality trait it must, first, behave differently than others. Second, these behavioural differences must be stable over a certain time, and third, they must be consistent in different contexts. (shrink)

What is a valid measuring instrument? Recent philosophy has attended to logic of justification of measures, such as construct validation, but not to the question of what it means for an instrument to be a valid measure of a construct. A prominent approach grounds validity in the existence of a causal link between the attribute and its detectable manifestations. Some of its proponents claim that, therefore, validity does not depend on pragmatics and research context. In this paper, I cast doubt (...) on the possibility of a context-independent causal account of validity. I assess several versions, arguing that all of them fail to judge the validity of measuring instruments correctly. Because different research purposes require different properties from measuring instruments, no account of validity succeeds without referring to the specific research purpose that creates the need for measurement in the first place. (shrink)

There is a received view on measurement scales. It includes both a classification of scales and a set of prescriptions regarding measurement inferences. This article casts doubt on the adequacy of this received view. To do this, I propose an epistemic characterization of the ordinal/interval distinction, that is, one in terms of researchers’ beliefs. This novel characterization reveals the ordinal/interval distinction as too coarse grained and thus the received view as too restrictive of a framework for measurement research.

The development of nineteenth-century geodetic measurement challenges the dominant coherentist account of measurement success. Coherentists argue that measurements of a quantity are epistemically successful if their numerical outcomes converge across varying contextual constraints. Aiming at numerical convergence, in turn, offers an operational aim for scientists to solve problems of coordination. Geodesists faced such a problem of coordination between two indicators of the earth’s ellipticity, which were both based on imperfect ellipsoid models. While not achieving numerical convergence, their measurements produced novel (...) data that grounded valuable theoretical hypotheses. Consequently, they ought to be regarded as epistemically successful. This insight warrants a dynamic revision of coherentism, allowing to judge the success of a metric based on both its coherence and fruitfulness. On that view, scientific measurement aims to coordinate theoretical definitions and produce novel data and theoretical insights. (shrink)

This paper reconstructs the history of the trigonometrical surveying of Kashmir from 1855 to 1865. It highlights the strategies through which surveyors had to justify the employment of high-precision instruments and methods in Himalayan terrain. Only by tediously manipulating their institutional environment in India and Britain did the staff of the Kashmir survey manage to complete its operations in light of constant financial and physical hardship. To sustain their measurements, surveyors aligned themselves with various political projects, entertaining and shifting allegiances (...) with local rulers, scientific societies, and colonial institutions. After suffering severe cuts to instruments and assistance staff, the party was entirely stripped of funds by the East India Company in 1857 and relied on the material support of Maharaja Gulab Singh. Subsequently, surveyors adopted an expansionist rhetoric to gather the support of the Royal Geographical Society. In doing so, they framed precision as an essential contribution to imperial expansion, effective colonial rule, and intervention in ‘backward’ Kashmiri society and infrastructure. The Kashmir survey illustrates that rendering precision valuable requires an ongoing performative effort of justification to align epistemic with political and institutional interests. (shrink)

The popular science of phrenology is known for its preoccupation with geniuses and criminals, but this article shows that phrenologists also introduced ideas about the ‘average’ person. Popular phrenologists in the US and the UK examined the heads of their clients to give an indication of their character. Based on the publications of phrenologists and on a large collection of standardized charts with clients’ scores, this article analyses their definition of what they considered to be the ‘average’. It can be (...) concluded that phrenologists were some of the first to teach individuals to see their identity in relation to an imagined statistical community. (shrink)

The representational theory of measurement has long been the central paradigm in the philosophy of measurement. Such is not the case anymore, partly under the influence of the critique according to which RTM offers too poor descriptions of the measurement procedures actually followed in science. This can be called the metrological critique of RTM. I claim that the critique is partly irrelevant. This is because, in general, RTM is not in the business of describing measurement procedures, be it in idealized (...) form. To support this claim, I present various cases where RTM can be said to investigate measurement without providing any measurement procedure. Such limit cases lead to a better understanding of the RTM project. They also illustrate some of the questions which the philosophy of measurement can explore, when it is ready to go beyond the metrological viewpoint. (shrink)

At the intersection of taxonomy and nomenclature lies the scientific practice of typification. This practice occurs in biology with the use of holotypes (type specimens), in geology with the use of stratotypes, and in metrology with the use of measurement prototypes. In this paper I develop the first general definition of a scientific type and outline a new philosophical theory of types inspired by Pierre Duhem. I use this general framework to resolve the necessity-contingency debate about type specimens in philosophy (...) of biology, to advance the debate over the myth of the absolute accuracy of standards in metrology, and to address the definition-correlation debate in geology. I conclude that just as there has been a productive synergy between philosophical accounts of natural kinds and scientific taxonomic practices, so too there is much to be gained from developing a deeper understanding of the practices and philosophy of scientific types. (shrink)

What is the status of research on implicit bias? In light of meta-analyses revealing ostensibly low average correlations between implicit measures and behavior, as well as various other psychometric concerns, criticism has become ubiquitous. We argue that while there are significant challenges and ample room for improvement, research on the causes, psychological properties, and behavioral effects of implicit bias continues to deserve a role in the sciences of the mind as well as in efforts to understand, and ultimately combat, discrimination (...) and inequality. (shrink)

Multiple determination is the epistemic strategy of establishing the same result by means of multiple, independent procedures. It is an important strategy praised by both philosophers of science and practicing scientists. Despite the heavy appeal to multiple determination, little analysis has been provided regarding the specific grounds upon which its epistemic virtues rest. This article distinguishes between the various dimensions of multiple determination and shows how they can be used to evaluate the epistemic force of the strategy in particular cases. (...) Distinguishing between the various dimensions helps to resolve the disagreements regarding the relevance and epistemic import of multiple determination for scientific research. It also suggests a fruitful mode of interaction between the philosophy of science and (historical) accounts of scientific practice. (shrink)

This discussion centers on two desiderata: the role of measurement in information-gathering and physical interaction in scientific practice. By taking inspiration from van Fraassen’s view, we present a methodological account of perspectival measurement that addresses empirical practice where there is complex intervention, disagreeing results, and limited theory. The specific aim of our account is to provide a methodological prescription for developing measurement processes in the context of limited theory. The account should be useful to philosophers of science, who are interested (...) in the intersection between representation and intervention; scientists, who are interested in methodological suggestions for theory-development and reliability; and interdisciplinary researchers, who are interested in the intersections between the pandemic, built environments, and social processes. We apply the process-view of measurement to COVID-19, specifically, measuring replication in the SARS-CoV-2 virus. The aim is to show that our account tracks key elements—manipulation/intervention, independence, invariance, and theory-development—by organizing unfolding measurement processes. Additionally, we use our account to make prescriptive suggestions for measurement practice in the COVID-19 context by discussing the need to broaden measurement perspective on interaction, manipulation, and production. (shrink)

In this paper, I argue for a distinction between two scales of coordination in scientific inquiry, through which I reassess Georg Simon Ohm’s work on conductivity and resistance. Firstly, I propose to distinguish between measurement coordination, which refers to the specific problem of how to justify the attribution of values to a quantity by using a certain measurement procedure, and general coordination, which refers to the broader issue of justifying the representation of an empirical regularity by means of abstract mathematical (...) tools. Secondly, I argue that the development of Ohm’s measurement practice between the first and the second experimental phase of his work involved the change of the measurement coordination on which he relied to express his empirical results. By showing how Ohm relied on different calibration assumptions and practices across the two phases, I demonstrate that the concurrent change of both Ohm’s experimental apparatus and the variable that Ohm measured should be viewed based on the different form of measurement coordination. Finally, I argue that Ohm’s assumption that tension is equally distributed in the circuit is best understood as part of the general coordination between Ohm’s law and the empirical regularity that it expresses, rather than measurement coordination. (shrink)

In this dissertation, I present a novel account of the components that have a peculiar epistemic role in our scientific inquiries, since they contribute to establishing a form of coordination. The issue of coordination is a classic epistemic problem concerning how we justify our use of abstract conceptual tools to represent concrete phenomena. For instance, how could we get to represent universal gravitation as a mathematical formula or temperature by means of a numerical scale? This problem is particularly pressing when (...) justification for using these abstract tools comes, in part or entirely, from knowledge which is not independent from them, thus leading to threats of circularity. Achieving coordination between some abstract conceptual tools and the concrete phenomena that they are supposed to represent is usually a complex process, which involves several epistemic components. Some of these components eventually provide stable conditions for applying those abstract representations to concrete phenomena. It is in this sense of providing certain conditions of applicability that different philosophical traditions, as well as some contemporary reappraisals, view these components as constitutive or a priori. In this work, I present a new gradualist, contextualist, and relational approach to understand these constitutive components of scientific inquiry. It is gradualist inasmuch as the degree to which some component is constitutive depends on three quantifiable features: quasi-axiomaticity, generative potential, and empirical shielding. Since the quantification of these three features impinges on the history and practice of using these components in a scientific context, my approach is a contextualist one. Finally, my approach is relational in a double sense: first, it identifies ordinal relationships among epistemic components with respect to their constitutive character; second, these relationships are relative to a scientific framework of inquiry. After introducing my account and a classic example of constitutively a priori principles, i.e., Friedman’s (2001) analysis of Newtonian mechanics, I turn to my own case studies to demonstrate the advantages of my approach. Firstly, I discuss Okasha’s (2018) view of endogenization as a pervasive theoretical strategy in evolutionary biology and suggest that the constitutive character of the core Darwinian principles progressively increases with endogenization. Secondly, I apply a conceptual distinction between two varieties or scopes of coordination – general coordination and coordination in measurement – to Ohm’s work on electrical conductivity. This distinction allows me to pinpoint to what extent components along different dimensions (e.g., instrumentation, measurement, theorising, etc.) were constitutive of the forms of coordination which Ohm relied on. Thirdly, I discuss the epistemic function of the Hardy-Weinberg principle in the history and practice of population genetics. I assess this principle in terms of my account and identify approximation and stability as two components that are highly constitutive, in that they contribute to justifying its use in population genetics. Finally, applying my account to these case studies enables me to identify at least three qualitatively different types of constitutive components: domain-specific theoretical principles, material components, and domain-independent assumptions underlying reasoning abilities. In the light of my results, I draw some general conclusions on epistemic justification and scientific knowledge. (shrink)

In his review of Charles Spearman’s The Nature of ‘Intelligence’, R. G. Collingwood launched an attack upon psychometrics that was expanded in his Essay on Metaphysics. Although underrated by friend and foe alike, Collingwood’s critique identified a number of defects in the thinking of psychometricians that subsequently became entrenched. However, his main complaint was that psychology generally was a ‘fashionable scientific fraud’. This charge was inspired by his more general views on logic and metaphysics, which, however, as I argue, are (...) logically unsustainable. Ironically, other elements of his philosophy – his ‘fallacy of calculation’ and concept of ‘scale of forms’ – are relevant to psychometrics and tip the scales in favour of his otherwise unwarranted charge. (shrink)

Author's summary: I discuss the lessons that scientific realism, understood as a thesis about the metaphysical, epistemological, and semantic interpretation of scientific theories, has to learn from the philosophy of scientific practice. The standard arguments for scientific realism are shown to be incompatible with a practice-based understanding of theories, as they fail short of offering operationally sound concepts of "truth" and "reality. " I propose Hasok Chang's Active Realism (AR) as a solution to this compatibility problem and defend it against (...) common anti-realist arguments. Finally, I hold that AR offers important lessons for discussing the epistemic authority of scientific theories in public discourse: instead of the claims of scientific theories to truth, these discussions should focus on correct and incorrect domains of theory application. (shrink)

Newton published his deduction of universal gravity in Principia (first ed., 1687). To establish the universality (the particle-to-particle nature) of gravity, Newton must establish the additivity of mass. I call ‘additivity’ the property a body's quantity of matter has just in case, if gravitational force is proportional to that quantity, the force can be taken to be the sum of forces proportional to each particle's quantity of matter. Newton's argument for additivity is obscure. I analyze and assess manuscript versions of (...) Newton's initial argument within his initial deduction, dating from early 1685. Newton's strategy depends on distinguishing two quantities of matter, which I call ‘active’ and ‘passive’, by how they are measured. These measurement procedures frame conditions on the additivity of each quantity so measured. While Newton has direct evidence for the additivity of passive quantity of matter, he does not for that of the active quantity. Instead, he tries to infer the latter from the former via conceptual analyses of the third law of motion grounded largely on analogies to magnetic attractions. The conditions needed to establish passive additivity frustrate Newton's attempted inference to active additivity. (shrink)

Reports of quantitative experimental results often distinguish between the statistical uncertainty and the systematic uncertainty that characterize measurement outcomes. This article discusses the practice of estimating systematic uncertainty in high-energy physics. The estimation of systematic uncertainty in HEP should be understood as a minimal form of quantitative robustness analysis. The secure evidence framework is used to explain the epistemic significance of robustness analysis. However, the empirical value of a measurement result depends crucially not only on the resulting systematic uncertainty estimate, (...) but on the learning aims for which that result will be used. Important conceptual and practical questions regarding systematic uncertainty assessment call for further investigation. _1_ Introduction _2_ Systematic Uncertainty: The Very Idea _3_ Systematic Uncertainty in High-Energy Physics _4_ Methodological Debates in High-Energy Physics _5_ The Secure Evidence Framework _6_ Systematic Uncertainty Assessment as Robustness Analysis _7_ Security and Sensitivity _8_ Conclusion Appendix. (shrink)

We identify several ongoing debates related to implicit measures, surveying prominent views and considerations in each debate. First, we summarize the debate regarding whether performance on implicit measures is explained by conscious or unconscious representations. Second, we discuss the cognitive structure of the operative constructs: are they associatively or propositionally structured? Third, we review debates whether performance on implicit measures reflects traits or states. Fourth, we discuss the question of whether a person’s performance on an implicit measure reflects characteristics of (...) the person who is taking the test or characteristics of the situation in which the person is taking the test. Finally, we survey the debate about the relationship between implicit measures and (other kinds of) behavior. (shrink)

This article discusses the definitions of ‘‘measurement uncertainty” given in the three editions of the International Vocabulary of Metrology (VIM) and a fourth definition which was suggested for the next edition of this document. It is argued that none of the definitions is satisfying. First, a thorough definition of measurement uncertainty should supply an explanation about the meaning of the concept, which is missing from the VIM2&3. Secondly, when provided, the meanings are not accurate enough: the VIM1 version is flawed (...) and the possible future definition appeals to an overly restrictive notion of ‘‘belief”. Alternative options are then proposed, based on the conclusions that (i) measurement uncertainty is a statement – an inference – made by the experimenter about the measurand; (ii) it is only based on what is accessible to one’s knowledge, and therefore rests on the hypothesis that no unknown systematic error affects the measurement. (shrink)

This article develops a historico-critical analysis of uncertainty and accuracy in measurement through a case-study of the adjustment of the fundamental physical constants, in order to investigate the sceptical “problem of unknowability” undermining realist accounts of measurement. Every scientific result must include a “measurement uncertainty”, but uncertainty cannot be be eval- uated against the unknown, and therefore cannot be taken as an assessment of “accuracy”, defined in the metrological vocabulary as the closeness to the truth. The way scientists use and (...) interpret uncertainty in the adjustment activity illustrates how they try to overcome this predicament. I iden- tify two operative roles of measurement uncertainty, in the comparison and in the combination of measurement results. This duality implies a tension between selection and combination when aggregating results, leading to a crucial question: should the evaluation of uncertainties favour safety over precision? I present contrasting answers and identify a specific account of physicists who implicitly try to conciliate realism with the problem of unknowability. I argue that this invites us to reconsider accuracy from a dynamical standpoint, as the gradual achievement of scientific progress through error correction. Finally, I present two interpretations of measurement uncertainty, objective and epistemic, which I criticize and suggest improvements to. (shrink)