The study of human behavior is severely hampered by logistical problems, ethical and legal constraints, and funding shortfalls. However, the biggest difficulty of conducting social and behavioral research is the extraordinary complexity of the study phenomena. In this article, we review the impact of complexity on research design, hypothesis testing, measurement, data analyses, reproducibility, and the communication of findings in psychological science. The systematic investigation of the world often requires different approaches because of the variability in complexity. Confirmatory testing, multi-factorial (...) designs, survey methods, large samples, and modeling are frequently needed to study complex social and behavioral topics. Complexity impedes the measurement of general constructs, the reproducibility of results and scientific reporting, and the general rigor of research. Many of the benchmarks established by classic work in physical science are not attainable in studies of more complex phenomena. Consequently, the standards used to evaluate scientific research should be tethered to the complexity of the study topic. (shrink)

The evidence of your own eyes has often been regarded as unproblematic. But we know that people make mistaken observations. This can be looked on as unimportant if there issome class of statements that can serve as evidence for others, or if every statement in our corpus of knowledge is allowed to be no more than probable. Neither of these alternatives is plausible when it comes to machine or robotic observation. Then we must take the possibility of error seriously, and (...) we must be prepared to deal with error quantitatively. The problem of using internal evidence to arrive at error distributions is the main focus of the paper. (shrink)

This discussion centers on two desiderata: the role of measurement in information-gathering and physical interaction in scientific practice. By taking inspiration from van Fraassen’s view, we present a methodological account of perspectival measurement that addresses empirical practice where there is complex intervention, disagreeing results, and limited theory. The specific aim of our account is to provide a methodological prescription for developing measurement processes in the context of limited theory. The account should be useful to philosophers of science, who are interested (...) in the intersection between representation and intervention; scientists, who are interested in methodological suggestions for theory-development and reliability; and interdisciplinary researchers, who are interested in the intersections between the pandemic, built environments, and social processes. We apply the process-view of measurement to COVID-19, specifically, measuring replication in the SARS-CoV-2 virus. The aim is to show that our account tracks key elements—manipulation/intervention, independence, invariance, and theory-development—by organizing unfolding measurement processes. Additionally, we use our account to make prescriptive suggestions for measurement practice in the COVID-19 context by discussing the need to broaden measurement perspective on interaction, manipulation, and production. (shrink)

In experimental settings, scientists often “make” new things, in which case the aim is to intervene in order to produce experimental objects and processes—characterized as ‘effects’. In this discussion, I illuminate an important performative function in measurement and experimentation in general: intervention-based experimental production (IEP). I argue that even though the goal of IEP is the production of new effects, it can be informative for causal details in scientific representations. Specifically, IEP can be informative about causal relations in: regularities under (...) study; ‘intervention systems’, which are measurement/experimental systems; and new technological systems. (shrink)

Though he maintained a significant interest in theoretical aspects of measurement, Henry E. Kyburg, Jr. was critical of the representational theory that in many ways has come to dominate discussions concerning the foundations of measurement. In particular, Kyburg (in Savage and Ehrlich (eds) Philosophical and foundational issues in measurement theory, 1992 ) asserts that the representational theory of measurement, as introduced in (Scott and Suppes, Journal of Symbolic Logic, 23:113–128, 1958 ) and developed in (Krantz et al., Foundations of measurment: (...) additive and polynomial representations. Academic Press, 1971 ), cannot account for the measurement of error. The present work examines and responds to this charge. (shrink)

This paper offers a novel way of reconstructing conceptual change in empirical theories. Changes occur in terms of the structure of the dimensions—that is to say, the conceptual spaces—underlying the conceptual framework within which a given theory is formulated. Five types of changes are identified: (1) addition or deletion of special laws, (2) change in scale or metric, (3) change in the importance of dimensions, (4) change in the separability of dimensions, and (5) addition or deletion of dimensions. Given this (...) classification, the conceptual development of empirical theories becomes more gradual and rationalizable. Only the most extreme type—replacement of dimensions—comes close to a revolution. The five types are exemplified and applied in a case study on the development within physics from the original Newtonian mechanics to special relativity theory. (shrink)

Putnam's ``model-theoretic'' argument against metaphysical realism presupposes that an ideal scientific theory is expressible in a first order language. The central aim of this paper is to show that Putnam's ``first orderization'' of science, although unchallenged by numerous critics, makes his argument unsound even for adequate theories, never mind an ideal one. To this end, I will argue that quantitative theories, which dominate the natural sciences, can be adequately interpreted and evaluated only with the help of so-called theories of measurement (...) whose epistemological and methodological purpose is to justify systematic assignments of quantitative values to objects in the world. And, in order to fulfill this purpose, theories of measurement must have an essentially higher order logical structure. As a result, Putnam's argument fails because much of science turns out to rest on essentially higher order theoretical assumptions about the world. (shrink)

This work develops an epistemology of measurement, that is, an account of the conditions under which measurement and standardization methods produce knowledge as well as the nature, scope, and limits of this knowledge. I focus on three questions: (i) how is it possible to tell whether an instrument measures the quantity it is intended to? (ii) what do claims to measurement accuracy amount to, and how might such claims be justified? (iii) when is disagreement among instruments a sign of error, (...) and when does it imply that instruments measure different quantities? Based on a series of case studies conducted in collaboration with the US National Institute of Standards and Technology (NIST), I argue for a model-based approach to the epistemology of physical measurement. To measure a physical quantity, I argue, is to estimate the value of a parameter in an idealized model of a physical process. Such estimation involves inference from the final state (‘indication’) of a process to the value range of a parameter (‘outcome’) in light of theoretical and statistical assumptions. Contrary to contemporary philosophical views, measurement outcomes cannot be obtained by mapping the structure of indications. Instead, measurement outcomes as well as claims to accuracy, error and quantity individuation can only be adjudicated relative to a choice of idealized modelling assumptions. (shrink)