This paper discusses critically what simulation models of the evolution of cooperation can possibly prove by examining Axelrod’s “Evolution of Cooperation” (1984) and the modeling tradition it has inspired. Hardly any of the many simulation models in this tradition have been applicable empirically. Axelrod’s role model suggested a research design that seemingly allowed to draw general conclusions from simulation models even if the mechanisms that drive the simulation could not be identified empirically. But this research (...) design was fundamentally flawed. At best such simulations can claim to prove logical possibilities, i.e. they prove that certain phenomena are possible as the consequence of the modeling assumptions built into the simulation, but not that they are possible or can be expected to occur in reality. I suggest several requirements under which proofs of logical possibilities can nevertheless be considered useful. Sadly, most Axelrod-style simulations do not meet these requirements. It would be better not to use this kind of simulations at all. (shrink)

This paper discusses critically what simulation models of the evolution ofcooperation can possibly prove by examining Axelrod’s “Evolution of Cooperation” and the modeling tradition it has inspired. Hardly any of the many simulation models of the evolution of cooperation in this tradition have been applicable empirically. Axelrod’s role model suggested a research design that seemingly allowed to draw general conclusions from simulation models even if the mechanisms that drive the simulation could not be identified empirically. (...) But this research design was fundamentally flawed, because it is not possible to draw general empirical conclusions from theoretical simulations. At best such simulations can claim to prove logical possibilities, i.e. they prove that certain phenomena are possible as the consequence of the modeling assumptions built into the simulation, but not that they are possible or can be expected to occur in reality I suggest several requirements under which proofs of logical possibilities can nevertheless be considered useful. Sadly, most Axelrod-style simulations do not meet these requirements. I contrast this with Schelling’s neighborhood segregation model, thecore mechanism of which can be retraced empirically. (shrink)

One approach to validating simulation models is to formally compare model outputs with independent data. We consider such model validation from the point of view of Frequentist statistics. A range of estimates and tests of goodness of fit have been advanced. We review these approaches, and demonstrate that some of the tests suffer from difficulties in interpretation because they rely on the null hypothesisHypothesis that the model is similar to the observationsObservations. This reliance creates two unpleasant (...) possibilities, namely, a model could be spuriously validated when dataData are too few, or inappropriately rejected when data are too many. Finally, these tests do not allow a principled declaration of what a reasonable level of difference would be considering the purposes to which the model will be put. We consider equivalence tests, and demonstrate that they do not suffer from the previously identified shortcomings. We provide two case studies to illustrate the claims of the chapter. (shrink)

Using an example of a computer simulation of the convective structure of a red giant star, this paper argues that simulation is a rich inferential process, and not simply a "number crunching" technique. The scientific practice of simulation, moreover, poses some interesting and challenging epistemological and methodological issues for the philosophy of science. I will also argue that these challenges would be best addressed by a philosophy of science that places less emphasis on the representational capacity of (...) theories (and ascribes that capacity instead to models) and more emphasis on the role of theory in guiding (rather than determining) the construction of models. (shrink)

Computer simulations are nowadays often directly involved in the generation of experimental results. Given this dependency of experiments on computer simulations, that of simulations on models, and that of the models on free parameters, how do researchers establish trust in their experimental results? Using high-energy physics (HEP) as a case study, I will identify three different types of robustness that I call conceptual, methodological, and parametric robustness, and show how they can sanction this trust. However, as I will also show, (...) simulation models in HEP themselves fail to exhibit a type of robustness I call inverse parametric robustness. This combination of robustness and failures thereof is best understood by distinguishing different epistemic capacities of simulations and different senses of trust: Trusting simulations in their capacity to facilitate credible experimental results can mean accepting them as means for generating belief in these results, while this need not imply believing the models themselves in their capacity to represent an underlying reality. (shrink)

Using an example of a computer simulation of the convective structure of a red giant star, this paper argues that simulation is a rich inferential process, and not simply a “number crunching” technique. The scientific practice of simulation, moreover, poses some interesting and challenging epistemological and methodological issues for the philosophy of science. I will also argue that these challenges would be best addressed by a philosophy of science that places less emphasis on the representational capacity of (...) theories and more emphasis on the role of theory in guiding the construction of models. (shrink)

The teleological language in the target article is ill-advised, as it obscures the question of whether ecological and cultural inheritances are directed or random. Laland et al. present a very broad palette of explanatory possibilities; evolutionary simulation models could help narrow down the processes important in a particular case. Examples of such models are offered in the areas of language change and the Baldwin effect.

For computer simulation models to usefully inform climate risk management, uncertainties in model projections must be explored and characterized. Because doing so requires running the model many ti...

In this paper we investigate intergroup conflict and examine the impact of strategies to manage and hopefully reduce it. To do this, we use a probabilistic computer simulation model, based on feedback principles. The model examines how conflict between two groups evolves over time. Group differences and the occurrence of intergroup incidents drive the model. Intergroup hostility which depends on past history, recent conflict incidents, and group differences is the key variable that indicates the proclivity toward (...) conflict between the two groups. We use the model to examine various cases and the effect of conflict management strategies. Based on the model results, we develop some conclusions about the applicability of the findings to actual situations, as well as directions for further research. (shrink)

Recent technical improvements, such as 3D microscopy imaging, have shown the necessity of studying 3D biological tissue architecture during carcinogenesis. In the present paper a computer simulation model is developed allowing the visualization of the microscopic biological tissue architecture during the development of metaplastic and dysplastic lesions.The static part of the model allows the simulation of the normal, metaplastic and dysplastic architecture of an external epithelium. This model is associated to a knowledge base which contains (...) only data on the nasal epithelium. The latter has been well studied by numerous authors and its lesional states are well known. An inference engine allows the initialization of the static model parameters. A statistical comparison between simulated epithelia and real epithelia is achieved by adjusting the parameter values during the simulation. (shrink)

This article uses simulation as an empirical method for identifying process models of strategy effects in a category-learning task. A general set of learning assumptions defined a symbolic learning framework in which alternative simulation models were defined and tested. The goal was to identify process models that could account for previously reported data on the interaction between how a learner encounters category variance across a series of training samples and whether the task instructions suggested an active, hypothesis-testing approach, (...) or a more passive learning mode. Descriptive characterizations of active and passive learning were mapped into complementary settings of parameters operating with the general learning framework. Alternative models, defined by different configurations of these parameters, were evaluated on their goodness of fit to the observed data. The signature differences between models that best fit the passive learning data and models that best fit the active learning data concerned a delayed versus immediate learning parameter and a degree-of-match parameter that determined which patterns were retrieved to make category decisions. A functional account of these parameters is given by considering the learning task as a search process and the role of these parameters in localizing the impact of learning mechanisms in certain areas of the search space. Issues related to simulation as an empirical method for identifying candidate process models are discussed. (shrink)

Computational models of group opinion dynamics are one of the most active fields of sociophysics. In recent years, advances in model complexity and, in particular, the possibility to connect these models with detailed data describing individual behaviors, preferences and activities, have opened the way for the simulations to describe quantitatively selected, real world social systems. The simulations could be then used to study ‘what-if’ scenarios for opinion change campaigns, political, ideological or commercial. The possibility of the practical application of (...) the attitude change models necessitates that the research community working in the field should consider more seriously the moral aspects of their efforts, in particular the potential for their use for unintended goals. The paper discusses these issues, and offers a suggestion for a new research direction: using the attitude models to increase the awareness and detection of social manipulation cases. Such research would offer a scientific challenge and meet the ethical criteria. (shrink)

We claim that adjustable parameters play a crucial role in building and applying simulation models. We analyze that role and illustrate our findings using examples from equations of state in thermodynamics. In building simulation models, two types of experiments, namely, simulation and classical experiments, interact in a feedback loop, in which model parameters are adjusted. A critical discussion of how adjustable parameters function shows that they are boon and bane of simulation. They help to enlarge (...) the scope of simulation far beyond what can be determined by theoretical knowledge, but at the same time undercut the epistemic value of simulation models. (shrink)

Many philosophical accounts of scientific models fail to distinguish between a simulation model and other forms of models. This failure is unfortunate because there are important differences pertaining to their methodology and epistemology that favor their philosophical understanding. The core claim presented here is that simulation models are rich and complex units of analysis in their own right, that they depart from known forms of scientific models in significant ways, and that a proper understanding of the type (...) of model simulations are fundamental for their philosophical assessment. I argue that simulation models can be distinguished from other forms of models by the many algorithmic structures, representation relations, and new semantic connections involved in their architecture. In this article, I reconstruct a general architecture for a simulation model, one that faithfully captures the complexities involved in most scientific research with computer simulations. Furthermore, I submit that a new methodology capable of conforming such architecture into a fully functional, computationally tractable computer simulation must be in place. I discuss this methodology—what I call recasting—and argue for its philosophical novelty. If these efforts are heading towards the right interpretation of simulation models, then one can show that computer simulations shed new light on the philosophy of science. To illustrate the potential of my interpretation of simulation models, I briefly discuss simulation-based explanations as a novel approach to questions about scientific explanation. (shrink)

We claim that adjustable parameters play a crucial role in building and applying simulation models. We analyze that role and illustrate our findings using examples from equations of state in thermodynamics. In building simulation models, two types of experiments, namely, simulation and classical experiments, interact in a feedback loop, in which model parameters are adjusted. A critical discussion of how adjustable parameters function shows that they are boon and bane of simulation. They help to enlarge (...) the scope of simulation far beyond what can be determined by theoretical knowledge, but at the same time undercut the epistemic value of simulation models. (shrink)

In this paper I argue for a distinction between subjective and value laden aspects of judgements showing why equating the former with the latter has the potential to confuse matters when the goal is uncovering the influence of political influences on scientific practice. I will focus on three separate but interrelated issues. The first concerns the issue of ‘verification’ in computational modelling. This is a practice that involves a number of formal techniques but as I show, even these allegedly objective (...) methods ultimately rely on subjective estimation and evaluation of different types of parameters. This has implications for my second point which relates to uncertainty quantification—an assessment of the degree of uncertainty present in a particular modelling scenario. I argue that while this practice also involves subjective elements, in no way does that detract from its status as an epistemic exercise. Finally I discuss the relation between accuracy and uncertainty and how each relates to judgements that embody social/ethical/political concerns, in particular those associated with high consequence systems. (shrink)

Starting from some remarks about the use of models in psychology, Human Information Processing (henceforth called H.I.P.) models which sometimes use computer simulation will be examined. An attempt to show that simulation in psychology does not necessarily imply an H.I.P. approach is then made.

Simulation models of the Reiterated Prisoner's Dilemma have been popular for studying the evolution of cooperation since more than 30 years now. However, there have been practically no successful instances of empirical application of any of these models. At the same time this lack of empirical testing and confirmation has almost entirely been ignored by the modelers community. In this paper, I examine some of the typical narratives and standard arguments with which these models are justified by their authors (...) despite the lack of empirical validation. I find that most of the narratives and arguments are not at all compelling. None the less they seem to serve an important function in keeping the simulation business running despite its empirical shortcomings. (shrink)

When can macroscopic data about a system be used to set parameters in a microfoundational simulation? We examine the epistemic viability of tweaking parameter values to generate a better fit between the outcome of a simulation and the available observational data. We restrict our focus to microfoundational simulations—those simulations that attempt to replicate the macrobehavior of a target system by modeling interactions between microentities. We argue that tweaking can be effective but that there are two central risks. First, (...) tweaking risks overfitting the simulation to the data and thus compromising predictive accuracy; and second, it risks compromising the microfoundationality of the simulation. We evaluate standard responses to tweaking and propose strategies to guard against these risks. (shrink)

Objectives To explore how factors relating to grades and grading affect the correctness of choices that grant-review panels make among submitted proposals. To identify interventions in panel design that may be expected to increase the correctness of choices. -/- Method Experimentation with an empirically-calibrated computer simulation model of panel review. Model parameters are set in accordance with procedures at a national science funding agency. Correctness of choices among research proposals is operationalized as agreement with the choices of (...) an elite panel. -/- Conclusions The simulation model generates several hypotheses to guide further research. Increasing the number of grades used by panel members increases the correctness of simulated choices among submitted proposals. Collective decision procedures giving panels a greater capacity for discriminating among proposals also increase correctness. Surprisingly, differences in grading standards among panel members do not appreciably decrease correctness. (shrink)

Finding suitable analysis techniques for networks generated from social processes is a difficult task when the population changes over time. Traditional social network analysis measures may not work in such circumstances. It is argued that agent-based social networks should not be constrained by a priori assumptions about the evolved network and/or the analysis techniques. In most agent-based social simulation models, the number of agents remains fixed throughout the simulation; this paper considers the case when this does not hold. (...) Thus the aim of this paper is to demonstrate how the network signatures change when the agents’ population depends upon endogenous social processes. We argue for a much wider attention from the social simulation community in addressing this open research problem. (shrink)

Formidable difficulties face anyone trying to model social phenomena using a formal system, such as a computer program. The differences between formal systems and complex, multi-facetted and meaning-laden social systems are so fundamental that many will criticise any attempt to bridge this gap. Despite this, there are those who are so bullish about the project of social simulation that they appear to believe that simple computer models, that are also useful and reliable indicators of how aspects of society (...) works, are not only possible but within our grasp. This paper seeks to pour water on such optimism but, on the other hand, show that useful computational models might be ‘evolved’ In this way it is disagreeing with both naive positivist and relativistic post-modernist positions. However this will require a greater ‘selective pressure’ against models that are not grounded in evidence, ‘floating models’, and will result in a plethora of complex and context-specific models. (shrink)

The paper presents an argument for treating certain types of computer simulation as having the same epistemic status as experimental measurement. While this may seem a rather counterintuitive view it becomes less so when one looks carefully at the role that models play in experimental activity, particularly measurement. I begin by discussing how models function as “measuring instruments” and go on to examine the ways in which simulation can be said to constitute an experimental activity. By focussing on (...) the connections between models and their various functions, simulation and experiment one can begin to see similarities in the practices associated with each type of activity. Establishing the connections between simulation and particular types of modelling strategies and highlighting the ways in which those strategies are essential features of experimentation allows us to clarify the contexts in which we can legitimately call computer simulation a form of experimental measurement. (shrink)

This book analyses the impact computerization has had on contemporary science and explains the origins, technical nature and epistemological consequences of the current decisive interplay between technology and science: an intertwining of formalism, computation, data acquisition, data and visualization and how these factors have led to the spread of simulation models since the 1950s. -/- Using historical, comparative and interpretative case studies from a range of disciplines, with a particular emphasis on the case of plant studies, the author shows (...) how and why computers, data treatment devices and programming languages have occasioned a gradual but irresistible and massive shift from mathematical models to computer simulations. -/- . (shrink)

Qualitative validation consists in showing that a model is able to mimic available observed data. In population level biological models, the available data frequently represent a group status, such as pool testing, rather than the individual statuses. They are aggregated. Our objective was to explore an approach for qualitative validation of a model with aggregated data and to apply it to validate a stochastic model simulating the bovine viral-diarrhoea virus (BVDV) spread within a dairy cattle herd. Repeated (...) measures of the level of BVDV-specific antibodies in the bulk-tank milk (total milk production of a herd) were used to summarise the BVDV herd status. First, a domain of validation was defined to ensure a comparison restricted to dynamics of pathogen spread well identified among observed aggregated data (new herd infection with a wide BVDV spread). For simulations, scenarios were defined and simulation outputs at the individual animal level were aggregated at the herd level using an aggregation function. Comparison was done only for observed data and simulated aggregated outputs that were in the domain of validation. The validity of our BVDV model was not rejected. Drawbacks and ways of improvement of the approach are discussed. (shrink)

one takes to be the most salient, any pair could be judged more similar to each other than to the third. Goodman uses this second problem to showthat there can be no context-free similarity metric, either in the trivial case or in a scientifically ...

Mindreading is the ability to attribute mental states to other individuals. According to the Theory-Theory (TT), mindreading is based on one's possession of a Theory of Mind. On the other hand, the Simulation Theory (ST) maintains that one arrives at the attribution of a mental state by simulating it in one's own mind. In this paper, I propose a ST-TT hybrid model of the ability to attribute disgust on the basis of visual stimuli such as facial expressions, body (...) postures, etc. More precisely, while I defend Goldman's (2006) thesis that the ability to attribute disgust based on observing disgusted facial expressions stems from a mirror-based simulation process, I argue that ST is unable to account for the ability to attribute disgust based on non-facial visual stimuli; I propose, rather, that this latter ability is theory-based. My model is grounded in evidence from individuals suffering from Huntington's Disease. (shrink)

Recent application of theories of embodied or grounded cognition to the recognition and interpretation of facial expression of emotion has led to an explosion of research in psychology and the neurosciences. However, despite the accelerating number of reported findings, it remains unclear how the many component processes of emotion and their neural mechanisms actually support embodied simulation. Equally unclear is what triggers the use of embodied simulation versus perceptual or conceptual strategies in determining meaning. The present article integrates (...) behavioral research from social psychology with recent research in neurosciences in order to provide coherence to the extant and future research on this topic. The roles of several of the brain's reward systems, and the amygdala, somatosensory cortices, and motor centers are examined. These are then linked to behavioral and brain research on facial mimicry and eye gaze. Articulation of the mediators and moderators of facial mimicry and gaze are particularly useful in guiding interpretation of relevant findings from neurosciences. Finally, a model of the processing of the smile, the most complex of the facial expressions, is presented as a means to illustrate how to advance the application of theories of embodied cognition in the study of facial expression of emotion. (shrink)

This paper proposes an outline for a typology of the different forms that scientific objects can take in the life sciences. The first section discusses preparations (or specimens)—a form of scientific object that accompanied the development of modern biology in different guises from the seventeenth century to the present: as anatomical–morphological specimens, as microscopic cuts, and as biochemical preparations. In the second section, the characteristics of models in biology are discussed. They became prominent from the end of the nineteenth century (...) onwards. Some remarks on the role of simulations—characterising the life sciences of the turn from the twentieth to the twenty-first century—conclude the paper. -/- . (shrink)

The ArgumentIn its reconstruction of scientific practice, philosophy of science has traditionally placed scientific theories in a central role, and has reduced the problem of mediating between theories and the world to formal considerations. Many applications of scientific theories, however, involve complex mathematical models whose constitutive equations are analytically unsolvable. The study of these applications often consists in developing representations of the underlying physics on a computer, and using the techniques of computer simulation in order to learn about the (...) behavior of these systems. In many instances, these computer simulations are not simple number-crunching techniques. They involve a complex chain of inferences that serve to transform theoretical structures into specific concrete knowledge of physical systems. In this paper I argue that this process of transformation has its own epistemology. I also argue that this kind of epistemology is unfamiliar to most philosophy of science, which has traditionally concerned itself with the justification of theories, not with their application. Finally, I urge that the nature of this epistemology suggests that the end results of some simulations do not bear a simple, straightforward relation to the theories from which they stem. (shrink)

Simulation models of the Reiterated Prisoner's Dilemma have been popular for studying the evolution of cooperation since more than 30 years now. However, there have been practically no successful instances of empirical application of any of these models. At the same time this lack of empirical testing and confirmation has almost entirely been ignored by the modelers community. In this paper, I examine some of the typical narratives and standard arguments with which these models are justified by their authors (...) despite the lack of empirical validation. I find that most of the narratives and arguments are not at all compelling. None the less they seem to serve an important function in keeping the simulation business running despite its empirical shortcomings. (shrink)

Les modèles basés sur des agents en interactions, constituent des systèmes sociaux complexes, qui peuvent être simulés par informatiques. Ils se répandent dans les sciences économiques et sociales - comme dans la plupart des sciences des systèmes complexes. Des énigmes épistémologiques (ré)apparaissent. On a souvent opposé modèles et investigations empiriques : d’un côté, on considère les sciences empiriques fondées sur une observation méthodique (enquêtes, expériences) tandis que de l’autre, on conçoit les approches théoriques et la modélisation comme s’appuyant sur une (...) approche conceptuelle ou hypothético-déductive. la simulation a de son coté souvent été comparée à une forme d’expérience ou à une méthode intermédiaire entre la théorie et l’expérience. Tesfatsion a parlé de « laboratoire computationnel » comme d’une manière d’étudier « les comportements des systèmes complexes au moyen d’expériences sous contrôle qu’on peut répéter (réplicable)» et Axelrod a proclamé que la simulation serait « une troisième manière de pratiquer la science dans les sciences sociales », entre l’induction et la déduction. Nous introduisons de nouveaux concepts épistémologiques afin de montrer dans quelle mesure les auteurs ont raison lorsqu'ils se concentrent sur une signification empirique, instrumentale ou conceptuelle de leur modèle ou simulation. La première partie du chapitre discute plus particulièrement de l'épistémologie des modèles économiques à partir des travaux d’Hausman, Guala, Mäki, Sugden, Schelling etc. pour expliquer les divergences entre modèles et simulations. En distinguant entre modèles et simulations, comme entre entre types de modèles, types de simulations informatiques et types d'empiricité obtenue par une simulation, la seconde partie donne la possibilité de comprendre plus précisément - et ensuite de justifier - la diversité des positions épistémologiques présentées dans la première partie. En utilisant les notion de sous-symbolisation (due à Smolensky) et, de hiérarchie dénotationnelle (due à Goodman), une attention particulière est accordée à la multiplicité des pouvoirs dénotationnels des symboles en jeu dans les modèles complexes et les simulations informatiques. Selon cette grille d'analyse, on peut déterminer, dans chaque cas particulier son statut épistémique et la crédibilité qui peut y être associée. -/- Ce chapitre est une traduction (par Gilles Campagnolo) réviséee et augmentée par les auteurs de : Agent-Based Models and Simulations in Economics and Social Sciences: From Conceptual Exploration to Distinct Ways of Experimenting, Journal of Artificial Societies and Social Simulation 13 (1) 5 DOI: 10.18564/jasss.1532. (shrink)

The book examines issues related to the way modeling and simulation enable us to reconstruct aspects of the world we are investigating. It also investigates the processes by which we extract concrete knowledge from those reconstructions and how that knowledge is legitimated.

The Epistemology Of Computer Simulation has developed as an epistemological and methodological analysis of simulative sciences using quantitative computational models to represent and predict empirical phenomena of interest. In this paper, Executable Cell Biology and Agent-Based Modelling are examined to show how one may take advantage of qualitative computational models to evaluate reachability properties of reactive systems. In contrast to the thesis, advanced by EOCS, that computational models are not adequate representations of the simulated empirical systems, it is shown (...) how the representational adequacy of qualitative models is essential to evaluate reachability properties. Justification theory, if not playing an essential role in EOCS, is exhibited to be involved in the process of advancing and corroborating model-based hypotheses about empirical systems in ECB and ABM. Finally, the practice of evaluating model-based hypothesis by testing the simulated systems is shown to constitute an argument in favour of the thesis that computer simulations in ECB and ABM can be put on a par with scientific experiments. (shrink)