The aim of this article is to examine whether informational manipulation, used intentionally by the researcher to increase recruitment in the research study, can be morally acceptable. We argue that this question is better answered by following a non-normative account, according to which the ethical justifiability of informational manipulation should not be relevant to its definition. The most appropriate criterion by which informational manipulation should be considered as morally acceptable or not is the researcher’s special moral duties (...) towards their subjects. We also propose that a broader definition of manipulation of information should be adopted (than that already existing in the literature) since informational manipulation can affect not only a person’s beliefs but also their desires in decision-making. We conclude that manipulation of information can either be used to protect the potential subject and facilitate the informed consent process or be used to exploit and merely use a person for scientific goals. (shrink)

Timpson’s deflationary view of information is an innovative and well articulated view that had a great impact on the philosophy of physics community. However, recently some of the arguments supporting the deflationist view have been critically reviewed. The aim of this paper is to retain the general idea behind Timpson’s proposal, but replacing the conflictive elements used to support his thesis with new argumentative resources based on the notion of manipulability.

This paper examines the role and power of the state in modernity and its transformation throughout it and into the present. First, it recognizes the centrality of the role of information control for the modern state constitution, which allows sovereign power to extend to the national level. Secondly, it discusses the shift of state power from a purely informational power to an informational and bargaining power, as well as the gradual transformation of sovereignty into governmentality. Finally, it analyzes the (...) transformations that have led to a critical loss of both powers by the state and have enabled their acquisition by tech corporations. It examines the implications of this shift in power and the consequent disempowerment of the state, defining the mode of operation of the power embodied by tech corporations as a regime of performativity, rephrasing the Foucauldian regime of truth, which presided over the ways in which governmental power was performed. Such a regime bases its power not on the ability to order discourse and knowledge, but on the ability to automate it, and to predict and manipulate human behaviors. In this way, it has disintermediated not only the state in its role as the primary informational agent, but also, to some extent, the ability of individuals to assert rights through their actions. (shrink)

I consider problem of questions used with the purpose of manipulating. If one is proficient in the art of asking questions, he/she can manipulate answers to the posed questions. If one does not want to be manipulated by questions, one should manipulate questions themselves. Moreover, I show that questions are not only a tool of gaining new information.

The detection of hate speech and fake news in political discourse is at the same time a crucial necessity for democratic societies and a challenge for several areas of study. However, most of the studies have focused on what is explicitly stated: false article information, language that expresses hatred, derogatory expressions. This paper argues that the explicit dimension of manipulation is only one – and the least problematic – of the risks of political discourse. The language of the (...) unsaid is much more dangerous and incomparably more difficult to detect, hidden in different types of fallacies and inappropriate uses of emotive language. Through a threefold coding scheme based on the instruments of argumentation theory and pragmatics, a corpus of argumentative tweets published by 4 politicians (Matteo Salvini, Donald Trump, Jair Bolsonaro, and Joseph Biden) within 6 months from their taking office (corresponding to the official end of their election campaign) is analyzed, detecting the types of argument, the fallacies, and the uses and misuses of “emotive words.” This coding results in the argumentation profiles of the speakers, which are compared statistically to show their different implicit strategies and deceptive tactics. (shrink)

Computers today are not only the calculation tools - they are directly (inter)acting in the physical world which itself may be conceived of as the universal computer (Zuse, Fredkin, Wolfram, Chaitin, Lloyd). In expanding its domains from abstract logical symbol manipulation to physical embedded and networked devices, computing goes beyond Church-Turing limit (Copeland, Siegelman, Burgin, Schachter). Computational processes are distributed, reactive, interactive, agent-based and concurrent. The main criterion of success of computation is not its termination, but the adequacy of (...) its response, its speed, generality and flexibility; adaptability, and tolerance to noise, error,faults, and damage. Interactive computing is a generalization of Turing computing, and it calls for new conceptualizations (Goldin, Wegner). In the info-computationalist framework, with computation seen as information processing, natural computation appears as the most suitable paradigm of computation and information semantics requires logical pluralism. (shrink)

PurposeThe purpose of this paper is to introduce readers to the social and ethnical dimensions of information science.Design/methodology/approachThe paper provides a literature survey on the concept of information science and its history. It describes the different developments involved in the development of information science as a research field. It present various definitions and domains of the field that represent different stages of information science evolution.FindingsThis paper presents an updated image of information science as a research (...) field that takes into consideration a user centered approach and social and ethical issues that are involved in the information processes.Originality/valueThe paper describes the contribution of information science to social and ethical aspects of the information age such as: individual empowerment, education toward information awareness, information needs, the problem of decision making, manipulation of search result on the web and the role of the information professionals in diminishing digital divide. (shrink)

The use of list-learning paradigms to explore false memory has revealed several critical findings about the contributions of similarity and relatedness in memory phenomena more broadly. Characterizing the nature of “similarity and relatedness” can inform researchers about factors contributing to memory distortions and about the underlying associative and semantic networks that support veridical memory. Similarity can be defined in terms of semantic properties, lexical/associative properties, or structural properties. By manipulating the type of list and its relationship to a non-studied critical (...) item, we review the effects of these types of similarity on veridical and false memory. All forms of similarity reviewed here result in reliable error rates and the effects on veridical memory are variable. The results across a variety of paradigms and tests provide partial support for a number of theoretical explanations of false memory phenomena, but none of the theories readily account for all results. (shrink)

A substantial portion of the knowledge base of psychology is based on subjective reports with a risk of information bias. The objective of the present study was to elucidate one contextual source of variance and potential bias in subjective reports: the influence of affective state at the time of responding to questionnaires. Employees were subjected to mood-induction procedures in the laboratory. Neutral, positive, and negative moods were induced by combinations of pictures from the international affective picture set and music. (...) The subjects responded to questions on visual analog scales in order to optimize sensitivity and attenuate short-term memory effects. Most subjects exhibited significant affective-state inductions with no change in arousal. The analyses took affective response to the manipulation into account. Only four of 20 questions were somewhat influenced by induced affective state: job overload, social support from co-workers, satisfaction with getting to develop personally, and an item measuring agreeableness. In general, responding to questions of work that were phrased for valence was little or insignificantly influenced by induced affective state. (shrink)

Is there such a thing as information justice? In this paper, I argue that the current state of the information economy, particularly as it regards information and computing technology (ICT), is unjust, conferring power disproportionately on the information-wealthy at great expense to the information-poor. As ICT becomes the primary method for accessing and manipulating information, it ought to be treated as a foundational layer of the information economy. I argue that by maximizing the (...) liberties (freedom to use, freedom to distribute, freedom to modify, and so on) associated with certain computer software, an incentives-rich and stable environment can be established in ICT that will foster development of the information economy among the information poor. I suggest that the now-mature Free and Open Source Software paradigm, which has already produced widely-used enterprise-class applications, can be harnessed in support of these ends. (shrink)

It has been reported that behavior of experts and novices in various sporting tasks is impervious to the introduction of blur. However, studies have used diverse methods of blurring the visual stimulus, and tasks that did not always preserve the normal perception-action coupling. In the current study, we developed a novel experimental protocol to examine the effect of different levels of Gaussian blur on interception performance and eye gaze data using an immersive VR task. Importantly, this provided a realistic simulation (...) of a real-world boxing scenario in which expert combat athletes experienced a first-person, adaptive viewpoint of the visual environment, which could be blurred according to their gaze location. We found that participants exhibited similar interception performance in the presence of central blur or peripheral blur compared to a control condition with no blur. However, interception performance was significantly better with a central blur compared to peripheral blur. Eye gaze data indicated that although participants fixated at similar areas of interest irrespective of the presence of blur, fixation duration was significantly longer with a strong level of blur in the peripheral viewing condition than all levels of central blur and the control condition. These findings can be explained by relocating attention to different areas of the environment, which thereby influenced the perception of salient information. Participants also performed better on the first punch of a sequence preceded by a foot feint compared to arm feint or no feint. Still, irrespective of feint type, performance was significantly better on the second and third punch compared to the first punch. These findings are consistent with participants using additional information from the opponent's body movements and situational probabilities to increase performance as the sequence of punches developed. Overall, these are the first evidence for the use of VR as a means to examine gaze-contingent manipulations of the environment, and hence highlight the potential for facilitating learning and transfer to a real sporting situations. (shrink)

This article argues that the study conducted by Facebook in conjunction with Cornell University did not have sufficient ethical oversight, and neglected in particular to obtain necessary informed consent from the participants in the study. It establishes the importance of informed consent in Internet research ethics and suggests that in Facebook’s case, a reasonable shift could be made from traditional medical ethics ‘effective consent’ to a ‘waiver of normative expectations’, although this would require much-needed change to the company’s standard practice. (...) Finally, it gives some practical recommendations for how to implement such consent strategies, and how the ethical oversight gap between university-led research and industry-led research can be bridged, potentially using emerging Responsible Research and Innovation frameworks which are currently gathering momentum in Europe. (shrink)

The acceptability of sentences in natural language is constrained not only grammaticality, but also by the relationship between what is being conveyed and such factors as context and the beliefs of interlocutors. In many languages the critical element in a sentence (its focus) must be given grammatical prominence. There are different accounts of the nature of focus marking. Some researchers treat it as the grammatical realization of a potentially arbitrary feature of universal grammar and do not provide an explicit account (...) of its origins; others have argued, however, that focus marking is a (grammaticalized) functional solution to the problem of efficiently transmitting information via a noisy channel. By adding redundancy to highlight critical elements in particular, focus protects key parts of the message from noise. If this information‐theoretic account is true, then we should expect focus‐like behavior to emerge even in non‐linguistic communication systems given sufficient noise and pressures for efficiency. We tested this in an experiment in which participants played a simple communication game in which they had to click cells on a grid to communicate one of two line figures drawn across the grid. We manipulated the noise, available time, and required effort, and measured patterns of redundancy. Because the lines in many cases overlapped, meaning that only some parts of each line could be used to distinguish it from the other, we were able to compare the extent to which effort was expended on adding redundancy to critical (non‐overlapping) and non‐critical (overlapping) parts of the message. The results supported the information‐theoretic account of focus and shed light on the emergence of information structure in language. (shrink)

The papers collected in this volume exemplify some of the trends in current approaches to logic, language and computation. Written by authors with varied academic backgrounds, the contributions are intended for an interdisciplinary audience. The first part of this volume addresses issues relevant for multi-agent systems: reasoning with incomplete information, reasoning about knowledge and beliefs, and reasoning about games. Proofs as formal objects form the subject of Part II. Topics covered include: contributions on logical frameworks, linear logic, and different (...) approaches to formalized reasoning. Part III focuses on representations and formal methods in linguistic theory, addressing the areas of comparative and temporal expressions, modal subordination, and compositionality. (shrink)

The aim of this study is to analyze the information in the social media which is being produced and included into the stream by mass media in the context of digital ethics and cyber security. The principles of digital ethics includes norms that takes individual’s privacy of life into consideration. In addition to being a concept related to cyberspace, computer, and computer networks, it also includes the whole human-made activities, for this reason manipulation techniques in cyberspace appear as (...) an important cyber threat to users. As it comes to the purpose of coping with cyber threats the development of digital etic rules is essential. As a result of the violation of digital etic rules, wrong and false information is formed and individuals are misinformed. In the study, social media, which aims to bring individuals together on the basis of "being the same", has been evaluated within the scope of the culture industry concept of Adorno and Horkheimer. In this direction, content with a manipulative nature has been analyzed in the context of digital ethical principles. Then, social media threats encountered in cyberspace in general and information manipulation, in particular, are compared in the context of cybersecurity strategies implemented by states. As a result, it has been observed that the manipulative nature of information increases as it moves away from the principles of digital ethics. For this reason, it has been determined that all actors of cyberspace must be effective in order to develop and apply cyber ethics rules. (shrink)

The aim of the present paper is to supply an elucidation of the concept of information in the communicational context. For this purpose, two traditional interpretations of the concept of information, the epistemic and the physical interpretations, will be distinguished, and their specific problems will be considered. In particular, whereas the epistemic interpretation misses an essential feature of communication, the physical interpretation faces difficulties in the quantum domain. The final goal will be to argue that the difficulties of (...) the physical interpretation can be overcome by means of a manipulability conception of causation. (shrink)

The concept of “information” is virtually ubiquitous in contemporary cognitive science. It is claimed to be “processed” (in cognitivist theories of perception and comprehension), “stored” (in cognitivist theories of memory and recognition), and otherwise manipulated and transformed by the human central nervous system. Fred Dretske's extensive philosophical defense of a theory of informational content (“semantic” information) based upon the Shannon-Weaver formal theory of information is subjected to critical scrutiny. A major difficulty is identified in Dretske's equivocations in (...) the use of the concept of a “signal” bearing informational content. Gibson's alternative conception of information (construed as analog by Dretske), while avoiding many of the problems located in the conventional use of “signal”, raises different but equally serious questions. It is proposed that, taken literally, the human CNS does not extract or process information at all; rather, whatever “information” is construed as locatable in the CNS is information only for an observer-theorist and only for certain purposes. (shrink)

Psychology distinguishes between a bodily and a narrative self. Within neuroscience, models of the bodily self are based on exteroceptive sensorimotor processes or on the integration of interoceptive sensations. Recent research has revealed interactions between interoceptive and exteroceptive processing of self-related information, for example that mirror self-observation can improve interoceptive awareness. Using heartbeat perception, we measured the effect on interoceptive awareness of two experimental manipulations, designed to heighten attention to bodily and narrative aspects of the self. Participants gazed at (...) a photograph of their own face or at self-relevant words. In both experimental conditions interoceptive awareness was significantly increased, compared to baseline. Results show that attention to narrative aspects of self, previously regarded as relying on higher-order processes, has an effect similar to self-face stimuli in improving interoceptive awareness. Our findings extend the previously observed interaction between the bodily self and interoception to more abstract amodal representations of the self. (shrink)

Prediction markets are increasingly being considered as methods for gathering, summarizing and aggregating diffuse information by governments and businesses alike. Critics worry that these markets are susceptible to price manipulation by agents who wish to distort decision making. We study the effect of manipulators on an experimental market, and find that manipulators are unable to distort price accuracy. Subjects without manipulation incentives compensate for the bias in offers from manipulators by setting a different threshold at which they (...) are willing to accept trades. (shrink)

By classic results in social choice theory, any reasonable preferential voting method sometimes gives individuals an incentive to report an insincere preference. The extent to which different voting methods are more or less resistant to such strategic manipulation has become a key consideration for comparing voting methods. Here we measure resistance to manipulation by whether neural networks of varying sizes can learn to profitably manipulate a given voting method in expectation, given different types of limited information about (...) how other voters will vote. We trained over 70,000 neural networks of 26 sizes to manipulate against 8 different voting methods, under 6 types of limited information, in committee-sized elections with 5-21 voters and 3-6 candidates. We find that some voting methods, such as Borda, are highly manipulable by networks with limited information, while others, such as Instant Runoff, are not, despite being quite profitably manipulated by an ideal manipulator with full information. For the two probability models for elections that we use, the overall least manipulable of the 8 methods we study are Condorcet methods, namely Minimax and Split Cycle. (shrink)

In this paper we analyze the non-coercive ways in which researchers can use knowledge about the decision-making tendencies of potential participants in order to motivate them to consent to research enrollment. We identify which modes of influence preserve respect for participants’ autonomy and which disrespect autonomy, and apply the umbrella term of manipulation to the latter. We then apply our analysis to a series of cases adapted from the experiences of clinical researchers in order to develop a framework for (...) thinking through the ethics of manipulating people into research participation. All manipulation disrespects autonomy and is therefore pro tanto wrong. However, only deceptive manipulation invalidates the consent that results from it. Use of the other forms of manipulation can be permissible, but only if the outcome of using manipulation is sufficiently good and if the research cannot be carried out using ethically preferable means to obtain consent. (shrink)

The problem of the manipulation of data that arises when there is both opportunity and incentive to mislead is better accepted and studied — though by no means solved — in financial accounting than in medicine. This article analyzes pharmaceutical company manipulation of medical research as part of a broader problem of corporate manipulation of data in the creation of accounting profits. The article explores how our understanding of accounting fraud and misinformation helps us understand the risk (...) of similar information manipulation in the medical sciences. This understanding provides a framework for considering how best to improve the quality of medical research and analysis in light of the current system of medical information production. I offer three possible responses: (1) use of the Dodd-Frank whistleblower provisions to encourage reporting of medical research fraud; (2) a two-step academic journal review process for clinical trials; and (3) publicly subsidized trial-failure insurance. These would improve the release of negative information about drugs, thereby increasing the reliability of positive information. (shrink)

We address the issue of manipulating games through communication. In the specific setting we consider (a variation of Boolean games), we assume there is some set of environment variables, the values of which are not directly accessible to players; the players have their own beliefs about these variables, and make decisions about what actions to perform based on these beliefs. The communication we consider takes the form of (truthful) announcements about the values of some environment variables; the effect of an (...) announcement is the modification of the beliefs of the players who hear the announcement so that they accurately reflect the values of the announced variables. By choosing announcements appropriately, it is possible to perturb the game away from certain outcomes and towards others. We specifically focus on the issue of stabilisation: making announcements that transform a game from having no stable states to one that has stable configurations. (shrink)

We present an informational view of classical propositional logic that stems from a kind of informational semantics whereby the meaning of a logical operator is specified solely in terms of the information that is actually possessed by an agent. In this view the inferential power of logical agents is naturally bounded by their limited capability of manipulating “virtual information”, namely information that is not implicitly contained in the data. Although this informational semantics cannot be expressed by any (...) finitely-valued matrix, it can be expressed by a non-deterministic 3-valued matrix that was first introduced by W.V.O. Quine, but ignored by the logical community. Within the general framework presented in [21] we provide an in-depth discussion of this informational semantics and a detailed analysis of a specific infinite hierarchy of tractable approximations to classical propositional logic that is based on it. This hierarchy can be used to model the inferential power of resource-bounded agents and admits of a uniform proof-theoretical characterization that is half-way between a classical version of Natural Deduction and the method of semantic tableaux. (shrink)

Generative AI enables automated, effective manipulation at scale. Despite the growing general ethical discussion around generative AI, the specific manipulation risks remain inadequately investigated. This article outlines essential inquiries encompassing conceptual, empirical, and design dimensions of manipulation, pivotal for comprehending and curbing manipulation risks. By highlighting these questions, the article underscores the necessity of an appropriate conceptualisation of manipulation to ensure the responsible development of Generative AI technologies.

Mobile health applications that promise the user to help her with some aspect of her health are very popular: for-profit apps such as MyFitnessPal, Fitbit, or Headspace have tens of millions of users each. For-profit health apps are designed and run as optimization systems. One would expect that these health apps aim to optimize the health of the user, but in reality they aim to optimize user engagement and, in effect, conversion. This is problematic, I argue, because digital health environments (...) that aim to optimize user engagement risk being manipulative. To develop this argument, I first provide a brief analysis of the underlying business models and the resulting designs of the digital environments provided by popular for-profit health apps. In a second step, I present a concept of manipulation that can help analyze digital environments such as health apps. In the last part of the article, I use my concept of manipulation to analyze the manipulative potential of for-profit health apps. Although for-profit health can certainly empower their users, the conditions for empowerment also largely overlap with the conditions for manipulation. As a result, we should be cautious when embracing the empowerment discourse surrounding health apps. An additional aim of this article is to contribute to the rapidly growing literature on digital choice architectures and the ethics of influencing behavior through such choice architectures. I take health apps to be a paradigmatic example of digital choice architectures that give rise to ethical questions, so my analysis of the manipulative potential of health apps can also inform the larger literature on digital choice architectures. (shrink)

In this article, we seek to contribute to the debate on the requirement of disclosure in the context of informed consent for research. We defend the subjective standard of disclosure and describe ways to implement this standard in research practice. We claim that the researcher should make an effort to find out what kinds of information are likely to be relevant for those consenting to research. This invites researchers to take empirical survey information seriously, attempt to understand the (...) cultural context, talk to patients to be better able to understand what can be potentially different concerns and interests prevalent in the target population. The subjective standard of disclosure should be seen as a moral ideal that perhaps can never be perfectly implemented but still can and should be used as a normative ideal guiding research practice. In the light of these discussions, we call for more empirical research on what considerations are likely to be perceived as relevant by potential research participants recruited from different socio-economic and cultural groups. (shrink)

Novelty is central to the study of memory, but the wide range of experimental manipulations aimed to reveal its effects on learning produced inconsistent results. The novelty/encoding hypothesis suggests that novel information undergoes enhanced encoding and thus leads to benefits in memory, especially in recognition performance; however, recent studies cast doubts on this assumption. On the other hand, data from animal studies provided evidence on the robust effects of novelty manipulations on the neurophysiological correlates of memory processes. Conceptualizations and (...) operationalizations of novelty are remarkably variable, and were categorized into different subtypes, such as stimulus, context, associative or spatial novelty. Here, we summarize previous findings about the effects of novelty on memory and suggest that predictive coding theories provide a framework that could shed light on the differential influence of novelty manipulations on memory performance. In line with predictive coding theories, we emphasize the role of unexpectedness as a crucial property mediating the behavioral and neural effects of novelty manipulations. (shrink)

A framework is presented to better characterize the role of individual differences in information processing style and their interplay with contextual factors in determining decision making quality. In Experiment 1, we show that individual differences in information processing style are flexible and can be modified by situational factors. Specifically, a situational manipulation that induced an analytical mode of thought improved decision quality. In Experiment 2, we show that this improvement in decision quality is highly contingent on the (...) compatibility between the dominant thinking mode and the nature of the task. That is, encouraging an intuitive mode of thought led to better performance on an intuitive task but hampered performance on an analytical task. The reverse pattern was obtained when an analytical mode of thought was encouraged. We discuss the implications of these results for the assessment of decision making competence, and suggest practical directions to help individuals better adjust their information processing style to the situation at hand and make optimal decisions. (shrink)

Many countries are experimenting with planned (or quasi-) markets to discover if they can efficiently deliver health care in keeping with societal objectives. This paper examines the information requirements of this approach. Information is necessary in order to compare the performance of providers, to support billing, and to monitor access to care. It should be accurate, unambiguous, and resistant to manipulation. We draw on a project to find out how information on hospitalisation could be used in (...) contracting in the British National Health Service. We conclude that the existing British system fails to provide robust measures of how many patients are treated, for what conditions, and with what treatments. We identify some promising remedies, others that are more difficult, and some which may be impossible to implement in any planned market, given the uncertainty of clinical practice. (shrink)

PurposeTo investigate how search engine users manipulate the rankings of search results. Search engines employ different ranking methods in order to display the “best” results first. One of the ranking methods is PageRank, where the number of links pointing to the page influences its rank. The “anchor text,” the clickable text of the hypertext link is another “ingredient” in the ranking method. There are a number of cases where the public challenged the Google's ranking, by creating a so‐called “Google bomb” (...) – creating links to pages they wanted to be highly ranked for given query. Google is chosen as the search engine, because it is currently by far the most popular search engine.Design/methodology/approachPageRank, one of the major parameters of Google's ranking algorithm is described, and the author explains how this algorithm is exploited by communities of users to promote a certain web page for a specific query. This process is called “Google bombing.” Recent reaction of Google to this phenomenon is also described.FindingsSpecific examples of “accomplished Google bombs” show that the public is able to manipulate search results.Originality/valueGoogle, instead of being an unobtrusive information retrieval tool has become highly influential in the web scenery. Some users pay for search engine optimization, while others utilize the power of the crowd to influence Google's rankings. This paper supports the claims of Introna and Nissenbaum regarding the power of search engines. (shrink)

Source: Author: Eldar Sultanow, Sean Cox, Sebastian Homann, Philipp Koch, Olliver Franke Mass media initiated exhibitions of information and knowledge streams account for a significant factor of opinion-forming in modern digitalized nations and thus influence their country's political development. Within the framework of a globalized environment, this information has the ability to shape worldwide opinion and international policy decisions across geographical boundaries. Similarly, however, information and knowledge that does not flow freely has an impact on the behind (...) the scenes decisions of world affairs. Selective manipulation, consumed through hidden channels, is therefore a powerful tool for shaping both social and organizational environments. Currently no classification approaches exist in order to identify and evaluate this type of manipulation. Therefore, this article will discuss this type of manipulative communication and align each category into an assessment model. Forty-two varieties of manipulative arguments will be identified as well as classified along three-dimensions. A model has been developed which will serve as a tool to identify the degree and at which level manipulation was performed. ]]>. (shrink)

Nancy is ultimately most concerned about how to determine the relevance of evidence to implementation of evidence-based policy guidelines, in other words, the transferability of study results to a population different from the one that was studied and in which procedures or conditions are not the same as those in the study. And she is concerned about the privileged position Randomized Controlled Trials (RCTs) are given in the ranking schemes for evidence-based policy, because as she sees it RCTs do not (...) address this question while other methods do. RCTs are highly regarded because of their strength in ruling out confounding variables, but they can be weak on the transferability problem because the manipulations necessary for controlled experiment also guarantee that the setting and population are different from the situation and population targeted for application. However, both of these familiar points are simplifications that can be misleading. Some non-RCT type studies (e.g. soft interventions) can also be very good at ruling out confounding variables.1 And, as I will explain, the problems leading to the transferability problem – interacting variables and a difference between study and target populations – are present in any study, not unique to RCTs. In addition. (shrink)