We show that the common claim that internal validity should be understood as prior to external validity has, at least, three epistemologically problematic aspects: experimental artefacts, the implications of causal relations, and how the mechanism is measured. Each aspect demonstrates how important external validity is for the internal validity of the experimental result.

Until social psychology devotes as much attention to construct and external validity as it does to internal validity, the field will continue to produce theories that fail to replicate in the field and cannot be used to meliorate social problems.

In Persson & Wallin we show that the common claim that internal validity should be understood as prior to external validity has, at least, three epistemologically problematic aspects: experimental artefacts, the implications of causal relations, and how the mechanism is measured. Each aspect demonstrates how important external validity is for the internal validity of the experimental result. This note is an invited summary of these results.

International government and corporate corruption is increasingly under siege. Although various groups of researchers have quantified and documented world-wide corruption, apparently no one has validated the measures. This study finds a very strong significant correlation of three measures of corruption with each other, thereby indicating validity. One measure was of Black Market activity, another was of overabundance of regulation or unnecessary restriction of business activity. The third measure was an index based on interview perceptions of corruption (Corruption Perceptions Index (...) or CPI) in that nation. Validity of the three measures was further established by finding a highly significant correlation with real gross domestic product per capita (RGDP/Cap). The CPI had by far the strongest correlation with RGDP/Cap, explaining over three fourths of the variance.Corruption is increasingly argued to be a barrier to development and economic growth. Business students often do not see ethics courses as being as relevant as other value-free disciplines or core courses. The data in this study suggests otherwise. Sustainable economic development appears very dependent on a constant, virtuous cycle that includes corruption fighting, and the maintenance of trust and innovation, all reinforcing each other. (shrink)

Family carers of individual’s living with Huntington’s Disease (HD) manage a distinct and unique series of difficulties arising from the complex nature of HD. This paper presents the validation of the definitive measure of quality of life for this group. The Huntington’s Disease Quality of Life Battery for carers (HDQoL-C) was expanded and then administered to an international sample of 1716 partners and family carers from 13 countries. In terms of the psychometric properties of the tool, exploratory analysis of half (...) of the sample, demonstrated good internal consistency and reliability. Some items on the full version did not meet psychometric thresholds and a short version (HDQoL-Cs) was developed based on more stringent criteria. Confirmatory Factor Analysis of the model structure showed a good fit for all Factors and, indicated that the HDQoL-C and HDQoL-Cs are psychometrically robust measures of quality of life. We found that carers who lived with and looked after their spouse/partner had reduced sense of coping, hope for the future and overall quality of life. Carers with children who were at risk, carried the gene or were symptomatic also had poorer quality of life outcomes. Findings indicated the HDQoL-C and HDQoL-Cs are valid in multiple languages and across varied cultures as measures of self-reported quality of life in family carers of individual’s living with HD. These psychometrically validated tools can aid and guide the implementation of therapeutic interventions to improve life quality in this population. (shrink)

Much of the methodological discussion around experiments in economics and other social sciences is framed in terms of the notions of internal and external validity. The standard view is that internal validity and external validity stand in a relationship best described as a _trade-off_. However, it is also commonly held that internal validity is a _prerequisite_ to external validity. This article addresses the problem of the compatibility of these two ideas and analyzes (...) critically the standard arguments about the conditions under which a trade-off between internal and external validity arises. Our argument stands against common associations of internal validity and external validity with the distinction between field and laboratory experiments and assesses critically the arguments that link the artificiality of experimental settings done in the laboratory with the purported trade-off between internal and external validity. We conclude that the idea of a trade-off or tension between internal and external validity seems, upon analysis, far less cogent than its intuitive attractiveness may lead us to think at first sight. (shrink)

The article identifies a latent debate in the recent literature on the role and worth of experiments in economics and other social sciences concerning the relationship between the external and the internal validity of experimental designs. Our work identifies two incompatible views regarding the relationship between internal and external validity of experiments. While in the methodological literature references to the idea that there is a trade-off between the internal and external validity of experiments abound, (...) this view coexists with the position stating that internal validity is rather a prerequisite of external validity. By identifying the contours of this implicit debate in the recent methodological literature around the use of experiments in the social sciences we call attention upon a series of insufficiently conceptualized issues regarding the central notions of internal and external validity and we question the standard view positing a trade-off between the two. This article stands against common associations of internal validity and external validity with the distinction between field and laboratory experiments and assesses critically the arguments that link the artificiality of experimental settings done in the laboratory with the purported trade-off between internal and external validity. (shrink)

This article replicates a U.S. study of marketing norms in an international setting. The dimensionality and reliability of the scales are tested in the U.S., Singapore and South Africa. Support is found for the use of the scales, as modified. The norms of the current respondents are compared with those of the original U.S. respondents and each other. Differences between the three countries are found with respect to general honesty and integrity norms, but not for specific marketing-related norms. Differences between (...) the original study results and the current findings are assessed in terms of methodological and substantive factors. (shrink)

This paper develops an account of rigour in the use of thought experiments in ethics. I argue that there are two separate challenges to be faced. The first is internal validity: is the thought experiment designed in a way that allows its readers to make judgements that are confident and free of bias about the hypothesis or point of principle that it aims to test? The second is external validity: to what extent do ethical judgements that are (...) correct of the world of the thought experiment generalize to a wide variety of other contexts, including ethical decision-making in the actual world? Ensuring external validity is the harder and more important problem of rigour, yet it is one that few philosophers have even noticed, let alone begun to solve. (shrink)

This study assessed the International Critical Thinking Essay Test (ICTET-A) for inter-rater reliability, internal reliability, and criterion validity. A self-selecting sample of participants (N = 100) completed the ICTET-A and a comparison test online. We found the ICTET-A items to have moderate to good levels of inter-rater reliability, and overall excellent inter-rater consistency for total test scores. The test had good internal reliability. There was a strong correlation between scores on the ICTET-A and the comparison test. Factor (...) analysis showed that scores were best explained with one factor, suggesting the test measures a single construct. The ICTET-A can therefore be considered a valid measure of critical thinking. Additionally, we propose a short form of the test. (shrink)

According to a classical work on experimental design internal validity “refers to the approximate validity with which we infer that a relationship between two variables is causal or that the absence of a relationship implies the absence of cause”. External validity “refers to the approximate validity with which we can infer that the presumed causal relationship can be generalized to and across alternate measures of the cause and effect and across different types of persons, settings, (...) and times”. Since then, these have been the accepted definitions, with slight variations, of both concepts. However, there have been deep differences in interpreting the scope and limits of validity concepts in economics. From theory-driven experimental designs that defend the priority of the internal over the external validity to those researches that are demanding the importance of external validity in economics, we can find the most diverse points of view. What can experimental ethics learn, then, from recent debates on external and internal validity in experimental economics? If we want to elicit moral intuitions into the lab, are we testing moral theories that way? Could intuitions be generalized “across different types of persons, settings, and times”? Is that really possible? (shrink)

Weight stigma internalization among adolescents across weight categories leads to adverse psychological consequences. This study aims to adapt and validate a Chinese version of the Weight Bias Internalization Scale for Mainland Chinese children and adolescents. A total of 464 individuals aged 9 to 15 years participated in the present study. Based on item response theory and classical test theory, we selected the items for the C-WBIS and evaluated its reliability and validity. The item response theory yields support for the (...) one-dimensional factor mode. All item parameters fit the IRT model, eight items were adopted. No evidence of significant differential item functioning was found for gender and age groups. The C-WBIS was correlated with the Core Self-Evaluation Scale and two subscales of the Social Anxiety Scale for Children, which indicated an acceptable criterion-related validity. The C-WBIS is a reliable and valid measure that can be used as a psychometrically sound and informative tool to assess weight bias internalization among children and adolescents. (shrink)

Cross-cultural comparisons often investigate values that are assumed to have long-lasting influence on human conduct and thought. To capture and compare cultural values across cultures, Geert Hofstede's Cultural Dimensions Theory has offered an influential framework. Hofstede also provided a survey instrument, the Values Survey Module (VSM), for measuring cultural values as outlined in his Cultural Dimensions Theory. The VSM has since been subject to a series of revisions. Yet, data on countries have been derived from the original VSM — and (...) not on one of the revised versions of VSM. We tested three scales (indulgence, power distance, and individualism) from the latest version, the VSM 2013, as part of a larger survey across 57 countries. Two main findings emerged. For one thing, country scores based on the VSM 2013 scales correlated only weakly with country scores of the same cultural dimensions obtained in a large previous study. Thus, the validity of the VSM 2013 is in doubt. For another thing, the internal consistency of the VSM 2013 scales was overall poor, indicating that the scales did not reliably measure well-defined constructs. We discuss implications for cross-cultural research. (shrink)

Researchers often aim to make correct inferences both about that which is actually studied and about what the results generalize to. The language of internal and external validity is not used by everyone, but many of us would agree that intuitively the distinction makes a lot of sense. Two claims are commonly made with respect to internal and external validity. The first is that internal validity is prior to external validity since there is (...) nothing to generalize if the findings obtained in, for instance, the experimental setting do not hold. The first claim is explicit in many writings. See for instance Francisco Guala’s influential book The methodology of experimental economics. And it is often implicitly relied on. The second claim is that researchers have to make a trade-off between internal and external validity. When one is increased, the other will decrease. The second claim was made already from the start by D.T Campbell in his classic Factors relevant to the validity of experiments in social settings. There is a certain tension between the first and the second claim. It has been argued before that it might be difficult to combine them. We intend to make the stronger point that both claims are misconstrued. Our hypothesis is that the relationship between internal and external validity has to be re-conceptualized, and we will briefly indicate how. (shrink)

This study explored the evidence of validity of internal structure of the 12-item Functional Assessment of Chronic Illness Therapy—Spiritual Wellbeing Scale in Brazilian adolescents with chronic health conditions. The study involved 301 Brazilian adolescents with cancer, type 1 diabetes mellitus, or cystic fibrosis. Exploratory Factor Analysis, Confirmatory Factor Analysis, and Item Response Theory were used to test the internal structure. Reliability was determined with Cronbach’s Alpha and McDonald’s Omega. The EFA suggested a one-dimensional scale structure in contrast (...) to the original 2-factor model or the 3-factor model which were not reproduced in the current CFA. All quality indicators for the EFA one-factor exceeded the required criteria. The FACIT-Sp-12 for adolescents yielded strong evidence for a 1-factor model and with good reliability. (shrink)

The experimental revolution in the social sciences is one of the most significant methodological shifts undergone by the field since the ‘quantitative revolution’ in the nineteenth century. One of the often valued features of social science experimentation is precisely the fact that there are clear methodological rules regarding hypothesis testing that come from the methods of the natural sciences and from the methodology of RCTs in the biomedical sciences, and that allow for the adjudication among contentious causal claims. We examine (...) critically this claim and argue that some current understandings of the practices that surround social science experimentation overestimate the degree to which experiments can actually fulfil this role as “objective” adjudicators, by neglecting the importance of shared background knowledge or assumptions and of consensus regarding the validity of the constructs involved in an experiment. We take issue with the way the distinction between internal and external validity is often used to comment on the inferential import of experiments, used both among practitioners and among philosophers of science. We describe the ways in which the more common use of the internal/external distinction differs from Cook and Campbell’s original methodological project, in which construct validity and the four-fold validity typology were all important in assessing the inferential import of experiments. We argue that the current uses of the labels internal and external, as applied to experimental validity, help to encroach a simplistic view on the inferential import of experiments that, in turn, misrepresents their capacity to provide objective knowledge about the causal relations between variables. (shrink)

Workplace Incivility (WI) occurs worldwide and has negative consequences on individuals and organizations. Valid and comprehensive instruments have been used, specifically in English speaking countries, to measure such adverse process at work, but it is not available a validated instrument for research carried out in Spanish speaking countries. In this study we aim to test the psychometric properties of the Matthews and Ritter’s four-item Workplace Incivility Scale (2016) with Spanish workers (N= 407) from different sectors. Participants’ mean age was 38.73 (...) (SD= 10.45) years old and the percentage of female employees was 59.2%. Confirmatory factor analysis using AMOS 19.0 was carried out, presenting a good fit. The internal consistency, convergent and concurrent validity of the scale were examined. Results show good scale reliability and expected high correlations with social undermining. Moreover, the scale related to propensity to leave a job, job satisfaction, and psychological well-being in the expected way. After configural invariance across groups was established, testing for metric invariance and scalar invariance was performed. Considering Δχ² and ΔCFI tests for two nested models, the 4-item scale was invariant when the employment status is considered (permanent vs temporal, full-time vs part-time and supervisor vs non supervisors). Overall, our findings showed good psychometric properties of the shorter version of the Workplace Incivility Scale in Spain. Theoretical and practical implications of this study are discussed. (shrink)

Ethical decision making measures are widely applied as the principal dependent variable used in studies of research integrity. However, evidence bearing on the internal and external validity of these measures is not available. In this study, ethical decision making measures were administered to 102 graduate students in the biological, health, and social sciences, along with measures examining exposure to ethical breaches and the severity of punishments recommended. The ethical decision making measure was found to be related to exposure (...) to ethical events and the severity of punishments awarded. The implications of these findings for the application of ethical decision making measures are discussed. (shrink)

Discussions of reproducibility are casting doubts on the credibility of experimental outcomes in the life sciences. Although experimental evolution is not typically included in these discussions, this field is also subject to low reproducibility, partly because of the inherent contingencies affecting the evolutionary process. A received view in experimental studies more generally is that standardization (i.e., rigorous homogenization of experimental conditions) is a solution to some issues of significance and internal validity. However, this solution hides several difficulties, including (...) a reduction of external validity and reproducibility. After explaining the meaning of these two notions in the context of experimental evolution, we import from the fields of animal research and ecology and suggests that systematic heterogenization of experimental factors could prove a promising alternative. We also incorporate into our analysis some philosophical reflections on the nature and diversity of research objectives in experimental evolution. (shrink)

This unique volume introduces and discusses the methods of validating computer simulations in scientific research. The core concepts, strategies, and techniques of validation are explained by an international team of pre-eminent authorities, drawing on expertise from various fields ranging from engineering and the physical sciences to the social sciences and history. The work also offers new and original philosophical perspectives on the validation of simulations. Topics and features: introduces the fundamental concepts and principles related to the validation of computer simulations, (...) and examines philosophical frameworks for thinking about validation; provides an overview of the various strategies and techniques available for validating simulations, as well as the preparatory steps that have to be taken prior to validation; describes commonly used reference points and mathematical frameworks applicable to simulation validation; reviews the legal prescriptions, and the administrative and procedural activities related to simulation validation; presents examples of best practice that demonstrate how methods of validation are applied in various disciplines and with different types of simulation models; covers important practical challenges faced by simulation scientists when applying validation methods and techniques; offers a selection of general philosophical reflections that explore the significance of validation from a broader perspective. This truly interdisciplinary handbook will appeal to a broad audience, from professional scientists spanning all natural and social sciences, to young scholars new to research with computer simulations. Philosophers of science, and methodologists seeking to increase their understanding of simulation validation, will also find much to benefit from in the text. (shrink)

The extent to which people anticipate and are influenced by the potential future consequences of their current behavior is called Consideration of Future Consequences. A well-established tool to measure this construct is the 14-item Consideration of Future Consequences Scale. The CFC-14 has shown appropriate psychometric properties in several languages. This scale comprises two factors: the CFC-Immediate and the CFC-Future. The main goal of this study was to assess the psychometric properties and internal consistency of the CFC-14 Scale in Spanish, (...) using an Argentine sample. A secondary goal was to determine its convergent validity with impulsivity, and determine differences across gender and age groups. Using a web-based survey, we collected data from 512 participants aged 13-74 years. Confirmatory Factor Analysis showed a 2-factor model as the best solution for 13-items version. Standardized regression weights ranged from.50 to.66 for CFC-F and between.43 and.83 for CFC-I. Composite reliability was also adequate: CFC-F achieve? =.80 and CFC-I? =.82. There were no differences across gender and age. The CFC-F subscale and UPPS-P subscales correlations, were negative and significant, highlighting the negative and moderate correlation between CFC-F and the lack of premeditation, a dimension strictly related to intertemporal decisions making. Thus, CFC-14 has adequate psychometric properties in an Argentinian population, although more studies are necessary to determine the robustness of these findings. (shrink)

This study examined the validity and reliability of a Turkish version of the Modified Moral Sensitivity Questionnaire for Student Nurses. After obtaining permission to adapt the MMSQSN into Turkish, the translation/back-translation method was used with expert opinions to determine content validity. Factor analysis was conducted to examine the construct validity and test–retest was performed on the questionnaire to determine reliability. Cronbach’s alpha coefficients were calculated to assess for internal consistency. Participants included 272 baccalaureate degree student nurses (...) who took ethics lessons prior to their clinical internship. The factor analysis revealed that even though the factor structure in the original scale was the same, relevant items were categorized with similar components, and factor loads were sufficient. The correlation coefficient in the analyses of test–retest scores was.66 for the total scale and the Cronbach’s alpha was.73 for the total scale. The translated MMSQSN is a valid and reliable measure of ethical sensitivity in student nurses in Turkey. (shrink)

A commonplace misconception identifies Kelsen as a one-dimensional legal positivist and Habermas as a one-dimensional legal moralist. I argue, on the contrary, that both theorists defend a complex normative conception of democratic proceduralism that straddles the positivism/naturalism divide. I then show how their extension of this conception to international law commits them to a monistic human rights regime. I conclude that their realistic acknowledgment of the fragmented nature of legal paradigms and regimes entails a complementary qualification of their monism. Section (...) 10.1 situates Kelsen and Habermas’s proceduralism between natural law reasoning and formal positivism in opposition to Schmitt’s political-theological defense of decisionism. Section 10.2 compares the different methods by which Kelsen and Habermas defend democratic proceduralism. Section 10.3 shows how they extend this conception to international law in defending a monistic human rights regime. Section 10.4 discusses their respective views about the decisive role played by courts and constitutional review in this regime, and critically examines their proceduralist understanding of constitutional review. Section 10.5 concludes with an assessment of the limits and possibilities of constitutionalizing humanitarian law in international law in the face of persistent legal pluralization. (shrink)

Introduction The Defining Issues Test (DIT) aimed to measure one’s moral judgment development in terms of moral reasoning. The Neo-Kohlbergian approach, which is an elaboration of Kohlbergian theory, focuses on the continuous development of postconventional moral reasoning, which constitutes the theoretical basis of the DIT. However, very few studies have directly tested the internal structure of the DIT, which would indicate its construct validity. Objectives Using the DIT-2, a later revision of the DIT, we examined whether a bi-factor (...) model or 3-factor CFA model showed a better model fit. The Neo-Kohlbergian theory of moral judgment development, which constitutes the theoretical basis for the DIT-2, proposes that moral judgment development occurs continuously and that it can be better explained with a soft-stage model. Given these assertions, we assumed that the bi-factor model, which considers the Schema-General Moral Judgment (SGMJ), might be more consistent with Neo-Kohlbergian theory. Methods We analyzed a large dataset collected from undergraduate students. We performed confirmatory factor analysis (CFA) via weighted least squares. A 3-factor CFA based on the DIT-2 manual and a bi-factor model were compared for model fit. The three factors in the 3-factor CFA were labeled as moral development schemas in Neo-Kohlbergian theory (i.e., personal interests, maintaining norms, and postconventional schemas). The bi-factor model included the SGMJ in addition to the three factors. Results In general, the bi-factor model showed a better model fit compared with the 3-factor CFA model although both models reported acceptable model fit indices. Conclusion We found that the DIT-2 scale is a valid measure of the internal structure of moral reasoning development using both CFA and bi-factor models. In addition, we conclude that the soft-stage model, posited by the Neo-Kohlbergian approach to moral judgment development, can be better supported with the bi-factor model that was tested in the present study. (shrink)

Cognitive load theory has been widely used to help understand the process of learning and to design teaching interventions. The Cognitive Load Scale developed by Leppink and colleagues has emerged as one of the most validated and widely used self-report measures of intrinsic load, extraneous load, and germane load. In this paper we investigated an expansion of the CLS by using a multidimensional conceptualization of the EL construct that is relevant for physical and online teaching environments. The Multidimensional Cognitive Load (...) Scale for Physical and Online Lectures goes beyond the CLS's operationalization of EL by expanding the EL component which originally included factors related to instructions/explanations with sub-dimensions including EL stemming from noises, and EL stemming from both media and devices within the environment. Through three studies, we investigated the reliability, and internal and external validity of the MCLS-POL using the Partial Credit Model, Confirmatory Factor Analysis, and differences between students either attending a lecture physically or online. The results of Study 1 provide initial evidence for the validity and reliability of the MCLS-POL within a higher education sample, but also highlighted several potential improvements which could be made to the measure. These changes were made before re-evaluating the validity and reliability of the measure in a new sample of higher education psychology students, and psychological testing students. Together the studies provide evidence for a multidimensional conceptualization cognitive load and provide evidence of the validity, reliability, and sensitivity of the MCLS-POL and provide suggestions for future research directions. (shrink)

Using data from four different samples of full-time employees (Ntotal = 2,474), the present study was aimed to introduce and demonstrate the validity and reliability of the Organizational-Based General Self-esteem Scale (OB-GSE) a new six-item self-report scale to measure organizational-based self-esteem (OBSE) at work. Results provided evidence of (1) validity (internal, external, and convergent), (2) reliability, and (3) temporal stability of the OB-GSE scale. All in all, results attested the usefulness and the effectiveness of the OB-GSE scale.

Havstad (2022) argues that the argument from inductive risk for the claim that non-epistemic values have a legitimate role to play in the internal stages of science is deductively valid. She also defends its premises and thus soundness. This is, as far as we are aware, the best reconstruction of the argument from inductive risk in the existing literature. However, there is a small flaw in this reconstruction of the argument from inductive risk which appears to render the argument (...) invalid. This flaw is superficial, and a small amendment to it rescues the claim of validity. (shrink)

This article describes the development of a computerized version of a measure of ethical sensitivity to racial and gender intolerance, the Racial Ethical Sensitivity Test. The REST was based on James Rest's 4-component model of moral development and the professional codes of ethics from school-based professions. The new version, Racial and Ethical Sensitivity Test-Compact Disk, consists of 5 videotaped scenarios followed by an interactive "interview" presented on compact discs. Data from a study with 58 students provides initial validation of the (...) REST-CD. Ethical sensitivity to racial and gender intolerance in schools, as measured by the REST-CD, was moderately related to attitudes toward racial and gender equity issues in society as measured by the Quick Discrimination Index. The results provide evidence for both interrater and internal reliability of the REST-CD scores. This study also tests the hypothesized relationship between REST-CD scores and previous multicultural and ethics course work. Students with multicultural and ethics course experience have scored significantly higher on the REST-CD than students without course work. The paper-and-pencil tests are not significantly related to previous ethics/multicultural course work. In this article, we discuss the implications of the results and directions for future research. (shrink)

BackgroundHealth-related quality of life is known to be impaired in individuals with coronary artery disease, especially in those after a recent acute coronary syndrome. Heart failure is a common burden in this population that significantly contributes to worsening HRQoL. To accurately measure the level of HRQoL in individuals with CAD after ACS, disease-specific scales, such as the Minnesota living with heart failure questionnaire, are recommended. Nevertheless, to date, there has not been a study that would comprehensively evaluate the psychometric properties (...) of the MLHFQ in a large sample of individuals with CAD after ACS. The debate regarding the internal structure of MLHFQ is also still present. Hence, this study aimed to translate the MLHFQ and evaluate its internal structure, reliability/precision, and validity in individuals with CAD following ACS in Lithuania.MethodsIn the cross-sectional study, 1,083 participants were evaluated for sociodemographic and clinical characteristics. HRQoL was measured using the MLHFQ and the Short Form-36 health survey. In addition, exercise capacity was also evaluated in the study patients, using a standardized computer-driven bicycle ergometer.ResultsThe internal consistency of the MLHFQ subscales was found to be good. Confirmatory factor analysis provided the support for the three-factor model of the MLHFQ and showed acceptable fit [comparative fit indices = 0.894; goodness-of-fit = 0.898; non-normal fit index = 0.879, and root mean square error of approximation = 0.073]. Regarding convergent evidence, significant associations were found between the MLHFQ domains and the SF-36 domains and EC.ConclusionThe current study completed cultural validation and provided further information on the psychometric characteristics of the MLHFQ in Lithuania, suggesting MLHFQ as a valid and reliable instrument to measure HRQoL. The Lithuanian version of MLHFQ is best described by a three-factor solution, measuring physical, social, and emotional dimensions of HRQoL among individuals with CAD following ACS. (shrink)

This paper examines the properties of the validity and scope of arguments as standards for evaluating the epistemic qualities of particular deliberative exchanges within a context of value pluralism where parties can hold differing views of the common good based on incommensurable basic values. In this context, the task of political decisions is to maximise the interests of all, only judging between internally coherent versions of the common good on the basis of their mutual impact. The paper argues open, (...) democratic, deliberation provides the best chance of discovering such a path, through developing mutual understanding across incommensurable positions. Identifying the validity and scope of a deliberative exchange enhances this potential. Any deliberative exchange may be characterised in terms of its validity – the reasons that support its conclusions – and scope – the unquestioned assumptions that mark the boundaries of that reasoning. The paper explains the epistemic role of these two features in developing understanding across plural positions. Clarity about the validity of an exchange reveals positions that can be shared. Acknowledgement of its scope avoids over-extending its conclusions and reveals how positions differ, providing the starting point for further deliberation about their co-ordination. The paper ends by drawing the conclusion that deliberation characterised in this way should be democratic and open. (shrink)

Scholars and providers are coming to realize that one’s ability to notice and respond to internal body sensations contributes to an overall sense of wellbeing. Research has demonstrated a relationship between interoceptive awareness and anxiety, for example. Currently, however, tools for evaluating one’s interoception lack the conceptual foundation and clarity necessary to identify everyday behaviors that specifically reflect interoceptive awareness. Unlike existing interoceptive measures, the Sensory Profile Interoception scale is participation-based and grounded in Dunn’s Sensory Processing framework. In this (...) study we investigated concurrent validity by correlating the SPI with the Adolescent/Adult Sensory Profile ; we investigated construct validity by correlating the SPI with the Perth Alexithymia Scale, the Body Awareness Scale, and the State-Trait Anxiety Inventory. Using the REDCAP online platform, 74 college-aged participants completed the measures. Using Spearman rank order correlations there were statistically significant relationships between the corresponding sensory pattern subscales on SPI and A/ASP. The PAS was only weakly related to the registration subscale of the SPI. The BAS had significant relationships with seeking and avoiding on the SPI. The STAI had significant relationships with sensitivity and registrations of the SPI. Taken together, these findings provide evidence of construct validity of the SPI to identify participation patterns associated with both high and low interoception. With the more precise information the SPI provides, professionals can design tailored interventions to support everyday life goals and researchers can study interoception within authentic activities. (shrink)

Exposure to pesticides during infancy is associated with numerous adverse health outcomes. The assessment of knowledge and perception of pesticides exposure and risk among children has not been thoroughly studied. The aim of the study was to evaluate the reliability and validity of a questionnaire that measures the knowledge and perception of exposure to organophosphate pesticides among rural schoolchildren. The questionnaire was administered to 151 schoolchildren between 9 and 13years from four Chilean rural schools. An internal consistency analysis (...) of the ordinal alpha coefficient and a polychoric factor analysis for categorical data were used. The results show that the ordinal alpha was 0.95. Polychoric matrices of rotated components show the 17 questions summarized pesticide knowledge in five factors extracted after promax rotation. This factorial model explains 56.3% of the variance. The questions were grouped as follows: knowledge about pesticides ; knowledge of health effects related to pesticides exposure ; pesticide exposure through the growing of fruits and vegetables ; perception and action against pesticides exposure at school ; and perception and action against pesticides exposure at home. The questionnaire provides a useful tool for examining pesticide exposure in agricultural regions, allowing younger community members to participate. (shrink)

The purpose of this paper is to show how the degree of experimental validity of scientific procedures is crucially involved in determining two typical pragmatic modes in science, namely, the preservation of useful procedures and the disposal of useless ideas. The term 'pragmatic' will here be used following Schurz's characterisation of being internally pragmatic, as referring to that which proves useful for scientific or epistemic goals. The first part of the paper consists in a characterisation of the notion of (...) experimental validity. The second part is focused on several historical examples illustrating how the above pragmatic modes relate to the question of experimental validity. The Michelson-Morley experiment is presented as a case of a highly valid and useful experiment preserved through the development of different theories (like, on the one hand, the ether theory, upheld by Fitzgerald and Lorentz, and, on the other hand, Einstein's special theory of relativity). The concept of caloric will be discussed as an example of an idea that was discarded once it became useless, after heat was understood as a form of energy within the new frame provided by the kinetic theory of heat towards the middle of the 19th century. (shrink)

Introduction:The concept of mentalizing is nowadays widely used in research as well as in clinical practice. Despite its popularity, the development of an economic assessment is still challenging. The Mentalization Scale appears to be a promising measurement with good psychometric properties but lacking convergent validity with the Reflective Functioning Scale.Objective:This study aims to test the construct validity of the Mentalization Scale through correlations with the gold standard, the Reflective Functioning Scale, within a clinical sample. Furthermore, it was of (...) interest to replicate its internal consistency.Methods:Twenty-six inpatients of an acute psychiatric ward in Vienna were given the Mentalization Scale (MentS). They were interviewed with the Brief Reflective Function Interview, which was coded with the Reflective Functioning Scale. Correlations and internal consistency were calculated.Results:Concerning the primary aim of this study, the validity was satisfactory for the MentS whole-scale mentalizing as well as for the subscales self- and other-oriented mentalizing. Internal consistency was lower to the findings of the developer and close to the 0.70 threshold.Conclusion:Our findings could foster the psychometric properties of the MentS. Furthermore, the MentS seems to be a promising measurement tool for detecting different dimensions of reflective functioning. Limitations and further research are discussed. (shrink)

Many semantic theories become trivial when extended with a naïve validity predicate due to the validity paradoxes. The non-classical semantic theories are the ones that allegedly preserve the naïveté of the validity predicate while being capable of avoiding the validity paradoxes. This blocking, on the other hand, usually comes at a high cost. In this paper, we argue that the pre-theoretical notion of validity that the naïve validity predicate intends to capture is unattainable.

Body awareness refers to the individual ability to process signals originating from within the body, which provide a mapping of the body’s internal landscape and its relation with space and movement. The present study aims to evaluate psychometric properties and validate in French two self-report measures of body awareness: the Postural Awareness Scale, and the last version of the Multidimensional Assessment of Interoceptive Awareness questionnaire. We collected data in a non-clinical, adult sample using online survey, and a subset of (...) the original sample also completed the retest control. Factor analyses and reliability analyses were conducted. Construct validity of the PAS and the MAIA-2 were examined by testing their association with each other, and with self-report measures of personality, alexithymia and dispositional trait mindfulness. Factor analyses of the PAS supported the same two-factor structure as previously published versions. For the MAIA-2, factor analyses suggested that a six-factor structure, excluding Not-Worrying and Not-Distracting factors, could successfully account for a common general factor of self-reported interoception. We found satisfactory internal consistency, construct validity, and reliability over time for both the PAS and the MAIA-2. Altogether, our findings suggest that the French version of the PAS and the MAIA-2 are reliable self-report tools to assess both components of body awareness. (shrink)

The Anticipatory and Consummatory Interpersonal Pleasure Scale is a psychometric instrument that has been used to indirectly measure social anhedonia in many cross-cultural contexts, such as in Western, European, Eastern, and Israeli samples. However, little is known about the psychometric properties of the ACIPS in Korean samples. The primary goal of this study was to validate the Korean version of the ACIPS among non-help-seeking individuals. The sample consisted of 307 adult individuals who had no current or prior psychiatric history. Participants (...) were administered the ACIPS, along with the Behavioral Inhibition and Behavioral Activation Scales and Beck Depression Inventory. We examined the association of the total ACIPS scores with the other measures. The ACIPS showed good internal consistency. We also explored the factor structure of the Korean translation of the ACIPS using principal component analysis with Promax rotation and Kaiser normalization. Factor analysis yielded a three-factor structure that accounted for 58.8% of the variance. The three-factor model included the following subdomains: interactions involving close relationships, casual interactions, and interactions involving family members. Total BAS and BIS scores were significantly associated with total ACIPS scores, while BDI scores were inversely associated with total ACIPS scores. The current research indicates that the Korean version of the ACIPS is a useful and valid scale. Future directions include using the Korean translation of the ACIPS to elucidate the varying degrees of hedonic capacity in psychiatric patients. (shrink)

The importance of self-regulated learning has increased during the COVID-19 pandemic and measures for assessing students’ self-regulation skills and knowledge are greatly needed. We present the results of the first thorough adaptation of the Children’s Perceived use of Self-Regulated Learning Inventory. The inventory, consisting of 15 scales measuring nine components of SRL, was administered to a sample of 541 Slovenian ninth graders. Confirmatory factor analyses supported internal structure validity of most components, but two components required some structural modifications. (...) Internal consistency coefficients were acceptable for the majority of scale scores and were highly comparable to the original ones. While metric invariance across gender was confirmed, the scalar invariance of some scales needs further examination. Meaningful correlations with relevant externally assessed and self-reported self-regulation and school performance variables indicated good criterion validity of the inventory. The Slovenian version of the CP-SRLI thus proved to be a sufficiently valid and reliable instrument for assessing pupils’ learning self-regulation. (shrink)

Background: Nurses, social workers, and medical residents are ethically mandated to engage in policy advocacy to promote the health and well-being of patients and increase access to care. Yet, no instrument exists to measure their level of engagement in policy advocacy. Research objective: To describe the development and validation of the Policy Advocacy Engagement Scale, designed to measure frontline healthcare professionals’ engagement in policy advocacy with respect to a broad range of issues, including patients’ ethical rights, quality of care, culturally (...) competent care, preventive care, affordability/accessibility of care, mental healthcare, and community-based care. Research design: Cross-sectional data were gathered to estimate the content and construct validity, internal consistency, and test–retest reliability of the Policy Advocacy Engagement Scale. Participants and context: In all, 97 nurses, 94 social workers, and 104 medical residents were recruited from eight acute-care hospitals in Los Angeles County. Ethical considerations: Informed consent was obtained via Qualtrics and covered purposes, risks and benefits; voluntary participation; confidentiality; and compensation. Institutional Review Board approval was obtained from the University of Southern California and all hospitals. Findings: Results supported the validity of the concept and the instrument. In confirmatory factor analysis, seven items loaded onto one component with indices indicating adequate model fit. A Pearson correlation coefficient of.36 supported the scale’s test–retest stability. Cronbach’s α of.93 indicated strong internal consistency. Discussion: The Policy Advocacy Engagement Scale demonstrated satisfactory psychometric properties in this initial test. Findings should be considered within the context of the study’s limitations, which include a low response rate and limited geographic scope. Conclusion: The Policy Advocacy Engagement Scale appears to be the first validated scale to measure frontline healthcare professionals’ engagement in policy advocacy. With it, researchers can analyze variations in professionals’ levels of policy advocacy engagement, understand what factors are associated with it, and remedy barriers that might exist to their provision of it. (shrink)

To measure non-cognitive facets of competence, we developed and tested a new method that we refer to as Embedded Experience Sampling (EES). Domain-specific problem-solving competence is a multi-faceted construct that is not limited to cognitive facets such as domain knowledge or problem-solving strategies but also comprises non-cognitive facets in the sense of domain-specific emotional and motivational dispositions such as interest and self-concept. However, in empirical studies non-cognitive facets are usually either neglected or measured by generalized self-report questionnaires that are detached (...) from the performance assessment. To enable an integrated measurement, we developed the EES method to collect data on non-cognitive facets during scenario-based low-stakes assessments. Test-takers are requested to stop at certain times and spontaneously answer short items (EES items) regarding their actual experience of the problem situation. These EES items are embedded in an EES event that resembles typical social interactions with non-player characters. To evaluate the feasibility and validity of the method, we implemented EES in a series of three studies in the context of commercial vocational education and training (VET): A feasibility study with 77 trainees, a pilot study with 20 trainees, and the main study with 780 trainees who worked on three complex problem scenarios in a computer-based office simulation. In the present paper, we investigate how test-takers perceived the EES events, and whether social desirability biased their answers, and investigate the internal structure of the data and the relationship between EES data and data from several other sources. Interview data and survey data indicated no biases due to social desirability and no additional burden for the test-takers due to the EES events. A correlation analysis following the multitrait-multimethod approach as well as the calibration of a multidimensional model based on Item Response Theory (IRT) also supported the construct validity. Furthermore, EES data shows substantial correlations with test motivation but almost zero correlations with data from generalized retrospective self-report questionnaires on non-cognitive facets. Altogether, EES offers an alternative approach to measuring non-cognitive facets of competence under certain conditions. For instance, EES is also based on self-reporting and thus might not be suitable for high-stakes testing. (shrink)

High prevalence of musicians’ physical and mental performance-related health issues (PRHI) has been demonstrated over the last 30 years. To address this, health promotion strategies have been implemented at some post-secondary music institutions around the world, yet the high prevalence of PRHI has persisted. In 2018, an international group of researchers formed the Musicians’ Health Literacy Consortium to determine how best to decrease PRHI, and to examine the relationship between PRHI and health literacy. An outcome of the Consortium was the (...) development of a new health literacy tool for musicians, the MHL-Q19, which drew from the theoretical framework of the European health literacy suite of tools, HLS-EU. The aim of the current study was to evaluate the validity and reliability of the MHL-Q19. Participants completed a battery of questionnaires, including the HLS-EU-Q16 for the assessment of general health literacy; the Musculoskeletal Pain Intensity and Interference Questionnaire for Musicians (MPIIQM); the RAND-12 quality of life questionnaire; and the General Self-Efficacy scale (GSE). We hypothesized that the MHL-Q19 would have a weak correlation with the HLS-EU-Q16; moderate correlation with the physical component scale and weak correlation with the mental component scale of the RAND-12; moderate correlation with the GSE; and finally, moderate correlation with pain interference and weak correlation with pain intensity of the MPIIQM. A total of 549 post-secondary music students from six English-speaking countries completed the battery of questionnaires, and 328 of these participants provided valid responses to the MHL-Q19 alone 2 weeks later. The tool showed acceptable internal consistency and test–retest reliability. Three of our hypotheses were supported, although the strength of the correlations varied from what we had predicted. The fourth hypothesis was not supported; our findings indicate that lower health literacy scores were weakly related to higher MPIIQM pain intensity and interference scores. The results of this study support the notion that musicians’ health literacy is a distinct construct that cannot be fully evaluated with existing health literacy tools. Given that this is a new instrument, the evidence presented is positive and promising. Further studies will be needed to refine the tool. (shrink)

This book represents a unique endeavor to elucidate the story of Kosovo's unilateral quest for statehood. It is an inquiry into the international legal aspects and processes that shaped and surrounded the creation of the state of Kosovo. Being created outside the post-colonial context, Kosovo offers a unique yet controversial example of state emergence both in the theory and practice of creation of states. Accordingly, the book investigates the legal pathways, strategies, developments and policy positions of international agencies/actors and regional (...) players (in particular the EU) that helped Kosovo to establish its independence and gradually acquire statehood. Although contested, Kosovo, and its quest for statehood, represents a unique example of successful unilateral secession. The book therefore explores and analyses patterns of state formation and nation-building in Kosovo, and its transition to democracy. It presents a three-level assessment. First, seen from a historical perspective, the book examines the validity of the right of Kosovar-Albanians to self-determination and remedial secession. Second, from a legal positivist perspective, it scrutinizes all of the legalist arguments that support Kosovo's right to statehood, and claims that both traditional and legality-based criteria for statehood remain insufficient to determine whether Kosovo has achieved statehood. Third, from a post-factum perspective, the book analyzes the scope and extent to which the internationally blended element was decisive in Kosovo's state-formation and state-building processes. It explains how the EU's involvement as an 'internationally blended element' in Kosovo's efforts to achieve statehood was instrumental and played a crucial role in shaping the emerging state. In particular, the book elaborates on how the EU was able to streamline its mode of intervention in the context of state-building and reform. (shrink)

Fully automated vehicles (AVs) hold promise toward providing numerous societal benefits including reducing road fatalities. However, we are uncertain about how individuals’ perceptions will influence their ability to accept and adopt AVs. The 28-item Automated Vehicle User Perception Survey (AVUPS) is a visual analog scale that was previously constructed, with established face and content validity, to assess individuals’ perceptions of AVs. In this study, we examined construct validity, via exploratory factor analysis and subsequent Mokken scale analyses. Next, (...) class='Hi'>internal consistency was assessed via Cronbach’s alpha (α) and 2-week test–retest reliability was assessed via Spearman’s rho (ρ) and intraclass correlation coefficient (ICC). The Mokken scale analyses resulted in a refined 20-item AVUPS and three Mokken subscales assessing specific domains of adults’ perceptions of AVs: (a)Intention to use; (b)perceived barriers; and (c)well-being. The Mokken scale analysis showed that all item-coefficients of homogeneity (H) exceeded 0.3, indicating that the items reflect a single latent variable. The AVUPS indicated a strong Mokken scale (Hscale= 0.51) with excellent internal consistency (α = 0.95) and test–retest reliability (ρ = 0.76, ICC = 0.95). Similarly, the three Mokken subscales ranged from moderate to strong (rangeHscale= 0.47–0.66) and had excellent internal consistency (range α = 0.84–0.94) and test–retest reliability (range ICC = 0.84–0.93). The AVUPS and three Mokken subscales of AV acceptance were validated in a moderate sample size (N= 312) of adults living in the United States. Two-week test–retest reliability was established using a subset of Amazon Mechanical Turk participants (N= 84). The AVUPS, or any combination of the three subscales, can be used to validly and reliably assess adults’ perceptions before and after being exposed to AVs. The AVUPS can be used to quantify adults’ acceptance of fully AVs. (shrink)