Family carers of individual’s living with Huntington’s Disease (HD) manage a distinct and unique series of difficulties arising from the complex nature of HD. This paper presents the validation of the definitive measure of quality of life for this group. The Huntington’s Disease Quality of Life Battery for carers (HDQoL-C) was expanded and then administered to an international sample of 1716 partners and family carers from 13 countries. In terms of the psychometric properties of the tool, exploratory analysis of (...) half of the sample, demonstrated good internal consistency and reliability. Some items on the full version did not meet psychometric thresholds and a short version (HDQoL-Cs) was developed based on more stringent criteria. Confirmatory Factor Analysis of the model structure showed a good fit for all Factors and, indicated that the HDQoL-C and HDQoL-Cs are psychometrically robust measures of quality of life. We found that carers who lived with and looked after their spouse/partner had reduced sense of coping, hope for the future and overall quality of life. Carers with children who were at risk, carried the gene or were symptomatic also had poorer quality of life outcomes. Findings indicated the HDQoL-C and HDQoL-Cs are valid in multiple languages and across varied cultures as measures of self-reported quality of life in family carers of individual’s living with HD. These psychometrically validated tools can aid and guide the implementation of therapeutic interventions to improve life quality in this population. (shrink)

In Persson & Wallin we show that the common claim that internal validity should be understood as prior to external validity has, at least, three epistemologically problematic aspects: experimental artefacts, the implications of causal relations, and how the mechanism is measured. Each aspect demonstrates how important external validity is for the internal validity of the experimental result. This note is an invited summary of these results.

Until social psychology devotes as much attention to construct and external validity as it does to internal validity, the field will continue to produce theories that fail to replicate in the field and cannot be used to meliorate social problems.

We show that the common claim that internal validity should be understood as prior to external validity has, at least, three epistemologically problematic aspects: experimental artefacts, the implications of causal relations, and how the mechanism is measured. Each aspect demonstrates how important external validity is for the internal validity of the experimental result.

International government and corporate corruption is increasingly under siege. Although various groups of researchers have quantified and documented world-wide corruption, apparently no one has validated the measures. This study finds a very strong significant correlation of three measures of corruption with each other, thereby indicating validity. One measure was of Black Market activity, another was of overabundance of regulation or unnecessary restriction of business activity. The third measure was an index based on interview perceptions of corruption (Corruption Perceptions Index or (...) CPI) in that nation. Validity of the three measures was further established by finding a highly significant correlation with real gross domestic product per capita (RGDP/Cap). The CPI had by far the strongest correlation with RGDP/Cap, explaining over three fourths of the variance.Corruption is increasingly argued to be a barrier to development and economic growth. Business students often do not see ethics courses as being as relevant as other value-free disciplines or core courses. The data in this study suggests otherwise. Sustainable economic development appears very dependent on a constant, virtuous cycle that includes corruption fighting, and the maintenance of trust and innovation, all reinforcing each other. (shrink)

Much of the methodological discussion around experiments in economics and other social sciences is framed in terms of the notions of internal and external validity. The standard view is that internal validity and external validity stand in a relationship best described as a _trade-off_. However, it is also commonly held that internal validity is a _prerequisite_ to external validity. This article addresses the problem of the compatibility of these two ideas and analyzes critically the standard arguments about (...) the conditions under which a trade-off between internal and external validity arises. Our argument stands against common associations of internal validity and external validity with the distinction between field and laboratory experiments and assesses critically the arguments that link the artificiality of experimental settings done in the laboratory with the purported trade-off between internal and external validity. We conclude that the idea of a trade-off or tension between internal and external validity seems, upon analysis, far less cogent than its intuitive attractiveness may lead us to think at first sight. (shrink)

This article replicates a U.S. study of marketing norms in an international setting. The dimensionality and reliability of the scales are tested in the U.S., Singapore and South Africa. Support is found for the use of the scales, as modified. The norms of the current respondents are compared with those of the original U.S. respondents and each other. Differences between the three countries are found with respect to general honesty and integrity norms, but not for specific marketing-related norms. Differences between (...) the original study results and the current findings are assessed in terms of methodological and substantive factors. (shrink)

The article identifies a latent debate in the recent literature on the role and worth of experiments in economics and other social sciences concerning the relationship between the external and the internal validity of experimental designs. Our work identifies two incompatible views regarding the relationship between internal and external validity of experiments. While in the methodological literature references to the idea that there is a trade-off between the internal and external validity of experiments abound, this view coexists (...) with the position stating that internal validity is rather a prerequisite of external validity. By identifying the contours of this implicit debate in the recent methodological literature around the use of experiments in the social sciences we call attention upon a series of insufficiently conceptualized issues regarding the central notions of internal and external validity and we question the standard view positing a trade-off between the two. This article stands against common associations of internal validity and external validity with the distinction between field and laboratory experiments and assesses critically the arguments that link the artificiality of experimental settings done in the laboratory with the purported trade-off between internal and external validity. (shrink)

According to a classical work on experimental design internal validity “refers to the approximate validity with which we infer that a relationship between two variables is causal or that the absence of a relationship implies the absence of cause”. External validity “refers to the approximate validity with which we can infer that the presumed causal relationship can be generalized to and across alternate measures of the cause and effect and across different types of persons, settings, and times”. Since then, (...) these have been the accepted definitions, with slight variations, of both concepts. However, there have been deep differences in interpreting the scope and limits of validity concepts in economics. From theory-driven experimental designs that defend the priority of the internal over the external validity to those researches that are demanding the importance of external validity in economics, we can find the most diverse points of view. What can experimental ethics learn, then, from recent debates on external and internal validity in experimental economics? If we want to elicit moral intuitions into the lab, are we testing moral theories that way? Could intuitions be generalized “across different types of persons, settings, and times”? Is that really possible? (shrink)

This paper develops an account of rigour in the use of thought experiments in ethics. I argue that there are two separate challenges to be faced. The first is internal validity: is the thought experiment designed in a way that allows its readers to make judgements that are confident and free of bias about the hypothesis or point of principle that it aims to test? The second is external validity: to what extent do ethical judgements that are correct of (...) the world of the thought experiment generalize to a wide variety of other contexts, including ethical decision-making in the actual world? Ensuring external validity is the harder and more important problem of rigour, yet it is one that few philosophers have even noticed, let alone begun to solve. (shrink)

Weight stigma internalization among adolescents across weight categories leads to adverse psychological consequences. This study aims to adapt and validate a Chinese version of the Weight Bias Internalization Scale for Mainland Chinese children and adolescents. A total of 464 individuals aged 9 to 15 years participated in the present study. Based on item response theory and classical test theory, we selected the items for the C-WBIS and evaluated its reliability and validity. The item response theory yields support for the one-dimensional (...) factor mode. All item parameters fit the IRT model, eight items were adopted. No evidence of significant differential item functioning was found for gender and age groups. The C-WBIS was correlated with the Core Self-Evaluation Scale and two subscales of the Social Anxiety Scale for Children, which indicated an acceptable criterion-related validity. The C-WBIS is a reliable and valid measure that can be used as a psychometrically sound and informative tool to assess weight bias internalization among children and adolescents. (shrink)

This study assessed the International Critical Thinking Essay Test (ICTET-A) for inter-rater reliability, internal reliability, and criterion validity. A self-selecting sample of participants (N = 100) completed the ICTET-A and a comparison test online. We found the ICTET-A items to have moderate to good levels of inter-rater reliability, and overall excellent inter-rater consistency for total test scores. The test had good internal reliability. There was a strong correlation between scores on the ICTET-A and the comparison test. Factor analysis (...) showed that scores were best explained with one factor, suggesting the test measures a single construct. The ICTET-A can therefore be considered a valid measure of critical thinking. Additionally, we propose a short form of the test. (shrink)

Cross-cultural comparisons often investigate values that are assumed to have long-lasting influence on human conduct and thought. To capture and compare cultural values across cultures, Geert Hofstede's Cultural Dimensions Theory has offered an influential framework. Hofstede also provided a survey instrument, the Values Survey Module (VSM), for measuring cultural values as outlined in his Cultural Dimensions Theory. The VSM has since been subject to a series of revisions. Yet, data on countries have been derived from the original VSM — and (...) not on one of the revised versions of VSM. We tested three scales (indulgence, power distance, and individualism) from the latest version, the VSM 2013, as part of a larger survey across 57 countries. Two main findings emerged. For one thing, country scores based on the VSM 2013 scales correlated only weakly with country scores of the same cultural dimensions obtained in a large previous study. Thus, the validity of the VSM 2013 is in doubt. For another thing, the internal consistency of the VSM 2013 scales was overall poor, indicating that the scales did not reliably measure well-defined constructs. We discuss implications for cross-cultural research. (shrink)

For critical legal scholars, the ongoing far-right assault upon the liberal status quo poses a distinct dilemma. On the one hand, the desire to condemn the far-right is overwhelming. On the other hand, such condemnations are susceptible to being appropriated as a validation of the very liberalism that critical theorists have long questioned. In seeking to transcend this dilemma, my focus is on the discourse of ‘white genocide’ — a commonplace belief amongst the far-right/white nationalists that ‘whites’, as a (...) discrete group, are facing demographic destruction as a result of deliberate policy choices. Such a belief has motivated acts of extreme violence. While libel to dismissal by experts on mainstream understandings of genocide, namely international criminal lawyers, I argue that this ‘white genocide’ discourse deserves careful scrutiny as a jurisprudential and socio-legal phenomenon that reveals key weaknesses in present modalities of liberal justification. Drawing upon an array of recent critical theories, I show how a liberalism unable to face its own decline enables the very far-right assertions it purports to oppose. Thus, given liberalism’s failure to act as a neutral arbiter, an alternative approach for those opposing the far-right is to develop a vision of politics and society that confront believers in ‘white genocide’ on a more substantive level. This, I argue, forces the far-right’s opponents to disavow liberal scepticism towards utopian transformation as well as the juridical understandings and institutions that allow this scepticism to durably persist. (shrink)

This study explored the evidence of validity of internal structure of the 12-item Functional Assessment of Chronic Illness Therapy—Spiritual Wellbeing Scale in Brazilian adolescents with chronic health conditions. The study involved 301 Brazilian adolescents with cancer, type 1 diabetes mellitus, or cystic fibrosis. Exploratory Factor Analysis, Confirmatory Factor Analysis, and Item Response Theory were used to test the internal structure. Reliability was determined with Cronbach’s Alpha and McDonald’s Omega. The EFA suggested a one-dimensional scale structure in contrast to (...) the original 2-factor model or the 3-factor model which were not reproduced in the current CFA. All quality indicators for the EFA one-factor exceeded the required criteria. The FACIT-Sp-12 for adolescents yielded strong evidence for a 1-factor model and with good reliability. (shrink)

Researchers often aim to make correct inferences both about that which is actually studied and about what the results generalize to. The language of internal and external validity is not used by everyone, but many of us would agree that intuitively the distinction makes a lot of sense. Two claims are commonly made with respect to internal and external validity. The first is that internal validity is prior to external validity since there is nothing to generalize if (...) the findings obtained in, for instance, the experimental setting do not hold. The first claim is explicit in many writings. See for instance Francisco Guala’s influential book The methodology of experimental economics. And it is often implicitly relied on. The second claim is that researchers have to make a trade-off between internal and external validity. When one is increased, the other will decrease. The second claim was made already from the start by D.T Campbell in his classic Factors relevant to the validity of experiments in social settings. There is a certain tension between the first and the second claim. It has been argued before that it might be difficult to combine them. We intend to make the stronger point that both claims are misconstrued. Our hypothesis is that the relationship between internal and external validity has to be re-conceptualized, and we will briefly indicate how. (shrink)

The experimental revolution in the social sciences is one of the most significant methodological shifts undergone by the field since the ‘quantitative revolution’ in the nineteenth century. One of the often valued features of social science experimentation is precisely the fact that there are clear methodological rules regarding hypothesis testing that come from the methods of the natural sciences and from the methodology of RCTs in the biomedical sciences, and that allow for the adjudication among contentious causal claims. We examine (...) critically this claim and argue that some current understandings of the practices that surround social science experimentation overestimate the degree to which experiments can actually fulfil this role as “objective” adjudicators, by neglecting the importance of shared background knowledge or assumptions and of consensus regarding the validity of the constructs involved in an experiment. We take issue with the way the distinction between internal and external validity is often used to comment on the inferential import of experiments, used both among practitioners and among philosophers of science. We describe the ways in which the more common use of the internal/external distinction differs from Cook and Campbell’s original methodological project, in which construct validity and the four-fold validity typology were all important in assessing the inferential import of experiments. We argue that the current uses of the labels internal and external, as applied to experimental validity, help to encroach a simplistic view on the inferential import of experiments that, in turn, misrepresents their capacity to provide objective knowledge about the causal relations between variables. (shrink)

Introduction The Defining Issues Test (DIT) aimed to measure one’s moral judgment development in terms of moral reasoning. The Neo-Kohlbergian approach, which is an elaboration of Kohlbergian theory, focuses on the continuous development of postconventional moral reasoning, which constitutes the theoretical basis of the DIT. However, very few studies have directly tested the internal structure of the DIT, which would indicate its construct validity. Objectives Using the DIT-2, a later revision of the DIT, we examined whether a bi-factor model (...) or 3-factor CFA model showed a better model fit. The Neo-Kohlbergian theory of moral judgment development, which constitutes the theoretical basis for the DIT-2, proposes that moral judgment development occurs continuously and that it can be better explained with a soft-stage model. Given these assertions, we assumed that the bi-factor model, which considers the Schema-General Moral Judgment (SGMJ), might be more consistent with Neo-Kohlbergian theory. Methods We analyzed a large dataset collected from undergraduate students. We performed confirmatory factor analysis (CFA) via weighted least squares. A 3-factor CFA based on the DIT-2 manual and a bi-factor model were compared for model fit. The three factors in the 3-factor CFA were labeled as moral development schemas in Neo-Kohlbergian theory (i.e., personal interests, maintaining norms, and postconventional schemas). The bi-factor model included the SGMJ in addition to the three factors. Results In general, the bi-factor model showed a better model fit compared with the 3-factor CFA model although both models reported acceptable model fit indices. Conclusion We found that the DIT-2 scale is a valid measure of the internal structure of moral reasoning development using both CFA and bi-factor models. In addition, we conclude that the soft-stage model, posited by the Neo-Kohlbergian approach to moral judgment development, can be better supported with the bi-factor model that was tested in the present study. (shrink)

Ethical decision making measures are widely applied as the principal dependent variable used in studies of research integrity. However, evidence bearing on the internal and external validity of these measures is not available. In this study, ethical decision making measures were administered to 102 graduate students in the biological, health, and social sciences, along with measures examining exposure to ethical breaches and the severity of punishments recommended. The ethical decision making measure was found to be related to exposure to (...) ethical events and the severity of punishments awarded. The implications of these findings for the application of ethical decision making measures are discussed. (shrink)

Cognitive load theory has been widely used to help understand the process of learning and to design teaching interventions. The Cognitive Load Scale developed by Leppink and colleagues has emerged as one of the most validated and widely used self-report measures of intrinsic load, extraneous load, and germane load. In this paper we investigated an expansion of the CLS by using a multidimensional conceptualization of the EL construct that is relevant for physical and online teaching environments. The Multidimensional Cognitive Load (...) Scale for Physical and Online Lectures goes beyond the CLS's operationalization of EL by expanding the EL component which originally included factors related to instructions/explanations with sub-dimensions including EL stemming from noises, and EL stemming from both media and devices within the environment. Through three studies, we investigated the reliability, and internal and external validity of the MCLS-POL using the Partial Credit Model, Confirmatory Factor Analysis, and differences between students either attending a lecture physically or online. The results of Study 1 provide initial evidence for the validity and reliability of the MCLS-POL within a higher education sample, but also highlighted several potential improvements which could be made to the measure. These changes were made before re-evaluating the validity and reliability of the measure in a new sample of higher education psychology students, and psychological testing students. Together the studies provide evidence for a multidimensional conceptualization cognitive load and provide evidence of the validity, reliability, and sensitivity of the MCLS-POL and provide suggestions for future research directions. (shrink)

Workplace Incivility (WI) occurs worldwide and has negative consequences on individuals and organizations. Valid and comprehensive instruments have been used, specifically in English speaking countries, to measure such adverse process at work, but it is not available a validated instrument for research carried out in Spanish speaking countries. In this study we aim to test the psychometric properties of the Matthews and Ritter’s four-item Workplace Incivility Scale (2016) with Spanish workers (N= 407) from different sectors. Participants’ mean age was 38.73 (...) (SD= 10.45) years old and the percentage of female employees was 59.2%. Confirmatory factor analysis using AMOS 19.0 was carried out, presenting a good fit. The internal consistency, convergent and concurrent validity of the scale were examined. Results show good scale reliability and expected high correlations with social undermining. Moreover, the scale related to propensity to leave a job, job satisfaction, and psychological well-being in the expected way. After configural invariance across groups was established, testing for metric invariance and scalar invariance was performed. Considering Δχ² and ΔCFI tests for two nested models, the 4-item scale was invariant when the employment status is considered (permanent vs temporal, full-time vs part-time and supervisor vs non supervisors). Overall, our findings showed good psychometric properties of the shorter version of the Workplace Incivility Scale in Spain. Theoretical and practical implications of this study are discussed. (shrink)

This unique volume introduces and discusses the methods of validating computer simulations in scientific research. The core concepts, strategies, and techniques of validation are explained by an international team of pre-eminent authorities, drawing on expertise from various fields ranging from engineering and the physical sciences to the social sciences and history. The work also offers new and original philosophical perspectives on the validation of simulations. Topics and features: introduces the fundamental concepts and principles related to the validation (...) of computer simulations, and examines philosophical frameworks for thinking about validation; provides an overview of the various strategies and techniques available for validating simulations, as well as the preparatory steps that have to be taken prior to validation; describes commonly used reference points and mathematical frameworks applicable to simulation validation; reviews the legal prescriptions, and the administrative and procedural activities related to simulation validation; presents examples of best practice that demonstrate how methods of validation are applied in various disciplines and with different types of simulation models; covers important practical challenges faced by simulation scientists when applying validation methods and techniques; offers a selection of general philosophical reflections that explore the significance of validation from a broader perspective. This truly interdisciplinary handbook will appeal to a broad audience, from professional scientists spanning all natural and social sciences, to young scholars new to research with computer simulations. Philosophers of science, and methodologists seeking to increase their understanding of simulation validation, will also find much to benefit from in the text. (shrink)

This study examined the validity and reliability of a Turkish version of the Modified Moral Sensitivity Questionnaire for Student Nurses. After obtaining permission to adapt the MMSQSN into Turkish, the translation/back-translation method was used with expert opinions to determine content validity. Factor analysis was conducted to examine the construct validity and test–retest was performed on the questionnaire to determine reliability. Cronbach’s alpha coefficients were calculated to assess for internal consistency. Participants included 272 baccalaureate degree student nurses who took ethics (...) lessons prior to their clinical internship. The factor analysis revealed that even though the factor structure in the original scale was the same, relevant items were categorized with similar components, and factor loads were sufficient. The correlation coefficient in the analyses of test–retest scores was.66 for the total scale and the Cronbach’s alpha was.73 for the total scale. The translated MMSQSN is a valid and reliable measure of ethical sensitivity in student nurses in Turkey. (shrink)

Discussions of reproducibility are casting doubts on the credibility of experimental outcomes in the life sciences. Although experimental evolution is not typically included in these discussions, this field is also subject to low reproducibility, partly because of the inherent contingencies affecting the evolutionary process. A received view in experimental studies more generally is that standardization (i.e., rigorous homogenization of experimental conditions) is a solution to some issues of significance and internal validity. However, this solution hides several difficulties, including a (...) reduction of external validity and reproducibility. After explaining the meaning of these two notions in the context of experimental evolution, we import from the fields of animal research and ecology and suggests that systematic heterogenization of experimental factors could prove a promising alternative. We also incorporate into our analysis some philosophical reflections on the nature and diversity of research objectives in experimental evolution. (shrink)

Many semantic theories become trivial when extended with a naïve validity predicate due to the validity paradoxes. The non-classical semantic theories are the ones that allegedly preserve the naïveté of the validity predicate while being capable of avoiding the validity paradoxes. This blocking, on the other hand, usually comes at a high cost. In this paper, we argue that the pre-theoretical notion of validity that the naïve validity predicate intends to capture is unattainable.

A commonplace misconception identifies Kelsen as a one-dimensional legal positivist and Habermas as a one-dimensional legal moralist. I argue, on the contrary, that both theorists defend a complex normative conception of democratic proceduralism that straddles the positivism/naturalism divide. I then show how their extension of this conception to international law commits them to a monistic human rights regime. I conclude that their realistic acknowledgment of the fragmented nature of legal paradigms and regimes entails a complementary qualification of their monism. Section (...) 10.1 situates Kelsen and Habermas’s proceduralism between natural law reasoning and formal positivism in opposition to Schmitt’s political-theological defense of decisionism. Section 10.2 compares the different methods by which Kelsen and Habermas defend democratic proceduralism. Section 10.3 shows how they extend this conception to international law in defending a monistic human rights regime. Section 10.4 discusses their respective views about the decisive role played by courts and constitutional review in this regime, and critically examines their proceduralist understanding of constitutional review. Section 10.5 concludes with an assessment of the limits and possibilities of constitutionalizing humanitarian law in international law in the face of persistent legal pluralization. (shrink)

Introduction:The concept of mentalizing is nowadays widely used in research as well as in clinical practice. Despite its popularity, the development of an economic assessment is still challenging. The Mentalization Scale appears to be a promising measurement with good psychometric properties but lacking convergent validity with the Reflective Functioning Scale.Objective:This study aims to test the construct validity of the Mentalization Scale through correlations with the gold standard, the Reflective Functioning Scale, within a clinical sample. Furthermore, it was of interest to (...) replicate its internal consistency.Methods:Twenty-six inpatients of an acute psychiatric ward in Vienna were given the Mentalization Scale (MentS). They were interviewed with the Brief Reflective Function Interview, which was coded with the Reflective Functioning Scale. Correlations and internal consistency were calculated.Results:Concerning the primary aim of this study, the validity was satisfactory for the MentS whole-scale mentalizing as well as for the subscales self- and other-oriented mentalizing. Internal consistency was lower to the findings of the developer and close to the 0.70 threshold.Conclusion:Our findings could foster the psychometric properties of the MentS. Furthermore, the MentS seems to be a promising measurement tool for detecting different dimensions of reflective functioning. Limitations and further research are discussed. (shrink)

The extent to which people anticipate and are influenced by the potential future consequences of their current behavior is called Consideration of Future Consequences. A well-established tool to measure this construct is the 14-item Consideration of Future Consequences Scale. The CFC-14 has shown appropriate psychometric properties in several languages. This scale comprises two factors: the CFC-Immediate and the CFC-Future. The main goal of this study was to assess the psychometric properties and internal consistency of the CFC-14 Scale in Spanish, (...) using an Argentine sample. A secondary goal was to determine its convergent validity with impulsivity, and determine differences across gender and age groups. Using a web-based survey, we collected data from 512 participants aged 13-74 years. Confirmatory Factor Analysis showed a 2-factor model as the best solution for 13-items version. Standardized regression weights ranged from.50 to.66 for CFC-F and between.43 and.83 for CFC-I. Composite reliability was also adequate: CFC-F achieve? =.80 and CFC-I? =.82. There were no differences across gender and age. The CFC-F subscale and UPPS-P subscales correlations, were negative and significant, highlighting the negative and moderate correlation between CFC-F and the lack of premeditation, a dimension strictly related to intertemporal decisions making. Thus, CFC-14 has adequate psychometric properties in an Argentinian population, although more studies are necessary to determine the robustness of these findings. (shrink)

Havstad (2022) argues that the argument from inductive risk for the claim that non-epistemic values have a legitimate role to play in the internal stages of science is deductively valid. She also defends its premises and thus soundness. This is, as far as we are aware, the best reconstruction of the argument from inductive risk in the existing literature. However, there is a small flaw in this reconstruction of the argument from inductive risk which appears to render the argument (...) invalid. This flaw is superficial, and a small amendment to it rescues the claim of validity. (shrink)

Stress in health care is affected by moral factors. When people are prevented from doing ‘good’ they may feel that they have not done what they ought to or that they have erred, thus giving rise to a troubled conscience. Empirical studies show that health care personnel sometimes refer to conscience when talking about being in ethically difficult everyday care situations. This study aimed to construct and validate the Stress of Conscience Questionnaire (SCQ), a nine-item instrument for assessing stressful situations (...) and the degree to which they trouble the conscience. The items were based on situations previously documented as causing negative stress for health care workers. Content and face validity were established by expert panels and pilot studies that selected relevant items and modified or excluded ambiguous ones. A convenience sample of 444 health care personnel indicated that the SCQ had acceptable validity and internal consistency (Cronbach’s alpha exceeded 0.83 for the overall scale). Explorative factor analysis identified and labelled two factors: ‘internal demands’ and ‘external demands and restrictions’. The findings suggest that the SCQ is a concise and practical instrument for use in various health care contexts. (shrink)

To measure non-cognitive facets of competence, we developed and tested a new method that we refer to as Embedded Experience Sampling (EES). Domain-specific problem-solving competence is a multi-faceted construct that is not limited to cognitive facets such as domain knowledge or problem-solving strategies but also comprises non-cognitive facets in the sense of domain-specific emotional and motivational dispositions such as interest and self-concept. However, in empirical studies non-cognitive facets are usually either neglected or measured by generalized self-report questionnaires that are detached (...) from the performance assessment. To enable an integrated measurement, we developed the EES method to collect data on non-cognitive facets during scenario-based low-stakes assessments. Test-takers are requested to stop at certain times and spontaneously answer short items (EES items) regarding their actual experience of the problem situation. These EES items are embedded in an EES event that resembles typical social interactions with non-player characters. To evaluate the feasibility and validity of the method, we implemented EES in a series of three studies in the context of commercial vocational education and training (VET): A feasibility study with 77 trainees, a pilot study with 20 trainees, and the main study with 780 trainees who worked on three complex problem scenarios in a computer-based office simulation. In the present paper, we investigate how test-takers perceived the EES events, and whether social desirability biased their answers, and investigate the internal structure of the data and the relationship between EES data and data from several other sources. Interview data and survey data indicated no biases due to social desirability and no additional burden for the test-takers due to the EES events. A correlation analysis following the multitrait-multimethod approach as well as the calibration of a multidimensional model based on Item Response Theory (IRT) also supported the construct validity. Furthermore, EES data shows substantial correlations with test motivation but almost zero correlations with data from generalized retrospective self-report questionnaires on non-cognitive facets. Altogether, EES offers an alternative approach to measuring non-cognitive facets of competence under certain conditions. For instance, EES is also based on self-reporting and thus might not be suitable for high-stakes testing. (shrink)

This article describes the development of a computerized version of a measure of ethical sensitivity to racial and gender intolerance, the Racial Ethical Sensitivity Test. The REST was based on James Rest's 4-component model of moral development and the professional codes of ethics from school-based professions. The new version, Racial and Ethical Sensitivity Test-Compact Disk, consists of 5 videotaped scenarios followed by an interactive "interview" presented on compact discs. Data from a study with 58 students provides initial validation of (...) the REST-CD. Ethical sensitivity to racial and gender intolerance in schools, as measured by the REST-CD, was moderately related to attitudes toward racial and gender equity issues in society as measured by the Quick Discrimination Index. The results provide evidence for both interrater and internal reliability of the REST-CD scores. This study also tests the hypothesized relationship between REST-CD scores and previous multicultural and ethics course work. Students with multicultural and ethics course experience have scored significantly higher on the REST-CD than students without course work. The paper-and-pencil tests are not significantly related to previous ethics/multicultural course work. In this article, we discuss the implications of the results and directions for future research. (shrink)

This paper examines the properties of the validity and scope of arguments as standards for evaluating the epistemic qualities of particular deliberative exchanges within a context of value pluralism where parties can hold differing views of the common good based on incommensurable basic values. In this context, the task of political decisions is to maximise the interests of all, only judging between internally coherent versions of the common good on the basis of their mutual impact. The paper argues open, democratic, (...) deliberation provides the best chance of discovering such a path, through developing mutual understanding across incommensurable positions. Identifying the validity and scope of a deliberative exchange enhances this potential. Any deliberative exchange may be characterised in terms of its validity – the reasons that support its conclusions – and scope – the unquestioned assumptions that mark the boundaries of that reasoning. The paper explains the epistemic role of these two features in developing understanding across plural positions. Clarity about the validity of an exchange reveals positions that can be shared. Acknowledgement of its scope avoids over-extending its conclusions and reveals how positions differ, providing the starting point for further deliberation about their co-ordination. The paper ends by drawing the conclusion that deliberation characterised in this way should be democratic and open. (shrink)

Using data from four different samples of full-time employees (Ntotal = 2,474), the present study was aimed to introduce and demonstrate the validity and reliability of the Organizational-Based General Self-esteem Scale (OB-GSE) a new six-item self-report scale to measure organizational-based self-esteem (OBSE) at work. Results provided evidence of (1) validity (internal, external, and convergent), (2) reliability, and (3) temporal stability of the OB-GSE scale. All in all, results attested the usefulness and the effectiveness of the OB-GSE scale.

Scholars and providers are coming to realize that one’s ability to notice and respond to internal body sensations contributes to an overall sense of wellbeing. Research has demonstrated a relationship between interoceptive awareness and anxiety, for example. Currently, however, tools for evaluating one’s interoception lack the conceptual foundation and clarity necessary to identify everyday behaviors that specifically reflect interoceptive awareness. Unlike existing interoceptive measures, the Sensory Profile Interoception scale is participation-based and grounded in Dunn’s Sensory Processing framework. In this (...) study we investigated concurrent validity by correlating the SPI with the Adolescent/Adult Sensory Profile ; we investigated construct validity by correlating the SPI with the Perth Alexithymia Scale, the Body Awareness Scale, and the State-Trait Anxiety Inventory. Using the REDCAP online platform, 74 college-aged participants completed the measures. Using Spearman rank order correlations there were statistically significant relationships between the corresponding sensory pattern subscales on SPI and A/ASP. The PAS was only weakly related to the registration subscale of the SPI. The BAS had significant relationships with seeking and avoiding on the SPI. The STAI had significant relationships with sensitivity and registrations of the SPI. Taken together, these findings provide evidence of construct validity of the SPI to identify participation patterns associated with both high and low interoception. With the more precise information the SPI provides, professionals can design tailored interventions to support everyday life goals and researchers can study interoception within authentic activities. (shrink)

High prevalence of musicians’ physical and mental performance-related health issues (PRHI) has been demonstrated over the last 30 years. To address this, health promotion strategies have been implemented at some post-secondary music institutions around the world, yet the high prevalence of PRHI has persisted. In 2018, an international group of researchers formed the Musicians’ Health Literacy Consortium to determine how best to decrease PRHI, and to examine the relationship between PRHI and health literacy. An outcome of the Consortium was the (...) development of a new health literacy tool for musicians, the MHL-Q19, which drew from the theoretical framework of the European health literacy suite of tools, HLS-EU. The aim of the current study was to evaluate the validity and reliability of the MHL-Q19. Participants completed a battery of questionnaires, including the HLS-EU-Q16 for the assessment of general health literacy; the Musculoskeletal Pain Intensity and Interference Questionnaire for Musicians (MPIIQM); the RAND-12 quality of life questionnaire; and the General Self-Efficacy scale (GSE). We hypothesized that the MHL-Q19 would have a weak correlation with the HLS-EU-Q16; moderate correlation with the physical component scale and weak correlation with the mental component scale of the RAND-12; moderate correlation with the GSE; and finally, moderate correlation with pain interference and weak correlation with pain intensity of the MPIIQM. A total of 549 post-secondary music students from six English-speaking countries completed the battery of questionnaires, and 328 of these participants provided valid responses to the MHL-Q19 alone 2 weeks later. The tool showed acceptable internal consistency and test–retest reliability. Three of our hypotheses were supported, although the strength of the correlations varied from what we had predicted. The fourth hypothesis was not supported; our findings indicate that lower health literacy scores were weakly related to higher MPIIQM pain intensity and interference scores. The results of this study support the notion that musicians’ health literacy is a distinct construct that cannot be fully evaluated with existing health literacy tools. Given that this is a new instrument, the evidence presented is positive and promising. Further studies will be needed to refine the tool. (shrink)

Automated neuropsychiatric batteries have been used in research and clinical practice, including for chronic diseases, such as Systemic Lupus Erythematosus. The Pediatric Automated Neuropsychological Assessment Metrics battery, originally developed for use in American-English speaking individuals, allows tracking of cognitive functions. It can be applied to people over 9 years old. The aim of this study was to translate and present initial validation data from the Ped-ANAM into Brazilian-Portuguese. We translated the battery according to Beaton’s guidelines. Psychometric properties were tested, (...) internal consistency was analyzed by Cronbach’s alpha coefficient, test-retest reliability by the intraclass correlation coefficient. Further, we measured the test execution speed at both times as a temporal stability. Principal component analysis was used for structural validity. Evidence of construct validity was assessed through assessment of the relationships with the Wechsler Intelligence Scales. All participants prior to the start of study related activities signed an informed consent form approved by the local ethics committee. A sample of 230 individuals [mean of age: 23 years; 65% females] was included; a subset of 51 individuals [mean of age: 18 years, 59% female] completed the Ped-ANAM twice to assess test-retest reliability, and another subset of 54 individuals [mean of age: 20.4 years; 67% female] completed the Wechsler Intelligence Scales for Children and Adult for assessment of the Ped-ANAM’s construct validity. Our results suggest that the internal consistency of the Ped-ANAM and its subtest test-retest reliability were excellent. There was no clustering in the Principal Components Analysis, suggestive of non-grouping of the evaluated variables. Construct validity assessment to the Wechsler Scales showed expected ranges of low to strong correlations. We concluded that, based on the results of this study, a cross-culturally validated Brazilian-Portuguese version of the Ped-ANAM has been developed and it is a reliable tool for the screening cognitive function. (shrink)

Rejecting the Cut rule has been proposed as a strategy to avoid both the usual semantic paradoxes and the so-called v-Curry paradox. In this paper we consider if a Cut-free theory is capable of accurately representing its own notion of validity. We claim that the standard rules governing the validity predicate are too weak for this purpose and we show that although it is possible to strengthen these rules, the most obvious way of doing so brings with it a serious (...) problem: an internalized version of Cut can be proved for a Curry-like sentence. We also evaluate a number of possible ways of escaping this difficulty. (shrink)

The purpose of this paper is to show how the degree of experimental validity of scientific procedures is crucially involved in determining two typical pragmatic modes in science, namely, the preservation of useful procedures and the disposal of useless ideas. The term 'pragmatic' will here be used following Schurz's characterisation of being internally pragmatic, as referring to that which proves useful for scientific or epistemic goals. The first part of the paper consists in a characterisation of the notion of experimental (...) validity. The second part is focused on several historical examples illustrating how the above pragmatic modes relate to the question of experimental validity. The Michelson-Morley experiment is presented as a case of a highly valid and useful experiment preserved through the development of different theories (like, on the one hand, the ether theory, upheld by Fitzgerald and Lorentz, and, on the other hand, Einstein's special theory of relativity). The concept of caloric will be discussed as an example of an idea that was discarded once it became useless, after heat was understood as a form of energy within the new frame provided by the kinetic theory of heat towards the middle of the 19th century. (shrink)

Body awareness refers to the individual ability to process signals originating from within the body, which provide a mapping of the body’s internal landscape and its relation with space and movement. The present study aims to evaluate psychometric properties and validate in French two self-report measures of body awareness: the Postural Awareness Scale, and the last version of the Multidimensional Assessment of Interoceptive Awareness questionnaire. We collected data in a non-clinical, adult sample using online survey, and a subset of (...) the original sample also completed the retest control. Factor analyses and reliability analyses were conducted. Construct validity of the PAS and the MAIA-2 were examined by testing their association with each other, and with self-report measures of personality, alexithymia and dispositional trait mindfulness. Factor analyses of the PAS supported the same two-factor structure as previously published versions. For the MAIA-2, factor analyses suggested that a six-factor structure, excluding Not-Worrying and Not-Distracting factors, could successfully account for a common general factor of self-reported interoception. We found satisfactory internal consistency, construct validity, and reliability over time for both the PAS and the MAIA-2. Altogether, our findings suggest that the French version of the PAS and the MAIA-2 are reliable self-report tools to assess both components of body awareness. (shrink)

The Anticipatory and Consummatory Interpersonal Pleasure Scale is a psychometric instrument that has been used to indirectly measure social anhedonia in many cross-cultural contexts, such as in Western, European, Eastern, and Israeli samples. However, little is known about the psychometric properties of the ACIPS in Korean samples. The primary goal of this study was to validate the Korean version of the ACIPS among non-help-seeking individuals. The sample consisted of 307 adult individuals who had no current or prior psychiatric history. Participants (...) were administered the ACIPS, along with the Behavioral Inhibition and Behavioral Activation Scales and Beck Depression Inventory. We examined the association of the total ACIPS scores with the other measures. The ACIPS showed good internal consistency. We also explored the factor structure of the Korean translation of the ACIPS using principal component analysis with Promax rotation and Kaiser normalization. Factor analysis yielded a three-factor structure that accounted for 58.8% of the variance. The three-factor model included the following subdomains: interactions involving close relationships, casual interactions, and interactions involving family members. Total BAS and BIS scores were significantly associated with total ACIPS scores, while BDI scores were inversely associated with total ACIPS scores. The current research indicates that the Korean version of the ACIPS is a useful and valid scale. Future directions include using the Korean translation of the ACIPS to elucidate the varying degrees of hedonic capacity in psychiatric patients. (shrink)

The importance of self-regulated learning has increased during the COVID-19 pandemic and measures for assessing students’ self-regulation skills and knowledge are greatly needed. We present the results of the first thorough adaptation of the Children’s Perceived use of Self-Regulated Learning Inventory. The inventory, consisting of 15 scales measuring nine components of SRL, was administered to a sample of 541 Slovenian ninth graders. Confirmatory factor analyses supported internal structure validity of most components, but two components required some structural modifications. (...) class='Hi'>Internal consistency coefficients were acceptable for the majority of scale scores and were highly comparable to the original ones. While metric invariance across gender was confirmed, the scalar invariance of some scales needs further examination. Meaningful correlations with relevant externally assessed and self-reported self-regulation and school performance variables indicated good criterion validity of the inventory. The Slovenian version of the CP-SRLI thus proved to be a sufficiently valid and reliable instrument for assessing pupils’ learning self-regulation. (shrink)