Playtime in urban cities has become an indoor activity for children due to limited access to natural outdoor environments. This product of urbanization makes the case for the introduction of biophilic design. However, playrooms are often neglected as a possibility in designing a natural space indoors. Interior designers and other specialists lack a reliable tool to identify and incorporate biophilic features into the design of these indoor environments in urban settings. The Biophilic Interior Design Matrix (BID-M) developed by McGee and (...) Marshall-Baker quantifies 52 of Kellert’s biophilic design attributes to assess their presence and absence within interior spaces. We expanded its use by testing the matrix in a new type of space, urban playrooms, and coded images of 45 children’s playrooms within Manhattan residential buildings in New York City, including assessing a larger sample and reliability rate compared to McGee and Marshall-Baker’s research. Inter-rater reliability of the overall design matrix and individual matrix items was measured with percent agreement and free-marginal multirater kappa. Reliability testing showed overall good reliability of the overall design matrix. Several matrix items had low reliability between raters. Our findings show that the BID-M needs to be modified to better assess urban interior spaces for children. (shrink)

Despite growing interest in emotion regulation, the degree to which psychophysiological measures of emotion regulation are stable over time remains unknown. We examined four-week test-retest reliability of corrugator electromyographic and eyeblink startle measures of negative emotion and its regulation. Both measures demonstrated similar sensitivity to the emotion manipulation, but only individual differences in corrugator modulation and regulation showed adequate reliability. Startle demonstrated diminished sensitivity to the regulation instructions across assessments and poor reliability. This suggests that corrugator (...) represents a trait-like measure of voluntary emotion regulation, whereas startle should be used with caution for assessing individual differences. The data also suggest that corrugator and startle might index partially dissociable constructs and underscore the need to collect multiple measures of emotion. (shrink)

BackgroundThe triangle completion test has been used to assess egocentric wayfinding for decades, yet there is little information on its reliability. We developed a virtual reality based test and investigated whether either test of spatial navigation was reliable.ObjectiveTo examine test-retest reliability of the real-world and VR triangle completion tests. A secondary objective was to examine the usability of the VR based test.Materials and methodsThirty healthy adults aged 18–45 years were recruited to this block (...) randomized study. Participants completed two sessions of triangle completion tests in the real-world and VR on the same day with a break between sessions.ResultsIn both test versions distance from the endpoint and angle of deviation showed poor test-retest reliability. Distance traveled had moderate reliability in both the real-world and VR tests. The VR triangle test showed poor correlation with the real-world test.ConclusionThe triangle completion test has poor test-retest reliability and demonstrates poor concurrent validity between the real-world and VR. Nevertheless, it was feasible to translate a real-world test of spatial navigation into VR. VR provides opportunities for development of clinically relevant spatial navigation tests in the future. (shrink)

In people with chronic low back pain, maladaptive structural and functional changes on a cortical level have been identified. On a functional level, somatosensory cortical excitability has been shown to be reduced in chronic pain conditions, resulting in cortical disinhibition. The occurrence of structural and/or functional maladaptive cortical changes in people with CLBP could play a role in maintaining the pain. There is currently no measurement protocol for cortical excitability that employs stimulation directly to the lower back. We developed a (...) protocol for the measurement of single pulse somatosensory evoked potential waveforms and paired-pulse behavior generated from sensory nerves of the lower back and quantified its test–retest reliability in a sample of 30 healthy individuals to gain insights into the normal variability of cortical responses, which could then be compared to results from people with CLBP. We investigated cortical excitability by measuring SEPs and PPB. PPB was defined as the ratio of the amplitude of the second cortical response divided by the first cortical response. A2s was determined by subtracting the response to single-pulse stimuli from the paired pulse stimuli response to account for linear superposition effects. The test–retest reliability of the protocol was very poor with no evidence of systematic bias but a high amount of random variability between sessions. There was no significant difference in the right side PPB for session 1 and session 2 ; mean session difference [ = −0.44 ; t = −1.17, p = 0.26]. The ICC3.1 for the outlier-removed right side PPB were 0.19 and 0.43 for left side PPB. This finding potentially has wider implications for PPB protocols. If these findings were replicated in other groups and other nerves, it would question the validity of this measure more generally. However, these findings are restricted to healthy people and sensory nerves of the lower back and may not be generalizable. (shrink)

We show that if among the tested hypotheses the number of true hypotheses is not equal to the number of false hypotheses, then Neyman-Pearson theory of testing hypotheses does not warrant minimal epistemic reliability. We also argue that N-P does not protect from the possible negative effects of the pragmatic value-laden unequal setting of error probabilities on N-P’s epistemic reliability. Most importantly, we argue that in the case of a negative impact no methodological adjustment is available to neutralize (...) it, so in such cases the discussed pragmatic-value-ladenness of N-P inevitably compromises the goal of attaining truth. (shrink)

Background: The Bene-Anthony Family Relations Test is one of the most widely used measures of family dynamics seen from a child’s perspective. However, the most common issue surrounding this test is the lack of accurate normative scores for use with non-white ethnic groups. The purpose of this study was to examine the BAFRT’s reliability and validity for use with Arab children, as well as to provide normative data for this group. Methods: The BAFRT was translated into Arabic (...) and back-translated to ensure accuracy. The test was administered to a cohort of 394 Arab children, consisting of both cognitively normal children and children diagnosed with a psychological disorder, all aged 5–8 years old. Test-retest reliability was assessed using a sub-set of children and validity was tested against clinical status as well as CBCL and SDQ measures. Normative measures were calculated after examining the impact of influencing variables such as age and gender. Results: Statistical analyses showed that in our cohort of Arab children the BAFRT has good test-retest reliability, correlates well with measures of emotional and behavioral adjustment, and discriminates accurately between clinical and non-clinical children. Age, gender, and clinical status all significantly impacted upon BAFRT scores and therefore normative values are presented from our cohort when considering these variables. Conclusion: The normative scores we present will provide researchers and clinicians an appropriate reference point for the comparison of scores from Arab children and a starting point for future research into this area. (shrink)

Fully automated vehicles (AVs) hold promise toward providing numerous societal benefits including reducing road fatalities. However, we are uncertain about how individuals’ perceptions will influence their ability to accept and adopt AVs. The 28-item Automated Vehicle User Perception Survey (AVUPS) is a visual analog scale that was previously constructed, with established face and content validity, to assess individuals’ perceptions of AVs. In this study, we examined construct validity, via exploratory factor analysis and subsequent Mokken scale analyses. Next, internal consistency was (...) assessed via Cronbach’s alpha (α) and 2-week test–retest reliability was assessed via Spearman’s rho (ρ) and intraclass correlation coefficient (ICC). The Mokken scale analyses resulted in a refined 20-item AVUPS and three Mokken subscales assessing specific domains of adults’ perceptions of AVs: (a)Intention to use; (b)perceived barriers; and (c)well-being. The Mokken scale analysis showed that all item-coefficients of homogeneity (H) exceeded 0.3, indicating that the items reflect a single latent variable. The AVUPS indicated a strong Mokken scale (Hscale= 0.51) with excellent internal consistency (α = 0.95) and test–retest reliability (ρ = 0.76, ICC = 0.95). Similarly, the three Mokken subscales ranged from moderate to strong (rangeHscale= 0.47–0.66) and had excellent internal consistency (range α = 0.84–0.94) and test–retest reliability (range ICC = 0.84–0.93). The AVUPS and three Mokken subscales of AV acceptance were validated in a moderate sample size (N= 312) of adults living in the United States. Two-week test–retest reliability was established using a subset of Amazon Mechanical Turk participants (N= 84). The AVUPS, or any combination of the three subscales, can be used to validly and reliably assess adults’ perceptions before and after being exposed to AVs. The AVUPS can be used to quantify adults’ acceptance of fully AVs. (shrink)

We evaluated the reliability, validity, and differential item functioning (DIF) of a shorter version of the Defining Issues Test-1 (DIT-1), the behavioral DIT (bDIT), measuring the development of moral reasoning. 353 college students (81 males, 271 females, 1 not reported; age M = 18.64 years, SD = 1.20 years) who were taking introductory psychology classes at a public University in a suburb area in the Southern United States participated in the present study. First, we examined the reliability (...) of the bDIT using Cronbach’s α and its concurrent validity with the original DIT-1 using disattenuated correlation. Second, we compared the test duration between the two measures. Third, we tested the DIF of each question between males and females. Findings reported that first, the bDIT showed acceptable reliability and good concurrent validity. Second, the test duration could be significantly shortened by employing the bDIT. Third, DIF results indicated that the bDIT items did not favour any gender. Practical implications of the present study based on the reported findings are discussed. (shrink)

This study assessed the International Critical Thinking Essay Test (ICTET-A) for inter-rater reliability, internal reliability, and criterion validity. A self-selecting sample of participants (N = 100) completed the ICTET-A and a comparison test online. We found the ICTET-A items to have moderate to good levels of inter-rater reliability, and overall excellent inter-rater consistency for total test scores. The test had good internal reliability. There was a strong correlation between scores on the ICTET-A (...) and the comparison test. Factor analysis showed that scores were best explained with one factor, suggesting the test measures a single construct. The ICTET-A can therefore be considered a valid measure of critical thinking. Additionally, we propose a short form of the test. (shrink)

The neo-Kohlbergian approach to moral reasoning development maintains that intermediate concepts lie between bedrock moral schemas and professional codes of ethics and deal with issues of confidentiality, competence, informed consent, allocation of resources and professional autonomy (Rest et. al, 1999b Rest, J., Narvaez, D., Bebeau, M., & Thoma, S. J. (1999b). Postconventional moral thinking: A neo-Kohlbergian approach. Lawrence Erlbaum Associates.[Crossref], [Google Scholar]). Intermediate concepts provide concrete guides for behavior, they contrast general moral schemas that are concerned with issues of fairness, (...) justice and equality. This paper outlines the development and testing of a prototype Intermediate Concept Measure for teachers (TICM). Results indicate that the TICM has respectable psychometric properties and assesses a construct in the moral domain. (shrink)

PISA claims that it can extend its reach from its current core subjects of Reading, Science, Maths and problem-solving. Yet given the requirement for high levels of reliability for PISA, especially in the light of its current high stakes character, proposed widening of its subject coverage cannot embrace some important aspects of the social and aesthetic world. Verdicts on the latter often have holistic features, and there are dangers that such verdicts involve attempts to compare what cannot be compared. (...) Judgments about the normative and the social often feature a legitimate lack of consistency. (shrink)

Objective: The establishment of patient-centered measures capable of empirically determining meaningful cognitive change after surgery can significantly improve the medical care of epilepsy patients. Thus, this study aimed to develop reliable change indices (RCIs) and standardized regression-based (SRB) change norms for a comprehensive neuropsychological test battery in the German language. Methods: Forty-seven consecutive patients with temporal lobe epilepsy underwent neuropsychological assessments, both before and 12 months after surgery. Practice-effect-adjusted RCIs and SRB change norms for each test score were (...) computed. To assess their usefulness, the presented methods were applied to a clinical sample, and binary logistic regression analyses were conducted to model the odds of achieving improvement in quality of life (QOL) after surgery. Results: The determined RCIs at 90% confidence intervals, and the SRB equations for each test score included in the test battery are provided. Cohen’s kappa analyses revealed a moderate mean agreement between the two measures, varying from slight to almost perfect agreement across test scores. Using these measures, a negative association between improvement in QOL and decline in verbal memory functions after surgery was detected. Significance: To the best of our knowledge, this study is the first to provide RCIs and SRB change norms necessary for the objective determination of neuropsychological change in a comprehensive test battery in the German language, facilitating the individual monitoring of improvement and decline in each patients’ cognitive functioning and psychosocial situations after epilepsy surgery. The application of the described measures revealed a strong negative association between improvement in QOL and decline in verbal memory functions after surgery. (shrink)

To avoid post-neurosurgical language deficits, intraoperative mapping of the language function in the brain can be complemented with preoperative mapping with functional magnetic resonance imaging. The validity of an fMRI “language localizer” paradigm crucially depends on the choice of an optimal language task and baseline condition. This study presents a new fMRI “language localizer” in Russian using overt sentence completion, a task that comprehensively engages the language function by involving both production and comprehension at the word and sentence level. The (...) paradigm was validated in 18 neurologically healthy volunteers who participated in two scanning sessions, for estimating test–retest reliability. For the first time, two baseline conditions for the sentence completion task were compared. At the group level, the paradigm significantly activated both anterior and posterior language-related regions. Individual-level analysis showed that activation was elicited most consistently in the inferior frontal regions, followed by posterior temporal regions and the angular gyrus. Test–retest reliability of activation location, as measured by Dice coefficients, was moderate and thus comparable to previous studies. Test–retest reliability was higher in the frontal than temporo-parietal region and with the most liberal statistical thresholding compared to two more conservative thresholding methods. Lateralization indices were expectedly left-hemispheric, with greater lateralization in the frontal than temporo-parietal region, and showed moderate test-retest reliability. Finally, the pseudoword baseline elicited more extensive and more reliable activation, although the syllable baseline appears more feasible for future clinical use. Overall, the study demonstrated the validity and reliability of the sentence completion task for mapping the language function in the brain. The paradigm needs further validation in a clinical sample of neurosurgical patients. Additionally, the study contributes to general evidence on test–retest reliability of fMRI. (shrink)

The purpose of this study was to develop a Physician's Spiritual Well-Being Scale (PSpWBS). The significance of a physician's spiritual well-being was explored through in-depth interviews with and qualitative data collection from focus groups. Based on the results of qualitative analysis and related literature, the PSpWBS consisting of 25 questions was established. Reliability and validity tests were performed on 177 subjects. Four domains of the PSpWBS were devised: physician's characteristics; medical practice challenges; response to changes; and overall well-being. The (...) explainable total variance was 65.65%. Cronbach α was 0.864 when the internal consistency of the whole scale was calculated. Factor analysis showed that the internal consistency Cronbach α value for each factor was between 0.625 and 0.794 and the split-half reliability was 0.865. The scale has satisfactory reliability and validity and could serve as the basis for assessment of the spiritual well-being of a physician. (shrink)

The coherentist theory of justification provides a response to the sceptical challenge: even though the independent processes by which we gather information about the world may be of dubious quality, the internal coherence of the information provides the justification for our empirical beliefs. This central canon of the coherence theory of justification is tested within the framework of Bayesian networks, which is a theory of probabilistic reasoning in artificial intelligence. We interpret the independence of the information gathering processes (IGPs) in (...) terms of conditional independences, construct a minimal sufficient condition for a coherence ranking of information sets and assess whether the confidence boost that results from receiving information through independent IGPs is indeed a positive function of the coherence of the information set. There are multiple interpretations of what constitute IGPs of dubious quality. Do we know our IGPs to be no better than randomization processes? Or, do we know them to be better than randomization processes but not quite fully reliable, and if so, what is the nature of this lack of full reliability? Or, do we not know whether they are fully reliable or not? Within the latter interpretation, does learning something about the quality of some IGPs teach us anything about the quality of the other IGPs? The Bayesian-network models demonstrate that the success of the coherentist canon is contingent on what interpretation one endorses of the claim that our IGPs are of dubious quality. (shrink)

Information generally comes from less than fully reliable sources. Rationality, it seems, requires that one take source reliability into account when reasoning on the basis of such information. Recently, Bovens and Hartmann (2003) proposed an account of the conjunction fallacy based on this idea. They show that, when statements in conjunction fallacy scenarios are perceived as coming from such sources, probability theory prescribes that the “fallacy” be committed in certain situations. Here, the empirical validity of their model was assessed. (...) The model predicts that statements added to standard conjunction problems will change the incidence of the fallacy. It also predicts that statements from reliable sources should yield an increase in fallacy rates (relative to unreliable sources). Neither the former (Experiment 1) nor the latter prediction (Experiment 3) was confirmed, although Experiment 2 showed that people can derive source reliability estimates from the likelihood of statements in a manner consistent with the tested model. In line with the experimental results, model fits and sensitivity analyses also provided very little evidence in favor of the model. This suggests that Bovens and Hartmann’s present model fails to explain fully people’s judgements in standard conjunction fallacy tasks. (shrink)

Advanced medical imaging, such as CT, fMRI and PET, has undergone enormous progress in recent years, both in accuracy and utilization. Such techniques often bring with them an illusion of immediacy, the idea that the body and its diseases can be directly inspected. In this paper we target this illusion and address the issue of the reliability of advanced imaging tests as knowledge procedures, taking positron emission tomography in oncology as paradigmatic case study. After individuating a suitable notion of (...) reliability, we argue that PET is a highly theory-laden and non-immediate knowledge procedure, in spite of the photographic-like quality of the images it delivers; the diagnostic conclusions based on the interpretation of PET images are population-dependent; PET images require interpretation, which is inherently observer-dependent and therefore variable. We conclude with a three-step methodological proposal for enhancing the reliability of advanced medical imaging. (shrink)

Larry Laudan has challenged the realist to come up with a program that submits realism to "those stringent empirical demands which the realist himself minimally insists on when appraising scientific theories." This paper shows how the realist can go about taking up Laudan on this challenge; and, in such a way that the realist hypothesis actually ends up being confirmed, by any empirical standards. In other words, it is shown that we can test for convergent realism, just as readily (...) as Laudan can test for a connection between theories that are controlled by the cannons of science and their subsequent reliability. (shrink)

Background: Screen time among adults represents a continuing and growing problem in relation to health behaviors and health outcomes. However, no instrument currently exists in the literature that quantifies the use of modern screen-based devices. The primary purpose of this study was to develop and assess the reliability of a new screen time questionnaire, an instrument designed to quantify use of multiple popular screen-based devices among the US population. -/- Methods: An 18-item screen-time questionnaire was created to quantify use (...) of commonly used screen devices (e.g. television, smartphone, tablet) across different time points during the week (e.g. weekday, weeknight, weekend). Test-retest reliability was assessed through intra-class correlation coefficients (ICCs) and standard error of measurement (SEM). The questionnaire was delivered online using Qualtrics and administered through Amazon Mechanical Turk (MTurk). -/- Results: Eighty MTurk workers completed full study participation and were included in the final analyses. All items in the screen time questionnaire showed fair to excellent relative reliability (ICCs = 0.50–0.90; all < 0.000), except for the item inquiring about the use of smartphone during an average weekend day (ICC = 0.16, p = 0.069). The SEM values were large for all screen types across the different periods under study. -/- Conclusions: Results from this study suggest this self-administered questionnaire may be used to successfully classify individuals into different categories of screen time use (e.g. high vs. low); however, it is likely that objective measures are needed to increase precision of screen time assessment. (shrink)

In The Abuse of Casuistry Jonsen and Toulmin describe one view of moral reasoning as follows:Those who take a rhetorical view of moral reasoning… do not assume that moral reasoning relies for its force on single chains of unbreakable deductions which link present cases back to some common starting point. Rather, this strength comes from accumulating many parallel, complementary considerations, which have to do with the current circumstances of the human individuals and communities involved and lend strength to our conclusions, (...) not like links to a chain but like strands to a rope or roots to a tree.Whether or not all moral reasoning resembles “strands to a rope,” bioethics testimony certainly does. Bioethics testimony is eclectic, a composite of many loosely woven strands. Rarely, if ever, is bioethics testimony “a chain of unbreakable deductions.” Rarely is it “pure” ethics, much less pure normative ethics. (shrink)

In The Abuse of Casuistry Jonsen and Toulmin describe one view of moral reasoning as follows:Those who take a rhetorical view of moral reasoning… do not assume that moral reasoning relies for its force on single chains of unbreakable deductions which link present cases back to some common starting point. Rather, this strength comes from accumulating many parallel, complementary considerations, which have to do with the current circumstances of the human individuals and communities involved and lend strength to our conclusions, (...) not like links to a chain but like strands to a rope or roots to a tree.Whether or not all moral reasoning resembles “strands to a rope,” bioethics testimony certainly does. Bioethics testimony is eclectic, a composite of many loosely woven strands. Rarely, if ever, is bioethics testimony “a chain of unbreakable deductions.” Rarely is it “pure” ethics, much less pure normative ethics. (shrink)

In their theoretical and experimental reflections on the capacities and behaviours of living systems, neuroscientists often formulate generalizations about the behaviour of neural circuits. These generalizations are highly idealized, as they omit reference to the myriads of conditions that could perturb the behaviour of the modelled system in real-world settings. This article analyses an experimental investigation of the behaviour of place cells in the rat hippocampus, in which highly idealized generalizations were tested by comparing predictions flowing from them with real-world (...) experimental results. The aim of the article is to identify under what conditions even single prediction failures regarding the behaviour of single cells sufficed to reject highly idealized generalizations, and under what conditions prima facie counter-examples were deemed to be irrelevant to the testing of highly idealized generalizations. The results of this analysis may contribute to understanding how idealized models are tested experimentally in neuroscience and used to make reliable predictions concerning living systems in real-world settings. (shrink)

In this paper, we propose the introduction of a neutrosophic chi-square-test for consistency, incorporating neutrosophic statistics. Our aim is to modify the existing chi-square -test for consistency in order to analyze imprecise data. We present a novel test statistic for the neutrosophic chi-square -test for consistency, which accounts for the uncertainties inherent in the data. To evaluate the performance of the proposed test, we compare it with the traditional chi-square -test for consistency based on (...) classical statistics. By conducting a comparative analysis, we assess the efficiency and effectiveness of our proposed neutrosophic chi-square-test for consistency. Furthermore, we illustrate the application of the proposed test through a numerical example, demonstrating how it can be utilized in practical scenarios. Through this implementation, we aim to provide empirical evidence of the improved performance of our proposed test when compared to the traditional chi-square-test for consistency based on classical statistics. We anticipate that the proposed neutrosophic chi-square-test for consistency will outperform its classical counterpart, offering enhanced accuracy and reliability when dealing with imprecise data. This advancement has the potential to contribute significantly to the field of statistical analysis, particularly in situations where data uncertainty and imprecision are prevalent. (shrink)

There is surprising evidence that introspection of our phenomenal states varies greatly between individuals and within the same individual over time. This puts pressure on the notion that introspection gives reliable access to our own phenomenology: introspective unreliability would explain the variability, while assuming that the underlying phenomenology is stable. I appeal to a body of neurocomputational, Bayesian theory and neuroimaging findings to provide an alternative explanation of the evidence: though some limited testing conditions can cause introspection to be unreliable, (...) mostly it is our phenomenology itself that is variable. With this account of phenomenal variability, the occurrence of the surprising evidence can be explained while generally retaining introspective reliability. (shrink)