Consensus conferences, also known as citizens’ panels—a collection of lay citizens akin to a jury but charged with deliberating on policy issues with a high technical content—are a potentially important way to conduct technology assessments, inform policy makers about public views of new technologies, and improve public understanding of and participation in technological decision making. The first citizens’ panel in the United States occurred in April 1997 on the issue of “Telecommunications and the Future of Democracy.” This article evaluates (...) the impact of this citizens’ panel. The standard criteria to evaluate the impact of analyses focus on the “actual impact” and on the “impact on general thinking.” To these standard criteria, this article introduces the evaluation of two impacts related to learning: impact on the training of knowledgeable personnel and the interaction with lay knowledge. The impact evaluation is based on a nearly comprehensive set of semistructured telephone interviews with the participants in the panel. (shrink)

Realising the societal gains from publicly funded health and medical research requires a model for a reflexive evaluation precedent for the societal impact of research. This research explores UK Research Excellence Framework evaluators’ values and opinions and assessing societal impact, prior to the assessment taking place. Specifically, we discuss the characteristics of two different impact assessment extremes – the “quality-focused” evaluation and “societal impact-focused” evaluation. We show the wide range of evaluator views about impact, and that these (...) views could be conceptually reflected in a range of different positions along a conceptual evaluation scale. We describe the characteristics of these extremes in detail, and discuss the different beliefs evaluators had which could influence where they positioned themselves along the scale. These decisions, we argue, when considered together, form a dominant definition of societal impact that influences the direction of its evaluation by the panel. (shrink)

Integrating large language models (LLMs) like GPT-4 into medical ethics is a novel concept, and understanding the effectiveness of these models in aiding ethicists with decision-making can have significant implications for the healthcare sector. Thus, the objective of this study was to evaluate the performance of GPT-4 in responding to complex medical ethical vignettes and to gauge its utility and limitations for aiding medical ethicists. Using a mixed-methods, cross-sectional survey approach, a panel of six ethicists assessed LLM-generated responses to eight (...) ethical vignettes.The main outcomes measured were relevance, reasoning, depth, technical and non-technical clarity, as well as acceptability of GPT-4’s responses. The readability of the responses was also assessed. Of the six metrics evaluating the effectiveness of GPT-4’s responses, the overall mean score was 4.1/5. GPT-4 was rated highest in providing technical (4.7/5) and non-technical clarity (4.4/5), whereas the lowest rated metrics were depth (3.8/5) and acceptability (3.8/5). There was poor-to-moderate inter-rater reliability characterised by an intraclass coefficient of 0.54 (95% CI: 0.30 to 0.71). Based on panellist feedback, GPT-4 was able to identify and articulate key ethical issues but struggled to appreciate the nuanced aspects of ethical dilemmas and misapplied certain moral principles.This study reveals limitations in the ability of GPT-4 to appreciate the depth and nuanced acceptability of real-world ethical dilemmas, particularly those that require a thorough understanding of relational complexities and context-specific values. Ongoing evaluation of LLM capabilities within medical ethics remains paramount, and further refinement is needed before it can be used effectively in clinical settings. (shrink)

BackgroundFunding agencies have long used panel discussion in the peer review of research grant proposals as a way to utilize a set of expertise and perspectives in making funding decisions. Little research has examined the quality of panel discussions and how effectively they are facilitated.MethodsHere, we present a mixed-method analysis of data from a survey of reviewers focused on their perceptions of the quality, effectiveness, and influence of panel discussion from their last peer review experience.ResultsReviewers indicated that panel discussions were (...) viewed favorably in terms of participation, clarifying differing opinions, informing unassigned reviewers, and chair facilitation. However, some reviewers mentioned issues with panel discussions, including an uneven focus, limited participation from unassigned reviewers, and short discussion times. Most reviewers felt the discussions affected the review outcome, helped in choosing the best science, and were generally fair and balanced. However, those who felt the discussion did not affect the outcome were also more likely to evaluate panel communication negatively, and several reviewers mentioned potential sources of bias related to the discussion. While respondents strongly acknowledged the importance of the chair in ensuring appropriate facilitation of the discussion to influence scoring and to limit the influence of potential sources of bias from the discussion on scoring, nearly a third of respondents did not find the chair of their most recent panel to have performed these roles effectively.ConclusionsIt is likely that improving chair training in the management of discussion as well as creating review procedures that are informed by the science of leadership and team communication would improve review processes and proposal review reliability. (shrink)

In recent years, with both the development of next‐generation sequencing approaches and the Supreme Court decision invalidating gene patents, declining costs have contributed to the emergence of a new model of hereditary cancer genetic testing. Multigene panel testing (or multiplex testing) involves using next‐generation sequencing technology to determine the sequence of multiple cancer‐susceptibility genes. In addition to high‐penetrance cancer‐susceptibility genes, multigene panels frequently include genes that are less robustly associated with cancer predisposition. Scientific understanding about associations between many specific (...) moderate‐penetrance gene variants and cancer risks is incomplete. The emergence of multigene panel tests has created unique challenges that may have meaningful psychosocial implications. Contrasted with the serial testing process, wherein patients consider the personal and clinical implications of each evaluated gene, with multigene panel testing, patients provide broad consent to whichever genes are included in a particular panel and then, after the test, receive in‐depth genetic counseling to clarify the distinct implications of their specific results. Consequently, patients undergoing multigene panel testing may have a less nuanced understanding of the test and its implications, and they may have fewer opportunities to self‐select against the receipt of particular types of genetic‐risk information. Evidence is conflicting regarding the emotional effects of this testing. (shrink)

The use of technologies like artificial intelligence can drive productivity growth, efficiency and innovation. The goal of this study is to develop an anomaly detection method for locating flaws on the surface of sandwich panels using YOLOv5. The proposed algorithm extracts information locally from an image through a prediction system that creates bounding boxes and determines whether the sandwich panel surface contains flaws. It attempts to reject or accept a product based on quality levels specified in the standard. To (...) evaluate the proposed method, a comparison was made with a sandwich panel damage detection method based on a convolutional neural network and methods based on thresholding. The findings show that the proposed method, which is based on an object detector, is more accurate than the alternatives. The characteristics of the model, which can reject or accept a product according to the standard and limit allowable manufacturing flaws to obtain a quality product, also enable this system to improve industrial standards for producing sandwich panels while increasing speed. (shrink)

For those with advanced life-limiting illness, the optimization of quality of life and avoidance of nonbeneficial treatments at the end of life are key ethical concerns. This article evaluates the efficacy of an Interdisciplinary Ethics Panel (IEP) approach to decision making at the end of life for unbefriended nursing home residents who lack decisional capacity and have advanced life-limiting illness, through the use of a ninestep algorithm developed for this purpose. We reviewed the outcomes of three quality-of-care phased initiatives conducted (...) in our facility, a large public nursing home in New York City, between June 2016 and February 2020, which indicated that this IEP approach promoted advance-care planning, as palliative measures were endorsed to optimize quality of life for this vulnerable population at the end of life. We also examined another quality-of-care initiative when this IEP approach was applied to end-of-life decision making for nursing home residents who had a surrogate during the COVID-19 pandemic. This application appeared to be beneficial in adding more residents to our Palliative Care Program while it improved rates of advance-care planning. When all of the above findings are considered, we believe this novel IEP approach and algorithm have the potential to be applied elsewhere after appropriate assessment. (shrink)

The output stability of the photovoltaic system is directly affected by temperature change of PV panels. In this paper, a novel temperature prediction method of PV panels with support vector machine is proposed, which can solve the temperature prediction problem in a complex environment. In order to optimize parameters of SVM, a Pigeon-Inspired Optimization method is given. Meanwhile, the delay factor is added to improve the PIO algorithm for avoiding the problem of local optimum. Moreover, a multisensor monitoring (...) system of PV is established, and the collected data of temperature are used to train and verify the accuracy of the model. Finally, the proposed method is evaluated using synthetic and actual data sets. Simulation results show that the DFPIO-SVM can obtain better predictive performance. (shrink)

As a preliminary step to beginning to assess the usefulness of clinical vignettes to measure ethical sensitivity in undergraduate medical students, five clinical vignettes with seven to nine ethical issues each were created. The ethical issues in the vignettes were discussed and outlined by an expert panel. One randomly selected vignette was presented to first, second and third year students at the University of Toronto as part of another examination. The students were asked to list the issues presented by the (...) patient problem. Responses from 281 students were obtained. These students identified an average of 2.72 ethical issues per vignette. Each response was classified under the domains of autonomy, beneficence and justice. Comparisons were made between classes and between vignettes. There was considerable variation between classes and the responses to different vignettes seem to indicate that different vignettes measure the various domains in different ways. It does appear that the use of vignettes is one way to measure aspects of ethical sensitivity in medical students but more study is required to clarify exactly what is being measured. (shrink)

Investing in research is a long-term, risky proposition. In agriculture, it could take fifteen years or more for a research finding to show an improvement in a farmer’s field. Yet, research institutions, like other organizations it needs to be evaluated. For more than twenty years, independent panels of outside experts have evaluated each of the international research centers that the Consultative Group of International Agricultural Research (CGIAR) supports. This paper examines the evolution of this review system, outlines the key (...) methodological challenges faced, and draws lessons for others engaged in evaluating research institutions. It notes that the scope of the CGIAR reviews have been broadened over time in response to users’ concerns. Reviews now cover four dimensions of performance: research results, quality and relevance of research, vision and strategic directions, and management efficiency. The methodological challenges faced in measurement, valuation, and attribution are reviewed, along with practices found to be helpful in addressing these concerns. The paper concludes that the panel approach to institutional evaluation has served CGIAR’s needs well, and recommends it as an evaluation technique for integrating quantitative and qualitative dimensions of institutional performance. (shrink)

© JNCCN-Journal of the National Comprehensive Cancer Network.Background: Next-generation tumor sequencing panels, which include multiple established and novel targets across cancers, are emerging in oncology practice, but lack formal positive coverage by US payers. Lack of coverage may impact access and adoption. This study identified challenges of NGTS coverage by private payers.Methods: We conducted semi-structured interviews with 14 NGTS experts on potential NGTS benefits, and with 10 major payers, representing more than 125,000,000 enrollees, on NGTS coverage considerations. We used (...) the framework approach of qualitative research for study design and thematic analyses and simple frequencies to further describe findings.Results: All interviewed payers see potential NGTS benefits, but all noted challenges to formal coverage: 80% state that inherent features of NGTS do not fit the medical necessity definition required for coverage, 70% view NGTS as a bundle of targets versus comprehensive tumor characterization and may evaluate each target individually, and 70% express skepticism regarding new evidence methods proposed for NGTS. Fifty percent of payers expressed sufficient concerns about NGTS adoption and implementation that will preclude their ability to issue positive coverage policies.Conclusions: Payers perceive that NGTS holds significant promise but, in its current form, poses disruptive challenges to coverage policy frameworks. Proactive multidisciplinary efforts to define the direction for NGTS development, evidence generation, and incorporation into coverage policy are necessary to realize its promise and provide patient access. This study contributes to current literature, as possibly the first study to directly interview US payers on NGTS coverage and reimbursement. (shrink)

Science advisory committees exercise complex collaborative expertise. Not only do committee members collaborate, they do so across disciplines, producing expert reports that make synthetic multidisciplinary arguments. When reports are controversial, critics target both report content and committee process. Such controversies call for the assessment of expert arguments, but the multidisciplinary character of the debate outstrips the usual methods developed by informal logicians for assessing appeals to expert authority. This article proposes a multi-dimensional contextualist framework for critical assessment and tests it (...) with a case study of the controversies over reports issued by the Intergovernmental Panel on Climate Change. The case study shows (1) how the critical contextualist framework can illuminate the controversy and guide evaluation of the various arguments and counterarguments; (2) how cases of this sort open up avenues for fruitful interdisciplinary collaboration between argumentation theorists and other fields; and (3) where further work is required in argumentation theory. (shrink)

Understanding the clinical significance of variants associated with hereditary cancer risk requires access to a pooled data resource or network of resources—a “cancer gene variant commons”—incorporating representative, well-characterized genetic data, metadata, and, for some purposes, pathways to case-level data. Several initiatives have invested significant resources into collecting and sharing cancer gene variant data, but further progress hinges on identifying and addressing unresolved policy issues. This commentary provides insights from a modified policy Delphi process involving experts from a range of stakeholder (...) groups involved in the data-sharing ecosystem. In particular, we describe policy issues and options generated by Delphi participants in five domains critical to the development of an effective cancer gene variant commons: incentives, financial sustainability, privacy and security, equity, and data quality. Our intention is to stimulate wider discussion and lay a foundation for further work evaluating policy options more in-depth and mapping them to those who have the power to bring about change. Addressing issues in these five domains will contribute to a cancer gene variant commons that supports better care for at-risk and affected patients, empowers patient communities, and advances research on hereditary cancers. (shrink)

Early modern medicine was much more dependent on the senses than its contemporary counterpart. Although a comprehensive medical theory existed that assigned great value to taste and odor of medicaments, historical descriptions of taste and odor appears imprecise and inconsistent to modern eyes. How did historical actors move from subjective experience of taste and odor to culturally stable agreements that facilitated communication about the sensory properties of medicaments? This paper addresses this question, not by investigating texts, but by going straight (...) to the sensory impression, which certain substances convey. The aim is not to overwrite or rectify historical descriptions but to investigate whether modern methodologies for sensory assessment can be enlisted to understand the past. We draw on history of science for framing and research questions, pharmaceutical science for knowledge of pharmaceuticals and preparations, and food and meal science for assaying procedures and protocols. We show that sensory evaluation can yield precise descriptions that would not have been alien to early modern medicine makers. However, there are problems with translating descriptions of taste between different historical contexts. By comparing contemporary descriptions of sensations with eighteenth‐century ones, the article discusses how sensory descriptions are highly dependent on context, and subject to historical change. (shrink)

This article examines a recent shift in the organization of prime-time news on Greek private television, from the `one-way' dissemination of information to an interactive format, where the news genre meets the talk show. By drawing on Hunston's model of evaluation in written academic discourse, it is argued that this conversational news format serves as a vehicle for evaluation, allowing the anchorpersons and journalist panels more freedom to voice concrete views. More specifically, prime-time news is generally cast (...) in terms of two major sub-genres, namely the debate and the structured panel discussion. These sub-genres particularly lend themselves to the performance of acts of evaluation by TV journalists. Far from merely reporting events, journalists unequivocally show that their main task is to jointly interpret reality on behalf of the viewer audience. They set about this task by explicitly encoding their personal attitudes, while directly challenging government spokespersons and policies. It is argued that, in so doing, media personalities in effect shape audience opinions. The data attest to the increasing empowerment of the Greek media, and illustrate the ways in which conversational processes bring into being the continuously evolving public sphere in contemporary Greece. (shrink)

Panels, boards, and committees throughout society evaluate all manner of things by grading them, first individually and then collectively. Thus risks are prioritized, research proposals are funded, and candidates are shortlisted for jobs. It is not usual to pick winners in political elections by grading the candidates, but there are examples in history. This article takes up a question about the quality of judgments and decisions made by grading: under which conditions are they likely to be right? An answer (...) comes in the form of a jury theorem for median grading. Here, the collective grade for a thing is the median of its individually assigned grades—the one in the middle, when all of them are listed from "top" to "bottom." A second objective of this article is to suggest a solution to problems of voter ignorance in democracies. The idea is for democratic assemblies to use voting methods that make more of people's limited knowledge than do commonly used methods, such as majority voting. It turns out that in theory anyway, and perhaps also in practice, median grading can enable unenlightened assemblies to “track the truth”—even as majority voting would run them off the rails. (shrink)

En janvier 1783, deux musiciennes, Bianca Sacchetti et Andrianna Ferrarese, s’enfuirent de l’ospedale des Mendicanti, à Venise, pour tenter leur chance sur les scènes de théâtre. Formées dans l’une des quatre institutions vénitiennes destinées à recueillir les orphelins de Venise, elles étaient devenues des musiciennes hors pair, chantaient chaque jour dans la chapelle de l’ospedale et jouaient de plusieurs instruments. Le dossier consacré à leur fugue, qui se trouve toujours à l’Archivio di Stato de Venise, nous donne les circonstances et (...) les raisons de leur fugue, mais fournit également des informations précieuses et uniques sur les aspirations des « filles du choeur » à une vie meilleure. Des documents inédits illustrent les relations d’amitié qui pouvaient exister entre deux jeunes femmes recueillies par charité et suffisamment talentueuses pour avoir réussi à devenir deux des meilleures musiciennes de Venise. Retrouvées par les autorités, elles poursuivirent d’ailleurs une brillante carrière, l’une à l’opéra, l’autre au sein de l’ospedale, la Ferrarese créant même l’un des rôles du Così fan tutte de Mozart. (shrink)

The aim of this paper is to investigate the consequences of the bibliometrics-based evaluation system of scientific production on the contents and methods of sciences. The research has been conducted by means of in-depth interviews to a multi-disciplinary panel of Italian researchers. We discuss the implications of bibliometrics-based evaluation on the choice of the research topic, on the experimental practices, on the dissemination habits. We observe that the validation of the bibliometrics-based evaluation practices relies on the acceptance (...) and diffusion within the scientific community, and that these practices are self-sustained through their wide application. We discuss possible evolving scenarios, also considering the recent development of digital archives. (shrink)

This article presents a new measure for intimate partner violence, the Gendered Violence in Partnerships Scale. The scale was developed in the Middle East with the aim to contribute to the global perspective on IPV by providing a contextual assessment tool for partner violence against women in violent-torn settings embedded in a patriarchal social structure. In an effort to generate a scale including IPV items relevant to the women of the population, a pragmatic step-wise procedure, with focus group discussions and (...) expert panels, was performed. The study’s analyses resulted in an 18-item checklist featuring four subscales of the GVPS that are based on a new typology of male-to-female partner violence presenting an alternative to the commonly used classification by type of abuse. Therein, dominating behaviors, existential threats, impulsive aggression, and aggravated physical assault were identified as reflective of the lived realities of women in the war-torn Middle East, which was confirmed in factor analysis. The scale’s psychometric properties were assessed with data from 1,009 displaced women in Iraq, and associations with measures of psychopathology were determined. Implications for IPV assessment and prevention possibilities in humanitarian contexts and beyond are discussed. (shrink)

Punctuated by joy, disappointments, and conflicts, research evaluation constitutes an intense, emotional moment in scientific life. Yet reviewers and research institutions often expect evaluations to be conducted objectively and dispassionately. Inspired by the scholarship describing the role of emotions in scientific practices, we argue instead, that reviewers actively define, display and manage their emotions in response to the structural organization of research evaluation. Our article examines reviewing practices used in the European Research Council’s (ERC) Starting and Consolidator grants (...) and in the Marie Skłodowska-Curie Action’s (MSCA) Individual Fellowships. These two European funding mechanisms offer different perspectives on the organization of grant evaluation. We conducted interviews with review panel members and analyzed various institutional documents. By drawing on the sociological concepts of feeling rules and emotional work, we demonstrate that reviewers define rules concerning how emotions should be experienced and expressed to ensure the proper functioning of evaluation, and that reviewers experience the need to actively regulate their emotions to comply with these rules. We present four feeling rules concerning the experience and expression of: (1) excitement for novelty during individual evaluation; (2) respect for others’ opinions and the absence of anger in review panels; (3) attentiveness and interest, which are seen as missing in online evaluations. Reviewers also expect ERC candidates to (4) avoid pride and manifest modesty during interviews. These rules demonstrate that proposal peer review is governed by emotional norms, and show the influence of organizational settings and moral requirements on research evaluation. (shrink)

Distinct sources of stress have emerged during the COVID-19 pandemic. Particularly, fear is expected to generate significant psychological burden on individuals and influence on either unsafe behavior that may hinder recovery efforts or virus-mitigating behaviors. However, little is known about the properties of measures to capture them in research and clinical settings. To resolve this gap, we evaluated the psychometric properties of a novel measure of fear of illness and viruses and tested its predictive value for future development of distress. (...) We extracted a random sample of 450 Chilean adult participants from a large cross-sectional survey panel and invited to participate in this intensive longitudinal study for 35 days. Of these, 163 ended up enrolling in the study after the demanding nature of the measurement schedule was clearly explained to them. For this final sample, we calculated different Confirmatory Factor Analyses (CFA) to evaluate the preliminary proposed structure for the instrument. Complementarily, we conducted a content analysis of the items to qualitatively extract its latent structure, which was also subject to empirical test via CFA. Results indicated that the original structure did not fit the data well; however, the new proposed structure based on the content analysis did. Overall, the modified instrument showed good reliability through all subscales both by its internal consistency with Cronbach’s alphas ranging from 0.814 to 0.913, and with test–retest correlations ranging from 0.715 to 0.804. Regarding its convergent validity, individuals who scored higher in fears tended to also score higher in depressive and posttraumatic stress symptoms at baseline. Furthermore, higher fears at baseline predicted a higher score in posttraumatic stress symptomatology 7 days later. These results provide evidence for the validity, reliability, and predictive performance of the scale. As the scale is free and multidimensional potentially not circumscribed to COVID-19, it might work as a step toward understanding the psychological impact of current and future pandemics, or further life-threatening health situations of similar characteristics. Limitations, practical implications, and future directions for research are discussed. (shrink)

The central question of this thesis is how one can learn about particular targets by using models of those targets. A widespread assumption is that models have to be representative models in order to foster knowledge about targets. Thus the thesis begins by examining the concept of representation from an epistemic point of view and supports an account of representation that does not distinguish between representation simpliciter and adequate representation. Representation, understood in the sense of a representative model, is regarded (...) as a success term. That is, a representative model is one relatum in a relation of adequate representation (Chapter 2). When a representative model represents a target, it allows users of this model to learn something about the target. It is argued that a representative model has this epistemic function because it shares relevant features with the target. This presupposes a similarity view of representation. Similarity views of representation face serious objections, which will be rebutted (Chapter 3). One way of spelling out a similarity view of representation is to defend an indirect view of representation. In this thesis, which does not argue for an indirect view, it is assumed that the indirect view is a good option, if not the best, for articulating the similarity view. It is demonstrated how such an indirect view can be expanded to account for cases of technological modeling. A case study in bioengineering is used to show that the indirect view of representation must acknowledge a distinction between two directions of fit in relations between vehicles and targets. In this context the notion of design is interpreted as a relation between a vehicle and a target, thereby connecting ideas from philosophy of science with ideas from philosophy of technology (Chapter 4). Fictionalist accounts of models are intended to tackle the issue of the ontology of models. In this thesis, however, two prominent fictionalist accounts are discussed from an epistemological point of view in light of the central question regarding how one can learn about targets by using models. This question is addressed from the standpoint of Waltonian fictionalism. The result of the discussion is that the two discussed Waltonian fictionalist accounts cannot sufficiently answer the question. These accounts are criticized for their inability to deliver a satisfactory epistemology of representation (Chapter 5). Although Waltonian fictionalism is criticized, the present thesis also shows that the foundational theory of Waltonian fictionalism, the theory of make-believe can nevertheless be used to account for the distinction between projections and predictions that is made by the Intergovernmental Panel on Climate Change (Chapter 6). (shrink)

The process of research is often lengthy and can be extremely arduous. It may take many years to proceed from the initial development of an idea through to the comparison of the new modalities against a current gold-standard practice. Each step along the way involves rigorous scientific review, where protocols are scrutinized by multiple scientists not only in the specific field at hand but related fields as well. In addition to scientific review, most countries require a further review by a (...) panel that will specifically address the ethics of the proposed research. In Canada, those panels are referred to as Research Ethics Boards (REB), with the United States counterparts known as Institutional Review Boards (IRB). (shrink)

In this paper, we analyze how citizens evaluate their president, especially focusing on why voters lower their evaluations at an individual-level perspective. We assert that citizens raise their evaluations of a new president when their expectations are met and lower their opinions when his or her performance disappoints them. Furthermore, the evaluations of the president are not only affected by a government's economic and diplomatic performance, but are also influenced by individual awareness of salient political issues, the contents of the (...) news, and their own perceived influence on politics. We test the theoretical hypotheses using Taiwan's Election and Democratization Study panel survey data. The statistical results support our theoretical hypotheses and show that when President Ma's performance did not meet respondents media exposure and political efficacy are significantly associated with the change in their opinions of Ma. (shrink)

The International Panel on Social Progress is an independent association of top research scholars with the goal of assessing methods for improving the main institutions of modern societies. The IPSP has produced a report consisting of twenty-two chapters in three volumes that distills the research of these scholars and outlines what the best social science has to say about positive social change. Written in accessible language by scholars across the social sciences and humanities, these volumes assess the achievements of world (...) societies in past centuries, the current trends, the dangers that we are now facing, and the possible futures in the twenty-first century. It covers the main socio-economic, political, and cultural dimensions of social progress, global as well as regional issues, and the diversity of challenges and their interplay around the world. The authors offer a cautious optimistic conclusion: multiple ideas for social progress and better policies are already available and deserve to be tested and implemented. (shrink)

A script concordance test was developed as an innovative tool for assessing ethical reasoning ability. An SCT of 12 medical ethical vignettes were constructed from the UNESCO Casebook on Human Dignity and Human Rights. The vignettes were reviewed by a panel of 15 medical experts before administration to a panel of 18 clinicians. The clinician’s answers were used to constitute the scoring key. The SCT was then administered to first and final year medical students. Data were analysed using SPSS. Internal (...) consistency was assessed using Cronbach’s alpha. SCT performance was tested for association with sex, year of study and race by comparing the mean SCT scores between categories within each variable. Internal consistency as measured by Cronbach’s alpha values, ranging from 0.597 to 0.902, indicated high intra-vignette reliability for 10 of the vignettes. Inter-vignette reliability was high at 0.797. Mean SCT scores were not significantly different between students of different gender, year of study and ethnicity. However, each vignette was able to distinguish between overall poor and good test performers. The SCT was able to differentiate between students with varying degrees of ethical reasoning ability. (shrink)

This is the first of three volumes containing a report from the International Panel on Social Progress. The IPSP is an independent association of top research scholars with the goal of assessing methods for improving the main institutions of modern societies. Written in accessible language by scholars across the social sciences and humanities, these volumes assess the achievements of world societies in past centuries, the current trends, the dangers that we are now facing, and the possible futures in the twenty-first (...) century. It covers the main socio-economic, political, and cultural dimensions of social progress, global as well as regional issues, and the diversity of challenges and their interplay around the world. This particular volume covers topics such as economic inequality and growth, finance and corporations, labor, capitalism, and social justice. (shrink)

All research is immersed in the competition for knowledge, but this is not always governed by fairness. In this opinion article, I elaborate on indicators of unfairness to be found in both evaluation guides and evaluation panels, and I spontaneously offer a number of rules of thumb meant to keep it at bay. Although they are explicitly offered to the Portuguese Foundation for Science and Technology (FCT) and in particular to the evaluation panel for Philosophy, Ethics (...) and Religion of FCT's fifth edition of their Individual Call to Scientific Employment Stimulus, here used as concrete illustrations of unfairness, my rules of thumb are guaranteed to promote fairness in the competition for knowledge in general. (shrink)

This is the third of three volumes containing a report from the International Panel on Social Progress. The IPSP is an independent association of top research scholars with the goal of assessing methods for improving the main institutions of modern societies. Written in accessible language by scholars across the social sciences and humanities, these volumes assess the achievements of world societies in past centuries, the current trends, the dangers that we are now facing, and the possible futures in the twenty-first (...) century. It covers the main socio-economic, political, and cultural dimensions of social progress, global as well as regional issues, and the diversity of challenges and their interplay around the world. This particular volume covers topics such as world cultures and religions, families, global health, education, and the contributions of social sciences to institutional change. (shrink)

Scientific knowledge has not stabilized in the current, early, phase of research and development of nanotechnologies creating a challenge to ‘upstream’ public engagement. Nevertheless, the idea that the public should be involved in deliberative discussions and assessments of emerging technologies at this early stage is widely shared among governmental and nongovernmental stakeholders. Many forums for public debate including focus groups, and citizen juries, have thus been organized to explore public opinions on nanotechnologies in a variety of countries over the past (...) few years. In Switzerland the Centre for Technology Assessment (TA-Swiss) organized such a citizen panel in fall 2006. Drawing from an ethnographic study of this panel called ‘publifocus on nanotechnologies, health, and environment’ this paper looks at the ways members of a stakeholder group deal with the epistemic uncertainty in their deliberation of nanotechnologies. By exploring the statements of the participants in the stakeholder discussion group, this paper reconstructs the narratives that constitute the epistemic foundations of the participants’ evaluations of nanotechnologies. (shrink)

Refining the model for an emergency department‐based mental health nurse practitioner outpatient service The mental health nurse practitioner (MHNP) role based in the emergency department (ED) has emerged in response to an increase in mental health‐related presentations and subsequent concerns over waiting times, co‐ordination of care and therapeutic intervention. The MHNP role also provides scope for the delivery of specialised primary care. Nursing authors are reporting on nurse‐led outpatient clinics as a method of healthcare delivery that allows for enhanced access (...) to health‐care, particularly following hospital discharge. However, due to a lack of in‐depth substantiation, this mode of service delivery requires more thorough investigation. This study describes the refinement phase undertaken before the implementation and pilot evaluation of a formalised and structured MHNP outpatient service in the ED of a large inner‐city hospital in Sydney, Australia. An expert advisory panel (EAP) consisting of key local informants was convened to provide feedback on and refinement to the proposed model. This related to issues such as target population, structure and process considerations, outcome measures and interface within the overall health service. Findings from the EAP meeting are presented and discussed. The importance of linking methods with the appropriate methodology in evaluating a healthcare program is highlighted. (shrink)

In 1995, the Intergovernmental Panel on Climate Change announced that anthropogenic climate change had become discernible. Since then, numerous independent studies have affirmed that anthropogenic climate change is underway, and the meta-conclusion that there is a broad expert consensus on this point. It has also been demonstrated that most of the challenges to this claim come from interested parties outside the scientific community. But even if we allow that the challenges to climate science are politically or economically motivated, it does (...) not prove that the scientific consensus is correct. In other words, even if we accept the fact of scientific consensus, how do we know that this consensus is not wrong? This chapter addresses this question by examining a set of criteria that philosophers have traditionally or recently identified as possible bases for trust in scientific conclusions, and shows that climate science meets all of these criteria. Thus, while there is no way to know for sure that scientists are correct in their conclusions, the various means we have to test and evaluate scientific claims lead to the conclusion that, so far as we are able to tell, it is most likely that scientists are not wrong about the reality of anthropogenic climate change. (shrink)

We consider a panel of experts asked to assign probabilities to events, both logically simple and complex. The events evaluated by different experts are based on overlapping sets of variables but may otherwise be distinct. The union of all the judgments will likely be probabilistic incoherent. We address the problem of revising the probability estimates of the panel so as to produce a coherent set that best represents the group’s expertise.

A central tenet of contemporary moral psychology is that people typically reject active forms of utilitarian sacrifice. Yet, evidence for secularization and declining empathic concern in recent decades suggests the possibility of systematic change in this attitude. In the present study, we employ hypothetical dilemmas to investigate whether judgments of utilitarian sacrifice are becoming more permissive over time. In a cross-sectional design, age negatively predicted utilitarian moral judgment (Study 1). To examine whether this pattern reflected processes of maturation, we asked (...) a panel to re-evaluate several moral dilemmas after an eight-year interval but observed no overall change (Study 2). In contrast, a more recent age-matched sample revealed greater endorsement of utilitarian sacrifice in a time-lag design (Study 3). Taken together, these results suggest that today’s younger cohorts increasingly endorse a utilitarian resolution of sacrificial moral dilemmas. (shrink)

In Human Cloning a panel of distinguished philosophers, medical ethicists, religious thinkers, and social critics tackle the thorny problems raised by the now real possibility of human cloning. In their wide ranging reviews, the distinguished contributors critically examine the major arguments for and against human cloning, probe the implications of such a procedure for society, and critically evaluate the "Report and Recommendations of the National Bioethics Advisory Commission." The debate includes both religious and secular arguments, as well as an outline (...) of the history of the cloning debate and a discussion of human cloning's impact on our sense of self and our beliefs about the meaning of life. (shrink)

Data documenting poor understanding among research participants and real-time efforts to assess comprehension in large-scale studies are focusing new attention on informed consent comprehension. Within the context of biobanking consent, we previously convened a multidisciplinary panel to reach consensus about what information must be understood for a prospective participant’s consent to be considered valid. Subsequently, we presented them with data from another study showing that many U.S. adults would fail to comprehend the information the panel had deemed essential. When asked (...) to evaluate the importance of the information again, panelists’ opinions shifted dramatically in the direction of requiring that less information be understood. Follow-up interviews indicated significant uncertainty about defining a threshold of understanding and what should happen when prospective participants are unable to grasp key information. These findings have important implications for urgently needed discussion of whether... (shrink)

The study investigates effects of the implementation of a law authorizing educational leave in Germany on individual participation in adult learning and education (ALE). In 2015, the federal state of Baden-Württemberg introduced the so-calledBildungszeitgesetz, legitimating an exemption for eligible employees of up to 5 days per year with continued payment of salary. Explaining participation in ALE is a central subject of educational research at national and international level. Current theoretical assumptions of rational choice and empirical findings of educational and socio-statistical (...) research suggest that within the general population, individuals’ availability of time affects the decision to participate and therefore lastly determines participation in ALE. However, current academia mainly discusses time as either a prerequisite for learning activities or as an observable outcome of participation and not as an explanatory factor. Furthermore, since recent studies remain on a descriptive level regarding influences of time on participation in ALE, no causal effects of the availability of time on participation are estimated. Hence, our study addresses this research gap by investigating effects of educational policy interventions such as theBildungszeitgesetzon participation in ALE. Policy interventions are ideally suited to examine the significance of time resources for participation, as the implementation of theBildungszeitgesetzprovides a specific timeframe for employees to participate in ALE outside of their working time. Drawing on data from the German National Educational Panel Study, we employ a difference-in-differences estimation strategy with propensity score matching and instrumental variable to identify the direct causal effect of the implementation of theBildungszeitgesetzon participation in ALE (N= 709). This combination toward causal inference controls for observed and unobserved baseline differences as well as heterogeneous treatment effects. The results reveal a non-significant but heterogeneous treatment effect of the implementation of theBildungszeitgesetzon individual participation in ALE. Contrary to our theoretical assumptions derived from rational choice approaches, we cannot confirm the hypothesis that the availability of time resources due to the implementation of theBildungszeitgesetzcauses a positive effect on participation in ALE. Furthermore, the results reveal that the implementation causes decreasing participation rates for younger adults, women and significantly for migrants. (shrink)

International regulation of autonomous weapon systems (AWS) is increasingly conceived as an exercise in risk management. This requires a shared approach for assessing the risks of AWS. This paper presents a structured approach to risk assessment and regulation for AWS, adapting a qualitative framework inspired by the Intergovernmental Panel on Climate Change (IPCC). It examines the interactions among key risk factors—determinants, drivers, and types—to evaluate the risk magnitude of AWS and establish risk tolerance thresholds through a risk matrix informed by (...) background knowledge of event likelihood and severity. Further, it proposes a methodology to assess community risk appetite, emphasizing that such assessments and resulting tolerance levels should be determined through deliberation in a multistakeholder forum. The paper highlights the complexities of applying risk-based regulations to AWS internationally, particularly the challenge of defining a global community for risk assessment and regulatory legitimization. (shrink)

Standard approaches to defining and evaluating environmental risk tend to reflect technocratic rather than democratic values. One consequence is that institutional mechanisms for achieving citizen participation in risk decisions rarely are studied or evaluated. This article presents a survey of five institutional mechanisms for allowing the lay public to influence environmental risk decisions: public hearings, initiatives, public surveys, negotiated rule making, and citizens review panels. It also defines democratic process criteria for assessing these and other participatory mechanisms.

Background:Moral courage is required at all levels of nursing. However, there is a need for development of instruments to measure nurses’ moral courage.Objectives:The objective of this study is to develop a scale to measure nurses’ self-assessed moral courage, to evaluate the scale’s psychometric properties, and to briefly describe the current level of nurses’ self-assessed moral courage and associated socio-demographic factors.Research design:In this methodological study, non-experimental, cross-sectional exploratory design was applied. The data were collected using Nurses’ Moral Courage Scale and analysed (...) statistically.Participants and research context:The data were collected from a convenience sample of 482 nurses from four different clinical fields in a major university hospital in Finland for the final testing of the scale. The pilot comprised a convenience sample of 129 nurses.Ethical considerations:The study followed good scientific inquiry guidelines. Ethical approval was obtained from the university ethics committee and permission to conduct the study from the participating hospital.Findings:Psychometric evaluation showed that the 4-sub-scale, 21-item Nurses’ Moral Courage Scale demonstrates good reliability and validity at its current state of development showing a good level of internal consistency for a new scale, the internal consistency values ranging from 0.73 to 0.82 for sub-scales and 0.93 for the total scale, thus well exceeding the recommended Cronbach’s alpha value of >0.7. Principal component analysis and confirmatory factor analysis supported the theoretical construct of Nurses’ Moral Courage Scale. Face validity and expert panel assessments markedly contributed to the relevance of items in establishing content validity.Discussion and conclusion:Nurses’ Moral Courage Scale provides a new generic instrument intended for measuring nurses’ self-assessed moral courage. Recognizing the importance of moral courage as a part of nurses’ moral competence and its assessment offers possibilities to develop interventions and educational programs for enhancement of moral courage. Research should focus on further validation measures of Nurses’ Moral Courage Scale in international contexts. (shrink)

Background and aimThe nature of pediatric settings may encounter nurses with more complicated ethical issues. A code of ethics guides nurses to act and decide ethically as a profession. Also, there is always a need to evaluate amount nurses adhere to this code of ethics, using valid and reliable instruments. This study aimed to develop a questionnaire and assess its psychometric properties to measure pediatric nurses' adherence to the code of ethics. MethodsIn this methodological research study, firstly, the questionnaire was (...) developed based on an extensive review of the related literature and the theoretical framework of nursing ethics. A panel of experts (n = 12) reviewed the preliminary questionnaire qualitatively and quantitatively (using CVI and CVR). A conveniently selected sample of 156 nurses working in pediatric wards in three hospitals filled out the questionnaire. The psychometric process included determining sample size and data adequacy using KMO and Bartlette's test of sphericity; exploratory factor analysis (principal component method with Promax rotation); item analysis; and Cronbach's alpha coefficient. Also, the Interclass Correlation Index (ICC) value was determined using a two-week interval test–retest method on 30 eligible nurses.ResultsThe CVI and CVR for the entire questionnaire were 0.85 and 0.78, respectively. The CVI and CVR of all items were reported higher than 0.59 and 0.8, respectively. Cronbach's alpha of the 28-items instrument was 0.92. Extracted six factors explained 65.31% of the total variance, and the values of the item correlations with the total questionnaire showed good internal consistency (0.52 to 0.90). The items of each factor were evaluated to determine the values they represent. Accordingly, the factors were named beneficence, nonmaleficence, human dignity, autonomy, informed consent, and honesty. The ICC value was 0.99.ConclusionsThe developed instrument is acceptable and has good reliability and validity. It can be used to assess the amount of pediatric nurses' adherence to the code of ethics by managers, teachers, and researchers. (shrink)

Building on nearly eighty years of scientific work, The Handbook of Emotional Intelligence is the first definitive resource that brings together a stellar panel of academics, researchers, and practitioners, in the field. Sweeping in scope, the text presents information on the most important conceptual models, reviews and evaluates the most valid and reliable methods for assessing emotional intelligence, and offers specific guidelines for applying the principles of Emotional Intelligence in a variety of settings.

Promising new solutions or risking unprecedented harms, science and its technological affordances are increasingly portrayed as matters of global concern, requiring in-kind responses. In a wide range of recent discourses and global initiatives, from the International Summits on Human Gene Editing to the Intergovernmental Panel on Climate Change, experts and policymakers routinely invoke cosmopolitan aims. The common rhetoric of a shared human future or of one humanity, however, does not always correspond to practice. Global inequality and a lack of accountability (...) within most institutional contexts of international governance render these cosmopolitan proclamations of ‘one human community’ incoherent and even harmful. More generally, there exists no shared normative standard for the cosmopolitan governance of science, with which such global initiatives could be evaluated. Taking a broadly philosophical perspective, the present paper aims to better understand this problem situation, identifying three high-level challenges global governance of technoscience: problematic ideals of technology and science, the unjust formation of “global” concerns, and the limitations of cosmopolitan theory. By holistically engaging these jointly empirical and normative sites of inquiry, scholars can better support humanity’s re-imagination of technoscientific practices within and beyond the nation-state. (shrink)