Scientific peer reviewers play an integral role in the grant selection process, yet very little has been reported on the levels of participation or the motivations of scientists to take part in peer review. The American Institute of Biological Sciences developed a comprehensive peer review survey that examined the motivations and levels of participation of grant reviewers. The survey was disseminated to 13,091 scientists in AIBS’s proprietary database. Of the 874 respondents, 76% indicated they had reviewed grant applications in the (...) last 3 years; however, the number of reviews was unevenly distributed across this sample. Higher review loads were associated with respondents who had submitted more grant proposals over this time period, some of whom were likely to be study section members for large funding agencies. The most prevalent reason to participate in a review was to give back to the scientific community and the most common reason to decline an invitation to review was lack of time. Interestingly, few suggested that expectation from the funding agency was a motivation to review. Most felt that review participation positively influenced their careers through improving grantsmanship and exposure to new scientific ideas. Of those who reviewed, respondents reported dedicating 2–5% of their total annual work time to grant review and, based on their self-reported maximum review loads, it is estimated they are participating at 56–87% of their capacity, which may have important implications regarding the sustainability of the system. Overall, it is clear that participation in peer review is uneven and in some cases near capacity, and more needs to be done to create new motivations and incentives to increase the future pool of reviewers. (shrink)

Police officers around the world must often select between equally unappealing, uncertain courses of action in an attempt to achieve the best outcome. Despite the immense importance of such decisions, there remains a lack of understanding in the study of individual differences in police decision-making. Here, using a sample of senior police officers recruited from decision-making training events across the United Kingdom (n = 96), we used the Least-worst Uncertain Choice Inventory For Emergency Responses (LUCIFER) to measure the effect of (...) maximization on both domain-specific (police) and domain-general (military) decisions. In line with a wealth of research on traditional “consumer” decisions, we found that police officers who were “maximizers” found decisions more difficult. Gender and previous military experience also influenced the process of decision-making. Specifically, police officers with military experience took more time to assess the situation but were faster to choose a course of action and commit to it. Female police officers also were slower to assess the situation. As recent events show, the outcomes of police decisions have significant consequences for the public, the officers involved, the police force as a whole, and the wider population, yet psychological research has yet to fully explore the role of individual differences in how such decisions are made. While this study does not seek to identify factors associated with “good” or “better” decision-makers, it provides strong support for the need to factor in perspectives of the individual when creating theory, or applied tools, in support of police decision-making. (shrink)

BackgroundFunding agencies have long used panel discussion in the peer review of research grant proposals as a way to utilize a set of expertise and perspectives in making funding decisions. Little research has examined the quality of panel discussions and how effectively they are facilitated.MethodsHere, we present a mixed-method analysis of data from a survey of reviewers focused on their perceptions of the quality, effectiveness, and influence of panel discussion from their last peer review experience.ResultsReviewers indicated that panel discussions were (...) viewed favorably in terms of participation, clarifying differing opinions, informing unassigned reviewers, and chair facilitation. However, some reviewers mentioned issues with panel discussions, including an uneven focus, limited participation from unassigned reviewers, and short discussion times. Most reviewers felt the discussions affected the review outcome, helped in choosing the best science, and were generally fair and balanced. However, those who felt the discussion did not affect the outcome were also more likely to evaluate panel communication negatively, and several reviewers mentioned potential sources of bias related to the discussion. While respondents strongly acknowledged the importance of the chair in ensuring appropriate facilitation of the discussion to influence scoring and to limit the influence of potential sources of bias from the discussion on scoring, nearly a third of respondents did not find the chair of their most recent panel to have performed these roles effectively.ConclusionsIt is likely that improving chair training in the management of discussion as well as creating review procedures that are informed by the science of leadership and team communication would improve review processes and proposal review reliability. (shrink)

ObjectiveIn this study, we extend the impact of mindfulness to the concept of least-worst decision-making. Least-worst decisions involve high-uncertainty and require the individual to choose between a number of potentially negative courses of action. Research is increasingly exploring least-worst decisions, and real-world events (such as the COVID-19 pandemic) show the need for individuals to overcome uncertainty and commit to a least-worst course of action. From sports to business, researchers are increasingly showing that “being mindful” has a range of positive performance-related (...) benefits. We hypothesized that mindfulness would improve least-worst decision-making because it would increase self-reflection and value identification. However, we also hypothesized that trait maximization (the tendency to attempt to choose the “best” course of action) would negatively interact with mindfulness.MethodsThree hundred and ninety-eight participants were recruited using Amazon MTurk and exposed to a brief mindfulness intervention or a control intervention (listening to an audiobook). After this intervention, participants completed the Least-Worst Uncertain Choice Inventory for Emergency Responders (LUCIFER).ResultsAs hypothesized, mindfulness increased decision-making speed and approach-tendencies. Conversely, for high-maximizers, increased mindfulness caused a slowing of the decision-making process and led to more avoidant choices.ConclusionsThis study shows the potential positive and negative consequences of mindfulness for least-worst decision-making, emphasizing the critical importance of individual differences when considering both the effect of mindfulness and interventions aimed at improving decision-making. (shrink)

The primary goal of the peer review of research grant proposals is to evaluate their quality for the funding agency. An important secondary goal is to provide constructive feedback to applicants for their resubmissions. However, little is known about whether review feedback achieves this goal. In this paper, we present a multi-methods analysis of responses from grant applicants regarding their perceptions of the effectiveness and appropriateness of peer review feedback they received from grant submissions. Overall, 56–60% of applicants determined the (...) feedback to be appropriate, although their judgments were more favorable if their recent application was funded. Importantly, independent of funding success, women found the feedback better written than men, and more white applicants found the feedback to be fair than non-white applicants. Also, perceptions of a variety of biases were specifically reported in respondents’ feedback. Less than 40% of applicants found the feedback to be very useful in informing their research and improving grantsmanship and future submissions. Further, negative perceptions of the appropriateness of review feedback were positively correlated with more negative perceptions of feedback usefulness. Importantly, respondents suggested that highly competitive funding pay-lines and poor inter-panel reliability limited the usefulness of review feedback. Overall, these results suggest that more effort is needed to ensure that appropriate and useful feedback is provided to all applicants, bolstering the equity of the review process and likely improving the quality of resubmitted proposals. (shrink)