The standard interpretation of cognitive reflection tests assumes that correct responses are reflective and lured responses are unreflective. However, prior process-tracing of mathematical reflection tests has cast doubt on this interpretation. In two studies (N = 201), we deployed a validated think-aloud protocol in-person and online to test how this assumption is satisfied by the new, validated, less familiar, and less mathematical verbal Cognitive Reflection Test (vCRT). Importantly, thinking aloud did not disrupt test performance compared to a control group. Moreover, (...) verbalized thoughts in both studies revealed that most (but not all) correct responses involved reflection and that most (but not all) lured responses lacked reflection. These data suggest that the vCRT usually satisfies the standard interpretation of the reflection tests (albeit not without exceptions) and that the vCRT can be a good measure of the construct theorized by the two-factor explication of ‘reflection’ (as deliberate and conscious). (shrink)

The squared paper or graphs are grid-based design representations used in engineering, industrial and craft design practices wherein designs are drawn over symmetrical grids. This paper reports grid-processing strategies undertaken by actors in a native craft practice, viz. Kashmiri carpet-weaving having three task contexts: (1) _design_, wherein designs are drawn on graph sheets and color scheme given by assigning practice-specific symbolic codes to the motifs by designers; (2) _coding_, wherein a cryptic script, called _talim_, is generated from these encoded graphs (...) by talim-writers; and (3) _weaving_, wherein this script is read, decoded and communicated in an equally cryptic trade-language by weavers among their teams. 32 video-recorded think-aloud sessions were conducted with talim-writers to understand their graph-processing and resultant coding strategies. The observations and qualitative analysis of transcripts revealed highly _situated_ strategies undertaken by experts keen on imbibing visuality of design embedded in the grids, in contrast to _embodied_ strategies undertaken by less-experienced coders keen on processing grids’ structural features and getting overwhelmed by grid-clutter in the process. In this landscape, the findings revealed a negotiated nature of errors instead of being deviations from the underlying grid and thereby objectively assessable. The paper makes recommendations for CAD systems to include more of those grid features exploited by experts during their graph processing to facilitate designers. (shrink)

Thinking aloud is the concurrent verbalization of thoughts while performing a task. The study of thinking-aloud protocols has a long tradition in cognitive psychology, the field of education, and the industrial-organizational context. It has been used rarely in cultural and cross-cultural psychology. This paper will describe thinking aloud as a useful method in cultural and cross-cultural psychology referring to a few studies in general and one study in particular to show the wide applications of this method. Thinking-aloud protocols can be (...) applied for a) improving the validity of cross-cultural surveys, b) process analysis of thoughts and the analysis of changes over time, c) theory development across cultures, d) the study of cultural meaning systems, and e) individual as well as group level analyses allowing hypothesis testing cross-culturally. Limitations of the thinking-aloud method are also discussed. (shrink)

This paper considers the piloting of an online learning component of a final-year social work degree ethics module at an inner-city English university. An Action Research approach was used to evaluate this pilot project and the paper illustrates how students were involved in developing and designing the teaching programme as part of the Action Research cycle. The paper explores theoretical aspects of e-learning pedagogy through an analysis of issues emerging during the planning and delivery of this pilot project. The (...) cognitive and affective impact of both face-to-face and electronic learning is discussed. It is suggested that some students may experience e-learning as a safe space for thinking about ethical dilemmas. The challenges for teachers and learners are highlighted and the author argues that in order to support student learning, online teaching needs to be carefully designed and appropriately resourced. (shrink)

I mention the benefits, challenges, and costs of using small group activities to enhance our students’ learning of critical thinking skills in our courses, and then describe ten examples of these groups. Two of these examples are not commonly reported in the literature on small groups, so I describe them in greater detail to facilitate their use in our courses.

Summary Why and how is the Gestalt theorists’ concept of productive thinking particularly suitable for being applied to the educational question of how student motivation can be encouraged, thus providing an important condition for self-regulated, intrinsically motivated learning? An answer to this question has been sought using an approach to the fostering of text comprehension ability, based upon the features specific to productive thinking, originally identified by Wertheimer and Duncker. Firstly, these specific features are dealt with and their educational implications (...) compared with those deriving from the definitions of problem-solving used most frequently in educational research. Secondly, an analysis is made of the process by which the features specific to productive thinking are turned into the conditions for a kind of text analysis suitable for designing an instructional project aimed at enhancing text comprehension ability and, at the same time, encouraging intrinsic motivation and self-regulation on the part of the learner. Thirdly, an educational project centred on the thinking-aloud poor reader is described, where thinking aloud and reflection–response are combined in order to guarantee the maximum level of intrinsic motivation. In the concluding section, the most important features of the project are discussed in relation to reciprocal teaching and scaffolding. (shrink)

Power and organizational hierarchies are ubiquitous to social institutions that form the foundation of modern society. Power differentials may act to constrain or enhance people’s ability to make good ethical decisions. However, little scholarly work has examined perceptions of this important topic. The present effort seeks to address this issue by interviewing academics about hypothetical ethical problems that involve power differences among those involved. Academics discussed what they would do in these scenarios, often drawing on their own experiences. Using a (...) think-aloud protocol, participants were prompted to discuss their reasoning and thinking behind their ethical decisions. These interview data were content analyzed using a semantic analysis program that identified a number of distinct ways that academics think about power differences and abuses in ethical situations. Implications of these findings are discussed. (shrink)

Two experiments are reported that employed think-aloud methods to test predictions concerning relevance effects and rationalisation processes derivable from Evans' (1996) heuristic-analytic theory of the selection task. Evans' account proposes that card selections are triggered by relevance-determining heuristics, with analytic processing serving merely to rationalise heuristically cued decisions. As such, selected cards should be associated with more references to both their facing and their hidden sides than rejected cards, which are not subjected to analytic rationalisation. Experiment 1 used a standard (...) selection-task paradigm, with negative components permuted through abstract conditional rules. Support was found for all heuristic-analytic predictions. This evidence was shown to be robust in Experiment 2, where "select - don't select" decisions were enforced for all cards. Both experiments also clarify the role played by secondary heuristics in cueing the consideration of hidden card values during rationalisation. We suggest that whilst Evans' heuristic-analytic model and Oaksford and Chater's (e.g., 2003) optimal data selection model can provide compelling accounts of our protocol findings, the mental models theory fares less well as an explanation of our full dataset. (shrink)

It is a well-acknowledged fact in legal translation studies that when searching for terminological equivalents, translators should make use of comparative conceptual analysis. Thus, legal translation trainees should be equipped with the necessary tools to carry out such analysis, but the question remains: are they? This paper is a follow-up to a study published in 2017, where modified think aloud protocols were used to explore the following research question: to what degree are university students doing a course in (...) legal and economic translation able to apply the methods of comparative conceptual analysis to translation of terms not accounted for sufficiently in legal dictionaries or terms with no straightforward equivalents. The results showed that major issues involve non-linearity of the analysis carried out and insufficient use of the resources available. The present study involves a different group of 29 BA students of the same course two years later, who were assigned the same task. As the retrospective protocols fail to simulate real-life conditions, this study uses screen recording and keystroke logging to track the processes leading to the identification of the conceptual equivalent in a more detailed and less subject-dependent manner. The results suggest that the steps most challenging for students include identification of relevant features defining the source and target language concepts, comparison of these features and selection, or creation, of an equivalent term reflecting the results of the analysis. Students also frequently show Google-driven searching, which influences the order of the steps performed in their analyses and the sources used. To address these challenges, translation training should include a range of tailor-made exercises focusing on the critical steps of the analysis as well as on improving web searching skills. (shrink)

Despite the importance of effective observational analysis in the technical aspects of climbing performance, limited research informs this aspect of climbing coach education. Thus, the purpose of the present research was to explore cognitive-perceptual mechanisms underpinning visual search strategies of expert and novice climbing coaches through the novel combination of eye-tracking technology and retrospective think-aloud methodology. Analysis of gaze data revealed expert climbing coaches to demonstrate fewer fixations of greater duration, and fixate on distinctly different areas of the (...) visual display, than their novice counterparts. Retrospective think-aloud interviews further demonstrated differences in the cognitive-perceptual mechanisms underpinning these visual search strategies, with expert coaches more cognisant of their visual search strategy. To expand, the gaze behaviour of expert climbing coaches was underpinned by hierarchical and complex knowledge structures relating to principles of climbing movement. This enabled expert coaches to actively focus on the most relevant aspects of a climber’s performance for analysis. Findings demonstrate the utility of combining eye tracking and retrospective think-aloud interviewing as a new, efficient methodology of capturing the cognitive-perceptual processes of climbing coaches to inform coaching education/strategies. (shrink)

The goal of this study was to assess the relationships between computational approaches to analyzing constructed responses made during reading and individual differences in the foundational skills of reading in college readers. We also explored if these relationships were consistent across texts and samples collected at different institutions and texts. The study made use of archival data that involved college participants who produced typed constructed responses under thinking aloud instructions reading history and science texts. They also took assessments of vocabulary (...) knowledge and proficiency in comprehension. The protocols were analyzed to assess two different ways to determine their cohesion. One approach involved assessing how readers established connections with themselves. The other approach involved assessing connections between the constructed responses and the texts that were read. Additionally, the comparisons were made by assessing both lexical and semantic comparisons. The result showed that both approaches for analyzing cohesion and making the comparisons were correlated with vocabulary knowledge and comprehension proficiency. The implications of the results for theory and practice are discussed. (shrink)

The increasing interconnectedness of academic research and external industry has left research vulnerable to conflicts of interest. These conflicts have the potential to undermine the integrity of scientific research as well as to threaten public trust in scientific findings. The present effort sought to identify themes in the perspectives of faculty researchers regarding conflicts of interest. Think-aloud interview responses were qualitatively analyzed in an effort to provide insights with regard to appropriate ways to address the threat of conflicts of interest (...) in research. Themes in participant responses included disclosure of conflicts of interest, self-removal from situations where conflict exists, accommodation of conflict, denial of the existence of conflict, and recognition of complexity of situations involving conflicts of interest. Moral disengagement operations are suggested to explain the appearance of each identified theme. In addition, suggestions for best practices regarding addressing conflicts of interest given these themes in faculty perspectives are provided. (shrink)

The digital revolution has widened the array of curriculum materials available to history teachers. Given the variable quality of these new materials and the deeply contextual nature of teaching, educators need better tools for selecting among the vast options available. This study aimed to validate a device designed for that purpose, called the Curriculum Materials Evaluation Tool (CMET). Using a questionnaire and think-aloud interview, the study examined how four social studies teachers evaluated a novel material set for potential classroom use, (...) and how the CMET mediated their analysis. Findings showed that the teachers preferred when materials are readily accessible and adaptable for their specific teaching context, in contrast to “one-size-fits-all” resources that dominate the Web. The CMET appeared to foster a deeper and broader analysis of the given material set, especially regarding its political and cultural orientation. The study suggests that teachers’ role in vetting and adapting digital materials be recognized and embraced. The CMET can contribute to that end through its use in district adoption committees, teacher professional development, and collaborative curriculum research. (shrink)

Reasoning patterns found in Galileo’s treatise on machines, On Mechanics, are compared with patterns identified in case studies of scientifically trained experts thinking aloud, and many similarities are found. At one level the primary patterns identified are ordered analogy sequences and special diagrammatic techniques to support them. At a deeper level I develop constructs to describe patterns that can support embodied, imagistic, mental simulations as a central underlying process. Additionally, a larger hypothesized pattern of ‘progressive imagistic generalization’—Galileo’s development of a (...) model or mechanism that becomes more and more general with each machine while still being imagistically projectable into many machines—provides a way to think about his progress toward a modern explanatory model of torque. By unpacking his arguments, we gain an appreciation of his skillful ability to foster imagistic processes underlying scientific thinking. (shrink)

The use of remember–know judgments to assess subjective experience associated with memory retrieval, or as measures of recollection and familiarity processes, has been controversial. In the current study we had participants think aloud during study and provide verbal reports at test for remember–know and confidence judgments. Results indicated that the vast majority of remember judgments for studied items were associated with recollection from study , but this correspondence was less likely for high-confidence judgments . Instead, high-confidence judgments were more likely (...) than remember judgments to be associated with incorrect recollection and a lack of recollection. Know judgments were typically associated with a lack of recollection , but still included recollection from the study context . Thus, although remember judgments provided fairly accurate assessments of retrieval including contextual details, know judgments did not provide accurate assessments of retrieval lacking contextual details. (shrink)

Two studies examined the use of think aloud (TA) protocol as a means for collecting data of cognitive processes during performance in golf. In study 1, TA was employed to examine if different verbalisation (Level 2 or Level 3 TA) instructions influence performance of high and low skilled golfers. Participants performed 30 putts using TA at either Level 2, Level 3, or no verbalization condition. Although Level 3 verbalization produced a higher volume of verbal data than Level 2, TA at (...) either level 2 or 3 did not impair putting performance compared to no verbalization. Study 2 examined the congruence between data collected via TA at Level 3 and cued retrospective recall of cognitive processes during golf performance. Experienced golfers performed six holes of golf whilst engaging in Level 3 TA. After performance, three semi-structured retrospective interviews were conducted (ten minutes after performance, 24 hours after performance and 48 hours after performance). A comparison of the themes identified large discrepancies between the information reported during TA and at interview, with only 38-41% similarity in variables reported to influence decision making on each hole. Both studies suggest TA is a valuable method for recording cognitive processes of individuals during task performance. TA provides richer verbal data regarding decisions than cued retrospective recall, and TA does not negatively impact performance. (shrink)

This article presents an exploratory analysis of the metaphoric structure of five artistic paintings within “Think aloud” protocols, in which a group of 14 English speakers with a low self-rated level of expertise in art and history of art expertise were asked to verbalize all their thoughts, ideas and impressions of the artworks. The main findings of this study can be summarized as follows: (1) multiple interpretations for the same artwork are possible, (2) the interpretations of the metaphorical structures (...) described by the participants often diverge from those advanced by the researchers. These findings challenge the methods by which metaphor identification and analysis in pictorials is currently approached. As a matter of fact, most of the research in pictorial metaphors tends to reduce stimuli such as artistic paintings to unique metaphoric interpretations generally produced by a single researcher by means of introspection. By addressing this methodological problem in metaphor research, this article contributes to the development of a theoretical and operational participant-based framework that takes into account the role of metaphoric conceptualization within the domain of art and art cognition. (shrink)

It has been widely theorized and empirically proven that self-regulated learning is related to more desired learning outcomes, e.g., higher performance in transfer tests. Research has shifted to understanding the role of SRL during learning, such as the strategies and learning activities, learners employ and engage in the different SRL phases, which contribute to learning achievement. From a methodological perspective, measuring SRL using think-aloud data has been shown to be more insightful than self-report surveys as it helps better in determining (...) the link between SRL activities and learning achievements. Educational process mining on the basis of think-aloud data enables a deeper understanding and more fine-grained analyses of SRL processes. Although students’ SRL is highly contextualized, there are consistent findings of the link between SRL activities and learning outcomes pointing to some consistency of the processes that support learning. However, past studies have utilized differing approaches which make generalization of findings between studies investigating the unfolding of SRL processes during learning a challenge. In the present study with 29 university students, we measured SRL via concurrent think-aloud protocols in a pre-post design using a similar approach from a previous study in an online learning environment during a 45-min learning session, where students learned about three topics and wrote an essay. Results revealed significant learning gain and replication of links between SRL activities and transfer performance, similar to past research. Additionally, temporal structures of successful and less successful students indicated meaningful differences associated with both theoretical assumptions and past research findings. In conclusion, extending prior research by exploring SRL patterns in an online learning setting provides insights to the replicability of previous findings from online learning settings and new findings show that it is important not only to focus on the repertoire of SRL strategies but also on how and when they are used. (shrink)

Data literacy – the ability to analyze, interpret, evaluate, and use data and data visualizations – has become increasingly important for understanding and communicating information in the discipline of history. In the United States, curricular standards and standardized assessments already reflect this importance, but educators lack a clear picture of how students use data visualizations when reasoning about the past. How do students use data visualizations when reasoning about a historical question? To what degree does using data visualizations enhance students’ (...) historical reasoning? What challenges do students face when attempting to use data visualizations? This study addresses these questions, investigating how fifth-grade, eighth-grade, and high school students use data visualizations from typical school textbooks. Twenty-seven students were interviewed, surveyed, and asked to think aloud about a historical question while using a textbook entry that included a data visualization. Results from qualitative and quantitative analyses highlight the potential for data visualizations to enhance historical reasoning. However, results also indicate that students are unlikely to read data visualizations on their own, underscoring the importance of providing targeted data literacy instruction. (shrink)

Einstellung effects designate the phenomenon where established routines can prevent people from finding other, possibly more efficient solutions. Here we investigate the mechanism behi...

Ethics isn’t a conversation exclusive to philosophers. There is value, then, in not only understanding how laypeople think about issues in ethics, but also bringing their judgments into dialogue with those of philosophers in order to make sense of agreement, disagreement, and the consequences of each. Experimental philosophers facilitate this dialogue uniquely by capturing laypeople’s judgments and analyzing them in light of philosophical theory. They have done so almost exclusively by using face valid quantitative surveys about philosophically interesting thought experiments. (...) Based on high participant support for this or that response, researchers conclude that a given theory is more or less intuitive, and in some cases that it is or isn’t true. However, such conclusions can only be drawn from quantitative survey data if one assumes those data accurately reflect laypeople’s thinking on the issues of interest, an assumption that can’t be justified by the quantitative data itself since they are potentially opaque. This is the methodological problem of experimental philosophy: experimental philosophers who use quantitative methods alone can’t sufficiently demonstrate their data to be reflective of relevant judgments/intuitions. To better explore people’s judgments on issues in ethics and to determine whether experimental philosophers are or aren’t getting what they take themselves to be getting in surveys, I recreated part of an experiment by Chituc, Henne, Sinnott-Armstrong, and De Brigard on the Kantian principle that “ought implies can”, or that whenever an agent ought to do something then it is the case that she can, and added a layer of qualitative data to it by having participants think aloud while completing the surveys and conduct a follow-up interview. With similar quantitative results to those from Chituc et al., I argue that my qualitative results 1) cast doubt on Chituc et al.’s data being reflective of many people’s judgments, especially on the more interesting questions relating to moral obligation; 2) reveal unique insights into how people think about OIC; 3) generally speak to the value of experimental philosophers using triangulation of methods in better understanding laypeople’s complex and varied thinking about questions important to ethics and beyond. Supplemental documents: Appendices A, B, C, D, and E are surveys I used in my study. Appendices C and D are derived from Chituc et al.’s publication “Blame, Not Ability, Impacts Moral ‘Ought’ Judgments for Impossible Actions: Toward an Empirical Refutation of ‘Ought’ Implies ‘Can.’” Appendix F is the recruitment flyer I distributed for my study. Appendix H is the quantitative data from my study. (shrink)

This helpful book is your personal toolkit for critical thinking. Author Tom Chatfield will show you how to sharpen your critical thinking by developing and practicing this specific set of skills, so you can: Spot an argument and understand why reasoning matters; Discover errors and evaluate evidence; Understand and account for bias; Become a savvy user of technology; and Develop clear, confident critical writing"--Publisher's website.

RESUMEN En el prólogo a la segunda edición de la Crítica de la razón pura, ¿qué ha querido decir Kant con una “revolución del modo de pensar” que se debe aplicar a la metafísica para que tome el camino de la ciencia? Cabe distinguir dos significados: uno de carácter metodológico, que asume que el conocimiento rige a los objetos y tendría alcance. Aplicada a la metafísica, supone una transformación más profunda que permite hablar, en segundo lugar, de un significado metafísico (...) específico, que implica que el conocimiento constituye aquello mismo a lo que se llama el objeto de las representaciones. ABSTRACT What is Kant referring to when, in the Preface to the Second Edition of the Critique of Pure Reason, he speaks of the “revolution in the way of thinking” that is needed for metaphysics to enter the path of science? Two meanings are possible. The first is a methodological one, which assumes that knowledge governs objects and would, therefore, extend to metaphysics. Applied to the latter, a more profound transformation is needed, one that would make it possible to speak of a specific metaphysical meaning entailing that knowledge constitutes the object of representations. (shrink)

This article focuses on academics’ conceptions of teaching research ethics and integrity. Seventeen academics from a Finnish research intensive university participated in this qualitative study. The data were collected using a qualitative multi-method approach, including think-aloud and interview data. The material was scrutinized using thematic analysis, with both deductive and inductive approaches. The results revealed variation in academics’ views on the responsibility for teaching research integrity, the methods employed to teach it and the necessity of intervening when misconduct occurs. (...) The academics emphasized the responsibility of the individual teacher and the student to foster integrity as well as the shared responsibility of all members of the academic community. However, many academics felt that they themselves needed pedagogical training. Most shared the view that practices of responsible conduct in research can be explicitly and intentionally taught through demonstration, explanation, and practice. However, the academics also noted that learning research integrity and ethics takes place implicitly. A few questioned the need for and the utility of training in the form of courses or through an explicitly addressed topic included in, for instance, methods courses. Their views on the question of how to deal with alleged cases of misconduct varied. While many academics considered a proactive approach the best way to prevent misconduct, some trusted more in a reactive approach. The results show that, while in general academics agree on the importance of research ethics, their conceptions of teaching it vary. The teaching conception bears consequences for the teaching methods chosen, assignment of responsibility for both teaching and students learning, and for the way in which teachers believe that misconduct should be responded to. (shrink)

Abstract.There is ample evidence that humans (and other primates) possess a knowledge instinct—a biologically driven impulse to make coherent sense of the world at the highest level possible. Yet behavioral decision‐making data suggest a contrary biological drive to minimize cognitive effort by solving problems using simplifying heuristics. Individuals differ, and the same person varies over time, in the strength of the knowledge instinct. Neuroimaging studies suggest which brain regions might mediate the balance between knowledge expansion and heuristic simplification. One region (...) implicated in primary emotional experience is more activated in individuals who use primitive heuristics, whereas two areas of the cortex are more activated in individuals with a strong knowledge drive: one region implicated in detecting risk or conflict and another implicated in generating creative ideas. Knowledge maximization and effort minimization are both evolutionary adaptations, and both are valuable in different contexts. Effort minimization helps us make minor and routine decisions efficiently, whereas knowledge maximization connects us to the beautiful, to the sublime, and to our highest aspirations. We relate the opposition between the knowledge instinct and heuristics to the biblical story of the fall, and argue that the causal scientific worldview is mathematically equivalent to teleological arguments from final causes. Elements of a scientific program are formulated to address unresolved issues. (shrink)

The Neo-Confucian writings of Bangye Yu Hyeong-won, the pioneer of Shilhak, did not remain, and he himself confessed his conversion from a ‘Qi centered view’ to 'Shilli theory', resulting in a variety of interpretations, making the whole aspect of his Neo-Confucian philosophy difficult to figure out. From that time on, as interpreted in his conversion from ‘anti Zhuzi Studies’ to ‘Zhuzi Studies’, he has been recognized as a Juri-theorist with a Li-centered thinking. Nevertheless, many scholars who paid attention to Yu's (...) 'The Theory of Governing Society' evaluated him as a reality-oriented Qi-theorist and experientialist. In this article, through analyzing the content and character of his Shilli theory expressed by Yu himself, and exploring the content, inclination degree, motive and purpose of the conversion he confessed at the age of 37, I examine whether his confession really meant a turn to Juri. I point out that even if he recognized Li's substance and developed Shilli theory, which emphasized Li’s independence and Superintendence Character, he still did not give up 'Qiwaiwuli' and 'Qizhili' and maintained a reality-oriented perspective that focuses on things and practice. I also point out that his Shilli theory has a light inclination that just adds reinforcement of the essential nature to the existence that is already firmly established in his philosophy. The trigger or purpose of the turn to Shilli theory was to secure absolute moral standards that could not be solved by Qi-centered theory, and to lay the cornerstone of his lifelong work, Bangyesurok, on the absolute principle of Tianli. Through this, I develop the argument that his Shilli theory was not a conversion to Juri. (shrink)

In this paper we argue that the protocols of subjects recalling the names of their high school classmates, as well as an army of traditional memory phenomena, can be understood from an information processing analysis which interprets retrieval as a problem‐solving process. This characterization of retrieval focuses on the reconstructive and recursive nature of the process of remembering. Retrieval is viewed as a process in which some information about a target item is used to construct a description of the (...) item and this description is used in attempts to recover new fragments of information. A new description i s formed and the process continues recursively. Three subprocesses are identified: FIND A CONTEXT, in which a proper environment for conducting a search i s established: SEARCH, in which bits and pieces of information appropriate to the context are recovered until an adequate description can be formed within the search context; and VERIFY, in which recovery information is checked for consistency.From the perspective this characterization, we examine the protocols of subjects asked to think aloud while recalling the names of their classmates. Subjects' retrievals continued for a surprisingly long period and were characterized by the phenomena of overshoot, systematic hypothesizing, fabrications, establishment of search contexts, self‐corrections, and the use of a number of basic search strategies. The view of memory as a problem‐solving process not only leads us to the identification of these phenomena but also to a framework for a coherent interpretation for them. (shrink)

Validated self-report measures of post-stroke fatigue are lacking. The Dutch Multifactor Fatigue Scale (DMFS) was translated into Danish, and response process evidence of validity was evaluated. DMFS consists of 38 Likert-rated items distributed on five subscales: Impact of fatigue (11 items), Signs and direct consequences of fatigue (9), Mental fatigue (7), Physical fatigue (6), and Coping with fatigue (5). Response processes to DMFS were investigated using a Three-Step Test-Interview (TSTI) protocol, and data were analyzed using Framework Analysis. Response processes (...) were indexed on the following categories: (i) “congruent,” response processes were related to the subscale construct; (ii) “incongruent,” response processes were not related to the subscale construct; (iii) “ambiguous,” response processes were both congruent and incongruent or insufficient to evaluate congruency; and (iv) “confused,” participants did not understand the item. Nine adults were recruited consecutively 10–34 months post-stroke (median = 26.5) at an outpatient brain injury rehabilitation center in 2019 [five females, mean age = 55 years (SD= 6.3)]. Problematic items were defined as <50% of response processes being congruent with the intended construct. Of the 38 items, five problematic items were identified, including four items of Physical fatigue and one of Mental fatigue. In addition, seven items posed various response difficulties to some participants due to syntactic complexity, vague terms, a presupposition, and a double-barrelled statement. In conclusion, findings elucidate the interpretative processes involved in responding to DMFS post-stroke, strengthen the evidence base of validity, and guide revisions to mitigate potential problems in item performance. (shrink)

Research investigating the intricacies of how self-regulated writing strategies are used in a finely focused area of the second language writing process is still lacking. This study takes a mixed-methods approach to explore Chinese English as a Foreign Language learners’ use of self-regulated writing strategies when revising based on automated, peer, and teacher feedback in an online EFL writing context. Thirty-six Chinese university learners filled in three questionnaires. In addition, four learners followed a think-aloud protocol while revising and responding to (...) a stimulated recall interview to provide further data. The results revealed that learners employed an array of self-regulated writing strategies to attain their feedback revision goals. Learners used more cognitive strategies when revising based on automated feedback compared with peer and teacher feedback and more motivational strategies when revising based on teacher feedback. The think-aloud data and stimulated recall interviews coincided with the quantitative findings. Textual analysis revealed that feedback type and quantity were associated with self-regulated writing strategy use. (shrink)

There is ample evidence that humans (and other primates) possess a knowledge instinct—a biologically driven impulse to make coherent sense of the world at the highest level possible. Yet behavioral decision-making data suggest a contrary biological drive to minimize cognitive effort by solving problems using simplifying heuristics. Individuals differ, and the same person varies over time, in the strength of the knowledge instinct. Neuroimaging studies suggest which brain regions might mediate the balance between knowledge expansion and heuristic simplification. One region (...) implicated in primary emotional experience is more activated in individuals who use primitive heuristics, whereas two areas of the cortex are more activated in individuals with a strong knowledge drive: one region implicated in detecting risk or conflict and another implicated in generating creative ideas. Knowledge maximization and effort minimization are both evolutionary adaptations, and both are valuable in different contexts. Effort minimization helps us make minor and routine decisions efficiently, whereas knowledge maximization connects us to the beautiful, to the sublime, and to our highest aspirations. We relate the opposition between the knowledge instinct and heuristics to the biblical story of the fall, and argue that the causal scientific worldview is mathematically equivalent to teleological arguments from final causes. Elements of a scientific program are formulated to address unresolved issues. (shrink)

How do people make difficult decisions in situations involving substantial risk and uncertainty? In this study, we presented a difficult medical decision to three expert physicians in a combined “thinking aloud” and “cross examination” experiment. Verbatim transcripts were analyzed using script analysis to observe the process of constructing and making the decision, and using referring phrase analysis to determine the representation of knowledge of likelihoods. These analyses are compared with a formal decision analysis of the same problem (...) to highlight similarities and differences. The process of making the decision resembles an incremental, sequential‐refinement planning algorithm, where a complex decision is broken into a sequence of choices to be made with a simplified description of the alternatives. This strategy results in certain kinds of relevant information being underweighted in the final decision. Knowledge of likelihood appears to be represented as symbolic descriptions capturing categorical and ordinal relations with “landrhark” likelihoods, only some of which are described numerically. Numerical probabilities, capable of being combined and compared arithmetically, were not observed. These observations suggest an explanation for the heuristics and biases in human decision making under uncertainty in terms of the processes that manipulate symbolic descriptions of likelihoods and construct plans of action for situations involving risk and uncertainty. (shrink)

This study explores preservice and practicing teachers’ conceptions of historical significance generally and for the history classroom. Using think-aloud interviews and card-sorting data, we engaged in qualitative analysis of how four preservice and five practicing teachers answered two questions related to determining significance: what events are most significant in world history and what events are most important for students to learn? Results showed that (a) participants answered the two questions differently, and (b) both practicing and preservice teachers added considerations (...) when responding to the question about what events are most important for students to learn. Through these analyses, we developed the term instructional significance to describe an aspect of pedagogical content knowledge that serves as a lens through which teachers view the content they teach, and think about that content in preparing to teach students. We use these findings and research on student and teacher conceptions of historical significance to propose a preliminary framework for instructional significance for teaching history. We conclude by suggesting the utility of the framework to history classrooms and to future research. (shrink)

Multi-level teaching has been proven to be more effective than a one-size-fits-all learning approach. This study aimed to develop and implement a multi-level remedial teaching scheme in various high school classes containing students of a wide range of learning levels and to determine its effect of their learning. The deterministic inputs noisy and gate model of cognitive diagnosis theory was used to classify students at multiple levels according to their knowledge and desired learning outcomes. A total of 680 senior high (...) school students from central provinces in China participated in the initial cognitive diagnostic test, and 1,615 high school sophomores from seven high schools in China participated in a formal cognitive diagnosis test. Thirty-six high school students from Southwestern China participated in the think-aloud protocols, and 258 seniors from three high schools in southwest China participated in the remedial teaching experiment. Through an analysis of students’ think-aloud protocols, cognitive errors of students at all levels were determined, and multi-level remedial teaching programs were designed to address these common cognitive errors. The remedial teaching programs were then implemented in three schools and compared with a control group. The results indicated that the students in the experimental group showed a more significant improvement. In this study, the steps of designing multi-level remedial teaching include assessment, classification, and preparing a teaching scheme, which are feasible and can have remarkable teaching effects. This process can be used for reference by teachers of various subjects. (shrink)

Metacognition, the cognition about cognition, is closely linked to intelligence and therefore understanding the metacognitive processes underlying intelligence test performance, specifically on Raven’s Progressive Matrices, could help advance the knowledge about intelligence. The measurement of metacognition, is often done using domain-general offline questionnaires or domain-specific online think-aloud protocols. This study aimed to investigate the relationship between metacognitive awareness and intelligence via the design and use of a novel Meta-Cognitive Awareness Scale – Domain Specific that encourages reflection of task strategy processes. (...) This domain-specific scale was first constructed to measure participants’ awareness of their own metacognition linked to Raven’s Progressive Matrices. Following discriminatory index and Exploratory Factor Analysis, a 15-item scale was derived. Exploratory Factor Analysis showed five factors: Awareness of Engagement in Self-Monitoring, Awareness of Own Ability, Awareness of Responding Speed/Time, Awareness of Alternative Solutions and Awareness of Requisite Problem-Solving Resources. The intelligence level of ninety-eight adults was then estimated using Raven’s Standard Progressive Matrices. Participants also completed the MCAS-DS, and further items that examined their test-taking behavior and Confidence level. Metacognitive awareness was positively correlated to standardized IQ scores derived from the SPM whilst Over-Confidence derived using the Confidence level measure was negatively correlated to SPM. Despite some limitations, this study shows promise for elucidating the relationship between metacognitive awareness and intelligence using the task-specific scale. (shrink)

Physical activity can prevent and treat multiple diseases. Exercise referral schemes have been used extensively as one healthcare pathway. Schemes typically involve the referral of an inactive individual, with a long term condition, for a time limited exercise programme. Evidence has shown limited benefit, yet the exploration of implementation is under researched. National guidance, in the United Kingdom, recommends that exercise referral schemes should not be commissioned unless behaviour change practices are implemented. Nonetheless, novel evaluations, which are sensitive to the (...) complex nature of behaviour change implementation, have not been undertaken. Therefore, this research sought to answer how, why, and in which circumstances behaviour change practices are implemented by exercise referral practitioners. Realist evaluation, a form of theory driven evaluation, was adopted to address the research question. Programme theory, the envisaged causal workings of implementation, was developed and tested to advance knowledge on how behaviour change practice can be achieved by exercise referral practitioners. An 8-month focused ethnography was used to develop programme theory. Subsequently, a survey was validated to empirically test programme theory. Adjudication between theory required an assessment of the fidelity to behaviour change practices. Therefore, vignettes were created and validated, which acted as a proxy to observations. The survey was then completed through online, and facilitated interviews, using a ‘think aloud’ methodology. The analysis showed that practice frameworks augment motivation when there is congruent practitioner characteristics and practice monitoring is utilised, whereas frameworks improve capability when faced with challenging attendees. Supportive leadership improves motivation when there is an organisational commitment to behaviour change and practitioners are passionate to empower attendees. Supportive leadership improves capability for implementation when a learning climate is created. Partnerships with medical professionals enhance implementation, through changes to motivation, when medical professionals commit and recognise the value of schemes, and partnerships enhance capability where medical professionals reinforce practice via congruent communication. On-going support enhances capability where practitioners are cognizant of their role and have lower behaviour change competencies, conversely, motivation is enhanced as practitioners become more capable. Exercise referral schemes risk being labelled ineffective without considering the implementation climate and fidelity to best practice guidance. This thesis provides portable and actionable findings, which could lead to a greater translation of behaviour change practices to applied settings in exercise referral and in other medically led community based self-management interventions. (shrink)

There is a paradox lying at the heart of the study of heredity. To understand the ways in which features are passed down from one generation to the next, we have to dig deeper and deeper into the ultimate nature of things - from organisms, to genes, to molecules. And yet as we do this, increasingly we find we are out of focus with our subjects. What has any of this to do with the living, breathing organisms with which we (...) started? Organisms are living. Molecules are not. How do we relate one to the other? In Genetic Analysis, one of the most important empirical scientists in the field in the twentieth century attempts, through a study of history and drawing on his own vast experience as a practitioner, to face this paradox head-on. His book offers a deep and innovative understanding of our ways of thinking about heredity. (shrink)

In this paper I argue that Turing proposed a new approach to the concept of thinking, based on his claim that intelligence is an ‘emotional concept’; and that the response-dependence interpretation of Turing’s ‘criterion for “thinking”’ is a better fit with his writings than orthodox interpretations. The aim of this paper is to clarify the response-dependence interpretation, by addressing such questions as: What did Turing mean by the expression ‘emotional’? Is Turing’s criterion subjective? Are ‘emotional’ judgements decided by social consensus? (...) Turing’s take on these issues impacts current philosophical debates on response-dependent concepts and on the nature of artificial intelligence. (shrink)

In an attempt to discover the facial action units for affective states that occur during complex learning, this study adopted an emote-aloud procedure in which participants were recorded as they verbalised their affective states while interacting with an intelligent tutoring system (AutoTutor). Participants’ facial expressions were coded by two expert raters using Ekman's Facial Action Coding System and analysed using association rule mining techniques. The two expert raters received an overall kappa that ranged between.76 and.84. The association rule mining (...) class='Hi'>analysis uncovered facial actions associated with confusion, frustration, and boredom. We discuss these rules and the prospects of enhancing AutoTutor with non-intrusive affect-sensitive capabilities. (shrink)