Abstract‘High stakes testing’ is to be understood as testing with serious consequences for students, their teachers and their educational institutions. It plays a central role in holding teachers and educational institutions to account. In a recent article Randall Curren seeks to refute a number of philosophical arguments developed in my The Limits of Educational Assessment against the legitimacy of high stakes testing. In this reply I contend that some of the arguments he identifies (...) are not mine, and that others survive his critique. (shrink)

Drawing on their extensive research, Nichols and Berliner document and categorize the ways that high-stakes testing threatens the purposes and ideals of the American education system. For more than a decade, the debate over high-stakes testing has dominated the field of education. This passionate and provocative book provides a fresh perspective on the issue and powerful ammunition for opponents of high-stakes tests. Their analysis is grounded in the application of Campbell’s Law, which (...) posits that the greater the social consequences associated with a quantitative indicator, the more likely it is that the indicator itself will become corrupted—and the more likely it is that the use of the indicator will corrupt the social processes it was intended to monitor. Nichols and Berliner illustrate both aspects of this “corruption,” showing how the pressures of high-stakes testing erode the validity of test scores and distort the integrity of the education system. Their analysis provides a coherent and comprehensive intellectual framework for the wide-ranging arguments against high-stakes testing, while putting a compelling human face on the data marshalled in support of those arguments. (shrink)

The results of some high-stakes aptitude tests in Austria have revealed sex differences. We suggest that such discrepancies are mediated not principally by differences in aptitudes, skills, and knowledge but gender differences in test takers’ perceptions of the test situation. Furthermore, previous research has indicated that candidates’ evaluations of the fairness of the testing tool are of great importance from an institutional point of view because such perceptions are known to influence an organization’s attractiveness. In this study, (...) we aimed to investigate how women and men perceive and evaluate certain aspects of a high-stakes test situation by using the results and evaluations of an actual medical school aptitude test (753 applicants; 59% women). Test takers voluntarily evaluated the test situation and rated specific aspects of it (e.g., the fairness of the selection tool) and provided information regarding their test anxiety immediately after they completed the 4-hour test. Data analyses indicated small, albeit significant sex differences in participants’ perceptions of the test. Men described the test situation as slightly giving more opportunity to socialize and possessing more opportunity to deceive than women did. Furthermore, the perception of the test situation did not directly predict the test results, but it served as a moderator for the indirect effect of test anxiety on test results. By contrast, there were significant direct effects but no indirect effects of situation perception on evaluations of the fairness of the selection tool: The more the test situation was perceived as a high-pressure situation, the lower the fairness ratings of the testing tool. Results were discussed with reference to gender roles and test fairness. (shrink)

: The purposes of this critical analysis are to clarify why high stakes testing reforms have become so prevalent in the United States and to explain the connection between current federal and state emphases on standardized testing reforms and educational opportunities. The article outlines the policy context for high stakes examinations, as well as the ideas of testing and accountability as major tenets of current education reform and policy. In partial explanation of the (...) widespread acceptance and use of standardized tests in the United States, we argue that there is a pervasive testing culture, in addition to other contributing factors such as administrative utility, profit motives, and political ideology. Finally, we offer a critique of high stakes testing reforms in light of concerns about equality of educational opportunity. (shrink)

This paper presents the results of a within-subject experiment testing whether an increase in the monetary stakes by a factor of 50 – which had never been done before – influences individual behavior in a simple ultimatum bargaining game. Contrary to current wisdom, we found that lowest acceptable offers stated by the responder are proportionally lower in the high-stake condition than in the low-stake condition. This result may be interpreted in terms of the type of utility functions (...) which characterize the subjects. However, in line with prior results, we find that an important increase of the monetary stakes in the ultimatum game has no effect on the offers made by the proposer. Yet, the present research suggests that the reasons underlying these offers are quite different when the stakes are high. (shrink)

The present research investigates gender gaps in the results of secondary school exit exams in mathematics in Poland in 2015. The analysis shows that, in the basic level exam, males are highly overrepresented at the upper end of the score distribution. The same pattern did not exist in the extended-level Matura. Two explanations are offered here. The differences are driven by gender self-selection in high school programs. Students who decide on maths-related tracks have more maths lessons than other students. (...) Secondly, a student who takes the extended Matura also has to take the basic Matura exam. As a result, the population of students taking the basic Matura is highly differentiated in terms of maths competence and motivation. Additionally, the analysis of differential item functioning shows that only a few items were flagged as having DIF. (shrink)

Of the many possible individual factors bearing on test preparation, one is how individuals’ motivational and cognitive perceptions affect test-driven preparation practices. This study reports an investigation into test preparation of a high-stakes writing test from the perspective of expectancy-value theory. Undergraduate students on their test preparation for the writing tasks of China’s Graduate School Entrance English Examination were recruited voluntarily from 11 universities in mainland China. The perceptions of GSEEE test takers, which included goal, task value, task (...) demand, and expectation of success, were identified. Five types of preparation practices were identified for the GSEEE writing tasks: memorizing practice, test familiarization, comprehensive learning, skills development and drilling practice. Structural equation modeling revealed that the expectancy-value model held up well for the paths from test takers’ perceptions to test-driven preparation practices, which were not construct-oriented but goal-motivated. The GSEEE test takers’ goal, determined by the high-stakes nature of admission test, explained their motivation and determined their behavior toward test preparation. Results also indicated that task demand was inadequate to be termed a strong factor in affecting test preparation. As such, the findings of this study offer evidence regarding how an expectancy-value model fit into test preparation mechanism and provide insights into the nature and scope of test preparation for high-stakes writing tests. (shrink)

This paper assesses the role of shadow education (SE), i.e., organised learning activities outside formal schooling, in the lives of secondary school students of different social backgrounds and in different school settings, in a high-stakes context. It draws on multilevel analysis of longitudinal Growing Up in Ireland data, alongside narratives from in-depth case study research in 10 schools. Framed within a social reproduction approach, we show how access to SE as an educational resource is socially stratified, accessible to (...) those with greater levels of family resources, and those attending schools with higher socio-economic student intakes. SE is viewed as an investment, particularly among students with average and above average levels of prior attainment, while high attaining students are less likely to use SE. Perhaps reflecting the normalisation of SE in the Irish context, students do not directly link engagement in such tuition to their socio-emotional wellbeing. (shrink)

Some risks have extremely high stakes. For example, a worldwide pandemic or asteroid impact could potentially kill more than a billion people. Comfortingly, scientific calculations often put very low probabilities on the occurrence of such catastrophes. In this paper, we argue that there are important new methodological problems which arise when assessing global catastrophic risks and we focus on a problem regarding probability estimation. When an expert provides a calculation of the probability of an outcome, they are really (...) providing the probability of the outcome occurring, given that their argument is watertight. However, their argument may fail for a number of reasons such as a flaw in the underlying theory, a flaw in the modeling of the problem, or a mistake in the calculations. If the probability estimate given by an argument is dwarfed by the chance that the argument itself is flawed, then the estimate is suspect. We develop this idea formally, explaining how it differs from the related distinctions of model and parameter uncertainty. Using the risk estimates from the Large Hadron Collider as a test case, we show how serious the problem can be when it comes to catastrophic risks and how best to address it. (shrink)

I will argue in what follows, following the insights of James Marshall on busno‐cratic power, that resistance to this new power is already well underway, and that this resistance is potentially problematic and potentially transgressive 1 . The self is not only a chooser in busno‐cratic land, it is also re‐commodifying itself and in so doing, beginning to struggle at the limits of its commodified situation. I will argue that commodified selves, as much as they are constrained, are also potent (...) sites for resistance. Part of that resistance is being waged in the terrain of the high stakes test, where the self that could ‘choose’ runs headlong into a product that definitively limits its range of choice. In order to engage critically with this resistance, I examine the cracks in the monolithic power of testing, cracks that point to the uncertainty of numbers and the ambivalent anxieties of test takers. (shrink)

The growth of high-stakes testing in state accountability systems necessitates further examination of their impact on stakeholders. Prompted by broader state-level reform in Kentucky, this evaluation aims to provide insight into a new accountability system's effect on social studies teachers. Using a goal-free evaluation model and case study design, the researchers examined the content and instructional decisions made by a group of U.S. history teachers in response to a new end-of-course exam designed by ACT-QualityCore. The evaluation incorporated (...) a content analysis of teacher materials, observation of a professional learning community meeting, and teacher interviews. The results of this evaluation indicate that teachers generally support the changes in the new assessment system but find specific elements frustrating and hesitate to completely revamp their instructional practices. Considering these assessment system changes occurred to advance Kentucky's goal of college and career readiness for all, this evaluation provides insight into what is actually happening in classrooms and should assist teachers and administrators as they assess the impact of these reforms on classroom practice. (shrink)

The University of Tehran English Proficiency Test (UTEPT) is a high-stakes entrance examination taken by more than 10,000 master’s degree holders annually. The examinees’ scores have a significant influence on the final decisions concerning admission to the University of Tehran Ph.D. programs. As a test validation investigation, the present study, which is a bias detection research in nature, utilized multistep logistic regression (LR) procedure to examine the presence of gender differential item functioning (DIF) in the UTEPT with a (...) sample of 6,555 examinees who took the test in November 2006. Specifically, the LR DIF two-degree of freedom Chi-squared test of significance was employed to test the significance of DIF. Following what has been recently suggested in the literature, the test of significance for DIF was accompanied by a measure of magnitude, namely the R-squared effect size for LR DIF, for the interpretation of which the two widely accepted classification schemes were used comparatively. The results reveal that 39 of the 100 items in the test display significant gender differences. However, these group differences are viewed as “negligible” based on both of the schemes. Accordingly, it could be argued that the UTEPT is a gender DIF-free test, though the Reading Comprehension section of the test remains in need of further analysis as it seems that the general trend of DIF indices at the item level may hint at an inclination towards males. (shrink)

This paper discusses literacy as a socio-political phenomenon from the perspective of several relatively independent educational discourses. The first is critical education theory and research revealing the hidden mechanisms by which education policies act in the interests of a global market economy. The second is the perspective of critical pedagogy scholars on contemporary educational challenges, who offer responses similar to those discussed in current discourse on informal civic education. The third is the heated discussion of high-stakes literacy (...) class='Hi'>testing (related to OECD literacy studies such as PISA, IALS, etc.) the results of which are used as a source of argumentation for diverse attitudes and educational consequences. Based on an analysis of literacy theory, research on active citizenship and civic education, the term “civic literacy” is proposed and argued as a relevant conceptual frame for conceptualizing school as an institution which can be involved in resistance to all forms of power politics or ideological indoctrination and manipulation, while at the same time, respecting the traditional values and aims of general education. (shrink)

I will argue in what follows, following the insights of James Marshall on busno‐cratic power, that resistance to this new power is already well underway, and that this resistance is potentially problematic and potentially transgressive (in Marshall's words ‘a reflective reconstitution’). The self is not only a chooser in busno‐cratic land, it is also re‐commodifying itself and in so doing, beginning to struggle at the limits of its commodified situation. I will argue that commodified selves, as much as they are (...) constrained, are also potent sites for resistance. Part of that resistance is being waged in the terrain of the high stakes test, where the self that could ‘choose’ runs headlong into a product that definitively limits its range of choice. In order to engage critically with this resistance, I examine the cracks in the monolithic power of testing, cracks that point to the uncertainty of numbers and the ambivalent anxieties of test takers. (shrink)

Different types of tasks exist, including tasks for research purposes or exams assessing knowledge. According to expectation-value theory, tests are related to different levels of effort and importance within a test taker. Test-taking effort and importance in students decreased over the course of high-stakes tests or low-stakes-tests in research on test-taking motivation. However, whether test-order changes affect effort, importance, and response processes of education students have seldomly been experimentally examined. We aimed to examine changes in effort and (...) importance resulting from variations in test battery order and their relations to response processes. We employed an experimental design assessing N = 320 education students’ test-taking effort and importance three times as well as their performance on cognitive ability tasks and a mock exam. Further relevant covariates were assessed once such as expectancies, test anxiety, and concentration. We randomly varied the order of the cognitive ability test and mock exam. The assumption of intraindividual changes in education students’ effort and importance over the course of test taking was tested by one latent growth curve that separated data for each condition. In contrast to previous studies, responses and test response times were included in diffusion models for examining education students’ response processes within the test-taking context. The results indicated intraindividual changes in education students’ effort or importance depending on test order but similar mock-exam response processes. In particular effort did not decrease, when the cognitive ability test came first and the mock exam subsequently but significantly decreased, when the mock exam came first and the cognitive ability test subsequently. Diffusion modeling suggested differences in response processes on cognitive ability tasks suggesting higher motivational levels when the cognitive ability test came first than vice versa. The response processes on the mock exam tasks did not relate to condition. (shrink)

Knowledge of pedagogy and social studies content influences a teacher's decision making and helps teachers conduct sound instructional practices despite the influence of high-stakes testing policies. Using national data from the Survey of the Status of Social Studies (S4), this study examined the associations of teachers’ professional characteristics, school environmental factors, and state testing policy on self-reported levels of authority that secondary level social studies teachers (grades 6–12) hold over key classroom tasks. Through hierarchical multiple regression (...) analysis, key findings from this study indicated that greater minority enrollments are associated with lower levels of instructional authority. Teachers who worked in states where a state-mandated social studies test was administered reported less freedom to choose what to teach and how to teach than those in non-testing states. Also, this study showed that in-field status, the type of licensure, and years of teaching experience are important factors in exercising social studies teachers’ instructional authority (e.g., their ability to balance effectively the demands of state-mandated reforms with teaching for meaningful student learning). This study recommends that schools with high minority enrollments, especially if these districts exist in a high stakes testing environment, should invest in teachers with high-quality social studies preparation. (shrink)

This paper continues an exchange between its author and Andrew Davis. Part I addresses the attribution and ontological status of mental constructs and argues that philosophical work on these topics does not undermine high stakes testing. Part II examines the significance for testing of the connectedness of meaningful learning. Part III addresses the high stakes in high stakes testing in connection with the risk entailed by limited scoring reliability. It concludes that (...) there is no straightforward relationship between the magnitude of what is at stake for students and teachers and the threshold of acceptable reliability in scoring. (shrink)

This article examines the attempted reform of education within an emerging audit culture in Australia that has led to the implementation of a high-stakes testing regime known as NAPLAN. NAPLAN represents a machine of auditing, which creates and accounts for data that are used to measure, amongst other things, good teaching. In particular, we address the logics of a policy intervention that aims to improve the quality of education through returning ‘good teaching’. Using Deleuze’s concepts of series, (...) events, copies and simulacra, we suggest that an attempt to return past commonsense logics of ‘good teaching’ as a result of NAPLAN is not possible. In an audit culture as exemplified by NAPLAN, ‘good teaching’ is being reconceptualized through those practices and becomes unrecognizable. Whilst policy claims to improved equity and quality are admirable, this article suggests that the simulacral change to logics of good teaching may actualize something very different. (shrink)

PISA claims that it can extend its reach from its current core subjects of Reading, Science, Maths and problem-solving. Yet given the requirement for high levels of reliability for PISA, especially in the light of its current high stakes character, proposed widening of its subject coverage cannot embrace some important aspects of the social and aesthetic world. Verdicts on the latter often have holistic features, and there are dangers that such verdicts involve attempts to compare what cannot (...) be compared. Judgments about the normative and the social often feature a legitimate lack of consistency. (shrink)

This case study explored how a teacher, Mr. Smith, and his students experienced a mandated performance assessment while simultaneously preparing for an end of the year high-stakes, multiple-choice assessment. We employed qualitative research methods to examine how the teacher enacted a mandated performance assessment during a unit on Byzantium and how students described their learning and classroom experiences from the unit. Drawing on Grant's idea of ambitious teaching and learning of history and Ball's work on policy realization, analysis (...) of these data indicated that Mr. Smith interpreted and enacted a performance assessment in ways that differed from how district and state policy makers intended. Despite an assessment that the district designed to promote historical thinking skills, students learned primarily factual knowledge. (shrink)

This paper explores some general considerations bearing on the question of whether virtue can be measured. What is moral virtue? What are measurement and evaluation, and what do they presuppose about the nature of what is measured or evaluated? What are the prospective contexts of, and purposes for, measuring or evaluating virtue, and how would these shape the legitimacy, methods, and likely success of measurement and evaluation? We contrast the realist presuppositions of virtue and measurement of virtue with the behavioral (...) operationalism of a common conception of measurement in psychometrics. We suggest a realist and non-reductive conceptualization of the measurability of virtue. We then discuss three possible educational contexts in which the measurement of virtue might be pursued: high-stakes testing and accountability schemes, the evaluation of programs in character education, and routine student evaluation. We argue that high-stakes testing of virtue would be ill-advised and counterproductive. We make some suggestions for how program evaluation in character education might proceed, and offer some examples of evaluation of student virtue-related learning. We conclude that virtue acquisition might be measured in a population of students accurately enough for program evaluation, while also arguing that student and program evaluation do not require comprehensive evaluations of how virtuous individual students are. Routine student evaluation will typically focus on specific aspects of virtue acquisition, and program evaluations can measure the aggregate progress of virtue acquisition in all its aspects while evaluating only limited aspects of the learning of individual students. (shrink)

This article explores the extent to which multiple-choice history/social studies exams measure student knowledge of social studies content. This article presents descriptive statistics that quantify the findings from a qualitative study. Data for this study were collected from 13 tenth-grade world history students in an urban classroom in New York State. Each participant answered 15 multiple-choice questions that had appeared on previous versions of the Global History and Geography Regents exam, the high-stakes exam they would have to take (...) at the end of the school year. As a small-scale exploratory study, the findings are not what quantitative researchers would call generalizable. Nevertheless, the findings raise questions about what tests measure, their effectiveness, and what constitutes social-studies knowledge. (shrink)

In the context of a global pandemic that started in 2020, the Chilean higher education institution Universidad Andrés Bello faced the challenge of giving continuity to its already established blended program for English courses while also starting the implementation of a high-stakes certification assessment for its students using the Test of English for International Communication Bridge. This study sought to evaluate how much of a mediating factor online teaching presence could be in the context of test preparation within (...) a language course in aspects related to autonomous learning and perceived learning outcomes. A mixed-methods approach was used. It included a survey applied to 1,642 eligible students of the English program. These quantitative data were complemented with students’ comments and teacher interviews. After triangulating quantitative and qualitative data, teaching presence was clearly perceived to be a relevant aspect of the online experience in the studied courses. However, both students’ and teachers’ voices evidenced pervasive challenges and tensions that hinder the potentially transformative benefits that online learning is expected to bring about. (shrink)

We offer a case-study in irrationality, showing that even in a high stakes context, intelligent and well trained professionals may adopt dominated practices. In multiple-choice tests one cannot distinguish lucky guesses from answers based on knowledge. Test-makers have dealt with this problem by lowering the incentive to guess, through penalizing errors (called formula scoring), and by eliminating various cues for outperforming random guessing (e.g., a preponderance of correct answers in middle positions), through key balancing. These policies, though widespread (...) and intuitively appealing, are in fact ‘‘irrational’’, and are dominated by alternative solutions. Number-right scoring is superior to formula scoring, and key randomization is superior to key balancing. We suggest that these policies have persisted since all stake-holders – test-makers, test-takers and test-coaches – share the same faulty intuitions. (shrink)

Coping with assessment tests are known to generate anxiety frequently in the students who face them. In academic circumstances with the continued presence of emotional disturbance, high demand, and stress, emotional and physical fatigue, typical of burnout syndrome, and can be detected. Anxiety and burnout are related to each other and even more closely in high-stakes tests. One of these tests is the examination imposed in Spain for access to the university. The objective of this work is (...) to analyze the presence of anxiety and burnout and the relationship between them in students who face these tests, both during the confinement situation due to the COVID-19 pandemic and during the pandemic after the lockdown. For this purpose, we used a sample of 1,021 students with a mean age of 17.89. Of these, 866 were students who were taking the test, while the rest were university students who had passed it recently. Our results show high levels of anxiety and burnout in students who face the evaluation test during the COVID-19 pandemic, sustained over time and especially in comparison with students who had already taken the exam. The association between higher levels of anxiety and higher levels of burnout in the students who take these exams was also verified. These results link the relationship between these two variables more solidly and suggest the need to include address anxiety to reduce burnout levels in these students. The results are discussed with regard to prior evidence and their applications. (shrink)

Routine testing is a practice whereby medical professionals ask all patients whether they would like an HIV test, regardless of whether there is anything unique to a given patient that suggests the presence of HIV. In three respects I aim to offer a fresh perspective on the debate about whether a developing country with a high rate of HIV infection morally ought to adopt routine testing. First, I present a neat framework that organises the moral issues at (...) stake, bringing out the basic principles involved and exhibiting their logical relationships. Second, appealing to the Kantian principle of respect for the dignity of persons, I offer a thorough justification for routine testing when it serves as a gateway to anti-retroviral treatment (ART). Third, I present a respect-based defence of the controversial and novel thesis that routine testing is morally justified even if ART is unaffordable or otherwise unavailable. (shrink)

This paper explores Dewey's landmark book Democracy and Education1 and the insights it holds for 21st-century education. Regarding the term "21st-century education," Alfie Kohn aptly notes that "we can take whatever objectives of teaching strategies we happen to favor and, merely by attaching a label that designates a future time period, endow them and ourselves with an aura of novelty and significance."2 The intention of this paper is to re-appropriate this term from two groups that tend to employ it. The (...) first of these is the standardization movement, which includes proponents of high-stakes testing and the concomitant narrowing of curricula. The second group is advocates for digital ubiquity in K–12 classrooms... (shrink)

While some argue that the only way to make a place for Philosophy for Children in today's strict, standardised classroom is to measure its efficacy in promoting reasoning, we believe that this must be avoided in order to safeguard what is truly unique in P4C dialogue. When P4C acquiesces to the very same quantitative measures that define the rest of learning, then the philosophical dimension drops out and P4C becomes yet another progressive curriculum and pedagogy for enhancing argumentation skills that (...) can easily be appropriated by any content area. What we want to offer in this article is a reevaluation of P4C that remains faithful to a radical kernel that we find when we do philosophy with children and young adults. To theorise the potential for P4C, we draw heavily on Agamben's work, and in particular his reflections on speech and infancy. We propose that the redemption of P4C necessitates a shift from a community of inquiry to a community of infancy. Such a community is not a community that operates according to predefined rules or standardised assessment protocols but rather is an inoperative community that is defined by letting ends idle. On our account, a community of infancy is an example of dialogic studious play that is neither ritual nor just play, thus avoiding the extreme polarities of the ritualised classrooms of high-stakes testing and the ‘ludic’ postmodern classroom of free play. What is at stake here is to preserve the last vestige of freedom within the school. (shrink)

German education plays a huge role in the development of education sciences and modern universities internationally. It is influenced by the educational concept of _Bildung_, which defines Germany ‘s theoretical and curricular ventures. This concept is famously untranslatable into other languages and is often misinterpreted as education, instruction, training, upbringing and other terms which don’t encompass its cultural ambitions. Despite this hurdle, _Bildung_ is now being recognized in current discussions of education issues such as standardization, teaching to the test, evidence-based (...) policy and high stakes testing. This volume clears up the confusion and misunderstandings surrounding _Bildung_ by examining the origins of the concept and how it has been applied throughout history. It paves the way for educators to fully understand and benefit from this model and all it has to offer. (shrink)

In the current climate of high-stakes testing and performance-based accountability measures, there is a pressing need to reconsider the nature of teaching and what capacities one must develop to be a good teacher. Educational policy experts around the world have pointed out that policies focused disproportionately on student test outcomes can promote teaching practices that are reified and mechanical, and which lead to students developing mere memorisation skills, rather than critical thinking and conceptual understanding. Philosophers of dialogue (...) and dialogic teaching offer a different view of teaching, one that counters mechanical, transmissive or ‘monologic’ teaching. In this paper, I seek to extend the notion of dialogic teaching as a method of supporting social and moral learning processes. Specifically, my focus is on answering the question: What capacities must a teacher have to engage students dialogically? Drawing on Paulo Freire and other contemporary philosophers, I examine dialogic interaction as involving a way of ‘being with learners’ and put forth three teacher capacities necessary for dialogic teaching: self-critique, narrativity and building community. I then examine further what is concretely entailed in the practice of dialogic teaching using research in educational psychology. I aim to highlight how dialogic teaching, unlike monologic teaching, involves the teacher's active ability to support learners’ identification and exploration of their own blind spots—that is, the limits of knowledge and ability—and those of others. Following this, I consider implications of my discussion for international policy on teacher assessment. I close the paper with considerations for future research on teacher capacity and teacher evaluation. This paper contributes to our understanding of teacher capacity and the nature and aims of good teaching. (shrink)

_The Opportunity Gap_ aims to shift attention from the current overwhelming emphasis on schools in discussions of the achievement gap to more fundamental questions about social and educational opportunity. The achievement gap looms large in the current era of high-stakes testing and accountability. Yet questions persist: Has the accountability movement—and attendant discussions on the achievement gap—focused attention on the true sources of educational failure in American schools? Do we need to look beyond classrooms and schools for credible (...) accounts of disparities in educational outcomes? The essays in this book reintroduce the overlooked central issue in educational inequity: the lack of opportunity that many social groups face in our common quest for educational attainment. In a series of wide-ranging and carefully nuanced essays, _The Opportunity Gap_ casts much-needed light on the vexed relationship between society and education—and on the crucial, persistent role that education plays in addressing social ills. Contributors include Gilberto Q. Conchas, Raewyn Connell, Pat English-Sand, Linda May Fitzgerald, Patresa Hartman, Jeff Howard, Mieko Kamii, Rafa M. Kasim, Christopher Kliewer, Robert A. LeVine, Sarah E. LeVine, Jodi Meyer-Mork, Robert Parris Moses, Sonia Nieto, Donna Raschke, Stephen W. Raudenbush, Ray C. Rist, Beatrice Schnell-Anzola, Irene Serna, Susan McAllister Swap, and Amy Stuart Wells; with an afterword by Ronald F. Ferguson. (shrink)

According to Stereotype Threat Hypothesis, fear of confirming gendered stereotypes causes women to experience anxiety in circumstances wherein their performance might potentially confirm those stereotypes, such as high-stakes testing scenarios in science, technology, engineering, and math courses. This anxiety causes women to underperform, which in turn causes them to withdraw from math-intensive disciplines. STH is thought by many to account for the underrepresentation of women in STEM fields, and a growing body of evidence substantiates this hypothesis. In (...) considering the plausibility of STH as an explanation for women's disproportionate attrition from undergraduate philosophy programs, one is struck by dissimilarities between STEM and philosophy that appear to undermine the applicability of STH to the latter. In this paper, I argue that these dissimilarities are either merely apparent or merely apparently relevant to the plausibility of STH as an explanation for gender disparities in philosophy. I argue further that, if research from STEM uncovers promising strategies for confronting stereotype threat, we should think about how to apply those strategies in our introductory philosophy classrooms. (shrink)

Within the overarching framework of considering the purpose of education, this book addresses issues such as the standards movement, high-stakes testing and accountability, and corporate education reform. It raises ethical questions related to school practices and considers the question of who should decide the purpose of education.

Only half of our nation's minority students graduate from high school along with their peers. For many groups—Latino, black, or Native American males—graduation rates are even lower. As states hasten to institute higher standards and high-stakes tests in the effort to raise student achievement, this situation is likely to worsen, particularly among minority students. Yet this educational and civil rights crisis remains largely hidden from public view. The dropout problem is far worse than statistics indicate. Many states (...) and districts simply do not count those students who fail to receive diplomas as dropouts. Even the hardest-hit urban districts report dropout rates of only 5-10 percent. In _Dropouts in America_, The Civil Rights Project reveals the scope of this hidden crisis, reviewing the most recent and accurate data on graduation and dropout rates, exploring the reasons that young people drop out of school, and presenting the most promising models for helping high school students graduate with their peers._ Dropouts in America_ is a call to action for educators, advocates, and policymakers alike, and an invaluable resource for those concerned with equal rights and the quality of American education. (shrink)

Internationally, over the last 20-30 years, changing the procedures and processes of assessment has come to be seen, by many educators as well as policy-makers, as a way to frame the curriculum and drive the reform of schooling. Such developments have often been manifested in large scale, high stakes testing programmes. At the same time educational arguments have been made about the need to provide students with good quality formative feedback, and informative reports about what they have (...) achieved. The chimera of a perfectly integrated and functioning curriculum and assessment system has been pursued, but such ambition far outstretches systemic capacity; it is neither feasible nor desirable. The national testing and examination system in England is an exemplar case. As national results have improved, much evidence suggests that, if anything, actual standards of achievement are falling, and grade inflation is undermining public confidence in the whole system. The paper will review these issues and tensions, and argue that a different model for developing curriculum and assessment is urgently needed. (shrink)

Today, art and education have precarious statuses. Arts programs are being cut from the curriculum at an alarming rate. While the No Child Left Behind Act of 2001 acknowledged the arts as a core academic subject, the arts were quickly eclipsed by the push toward quantifiable improvements on standardized tests. How should art educators respond to this urgent situation? While some might retreat back to an art-for-art’s-sake perspective, others find new justifications for the arts through the discourses of high- (...) class='Hi'>stakes testing that have put the arts at risk in the first place. In this second approach, the arts have utility in that they raise test scores.In this essay, I will chart another option, one that does not make... (shrink)

The outcomes of educational assessments undoubtedly have real implications for students, teachers, schools and education in the widest sense. Assessment results are, for example, used to award qualifications that determine future educational or vocational pathways of students. The results obtained by students in assessments are also used to gauge individual teacher quality, to hold schools to account for the standards achieved by their students, and to compare international education systems. Given the current high-stakes nature of educational assessment, it (...) is imperative that the measurement practices involved have stable philosophical foundations. However, this article casts doubt on the theoretical underpinnings of contemporary educational measurement models. Aspects of Wittgenstein’s later philosophy and Bohr’s philosophy of quantum theory are used to argue that a quantum theoretical rather than a Newtonian model is appropriate for educational measurement, and the associated implications for the concept of validity are elucidated. Whilst it is acknowledged that the transition to a quantum theoretical framework would not lead to the demise of educational assessment, it is argued that, where practical, current high-stakes assessments should be reformed to become as ‘low-stakes’ as possible. This article also undermines some of the pro high-stakes testing rhetoric that has a tendency to afflict education. (shrink)

Distributed cognition, as it considers how technologies augment cognition, informs technology integration in education. Most educational technologists interested in distributed cognition embrace a representational theory of mind. As this theory assumes cognition occurs in the brain and depends on the internal representation of external information, it is informed by a mind/body dualism that separates the individual student from material things. Alternatively, the theory of the extended mind describes the mind as a dynamic system of interactions inclusive of human agents, technologies (...) and other material things. Refusing the mind/body dualism, if one element is removed, the quality of cognitive activity declines. Across the cognitive sciences, there are debates between these representational and extended theories that have implications for what it means to be a student and for technology integration. However, distributed cognition research in educational technology ignores these debates. Instead, this research is conditioned by the discursive practices of a neoliberal assemblage of political, commercial and pedagogical institutions. In this era of high stakes testing, as the individual student is measured, evaluated and otherwise made subject through these practices, this assemblage expresses a tacit commitment to, and is productive of, the subjectivity of the individual student and thus benefits from the representational theory of mind. In this way, regardless of the recognized legitimacy of the theory of the extended mind, sustained by neoliberalism the field of educational technology will not soon question the veracity of the representational theory of mind or the mind/body dualism upon which it depends. (shrink)

In this dialogue, Sir Isaac Newton and the Priestess Diotima of Mantinea engage current debates in the politics of education and their conceptual underpinnings. Diotima challenges the assumption that the acquisition of educational content or skills should dominate our concept of learning. She develops an alternative conception of education as fundamentally moral, interpersonal, and emotional, and thus prone to destruction in the face of the objectifying forces of high-stakes testing and a reductive audit culture. Lord Newton is (...) skeptical of this conception, and of its pedagogical, rhetorical, and political implications. (shrink)

To measure non-cognitive facets of competence, we developed and tested a new method that we refer to as Embedded Experience Sampling (EES). Domain-specific problem-solving competence is a multi-faceted construct that is not limited to cognitive facets such as domain knowledge or problem-solving strategies but also comprises non-cognitive facets in the sense of domain-specific emotional and motivational dispositions such as interest and self-concept. However, in empirical studies non-cognitive facets are usually either neglected or measured by generalized self-report questionnaires that are detached (...) from the performance assessment. To enable an integrated measurement, we developed the EES method to collect data on non-cognitive facets during scenario-based low-stakes assessments. Test-takers are requested to stop at certain times and spontaneously answer short items (EES items) regarding their actual experience of the problem situation. These EES items are embedded in an EES event that resembles typical social interactions with non-player characters. To evaluate the feasibility and validity of the method, we implemented EES in a series of three studies in the context of commercial vocational education and training (VET): A feasibility study with 77 trainees, a pilot study with 20 trainees, and the main study with 780 trainees who worked on three complex problem scenarios in a computer-based office simulation. In the present paper, we investigate how test-takers perceived the EES events, and whether social desirability biased their answers, and investigate the internal structure of the data and the relationship between EES data and data from several other sources. Interview data and survey data indicated no biases due to social desirability and no additional burden for the test-takers due to the EES events. A correlation analysis following the multitrait-multimethod approach as well as the calibration of a multidimensional model based on Item Response Theory (IRT) also supported the construct validity. Furthermore, EES data shows substantial correlations with test motivation but almost zero correlations with data from generalized retrospective self-report questionnaires on non-cognitive facets. Altogether, EES offers an alternative approach to measuring non-cognitive facets of competence under certain conditions. For instance, EES is also based on self-reporting and thus might not be suitable for high-stakes testing. (shrink)