From the mid 1990s, the OECD started the planning of the Program for International Student Assessment, now well known as PISA. 1 The first PISA testing took place early in 2000, and the results were published in December 2001. Since then, PISA results have gradually become a kind of global “gold standard” for educational quality, and educational policy has been globalized, lifted out of the domestic policy, as proudly stated by the PISA director, Andreas Schleicher in (...) the TED-talk quoted below. The presentation is transcribed in 29 languages and has been seen by some 758 thousand viewers. (shrink)

This chapter contains sections titled: ANT and the ‘PISA Laboratory’ PISA: An Overview Background to the Study Making PISA Knowledge From ‘World’ to ‘Word’ Engaging in a ‘Politics of Fact’ Notes References.

Neoliberal educational reforms include extensive use of standardized tests. We examine the Program for International Student Assessment (PISA) initiated and developed by the Organization for Economic Cooperation and Development (OECD). Examining previous research on teachers’ reactions to neoliberal reforms altering their work context, we have identified three theoretical frameworks in use: labour process theory, derived from structural Marxism; post-structuralism, relying primarily on Foucault’s conceptualizations; and ‘new professionalism’, which has emerged from the theory of professions. A major weakness in (...) these frameworks is their inability to account for different reactions to the same structural and cultural conditions. Therefore, we suggest utilizing Archer’s theories of reflexivity and reflexive modes to understand these reactions. Presenting one Norwegian lower secondary school teacher’s reflexive engagement with PISA in the Norwegian school context as an example, our mixed methods case study indicates autonomous reflexivity as the prevailing mode. Meta-reflexivity rates second in prevalence. (shrink)

This article gives a critique of the methodology of OECD’s Programme for International Student Assessment (PISA). It is argued that PISA is invalidated by the fact that the methodology chosen does not constitute an adequate operationalisation of the question of inquiry. Therefore, contrary to the claims of PISA, PISA is not an assessment of the ‘knowledge and skills for life’ of students, but only of ‘knowledge and skills in assessment situations’. Even this latter form of assessment (...) is not fully reliable, however, because of problems at the level of concrete test items and because of an inherent confusion of relative and absolute evaluation. (shrink)

This article gives a critique of the methodology of OECD’s Programme for International Student Assessment (PISA). It is argued that PISA is invalidated by the fact that the methodology chosen does not constitute an adequate operationalisation of the question of inquiry. Therefore, contrary to the claims of PISA, PISA is not an assessment of the ‘knowledge and skills for life’ of students, but only of ‘knowledge and skills in assessment situations’. Even this latter form of assessment (...) is not fully reliable, however, because of problems at the level of concrete test items and because of an inherent confusion of relative and absolute evaluation. (shrink)

International large-scale assessments have gained much attention since the beginning of the twenty-first century, influencing education legislation in many countries. This includes Spain, where they have been used by successive governments to justify education policy change. Unfortunately, there was a problem with the PISA 2018 reading scores for this country, meaning the OECD refused to initially release the results. Therefore, in this paper we attempt to estimate the likely PISA 2018 reading scores for Spain, and for each region (...) within. The figure finally published by the OECD for Spain – in terms of reading scores – was 476.5 points, which is between the lower and upper bound of the interval we find (475 to 483 test points in 2018). Additionally, we report some robustness checks for the OCED countries participating in PISA 2018, which show that the difference between the actual scores and the ones we found with the imputation methods are quite close. (shrink)

This article discusses the PISA framework’s concept of reading. The main argument is that PISA’s cognitive approach to literacy only to a small extent captures the normative dimension of reading. Consequently, the test fails to reflect key aspects of literacy, such as identity, identity formation and the ability to participate in society on a deeper level. The argument is based on a normative or moral conception of meaning and reading comprehension, based on Hegel’s concept of recognition.

Log-file data from computer-based assessments can provide useful collateral information for estimating student abilities. In turn, this can improve traditional approaches that only consider response accuracy. Based on the amounts of time students spent on 10 mathematics items from the PISA 2012, this study evaluated the overall changes in and measurement precision of ability estimates and explored country-level heterogeneity when combining item responses and time-on-task measurements using a joint framework. Our findings suggest a notable increase in precision with the (...) incorporation of response times and indicate differences between countries in how respondents approached items as well as in their response processes. Results also showed that additional information could be captured through differences in the modeling structure when response times were included. However, such information may not reflect the testing objective. (shrink)

To explore the impact of academic burden on the physical and mental health of primary school students, combined with the results of the Programme for International Student Assessment report in 2018, the relationship among the development of mathematical literacy, mathematics academic burden, and the physical and mental health of primary school students is studied. First, the relationship between mathematical literacy and mathematics anxiety is analyzed, and related influencing factors and measurement methods of mathematics anxiety are introduced. A questionnaire is then (...) designed for primary school students’ mathematical stress, and the reliability and validity of the designed questionnaire are tested. Finally, a questionnaire survey is conducted on students, parents, and teachers in the third, fourth, and fifth grades of three standardized public primary schools. The results of the questionnaire survey show that students, teachers, and parents have a general understanding of the mathematics academic burden of primary school students at this stage. A total of 70% of teachers believe that primary school students have a heavy mathematics burden; 50% of parents think that primary school students are under heavy academic stress; 70% of primary school students believe that the heavy mathematics burden leads to reduced sleep time and extracurricular activities, which has a serious impact on the physical and mental health of primary school students. This research provides a reference for improving the current balance between education and students’ physical and mental health in China. (shrink)

This paper explores “the peopling of Europe through data practices” in relation to standardized testing of students in Denmark. Programme for International Student Assessment is a central component of Danish and European education infrastructures. In Denmark, mediocre PISA results spurred the introduction of national testing. With inspiration from Michel Foucault’s notion of biopolitics, this paper analyzes how complementary Danish national test assessment scales make up population objects and student subjects and how these scales are aligned with European and transnational (...) standards. A norm scale, standardized against the European Credit Transfer System grading scale, enacts a population whose performance can be tracked over time. A criteria scale introduces categories describing skills and enacts a moving student subject whose progression can be tracked. This paper argues that the three assessment scales enact the student population as bound to the nation and as simultaneously constituted in relation to transnational European categories and imaginaries of competition. As part of this, this paper discusses how the national test and PISA are used to single out students of non-European background, anticipated to be low PISA achievers and nonparticipants in a European knowledge economy. (shrink)

PISA claims that it can extend its reach from its current core subjects of Reading, Science, Maths and problem-solving. Yet given the requirement for high levels of reliability for PISA, especially in the light of its current high stakes character, proposed widening of its subject coverage cannot embrace some important aspects of the social and aesthetic world. Verdicts on the latter often have holistic features, and there are dangers that such verdicts involve attempts to compare what cannot be (...) compared. Judgments about the normative and the social often feature a legitimate lack of consistency. (shrink)

In the context of the new paradigms of the knowledge-based economy, education and the quality of the educational system is becoming one of the strongest factors of influence. Decisions regarding the financing of education have a particular impact on the level of expenditure in the pre-university system and on the organization of the system of study courses. Furthermore, they are closely linked to the economics and accounting of pre-university education institutions. The existence or lack of material resources can greatly influence (...) the teaching activity process and implicitly the results achieved by the system. This paper aims to examine the consequences of certain decisions regarding funding in education, student achievement in pre-university education using data on government spending in the world relative to a single student, the level of salaries in secondary education and the number of students per teacher and the student's test scores. The authors chose the quantitative research methodology using the multiple linear regression model with dependent and independent variables to test the extent to which certain parameters of the funding process can influence the results achieved by students in standardized tests. The research results show that decisions regarding the financing of education in terms of salaries and the level of funding based on the standard cost per student have a direct impact on the achievements of the students and also, on the scores achieved by students. (shrink)

Chinese students’ outstanding performance in several rounds of PISA tests has attracted extensive attention on Chinese teacher professional development practices and system. The school-based teachi...

A common approach for measuring the effectiveness of an education system or a school is the estimation of the impact that school interventions have on students’ academic performance. However, the latest trends aim to extend the focus beyond students’ acquisition of knowledge and skills, and to consider aspects such as well-being in the academic context. For this reason, the 2015 edition of the international assessment system PISA incorporated a new tool aimed at evaluating the socio-affective variables related to the (...) well-being of students. It is based on a definition focused on the five dimensions proposed in PISA theoretical framework: cognitive, psychological, social, physical and material. The main purpose of this study is to identify the well-being components that significantly affect student academic performance and to estimate the magnitude of school effects on the well-being of students in OECD countries, the school effect being understood as the ability of schools to increase subjective student well-being. To achieve this goal, we analyzed the responses of 234,000 students from thirty-five OECD countries to PISA 2015 questionnaires. Specifically, we considered non-cognitive variables in the questionnaires and student performance in science. The results indicated that the cognitive well-being dimension, composed of enjoyment of science, self-efficacy and instrumental motivation, as well as the test anxiety all had a consistent relationship with student performance across countries. In addition, the school effect, estimated through a two-level hierarchical linear model, in terms of student well-being was systematically low. While the school effect accounted for approximately 25% of the variance in the results for the cognitive dimension, only 5-9% of variance in well-being indicators was attributable to it. This suggests that the influence of school on student welfare is weak, and the effect is similar across countries. The present study contributes to the general discussion currently underway about the definition of well-being and the connection between well-being and achievement. The results highlighted two complementary concerns: there is a clear need to promote socio-emotional education in schools, and it is important to develop a rigorous framework for well-being assessment. The implications of the results and proposals for future studies are discussed. (shrink)

This paper discusses literacy as a socio-political phenomenon from the perspective of several relatively independent educational discourses. The first is critical education theory and research revealing the hidden mechanisms by which education policies act in the interests of a global market economy. The second is the perspective of critical pedagogy scholars on contemporary educational challenges, who offer responses similar to those discussed in current discourse on informal civic education. The third is the heated discussion of high-stakes literacy testing (related to (...) OECD literacy studies such as PISA, IALS, etc.) the results of which are used as a source of argumentation for diverse attitudes and educational consequences. Based on an analysis of literacy theory, research on active citizenship and civic education, the term “civic literacy” is proposed and argued as a relevant conceptual frame for conceptualizing school as an institution which can be involved in resistance to all forms of power politics or ideological indoctrination and manipulation, while at the same time, respecting the traditional values and aims of general education. (shrink)

In 1950, Alan Turing proposed his iconic imitation game, calling it a ‘test’, an ‘experiment’, and the ‘the only really satisfactory support’ for his view that machines can think. Following Turing’s rhetoric, the ‘Turing test’ has been widely received as a kind of crucial experiment to determine machine intelligence. In later sources, however, Turing showed a milder attitude towards what he called his ‘imitation tests’. In 1948, Turing referred to the persuasive power of ‘the actual production of machines’ rather (...) than that of a controlled experiment. Observing this, I propose to distinguish the logical structure from the rhetoric of Turing’s argument. I argue that Turing’s proposal of a crucial experiment may have been a concession to meet the standards of his interlocutors more than his own, while his construction of machine intelligence rather reveals a method of successive idealizations and exploratory experiments. I will draw a parallel with Galileo’s construction of idealized fall in a void and the historiographical controversies over the role of experiment in Galilean science. I suggest that Turing, like Galileo, relied on certain kinds of experiment, but also on rhetoric and propaganda to inspire further research that could lead to convincing scientific and technological progress. (shrink)

Resumen: Asociadamente a la complejización del sistema educacional, toman forma procedimientos que buscan su regulación y que, al mismo tiempo, van dando forma a las metas a lograr. En el caso de Chile, en los últimos 50 años se ha constituido un dispositivo de evaluación del sistema educacional de gran alcance, que incluye pruebas nacionales como el SIMCE y la PSU, el Sistema de Evaluación Docente, el Sistema de Acreditación Universitario, la evaluación de la productividad académica, pruebas internacionales como (...) class='Hi'>PISA y TIMSS, y la elaboración de rankings de instituciones educacionales. Este dispositivo es una tecnología clave de gubernamentalidad que posibilita regular la conducta de la población. En su constitución se entretejen conocimientos, teóricos y técnicos, provenientes de las ciencias sociales, con preocupaciones y estrategias que buscan el gobierno de la población. Se combinan ciencia social y poder. El dispositivo constituye una tecnología político moral con poderosos efectos performativos que dan forma a lo que asumimos, para todos los efectos prácticos, como la calidad educacional de las diferentes entidades del sistema -estudiantes, escuelas, programas, profesores, universidades, etc.- y que las valoriza en términos de tal calidad. El texto busca articular conceptualmente las operaciones de este dispositivo y sus derivaciones.: Associated with the increasing complexity of the educational system, procedures that seek its regulation take form and, at the same time, shape the goals to be achieved. In the case of Chile, in the last 50 years, a powerful evaluation device for the educational system has been established, which includes national tests such as SIMCE and PSU, the Teacher Evaluation System, the System of University Accreditation, the evaluation of the academic productivity, international tests such as PISA and TIMSS, and the elaboration of rankings of educational institutions. This device is a key technology of governmentality that makes possible to regulate the behavior of the population. In its constitution are interwoven theoretical and technical knowledge from the social sciences and concerns and strategies for the government of the population. Social science and power are combined. The device constitutes a moral and political technology with powerful performative effects that shape what we assume, for all practical purposes, as the educational quality of the different entities of the system -students, schools, programs, professors, universities, etc.-, which are valued in terms of such quality. The paper seeks to articulate theoretically the operations of this device and its derivations. (shrink)

This study examines the Programme for International Student Assessment, one of the most influential tools of global education reform discourses in the 21st century. The study focuses on the governing role of statistical data in the discourse constructed by the international comparative assessment, referring to the global educational governance of the OECD. Disturbingly, the systematic collection and distribution of data does not merely quantify student achievement. Rather, students and participating countries are also qualified and classified. Here, OECD’s PISA statistics (...) act as a governing technology enabling the comparisons; through PISA’s statistics, the OECD has largely fostered the test-driven education reform trends worldwide. In this study, statistical data are examined as political instruments visualizing intangible concepts, constructing definitions of good practice and improvement, and fabricating the individuals whose knowledge and skills are normalized. In conclusion, it is necessary to rethink the new sociopolitical instrument – PISA’s statistics – not as a master rationale to reform the educational system of each country, but as a mere reference point based on the system’s distinctiveness. (shrink)

Multiple goals balancing is an important but not yet fully validated dimension of complex problem solving (CPS). The present study used process data to explore how solvers clarify goals, set priorities, and balance conflicting goals. We extracted behavioral indicators of goal pursuit from the log data of 3,201 students on the third subtask of the “Ticket” task in the PISA 2012 CPS test. Cluster analysis was used to identify 10 groups that varied in goal pursuit behavior. Logistics and least-squares (...) regression analysis were used to explore how goal pursuit affected task scores and CPS proficiency. The results showed that competent solvers clarified goals and weighed priorities more effectively. They also made trade-offs between conflicting goals. The importance of theoretically-driven log data analysis and coping strategies in the face of multiple goals conflict scenarios was discussed. (shrink)

This article problematizes the way of thinking schooling in discourse of sign system, which involves opposition, and double gesture of inclusion/exclusion. Drawing on two fundamental texts of Taoism, the Tao Te Ching and Chuang Tzu, this article puts forward the seemingly passive Non-Word and Non-Self to resist the hierarchy ordering of conceptions and man, and to undo duality of binary opposition. It links the history of assessment and PISA to the rethinking of evidence and sign in contemporary movements. The (...) second section proposes teaching as wandering (you, 游), the transcendence into Non-Self with response to men’s natural inquiry, but not artificially manipulating and shaping man by privileging certain knowledge, value, and thoughts over other. Instead of making categories of race, gender, and normal/abnormal, Taoist provides a way of reconsider the self operating on assessing, standardizing, normalizing, correcting and predicting others in school accountability. It is built on the ontology of considering individual as belonging to an ultimate sameness, the oneness. The article concludes with underlying assumption that students are subjected to change, and their difference must be eliminated through standard test. It further questions tactics of reason that educational reform face in the current regime of school accountability. (shrink)

Objective Apeiron was founded in 1966 and has developed into one of the oldest and most distinguished journals dedicated to the study of ancient philosophy, ancient science, and, in particular, of problems that concern both fields. Apeiron is committed to publishing high-quality research papers in these areas of ancient Greco-Roman intellectual history; it also welcomes submission of articles dealing with the reception of ancient philosophical and scientific ideas in the later western tradition. The journal appears quarterly. Articles are peer-reviewed on (...) a double-blind basis. Topics ancient philosophy ancient science reception of ancient philosophical and scientific ideas in the later western tradition Article formats Original Articles. (shrink)

This study examined potential sources of grammatical gender variability in heritage speakers of Italian with a focus on morphological markedness. Fifty-four adult Italian HSs living in Germany and 40 homeland Italian speakers completed an online Self-Paced Reading Task and an offline Grammaticality Judgment Task. Both tasks involved sentences with grammatical and ungrammatical noun-adjective agreement, manipulating markedness. In grammatical sentences, both groups showed a markedness effect: shorter reading times and higher accuracy for sentences containing masculine nouns as compared to sentences with (...) feminine nouns. In ungrammatical sentences, although both groups were sensitive to ungrammaticality, only HSs showed a markedness effect, that is, they had significantly longer RTs and higher accuracy when violations were realized on feminine adjectives. Proficiency in the HL was a significant predictor of accuracy and RTs at the individual level. Taken together, results indicate that HSs acquire and process gender in a qualitatively similar way to homeland native speakers. However, RT evidence seems to suggest that at least under particular experimental methods, markedness considerations are more prevalent for HSs resulting in a speed-accuracy tradeoff. (shrink)

Philologus, founded in 1846, is one of the oldest and most respected periodicals in the field of Classics. It publishes articles on Greek and Latin literature, historiography, philosophy, history of religion, linguistics, reception, and the history of scholarship. The journal aims to contribute to our understanding of Greco-Roman culture and its lasting influence on European civilization. The journal Philologus, conceived as a forum for discussion among different methodological approaches to the study of ancient texts and their reception, publishes original scholarly (...) contributions with a strong international focus. Publications languages are: German, English, Italian, French. As of 2014 the publication of supplementary volumes will be resumed. The series Philologus. Supplemente / Philologus. Supplementary Volumes will publish monographs and edited volumes pertaining to all aspects of the study of ancient literature and its reception, with a special focus on topics concerning literary theory, philosophy and the history of scholarship from an interdisciplinary perspective. (shrink)

O presente artigo analisa as concepções desenvolvidas por Peter Singer e Onora O’Neill sobre o alívio da pobreza. Para atingir esse objetivo, são apresentadas possíveis formas de entender a pobreza, seguidas de uma comparação das visões dos autores. As proposições de Singer são examinadas à luz do utilitarismo de preferências, visando compreender o desenvolvimento da teoria do autor até a elaboração do altruísmo eficaz. A revisão da teoria de O’Neill, por sua vez, é feita a partir da ética kantiana, tradição (...) na qual a autora se filia, e a partir de sua proposição sobre necessidade do estabelecimento de deveres para o alívio da pobreza. Nas considerações finais, o artigo faz uma comparação crítica entre as duas concepções examinadas. (shrink)

This paper looks at the question of what it means for a psychological test to have construct validity. I approach this topic by way of an analysis of recent debates about the measurement of implicit social cognition. After showing that there is little theoretical agreement about implicit social cognition, and that the predictive validity of implicit tests appears to be low, I turn to a debate about their construct validity. I show that there are two questions at stake: First, (...) what level of detail and precision does a construct have to possess such that a test can in principle be valid relative to it? And second, what kind of evidence needs to be in place such that a test can be regarded as validated relative to a given construct? I argue that construct validity is not an all-or-nothing affair. It can come in degrees, because both our constructs and our knowledge of the explanatory relation between constructs and data can vary in accuracy and level of detail, and a test can fail to measure all of the features associated with a construct. I conclude by arguing in favor of greater philosophical attention to processes of construct development. (shrink)

While many philosophers of science have accorded special evidential significance to tests whose results are "novel facts", there continues to be disagreement over both the definition of novelty and why it should matter. The view of novelty favored by Giere, Lakatos, Worrall and many others is that of use-novelty: An accordance between evidence e and hypothesis h provides a genuine test of h only if e is not used in h's construction. I argue that what lies behind the intuition (...) that novelty matters is the deeper intuition that severe tests matter. I set out a criterion of severity akin to the notion of a test's power in Neyman-Pearson statistics. I argue that tests which are use-novel may fail to be severe, and tests that are severe may fail to be use-novel. I discuss the 1919 eclipse data as a severe test of Einstein's law of gravity. (shrink)

Your use of the JSTOR archive indicates your acceptance of J STOR’s Terms and Conditions of Use, available at http://www.jstor.org/about/terms.html. J STOR’s Terms and Conditions of Use provides, in part, that unless you have obtained prior permission, you may not download an entire issue of a journal or multiple copies of articles, and you may use content in the JSTOR archive only for your personal, non—commercial use.

As AI technologies are increasingly deployed in work, welfare, healthcare, and other domains, there is a growing realization not only of their power but of their problems. AI has the capacity to reinforce historical injustice, to amplify labor precarity, and to cement forms of racial and gendered inequality. An alternate set of values, paradigms, and priorities are urgently needed. How might we design and evaluate AI from an indigenous perspective? This article draws upon the five Tests developed by Māori (...) scholar Sir Hirini Moko Mead. This framework, informed by Māori knowledge and concepts, provides a method for assessing contentious issues and developing a Māori position. This paper takes up these tests, considers how each test might be applied to data-driven systems, and provides a number of concrete examples. This intervention challenges the priorities that currently underpin contemporary AI technologies but also offers a rubric for designing and evaluating AI according to an indigenous knowledge system. (shrink)

Research risks have to meet minimal risk requirements in order for the research to qualify for expedited ethics review, to be exempted from ethics review, or to be granted consent waivers. The definition of “minimal risk” in the Common Rule (45 CFR 46) relies on the risks-of-daily-life and risks-of-routine-tests as comparators against which research activities are assessed to meet minimal risk requirements. While either or both comparators have been adopted by major ethics codes, they have also been criticized. In (...) response to criticisms, elaborations, and alternative comparators have been proposed. In this paper, I approach the search for workable comparators from the point of view that ethical reasoning about minimal risk involves analogical reasoning using comparators. In this regard, I develop two necessary conditions for an adequate minimal risk conception, which I use to assess three comparators. I conclude that the risks-of-routine-tests best fits the analogical reasoning operating in minimal risk assessments. (shrink)

Considerable methodological difficulties abound in neuroimaging, and several philosophers of science have recently called into question the potential of neuroimaging studies to contribute to our knowledge of human cognition. These skeptical accounts suggest that functional hypotheses are underdetermined by neuroimaging data. I apply Mayo’s error-statistical account to clarify the evidential import of neuroimaging data and the kinds of inferences it can reliably support. Thus, we can answer the question “What can we reliably learn from neuroimaging?” and make sense of how (...) this knowledge can contribute to novel construals of cognition. (shrink)

In recent years, many philosophers have argued that it is inherently illiberal to make citizenship for migrants conditional on a test. On these arguments, liberalism itself demands either that no test be administered, or that the test be so easy as to serve merely a symbolic function. In this paper, I make two claims in response to these ideas. The first is that a citizenship test - even a difficult one - is not inherently illiberal, when what is tested for (...) reflects the actual backdrop of knowledge and history required for responsible participation in political discourse. The second is that we have reason to be suspicious of any existing citizenship test, but for reasons of prudence, rather than liberal principle. Existing political elites can be relied upon to make citizenship tests reflect not what is actually required for political agency, but what those elites would like to see reinforced and rein scribed as part of the national identity. Thus, we are right to be wary of citizenship tests - not because liberalism condemns them, but because of predictable moral failures on the part of those charged with writing such tests. (shrink)

My goal in this piece is to show that there is a problem lurking in the shadows of recent attempts to derive positive duties from Kant’s so-called universalizability tests and, further, to show that the most obvious way of fixing these attempts renders them unable to fulfill their function. I shall begin by motivating and explaining such an attempt.