From the mid 1990s, the OECD started the planning of the Program for International Student Assessment, now well known as PISA. 1 The first PISA testing took place early in 2000, and the results were published in December 2001. Since then, PISA results have gradually become a kind of global “gold standard” for educational quality, and educational policy has been globalized, lifted out of the domestic policy, as proudly stated by the PISA director, Andreas Schleicher in (...) the TED-talk quoted below. The presentation is transcribed in 29 languages and has been seen by some 758 thousand viewers. (shrink)

This article gives a critique of the methodology of OECD’s Programme for International Student Assessment (PISA). It is argued that PISA is invalidated by the fact that the methodology chosen does not constitute an adequate operationalisation of the question of inquiry. Therefore, contrary to the claims of PISA, PISA is not an assessment of the ‘knowledge and skills for life’ of students, but only of ‘knowledge and skills in assessment situations’. Even this latter form of assessment (...) is not fully reliable, however, because of problems at the level of concrete test items and because of an inherent confusion of relative and absolute evaluation. (shrink)

This article gives a critique of the methodology of OECD’s Programme for International Student Assessment (PISA). It is argued that PISA is invalidated by the fact that the methodology chosen does not constitute an adequate operationalisation of the question of inquiry. Therefore, contrary to the claims of PISA, PISA is not an assessment of the ‘knowledge and skills for life’ of students, but only of ‘knowledge and skills in assessment situations’. Even this latter form of assessment (...) is not fully reliable, however, because of problems at the level of concrete test items and because of an inherent confusion of relative and absolute evaluation. (shrink)

This chapter contains sections titled: ANT and the ‘PISA Laboratory’ PISA: An Overview Background to the Study Making PISA Knowledge From ‘World’ to ‘Word’ Engaging in a ‘Politics of Fact’ Notes References.

Neoliberal educational reforms include extensive use of standardized tests. We examine the Program for International Student Assessment (PISA) initiated and developed by the Organization for Economic Cooperation and Development (OECD). Examining previous research on teachers’ reactions to neoliberal reforms altering their work context, we have identified three theoretical frameworks in use: labour process theory, derived from structural Marxism; post-structuralism, relying primarily on Foucault’s conceptualizations; and ‘new professionalism’, which has emerged from the theory of professions. A major weakness in (...) these frameworks is their inability to account for different reactions to the same structural and cultural conditions. Therefore, we suggest utilizing Archer’s theories of reflexivity and reflexive modes to understand these reactions. Presenting one Norwegian lower secondary school teacher’s reflexive engagement with PISA in the Norwegian school context as an example, our mixed methods case study indicates autonomous reflexivity as the prevailing mode. Meta-reflexivity rates second in prevalence. (shrink)

International large-scale assessments have gained much attention since the beginning of the twenty-first century, influencing education legislation in many countries. This includes Spain, where they have been used by successive governments to justify education policy change. Unfortunately, there was a problem with the PISA 2018 reading scores for this country, meaning the OECD refused to initially release the results. Therefore, in this paper we attempt to estimate the likely PISA 2018 reading scores for Spain, and for each region (...) within. The figure finally published by the OECD for Spain – in terms of reading scores – was 476.5 points, which is between the lower and upper bound of the interval we find (475 to 483 test points in 2018). Additionally, we report some robustness checks for the OCED countries participating in PISA 2018, which show that the difference between the actual scores and the ones we found with the imputation methods are quite close. (shrink)

To explore the impact of academic burden on the physical and mental health of primary school students, combined with the results of the Programme for International Student Assessment report in 2018, the relationship among the development of mathematical literacy, mathematics academic burden, and the physical and mental health of primary school students is studied. First, the relationship between mathematical literacy and mathematics anxiety is analyzed, and related influencing factors and measurement methods of mathematics anxiety are introduced. A questionnaire is then (...) designed for primary school students’ mathematical stress, and the reliability and validity of the designed questionnaire are tested. Finally, a questionnaire survey is conducted on students, parents, and teachers in the third, fourth, and fifth grades of three standardized public primary schools. The results of the questionnaire survey show that students, teachers, and parents have a general understanding of the mathematics academic burden of primary school students at this stage. A total of 70% of teachers believe that primary school students have a heavy mathematics burden; 50% of parents think that primary school students are under heavy academic stress; 70% of primary school students believe that the heavy mathematics burden leads to reduced sleep time and extracurricular activities, which has a serious impact on the physical and mental health of primary school students. This research provides a reference for improving the current balance between education and students’ physical and mental health in China. (shrink)

This article discusses the PISA framework’s concept of reading. The main argument is that PISA’s cognitive approach to literacy only to a small extent captures the normative dimension of reading. Consequently, the test fails to reflect key aspects of literacy, such as identity, identity formation and the ability to participate in society on a deeper level. The argument is based on a normative or moral conception of meaning and reading comprehension, based on Hegel’s concept of recognition.

Log-file data from computer-based assessments can provide useful collateral information for estimating student abilities. In turn, this can improve traditional approaches that only consider response accuracy. Based on the amounts of time students spent on 10 mathematics items from the PISA 2012, this study evaluated the overall changes in and measurement precision of ability estimates and explored country-level heterogeneity when combining item responses and time-on-task measurements using a joint framework. Our findings suggest a notable increase in precision with the (...) incorporation of response times and indicate differences between countries in how respondents approached items as well as in their response processes. Results also showed that additional information could be captured through differences in the modeling structure when response times were included. However, such information may not reflect the testing objective. (shrink)

Objective Apeiron was founded in 1966 and has developed into one of the oldest and most distinguished journals dedicated to the study of ancient philosophy, ancient science, and, in particular, of problems that concern both fields. Apeiron is committed to publishing high-quality research papers in these areas of ancient Greco-Roman intellectual history; it also welcomes submission of articles dealing with the reception of ancient philosophical and scientific ideas in the later western tradition. The journal appears quarterly. Articles are peer-reviewed on (...) a double-blind basis. Topics ancient philosophy ancient science reception of ancient philosophical and scientific ideas in the later western tradition Article formats Original Articles. (shrink)

This paper explores “the peopling of Europe through data practices” in relation to standardized testing of students in Denmark. Programme for International Student Assessment is a central component of Danish and European education infrastructures. In Denmark, mediocre PISA results spurred the introduction of national testing. With inspiration from Michel Foucault’s notion of biopolitics, this paper analyzes how complementary Danish national test assessment scales make up population objects and student subjects and how these scales are aligned with European and transnational (...) standards. A norm scale, standardized against the European Credit Transfer System grading scale, enacts a population whose performance can be tracked over time. A criteria scale introduces categories describing skills and enacts a moving student subject whose progression can be tracked. This paper argues that the three assessment scales enact the student population as bound to the nation and as simultaneously constituted in relation to transnational European categories and imaginaries of competition. As part of this, this paper discusses how the national test and PISA are used to single out students of non-European background, anticipated to be low PISA achievers and nonparticipants in a European knowledge economy. (shrink)

This study examined potential sources of grammatical gender variability in heritage speakers of Italian with a focus on morphological markedness. Fifty-four adult Italian HSs living in Germany and 40 homeland Italian speakers completed an online Self-Paced Reading Task and an offline Grammaticality Judgment Task. Both tasks involved sentences with grammatical and ungrammatical noun-adjective agreement, manipulating markedness. In grammatical sentences, both groups showed a markedness effect: shorter reading times and higher accuracy for sentences containing masculine nouns as compared to sentences with (...) feminine nouns. In ungrammatical sentences, although both groups were sensitive to ungrammaticality, only HSs showed a markedness effect, that is, they had significantly longer RTs and higher accuracy when violations were realized on feminine adjectives. Proficiency in the HL was a significant predictor of accuracy and RTs at the individual level. Taken together, results indicate that HSs acquire and process gender in a qualitatively similar way to homeland native speakers. However, RT evidence seems to suggest that at least under particular experimental methods, markedness considerations are more prevalent for HSs resulting in a speed-accuracy tradeoff. (shrink)

PISA claims that it can extend its reach from its current core subjects of Reading, Science, Maths and problem-solving. Yet given the requirement for high levels of reliability for PISA, especially in the light of its current high stakes character, proposed widening of its subject coverage cannot embrace some important aspects of the social and aesthetic world. Verdicts on the latter often have holistic features, and there are dangers that such verdicts involve attempts to compare what cannot be (...) compared. Judgments about the normative and the social often feature a legitimate lack of consistency. (shrink)

Philologus, founded in 1846, is one of the oldest and most respected periodicals in the field of Classics. It publishes articles on Greek and Latin literature, historiography, philosophy, history of religion, linguistics, reception, and the history of scholarship. The journal aims to contribute to our understanding of Greco-Roman culture and its lasting influence on European civilization. The journal Philologus, conceived as a forum for discussion among different methodological approaches to the study of ancient texts and their reception, publishes original scholarly (...) contributions with a strong international focus. Publications languages are: German, English, Italian, French. As of 2014 the publication of supplementary volumes will be resumed. The series Philologus. Supplemente / Philologus. Supplementary Volumes will publish monographs and edited volumes pertaining to all aspects of the study of ancient literature and its reception, with a special focus on topics concerning literary theory, philosophy and the history of scholarship from an interdisciplinary perspective. (shrink)

O presente artigo analisa as concepções desenvolvidas por Peter Singer e Onora O’Neill sobre o alívio da pobreza. Para atingir esse objetivo, são apresentadas possíveis formas de entender a pobreza, seguidas de uma comparação das visões dos autores. As proposições de Singer são examinadas à luz do utilitarismo de preferências, visando compreender o desenvolvimento da teoria do autor até a elaboração do altruísmo eficaz. A revisão da teoria de O’Neill, por sua vez, é feita a partir da ética kantiana, tradição (...) na qual a autora se filia, e a partir de sua proposição sobre necessidade do estabelecimento de deveres para o alívio da pobreza. Nas considerações finais, o artigo faz uma comparação crítica entre as duas concepções examinadas. (shrink)

In the context of the new paradigms of the knowledge-based economy, education and the quality of the educational system is becoming one of the strongest factors of influence. Decisions regarding the financing of education have a particular impact on the level of expenditure in the pre-university system and on the organization of the system of study courses. Furthermore, they are closely linked to the economics and accounting of pre-university education institutions. The existence or lack of material resources can greatly influence (...) the teaching activity process and implicitly the results achieved by the system. This paper aims to examine the consequences of certain decisions regarding funding in education, student achievement in pre-university education using data on government spending in the world relative to a single student, the level of salaries in secondary education and the number of students per teacher and the student's test scores. The authors chose the quantitative research methodology using the multiple linear regression model with dependent and independent variables to test the extent to which certain parameters of the funding process can influence the results achieved by students in standardized tests. The research results show that decisions regarding the financing of education in terms of salaries and the level of funding based on the standard cost per student have a direct impact on the achievements of the students and also, on the scores achieved by students. (shrink)

Chinese students’ outstanding performance in several rounds of PISA tests has attracted extensive attention on Chinese teacher professional development practices and system. The school-based teachi...

A common approach for measuring the effectiveness of an education system or a school is the estimation of the impact that school interventions have on students’ academic performance. However, the latest trends aim to extend the focus beyond students’ acquisition of knowledge and skills, and to consider aspects such as well-being in the academic context. For this reason, the 2015 edition of the international assessment system PISA incorporated a new tool aimed at evaluating the socio-affective variables related to the (...) well-being of students. It is based on a definition focused on the five dimensions proposed in PISA theoretical framework: cognitive, psychological, social, physical and material. The main purpose of this study is to identify the well-being components that significantly affect student academic performance and to estimate the magnitude of school effects on the well-being of students in OECD countries, the school effect being understood as the ability of schools to increase subjective student well-being. To achieve this goal, we analyzed the responses of 234,000 students from thirty-five OECD countries to PISA 2015 questionnaires. Specifically, we considered non-cognitive variables in the questionnaires and student performance in science. The results indicated that the cognitive well-being dimension, composed of enjoyment of science, self-efficacy and instrumental motivation, as well as the test anxiety all had a consistent relationship with student performance across countries. In addition, the school effect, estimated through a two-level hierarchical linear model, in terms of student well-being was systematically low. While the school effect accounted for approximately 25% of the variance in the results for the cognitive dimension, only 5-9% of variance in well-being indicators was attributable to it. This suggests that the influence of school on student welfare is weak, and the effect is similar across countries. The present study contributes to the general discussion currently underway about the definition of well-being and the connection between well-being and achievement. The results highlighted two complementary concerns: there is a clear need to promote socio-emotional education in schools, and it is important to develop a rigorous framework for well-being assessment. The implications of the results and proposals for future studies are discussed. (shrink)

This paper discusses literacy as a socio-political phenomenon from the perspective of several relatively independent educational discourses. The first is critical education theory and research revealing the hidden mechanisms by which education policies act in the interests of a global market economy. The second is the perspective of critical pedagogy scholars on contemporary educational challenges, who offer responses similar to those discussed in current discourse on informal civic education. The third is the heated discussion of high-stakes literacy testing (related to (...) OECD literacy studies such as PISA, IALS, etc.) the results of which are used as a source of argumentation for diverse attitudes and educational consequences. Based on an analysis of literacy theory, research on active citizenship and civic education, the term “civic literacy” is proposed and argued as a relevant conceptual frame for conceptualizing school as an institution which can be involved in resistance to all forms of power politics or ideological indoctrination and manipulation, while at the same time, respecting the traditional values and aims of general education. (shrink)

In 1950, Alan Turing proposed his iconic imitation game, calling it a ‘test’, an ‘experiment’, and the ‘the only really satisfactory support’ for his view that machines can think. Following Turing’s rhetoric, the ‘Turing test’ has been widely received as a kind of crucial experiment to determine machine intelligence. In later sources, however, Turing showed a milder attitude towards what he called his ‘imitation tests’. In 1948, Turing referred to the persuasive power of ‘the actual production of machines’ rather (...) than that of a controlled experiment. Observing this, I propose to distinguish the logical structure from the rhetoric of Turing’s argument. I argue that Turing’s proposal of a crucial experiment may have been a concession to meet the standards of his interlocutors more than his own, while his construction of machine intelligence rather reveals a method of successive idealizations and exploratory experiments. I will draw a parallel with Galileo’s construction of idealized fall in a void and the historiographical controversies over the role of experiment in Galilean science. I suggest that Turing, like Galileo, relied on certain kinds of experiment, but also on rhetoric and propaganda to inspire further research that could lead to convincing scientific and technological progress. (shrink)

Resumen: Asociadamente a la complejización del sistema educacional, toman forma procedimientos que buscan su regulación y que, al mismo tiempo, van dando forma a las metas a lograr. En el caso de Chile, en los últimos 50 años se ha constituido un dispositivo de evaluación del sistema educacional de gran alcance, que incluye pruebas nacionales como el SIMCE y la PSU, el Sistema de Evaluación Docente, el Sistema de Acreditación Universitario, la evaluación de la productividad académica, pruebas internacionales como (...) class='Hi'>PISA y TIMSS, y la elaboración de rankings de instituciones educacionales. Este dispositivo es una tecnología clave de gubernamentalidad que posibilita regular la conducta de la población. En su constitución se entretejen conocimientos, teóricos y técnicos, provenientes de las ciencias sociales, con preocupaciones y estrategias que buscan el gobierno de la población. Se combinan ciencia social y poder. El dispositivo constituye una tecnología político moral con poderosos efectos performativos que dan forma a lo que asumimos, para todos los efectos prácticos, como la calidad educacional de las diferentes entidades del sistema -estudiantes, escuelas, programas, profesores, universidades, etc.- y que las valoriza en términos de tal calidad. El texto busca articular conceptualmente las operaciones de este dispositivo y sus derivaciones.: Associated with the increasing complexity of the educational system, procedures that seek its regulation take form and, at the same time, shape the goals to be achieved. In the case of Chile, in the last 50 years, a powerful evaluation device for the educational system has been established, which includes national tests such as SIMCE and PSU, the Teacher Evaluation System, the System of University Accreditation, the evaluation of the academic productivity, international tests such as PISA and TIMSS, and the elaboration of rankings of educational institutions. This device is a key technology of governmentality that makes possible to regulate the behavior of the population. In its constitution are interwoven theoretical and technical knowledge from the social sciences and concerns and strategies for the government of the population. Social science and power are combined. The device constitutes a moral and political technology with powerful performative effects that shape what we assume, for all practical purposes, as the educational quality of the different entities of the system -students, schools, programs, professors, universities, etc.-, which are valued in terms of such quality. The paper seeks to articulate theoretically the operations of this device and its derivations. (shrink)

This study examines the Programme for International Student Assessment, one of the most influential tools of global education reform discourses in the 21st century. The study focuses on the governing role of statistical data in the discourse constructed by the international comparative assessment, referring to the global educational governance of the OECD. Disturbingly, the systematic collection and distribution of data does not merely quantify student achievement. Rather, students and participating countries are also qualified and classified. Here, OECD’s PISA statistics (...) act as a governing technology enabling the comparisons; through PISA’s statistics, the OECD has largely fostered the test-driven education reform trends worldwide. In this study, statistical data are examined as political instruments visualizing intangible concepts, constructing definitions of good practice and improvement, and fabricating the individuals whose knowledge and skills are normalized. In conclusion, it is necessary to rethink the new sociopolitical instrument – PISA’s statistics – not as a master rationale to reform the educational system of each country, but as a mere reference point based on the system’s distinctiveness. (shrink)

Multiple goals balancing is an important but not yet fully validated dimension of complex problem solving (CPS). The present study used process data to explore how solvers clarify goals, set priorities, and balance conflicting goals. We extracted behavioral indicators of goal pursuit from the log data of 3,201 students on the third subtask of the “Ticket” task in the PISA 2012 CPS test. Cluster analysis was used to identify 10 groups that varied in goal pursuit behavior. Logistics and least-squares (...) regression analysis were used to explore how goal pursuit affected task scores and CPS proficiency. The results showed that competent solvers clarified goals and weighed priorities more effectively. They also made trade-offs between conflicting goals. The importance of theoretically-driven log data analysis and coping strategies in the face of multiple goals conflict scenarios was discussed. (shrink)

This article problematizes the way of thinking schooling in discourse of sign system, which involves opposition, and double gesture of inclusion/exclusion. Drawing on two fundamental texts of Taoism, the Tao Te Ching and Chuang Tzu, this article puts forward the seemingly passive Non-Word and Non-Self to resist the hierarchy ordering of conceptions and man, and to undo duality of binary opposition. It links the history of assessment and PISA to the rethinking of evidence and sign in contemporary movements. The (...) second section proposes teaching as wandering (you, 游), the transcendence into Non-Self with response to men’s natural inquiry, but not artificially manipulating and shaping man by privileging certain knowledge, value, and thoughts over other. Instead of making categories of race, gender, and normal/abnormal, Taoist provides a way of reconsider the self operating on assessing, standardizing, normalizing, correcting and predicting others in school accountability. It is built on the ontology of considering individual as belonging to an ultimate sameness, the oneness. The article concludes with underlying assumption that students are subjected to change, and their difference must be eliminated through standard test. It further questions tactics of reason that educational reform face in the current regime of school accountability. (shrink)

Este ensayo aporta una visión distinta a la interpretación de los resultados comparados de PISA 2000 contra 2015. Donde no se sobredimensiona a los países con mejores condiciones iniciales, ni se estigmatiza a aquellos cuyas condiciones de partida son más difíciles. Por tanto, México no puede ser considerado como el país de la OCDE con el sistema educativo más ineficaz. No existe evidencia que demuestre que estas evaluaciones hayan tenido como consecuencia mejoras en la calidad de la educación. Palabras (...) clave: Calidad de la educación, Evaluación educativa. PISA 2015. (shrink)

This article analyses international large-scale assessments in education from a temporal perspective. The article discusses and compares the different conceptions of time in the early inter...

Mathematics achievement in different education systems around the world is assessed periodically in the Programme for International Student Assessment. PISA is deemed to yield robust...

If a machine attains consciousness, how could we find out? In this paper, I make three related claims regarding positive tests of machine consciousness. All three claims center on the idea that an AI can be constructed “ad hoc”, that is, with the purpose of satisfying a particular test of consciousness while clearly not being conscious. First, a proposed test of machine consciousness can be legitimate, even if AI can be constructed ad hoc specifically to pass this test. This (...) is underscored by the observation that many, if not all, putative tests of machine consciousness can be passed by non-conscious machines via ad hoc means. Second, we can identify ad hoc AI by taking inspiration from the notion of an ad hoc hypothesis in philosophy of science. Third, given the first and the second claim, the most reliable tests of animal consciousness turn out to be valid and useful positive tests of machine consciousness as well. If a non-ad hoc AI exhibits clusters of cognitive capacities facilitated by consciousness in humans which can be selectively switched off by masking and if it reproduces human behavior in suitably designed double dissociation tasks, we should treat the AI as conscious. (shrink)

The present paper gives an overview of the reflections of and reactions to publishing the results of the first wave of the OECD study Programme for International Student Assessment (PISA) in the Czech Republic and in Germany. The choice of these two countries enables us to document how the same results could be perceived very differently in diverse country contexts and could lead to a different reaction from policy-makers. In spite of large reforms and numerous policy measures being adopted (...) in Germany in reaction to the PISA results, compared with no response from policy-makers in the Czech Republic, it is argued, that in both countries policy-makers failed to tackle the major problem of their educational systems—its selective nature. In the final section we discuss various mis(uses) of PISA and its supranational and global character influencing local policies. (shrink)

The OECD's Programme for International Student Assessment (PISA) is increasingly depended upon by education policy makers to provide reliable measures of their country's education system against international benchmarks. PISA attempts to provide efficient, scientific and technical means to develop educational policies which achieve optimal outcomes (Berg & Timmermans, 2000, p. 31). This kind of scientific evidence is seen by policy makers as being free of prejudice and ideology. Science is expected to represent the truth, state universal facts and (...) make predictions. Thus PISA seeks to rank countries' performances, work out future scenarios and offer policy direction. By what means does PISA gain knowledge and speak with confidence about diverse cultures and distant nations? How does it acquire a ‘voice from nowhere’ (Haraway, 1988; Suchman, 2000), and become a modern-day Oracle that countries might consult for policy advice? Modelled on early actor-network accounts of laboratory life, this ethnography traces how PISA knowledge comes to be made, guided by interview data with two ‘insiders’ in the ‘PISA laboratory’. It traces the translations and the circulating reference that turn PISA into a ‘centre of calculation’. It highlights how human and non-human entities are imbricated in the assembling of scientific facts and argues for a suspension of the divide between ‘science’ and ‘politics’. In the process, the paper offers an empirical instantiation of how some concepts from actor-network theory may be applied in the field of education policy, and ponders the implications of such an understanding for evidence based policy making. (shrink)

This volume is a Festschrift in honour of Enrico Moriconi, to celebrate his 70th birthday and retirement. It consists of twelve original short essays by some of his friends, colleagues and former students, in the areas of general logic, proof theory, history of logic, philosophy of mathematics, epistemology and philosophy of language, mainly focused on some of his favourite research topics.

The accelerating advances in the fields of neuroscience, artificial intelligence, and robotics have been garnering interest and raising new philosophical, ethical, or practical questions that depend on whether or not there may exist a scientific method of probing consciousness in machines. This paper provides an analytic review of the existing tests for machine consciousness proposed in the academic literature over the past decade, and an overview of the diverse scientific communities involved in this enterprise. The tests put forward (...) in their work typically fall under one of two grand categories: architecture and behaviour. Each category has its strengths and weaknesses. Architecture tests' main advantage is that they could apparently test for qualia, a feature that has been receiving increasing attention in recent years. Behaviour tests are more synthetic and more practicable, but give a stronger role to ex post human interpretation of behaviour. We show how some disciplines and places have affinities towards certain type of tests, and which tests are more influential according to scientometric indicators. (shrink)

This paper reports on a survey of auditors in New Zealand which investigates the nature of the moral judgements they make on a series of problems with ethical dimensions. The framework adopted for this purpose is developed from earlier work which identifies a range of ethical principles which may be involved in business ethical decision‐making. Auditors responded to a questionnaire which posed, firstly, several questions about the context of their ethical decision‐making, and secondly, a series of vignettes elaborating problematical dilemmas (...) which required the selection of one of four possible responses. Data was analysed to determine whether or not it confirmed previous findings in suggesting a predominant ethical orientation for auditors. The results were correlated with demographic variables in order to determine whether or not age, gender, position in firm and size of employee firm were significantly correlated to ethical response. The survey results, on the whole, confirmed the ethical orientation suggested by previous findings, but there were some unexpected results in three out of the ten vignettes examined. Although some correlations were found between the demographic variables and subject responses, the evidence of this survey does not strongly suggest a consistent significant correlation. (shrink)