Perhaps the most widely touted of GPT-4’s at-launch, zero-shot capabilities has been its reported 90th-percentile performance on the Uniform Bar Exam. This paper begins by investigating the methodological challenges in documenting and verifying the 90th-percentile claim, presenting four sets of findings that indicate that OpenAI’s estimates of GPT-4’s UBE percentile are overinflated. First, although GPT-4’s UBE score nears the 90th percentile when examining approximate conversions from February administrations of the Illinois Bar Exam, these estimates are heavily skewed towards repeat test-takers (...) who failed the July administration and score significantly lower than the general test-taking population. Second, data from a recent July administration of the same exam suggests GPT-4’s overall UBE percentile was below the 69th percentile, and $$\sim$$ ∼ 48th percentile on essays. Third, examining official NCBE data and using several conservative statistical assumptions, GPT-4’s performance against first-time test takers is estimated to be $$\sim$$ ∼ 62nd percentile, including $$\sim$$ ∼ 42nd percentile on essays. Fourth, when examining only those who passed the exam (i.e. licensed or license-pending attorneys), GPT-4’s performance is estimated to drop to $$\sim$$ ∼ 48th percentile overall, and $$\sim$$ ∼ 15th percentile on essays. In addition to investigating the validity of the percentile claim, the paper also investigates the validity of GPT-4’s reported scaled UBE score of 298. The paper successfully replicates the MBE score, but highlights several methodological issues in the grading of the MPT + MEE components of the exam, which call into question the validity of the reported essay score. Finally, the paper investigates the effect of different hyperparameter combinations on GPT-4’s MBE performance, finding no significant effect of adjusting temperature settings, and a significant effect of few-shot chain-of-thought prompting over basic zero-shot prompting. Taken together, these findings carry timely insights for the desirability and feasibility of outsourcing legally relevant tasks to AI models, as well as for the importance for AI developers to implement rigorous and transparent capabilities evaluations to help secure safe and trustworthy AI. (shrink)

Le moins que l’on puisse dire est que la question de la surprise (Überraschung) ne paraît pas revêtir un statut central dans le chef d’œuvre philosophique de Heidegger, puisque ce mot même y est absent et qu’on n’y découvre, en tout et pour tout, que deux uniques occurrences de deux de ses dérivés : Überraschtwerden [être surpris] et Überraschende [surprenant], présents dans deux phrases de la page 355. Le passage où ils interviennent est le suivant : Umgekehrt gründet die Möglichkeit (...) des Übe... (shrink)

In dieser Arbeit werden die Thesen S. J. Becks über den kantischen Begriff von Ding-an-sich geprüft. Es sollen weder die zwei Doktrinen verglichen werden, noch die Punkte, in denen sie übereinstimmen, noch die Punkte, in denen sie sich voneinander entfernen. Basis-Voraussetzung ist mehr die Idee, dass es eine kantische Lehre des Ding-an-sich nicht gibt, sondern, dass es vielfältige divergente Tendenzen gibt in der Art, wie Kant das Problem bearbeitet. Die Auffassung Becks wird als ein Dialog mit denjenigen divergenten Tendenzen dargestellt, (...) die in Kants Gedanken koexistieren, und dadurch eine Reflexion, die an die eigene innere Entwicklung der kritischen Philosophie gebunden ist. Die Originalität von Becks Auffassung liegt in seiner Entscheidung eine eng idealistische Interpretation der transzendentale Philosophie zu privilegieren und - infolgedessen - die theoretischen Nichtigkeit des Begriffs des Ding-an-sich zu behaupten, wenn die systematische Darstellung der kritischen Philosophie nach seinem einzigen, voraussichtlichen Prinzip unternommen wird: das Prinzip der ursprünglichen synthetischen Einheit der Apperzeption. Diese Arbeit wird in drei Teile geteilt. Im ersten Teil wird Becks These geprüft, ob in der Kritik des vorliegenden Begriffs des Ding-an-sich eine Bewilligung Kants an dem Dogmatismus liegt, die durch didaktische und pädagogische Gründe determiniert ist. Im zweiten Teil werden die Übe rprüfungen, die von der systematischen Darstellung der kritischen Philosophie bei den Doktrinen der transzendentalen ästhetik, der transzendentalen Analytik und dem Schematismus gemacht werden müssen, gezeigt, so wie die nachfolgenden änderungen vom Sinn der Affektion, Synthese und Subsumption. Letztlich, im dritten Teil wird dargelegt, dass die Entscheidung Becks für den Idealismus mit einigen Punkten von Kants Denken nicht übereinstimmt und deswegen von ihm abgelehnt werden müsste. (shrink)

This paper examines the availability and adequacy of schools’ infrastructural facilities for implementation of the Universal Basic Education program in Nigeria. Adopting the ex post facto design, the researchers used existing school data on physical facilities, including a survey of key stakeholders in the education sector. Data analysed revealed inadequacy of physical facilities for effective implementation of the UBE program. It was accordingly recommended that government at the national, state and local levels show better commitment to the implementation of the (...) Universal Basic Education program. (shrink)

In lieu of an abstract, here is a brief excerpt of the content:Reviewed by:Aspirations for Modernity and Prosperity: Symbols and Sources behind Pentecostal/Charismatic Growth in Indonesia ed. by Christine E. Gudorf, Zainal Abidin Bagir, and Marthen TahunEmily DubieAspirations for Modernity and Prosperity: Symbols and Sources behind Pentecostal/Charismatic Growth in Indonesia Edited by Christine E. Gudorf, Zainal Abidin Bagir, and Marthen Tahun ADELAIDE, SOUTH AUSTRALIA: ATF THEOLOGY, 2014. X 1 231 PP. $34.95In Aspirations for Modernity and Prosperity, the authors and editors (...) survey the outcomes of a two-year study on Indonesian Pentecostal and Charismatic Christianity. Considered likely to be the fastest-growing form of Christianity, Pentecostal and Charismatic (P/C) movements embrace more than half a billion adherents globally. This volume contributes to recent scholarly attention on this expansion and its social characteristics through the study of 270 churches across five major Indonesian cities.With funding from the Pentecostal and Charismatic Research Initiative at the University of Southern California, seven of the eight essays are authored by [End Page 216] Indonesian researchers. The chapters consider a wide range of P/C characteristics: its liturgical contours, spirituality, sociological makeup, understandings of sex and gender, the organizational history of affiliated synods, and relations with non-P/C Christians and Muslims. While the articles draw on English-language P/C scholarship in only a limited way, they frequently cite publications in Bahasa, making accessible to the English-speaking world materials otherwise unavailable.The title of the book suggests the unifying premise of the collection: ambitions for modernity and prosperity fuel the rapid growth of P/C Christianity in Indonesia. As indicative of these motivations, the authors point to P/C professionalism, technological savviness, use of English, celebration of financial success, inattention to ethnic identities, and connections with global Christianity. Ubed Abdilah Syarif makes the strongest case for this argument in chapter 4, drawing on interviews with pastors and their account of the P/C "theology of success."The collection considers the ethics of P/C Christians only in passing. With the Muslim majority, P/C Christians share numerous moral restrictions, including on alcohol, smoking, bribery, and pornography. When prohibition does not direct moral action, P/C Christians navigate daily life with pragmatic flexibility, intuitions, and direct communication with God (40–43). These brief observations signal the need for a deeper understanding of P/C moral reflection and its constructive contributions to Christian ethics.Further, the recent turn to fieldwork in Christian ethics makes this book instructive for how it illuminates the difficulties accompanying qualitative methods. As the preface notes, the non-P/C religious identities of the Indonesian researchers slowed gaining access to pastors and congregations (viii, 4, 8–9). Beyond this passing admission, the authors spend little time considering their relationship with their object of inquiry. The tone throughout proceeds as description with the most remarkable field experiences going unexamined. To illustrate, Y. Agus Heru Santoso recounts her participation in a revival meeting: "Spontaneously, I, too stood up, sang the song, and started to pray in a language I have never learnt nor heard. … I am not and never have been P/C" (50). Despite the reader's immediate interest, Santoso continues in a disinterested tone. A more reflexive consideration of the perplexities of participant observation, with its disorienting plunge into the informants' world, would have deepened the readers' understanding of P/C experience.A further methodological challenge is found in the periodic dissonance between the authors' interpretations and P/C Christians' own utterances. This is most evident in chapter 2 where Johanes Louis M. Lengkong attributes the rapid growth of P/C Christianity to an aspiration for status and "global Christian citizenship" (29). Yet this reoccurring claim appears predominantly based [End Page 217] on the author's own inferences rather than on survey and interview data. While the concluding analysis may be correct, the subtle yet systematic dismissal of alternative emic explanations requires further defense.Despite these shortcomings, the articles shed valuable light on the shape of Indonesian P/C Christianity through examination of a variety of aspects. The volume thus forms an engaging resource on a very significant stream of world Christianity that merits greater attention in the field of Christian ethics. [End Page 218... (shrink)