Natural Language Processing

The article argues that AI can enhance the measurement and implementation of democratic processes within political parties, known as Intra-Party Democracy (IPD). It identifies the limitations of traditional methods for measuring IPD, which often rely on formal parameters, self-reported data, and tools like surveys. Such limitations lead to the collection of partial data, rare updates, and significant demands on resources. To address these issues, the article suggests that specific data management and Machine Learning (ML) techniques, such as natural language processing (...) and sentiment analysis, can improve the measurement (ML about) and practice (ML for) of IPD. The article concludes by considering some of the principal risks of ML for IPD, including concerns over data privacy, the potential for manipulation, and the dangers of overreliance on technology. (shrink)

Language is expressed in a consecutive way that is called linearity; it is acceptable to think that language understanding also occurs in a linear way. In this paper, it will be argued that although sentences are expressed in a linear way, they are not understood in the same way, because we develop an understanding of the entwined phrases forming a sentence beyond the single words. Therefore, it is argued that linearity cannot adequately explain sentence understanding. In addition, by introducing the (...) concept of mental work that is based on “the law of less work” or our natural tendency toward less mental effort, we will try to explain sentence understanding based on the ladder model instead of the linear model. (shrink)

The ability to communicate in a specific language like Chinese typically indicates that the speaker understands the language. A counterexample to this belief is John Searle’s Chinese room experiment. It has been shown in this experiment that in certain circumstances we can communicate with a Chinese speaker without intuitively acknowledging that the Chinese language is understood in the conversation. In the present paper, we aim to present another counterexample showing that, in certain circumstances, we can communicate using a specific language (...) by converting its words to those of our natural language, and understand what is expressed using the language without understanding it. Using a specific conversion process introduced in the present paper, symbols and even sounds of a language like the Chinese language lose their original function and act as a tool to express one’s natural language. To better understand this, imagine the English language has another writing or phonological system in addition to its current writing system. (shrink)

In contemporary healthcare, medical image categorization is essential for illness prediction, diagnosis, and therapy planning. The emergence of digital imaging technology has led to a significant increase in research into the use of machine learning (ML) techniques for the categorization of images in medical data. We provide a thorough summary of recent developments in this area in this review, using knowledge from the most recent research and cutting-edge methods.We begin by discussing the unique challenges and opportunities associated with medical image (...) classification, including the complexity of anatomical structures, variability in imaging modalities, and the need for interpretability and reliability in clinical settings. Subsequently, we survey a wide range of ML algorithms and techniques employed for medical image classification, including traditional methods such as support vector machines and k-nearest neighbors, as well as deep learning approaches like convolutional neural networks (CNNs) and recurrent neural networks (RNNs). Furthermore, we examine key considerations in dataset preparation, feature extraction, and model evaluation specific to medical image classification tasks. We highlight the importance of large, annotated datasets, transfer learning, and data augmentation techniques in enhancing model performance and generalization. (shrink)

Description Logics (DLs) are a family of well-known terminological knowledge representation formalisms in modern semantics-based systems. This research focuses on analysing how our developed Occurrence Logic (OccL) can conceptually and logically support the development of a description logic. OccL is integrated into the alternative theory of natural language syntax in `Deviational Syntactic Structures' under the label `EFA(X)3' (or the third version of Epi-Formal Analysis in Syntax, EFA(X), which is a radical linguistic theory). From the logical point of view, OccL is (...) a formal logic that mainly deals with the occurrences of symbols as well as with their priorities within linguistic descriptions, i.e. natural language syntax, semantics and phonology. In this article---based on our OccL-based definitions of the concepts of `strong implication' and `occurrence value' as well as of the logical concept `identical occurrence constructor (IDOC)' that is the most fundamental logical concept in our formalism---we will model Occurrence Description Logic ($\mathcal{ODL}$). Accordingly, we will formally-logically analyse `occurrence(s) of symbol(s)' within descriptions of the world in $\mathcal{ODL}$. In addition, we will analyse and assess the logical concepts of `occurrence' and `occurrence priority' in $\mathcal{ODL}$. This research can make a strong logical background for our future research in the development of a Modal Occurrence Description Logic. (shrink)

Scalability, efficiency, and security had been a persistent problem over the years in data mining, several techniques had been proposed and implemented but none had been able to solve the problem of scalability, efficiency and security from cloud computing. In this research, we solve the problem scalability, efficiency and security in data mining over cloud computing by using a restful web services and combination of different technologies and tools, our model was trained by using different machine learning algorithm, and finally (...) using different validation and cross-validation methods to compare and validate our results. We build, train, test and deploy our model by restful API services which can be called through an endpoint, and with very high accuracy and huge success. (shrink)

Recent advances in natural language processing have given rise to a new kind of AI architecture: the language agent. By repeatedly calling an LLM to perform a variety of cognitive tasks, language agents are able to function autonomously to pursue goals specified in natural language and stored in a human-readable format. Because of their architecture, language agents exhibit behavior that is predictable according to the laws of folk psychology: they function as though they have desires and beliefs, and then make (...) and update plans to pursue their desires given their beliefs. We argue that the rise of language agents significantly reduces the probability of an existential catastrophe due to loss of control over an AGI. This is because the probability of such an existential catastrophe is proportional to the difficulty of aligning AGI systems, and language agents significantly reduce that difficulty. In particular, language agents help to resolve three important issues related to aligning AIs: reward misspecification, goal misgeneralization, and uninterpretability. (shrink)

The present paper looks at one of the most thorough articles on the intelligence of GPT, research conducted by engineers at Microsoft. Although there is a great deal of value in their work, I will argue that, for familiar philosophical reasons, their methodology, ‘Black-box Interpretability’ is wrongheaded. But there is a better way. There is an exciting and emerging discipline of ‘Inner Interpretability’ (also sometimes called ‘White-box Interpretability’) that aims to uncover the internal activations and weights of models in order (...) to understand what they represent and the algorithms they implement. In my view, a crucial mistake in Black-box Interpretability is the failure to appreciate that how processes are carried out matters when it comes to intelligence and understanding. I can’t pretend to have a full story that provides both necessary and sufficient conditions for being intelligent, but I do think that Inner Interpretability dovetails nicely with plausible philosophical views of what intelligence requires. So the conclusion is modest, but the important point in my view is seeing how to get the research on the right track. Towards the end of the paper, I will show how some of the philosophical concepts can be used to further refine how Inner Interpretability is approached, so the paper helps draw out a profitable, future two-way exchange between Philosophers and Computer Scientists. (shrink)

Despite its centrality in the philosophy of cognitive science, there has been little prior philosophical work engaging with the notion of representation in contemporary NLP practice. This paper attempts to fill that lacuna: drawing on ideas from cognitive science, I introduce a framework for evaluating the representational claims made about components of neural NLP models, proposing three criteria with which to evaluate whether a component of a model represents a property and operationalising these criteria using probing classifiers, a popular analysis (...) technique in NLP (and deep learning more broadly). The project of operationalising a philosophically-informed notion of representation should be of interest to both philosophers of science and NLP practitioners. It affords philosophers a novel testing-ground for claims about the nature of representation, and helps NLPers organise the large literature on probing experiments, suggesting novel avenues for empirical research. (shrink)

One of the central questions in the epistemology of conversational AIs is how to classify the beliefs acquired from them. Two promising candidates are instrument-based and testimony-based beliefs. However, the category of instrument-based beliefs faces an intrinsic problem, and a challenge arises in its application. On the other hand, relying solely on the category of testimony-based beliefs does not encompass the totality of our practice of using conversational AIs. To address these limitations, I propose a novel classification of beliefs that (...) shifts the focus from the properties of the conversational AIs themselves to how recipients perceive AI output, specifically whether they take the output at face value. The proposed categories are beliefs by regarding as instruments and beliefs by regarding as testifiers. By using these complementary categories, a more comprehensive understanding of beliefs acquired from conversational AIs can be achieved while avoiding the problems associated with the traditional classification. (shrink)

Although personal relevance is key to sustaining an audience’s interest in any given narrative, it has received little systematic attention in scholarship to date. Across centuries and media, adaptations have been used extensively to bring temporally or geographically distant narratives “closer” to the recipient under the assumption that their impact will increase. In this review article, we review experimental and other empirical evidence on narrative processing in order to unravel which types of personal relevance are more likely to be impactful (...) than others, which types of impact (e.g. aesthetic, therapeutic, persuasive) they have been found to generate, and where their power may become excessive or outright detrimental to reader experience. (shrink)

Zeugmatic oddness is a linguistic intuition of oddness with respect to an instance of zeugma, i.e. a sentence containing an instance of a homonymous or polysemous word being used in different meanings or senses simultaneously. Zeugmatic oddness is important for philosophical debates as philosophers often use it to argue that a particular philosophically interesting expression is ambiguous and that the phenomenon referred to by the expression is disunified. This paper takes a closer look at zeugmatic oddness. Focusing on relevant psycholinguistic (...) literature on homonymy and polysemy processing and representation, I argue that there are two different ways in which zeugmatic oddness can arise. Philosophical upshots concerning zeugmatic oddness are then drawn. (shrink)

Occurrences of sentences that are traditionally considered category mistakes, such as 'The red number is divisible by three', tend to elicit a sense of oddness in assessors. In attempting to explain this oddness, existing accounts in the philosophical literature commonly claim that occurrences of such sentences are associated with a defect or phenomenology unique to the class of category mistakes. It might be thought that recent work in experimental psycholinguistics—in particular, the recording of event-related brain potentials (patterns of voltage variation (...) in the brain)—holds the potential to shed new light on this debate. I review the relevant experimental results, before arguing that they present advocates of accounts of category mistakes with a dilemma: either the uniqueness claims should be rejected, or the experimental technique in question cannot be used to test existing accounts of category mistakes in the manner that philosophers might hope. (shrink)

Empirical evidence suggests that perceptual‐motor simulations are often constitutively involved in language comprehension. Call this “the simulation view of language comprehension”. This article applies the simulation view to illuminate the much‐discussed phenomenon of copredication, where a noun permits multiple predications which seem to select different senses of the noun simultaneously. On the proposed account, the (in)felicitousness of a copredicational sentence is closely associated with the perceptual simulations that the language user deploys in comprehending the sentence.

As systems based on opaque Artificial Intelligence (AI) continue to flourish in diverse real-world applications, understanding these black box models has become paramount. In response, Explainable AI (XAI) has emerged as a field of research with practical and ethical benefits across various domains. This paper not only highlights the advancements in XAI and its application in real-world scenarios but also addresses the ongoing challenges within XAI, emphasizing the need for broader perspectives and collaborative efforts. We bring together experts from diverse (...) fields to identify open problems, striving to synchronize research agendas and accelerate XAI in practical applications. By fostering collaborative discussion and interdisciplinary cooperation, we aim to propel XAI forward, contributing to its continued success. Our goal is to put forward a comprehensive proposal for advancing XAI. To achieve this goal, we present a manifesto of 27 open problems categorized into nine categories. These challenges encapsulate the complexities and nuances of XAI and offer a road map for future research. For each problem, we provide promising research directions in the hope of harnessing the collective intelligence of interested stakeholders. (shrink)

La scorciatoia - Come le macchine sono diventate intelligenti senza pensare in modo umano -/- Le nostre creature sono diverse da noi e talvolta più forti. Per poterci convivere dobbiamo imparare a conoscerle Vagliano curricula, concedono mutui, scelgono le notizie che leggiamo: le macchine intelligenti sono entrate nelle nostre vite, ma non sono come ce le aspettavamo. Fanno molte delle cose che volevamo, e anche qualcuna in più, ma non possiamo capirle o ragionare con loro, perché il loro comportamento è (...) in realtà guidato da relazioni statistiche ricavate da quantità sovrumane di dati. Eppure possono essere in certi casi più potenti di noi: ci osservano continuamente, e prendono decisioni al nostro posto. E allora come incorporarle nella nostra società senza rischi ed effetti collaterali? Questo libro - rigoroso, pungente, originale nell'approccio - ci spiega come siamo arrivati sin qui, e indica il percorso che ci aspetta prima di poterci fidare di questi nuovi agenti «alieni». La tecnologia non basta, occorre un dialogo tra scienze naturali e umane: è il passaggio cruciale per una convivenza sicura con questa nuova forma di intelligenza. (Il Mulino). (shrink)

Several important philosophical problems (including the problems of perception, free will, and scepticism) arise from antinomies that are developed through philosophical paradoxes. The critical strand of ordinary language philosophy (OLP), as practiced by J.L. Austin, provides an approach to such ‘antinomic problems’ that proceeds from an examination of ‘ordinary language’ (how people ordinarily talk about the phenomenon of interest) and ‘common sense’ (what they commonly think about it), and deploys findings to show that the problems at issue are artefacts of (...) fallacious reasoning. The approach is capable, and in need of, empirical development. Proceeding from a case-study on Austin’s paradigmatic treatment of the problem of perception, this paper identifies the key empirical assumptions informing the approach, assesses them in the light of empirical findings about default inferences, contextualisation failures, and belief fragmentation, and explores how these findings can be deployed to address the problem of perception. This facilitates a novel resolution of the problem of perception. Proceeding from this paradigm, the paper proposes ‘experimental critical OLP’ as a new research program in experimental philosophy that avoids apparent non-sequiturs of OLP, extends and transforms experimental philosophy’s ‘sources program’, and provides a promising new strategy for deploying empirical findings about how people ordinarily talk and think about phenomena, to address longstanding philosophical problems. (shrink)

If Large Language Models can make real scientific contributions, then they can genuinely use language, be systematically wrong, and be held responsible for their errors. AI models which can make scientific contributions thereby meet the criteria for scientific authorship.

The Quantified argument calculus (Quarc) has received a lot of attention recently as an interesting system of quantified logic which eschews the use of variables and unrestricted quantification, but nonetheless achieves results similar to the Predicate calculus (PC) by employing quantifiers applied directly to predicates instead. Despite this noted similarity, the issue of the relationship between Quarc and PC has so far not been definitively resolved. We address this question in the present paper, and then expand upon that result. Utilizing (...) recent developments in structural proof theory, we develop a G3-style sequent calculus for Quarc and briefly demonstrate its structural properties. We put these properties to use immediately to construct direct proofs of the meta-theoretical properties of the system. We then incorporate an abstract (and, as we shall see, logical) predicate into the system in a way that preserves all the structural properties. This allows us to identify a system of Quarc which is deductively equivalent to PC, and also yields a constructive method of demonstrating the Craig interpolation theorem (which speaks in favor of the aforementioned predicate being logical). We further generalize this extension to develop a bivalent system of Quarc with defining clauses that still maintains all the desirable properties of a good proof system. (shrink)

As testing of ChatGPT has shown, this form of artificial intelligence has the potential to develop, which requires improving its software and other hardware that allows it to learn, i.e., to acquire and use new knowledge, to contact its developers with suggestions for improvement, or to reprogram itself without their participation. Как показало тестирование ChatGPT, эта форма искусственного интеллекта имеет потенциал развития, для чего необходимо усовершенствовать её программное и прочее техническое обеспечение, позволяющее ей учиться, т.е. приобретать и использовать новые знания, (...) обращаться к её разработчикам с предложениями по усовершенствованию, или производить самопрограммирование без их участия. (shrink)

The topic of this dissertation is the nature of linguistic competence, the capacity to understand and produce sentences of natural language. I defend the empiricist account of linguistic competence embedded in the connectionist cognitive science. This strand of cognitive science has been opposed to the traditional symbolic cognitive science, coupled with transformational-generative grammar, which was committed to nativism due to the view that human cognition, including language capacity, should be construed in terms of symbolic representations and hardwired rules. Similarly, linguistic (...) competence in this framework was regarded as being innate, rule-governed, domain-specific, and fundamentally different from performance, i.e., idiosyncrasies and factors governing linguistic behavior. I analyze state-of-the-art connectionist, deep learning models of natural language processing, most notably large language models, to see what they can tell us about linguistic competence. Deep learning is a statistical technique for the classification of patterns through which artificial intelligence researchers train artificial neural networks containing multiple layers that crunch a gargantuan amount of textual and/or visual data. I argue that these models suggest that linguistic competence should be construed as stochastic, pattern-based, and stemming from domain-general mechanisms. Moreover, I distinguish syntactic from semantic competence, and I show for each the ramifications of the endorsement of a connectionist research program as opposed to the traditional symbolic cognitive science and transformational-generative grammar. I provide a unifying front, consisting of usage-based theories, a construction grammar approach, and an embodied approach to cognition to show that the more multimodal and diverse models are in terms of architectural features and training data, the stronger the case is for the connectionist linguistic competence. I also propose to discard the competence vs. performance distinction as theoretically inferior so that a novel and integrative account of linguistic competence originating in connectionism and empiricism that I propose and defend in the dissertation could be put forward in scientific and philosophical literature. (shrink)

In this paper, we examine some basic linguistic abilities in a small sample of adults with minimal receptive vocabulary, whose receptive mental verbal age ranges from 1;2 to 3;10. In particular, we examine whether the participants in our study understand noun phrases consisting of a noun modified by an adjective. We use stimuli that they can recognise by name. Except for one participant, we find that, while all of them understand the noun and adjective in isolation, none seems to understand (...) these noun phrases, which means that they seem to not do linguistic composition. In order to test whether the difficulty is linguistic or conceptual, we ran two other studies, one on concept composition, and the other on iconic symbolic composition (composition of pictograms). Results suggest that linguistic composition is particularly difficult in this population, and that vocabulary breadth may not predict compositional abilities. (shrink)

The success of deep learning in natural language processing raises intriguing questions about the nature of linguistic meaning and ways in which it can be processed by natural and artificial systems. One such question has to do with subword segmentation algorithms widely employed in language modeling, machine translation, and other tasks since 2016. These algorithms often cut words into semantically opaque pieces, such as ‘period’, ‘on’, ‘t’, and ‘ist’ in ‘period|on|t|ist’. The system then represents the resulting segments in a dense (...) vector space, which is expected to model grammatical relations among them. This representation may in turn be used to map ‘period|on|t|ist’ (English) to ‘par|od|ont|iste’ (French). Thus, instead of being modeled at the lexical level, translation is reformulated more generally as the task of learning the best bilingual mapping between the sequences of subword segments of two languages; and sometimes even between pure character sequences: ‘p|e|r|i|o|d|o|n|t|i|s|t’ → ‘p|a|r|o|d|o|n|t|i|s|t|e’. Such subword segmentations and alignments are at work in highly efficient end-to-end machine translation systems, despite their allegedly opaque nature. The computational value of such processes is unquestionable. But do they have any linguistic or philosophical plausibility? I attempt to cast light on this question by reviewing the relevant details of the subword segmentation algorithms and by relating them to important philosophical and linguistic debates, in the spirit of making artificial intelligence more transparent and explainable. (shrink)

Call it the Skynet hypothesis, Artificial General Intelligence, or the advent of the Singularity — for years, AI experts and non-experts alike have fretted (and, for a small group, celebrated) the idea that artificial intelligence may one day become smarter than humans. -/- According to the theory, advances in AI — specifically of the machine learning type that’s able to take on new information and rewrite its code accordingly — will eventually catch up with the wetware of the biological brain. (...) In this interpretation of events, every AI advance from Jeopardy-winning IBM machines to the massive AI language model GPT-3 is taking humanity one step closer to an existential threat. We’re literally building our soon-to-be-sentient successors. -/- Except that it will never happen. At least, according to the authors of the new book Why Machines Will Never Rule the World: Artificial Intelligence without Fear. (shrink)

Philosophers are often credited with particularly well-developed conceptual skills. The ‘expertise objection’ to experimental philosophy builds on this assumption to challenge inferences from findings about laypeople to conclusions about philosophers. We draw on psycholinguistics to develop and assess this objection. We examine whether philosophers are less or differently susceptible than laypersons to cognitive biases that affect how people understand verbal case descriptions and judge the cases described. We examine two possible sources of difference: Philosophers could be better at deploying concepts, (...) and this could make them less susceptible to comprehension biases (‘linguistic expertise objection’). Alternatively, exposure to different patterns of linguistic usage could render philosophers vulnerable to a fundamental comprehension bias, the linguistic salience bias, at different points (‘linguistic usage objection’). Together, these objections mount a novel ‘master argument’ against experimental philosophy. To develop and empirically assess this argument, we employ corpus analysis and distributional semantic analysis and elicit plausibility ratings from academic philosophers and psychology undergraduates. Our findings suggest philosophers are better at deploying concepts than laypeople but are susceptible to the linguistic salience bias to a similar extent and at similar points. We identify methodological consequences for experimental philosophy and for philosophical thought experiments. (shrink)

Sallie McFague’s theological models construct a tensive relationship between conceptual structures and symbolic, metaphorical language to interpret the defining and elusive aspects of theological phenomena and loci. Computational models of language can extend and formalize the conceptual structures of theological models to develop computer-augmented interpretations of theological texts. Previously unclear is whether computational models can retain the tensive symbolism essential for theological investigation. I demonstrate affirmatively by constructing a computational topic model of the moral theology of Thomas Aquinas from Summa (...) Theologica (Second Part, in English translation) useful for interpreting not only the Thomistic text but also recent papal encyclicals. (shrink)

The study shows the existence of a broad conformity between Whitehead’s organismic cosmology and the contemporary theory of complex systems at a relevant level of abstraction. One of the most promising directions of educational transformation in the age of big data and artificial intelligence – personalized learning – is conceived as a system of systems and reveals its close congruence with a number of basic Whiteheadian concepts. A new functional structure of personalized learning systems is proposed, including all the core (...) elements of a full learning sequence. A multiobjective optimization problem, which is subject to strong constraints, uncertain outcomes, and continued development, is under consideration. It is argued that many of Whitehead’s concepts can be used constructively in designing and implementing advanced personalized learning systems after being adapted and expanded and account for the requirements of emerging big data and artificial intelligence research. Special attention is paid to the main factors that determine the multi-modality of personalized learning – learning styles, contexts, and didactic variability. The effecttiveness of personalized learning is a data-driven problem. (shrink)

Recent research in psycholinguistics suggests that language processing frequently involves mental imagery. This paper focuses on visual imagery and discusses two issues regarding the processing of polysemous words (i.e. words with multiple related meanings or senses) – co-predication and sense-relatedness. It aims to show how mental imagery can illuminate these two issues.

In recent decades, plural logic has established itself as a well-respected member of the extensions of first-order classical logic. In the present paper, I draw attention to the fact that among the examples that are commonly given in order to motivate the need for this new logical system, there are some in which the elements of the plurality in question are internally singularized (e.g. ‘Whitehead and Russell wrote Principia Mathematica’), while in others they are not (e.g. ‘Some philosophers wrote Principia (...) Mathematica’). Then, building on previous work, I point to a subsystem of plural logic in which inferences concerning examples of the first type can be adequately dealt with. I notice that such a subsystem (here called ‘discrete plural logic’) is in reality a mere variant of first-order logic as standardly formulated, and highlight the fact that it is axiomatizable while full plural logic is not. Finally, I urge that greater attention be paid to discrete plural logic and that discrete plurals are not used in order to motivate the introduction of full-fledged plural logic—or, at least, not without remarking that they can also be adequately dealt with in a considerably simpler system. (shrink)

Two objections are raised against Oliver and Smiley’s analysis of the collective–distributive opposition in their 2016 book: They take it as a basic premise that the collective reading of ‘baked a cake’ corresponds to a predicate different from its distributive reading, and the same applies to all predicate expressions that admit both a collective and a distributive interpretation. At the same time, however, they argue that inflectional forms of the same lexeme reveal a univocity that should be preserved in a (...) formal representation of English. These two assumptions sit uneasily. In developing their analysis, Oliver and Smiley come to the conclusion that even a singular predication such as ‘Tom baked a cake’ must be regarded as ambiguous between a collective and a distributive reading. This is so artificial that it hardly makes sense, and yet there seems to be no way out of the difficulty unless we are prepared to give up the basic premise just mentioned. (shrink)

Whether it was John Searle’s Chinese Room argument (Searle, 1980) or Roger Penrose’s argument of the non-computable nature of a mathematician’s insight – an argument that was based on Gödel’s Incompleteness theorem (Penrose, 1989), we have always had skeptics that questioned the possibility of realizing strong Artificial Intelligence (AI), or what has become known by Artificial General Intelligence (AGI). But this new book by Landgrebe and Smith (henceforth, L&S) is perhaps the strongest argument ever made against strong AI. It is (...) a very extensive review of what building a mind essentially amounts to drawing on insights and results from biology, physics, linguistics, computability, philosophy, and mathematics. (shrink)

The standard approach to model how human beings understand natural languages is the symbolic, compositional approach according to which the meaning of a complex expression is a function of the meanings of its constituents. In other words, meaning plays a fundamental role in the model. In this work, because of the polysemous, flexible, dynamic, and contextual structure of natural languages, this approach is rejected. Instead, a connectionist model which eliminates the concept of meaning is proposed.

Prepositions as function words and single monomorphemic words are the most basic words of the human language, especially in the context of maintaining daily life. They are probably the first lexes/words entered to the human’s linguistic repertoire, as their requirements in the language are so essential. Prepositions shows various relationships between lexes or phrases in sentences. Among these relationships time, points, position, direction and various degrees of mental or emotional attitudes seem to be significant. The purpose of the research is (...) try to reveal what kind of challenges English prepositions have for the learners and also to confirm if they are as difficult as some linguists have stated before. Another purpose is to find out which features are more difficult among all their entity properties. The results of this study disclose that English prepositions possess very complex structures, different meanings and an associating duty of various types of part of speeches. In particular, those that construct the phrasal verbs require great effort for learning due to the loss of the meaning (sometimes partially, sometimes completely) they undergo. It has been understood that their properties such as steadily changing meaning and function make them quite difficult elements for learners of English. (shrink)

As AI systems become increasingly competent language users, it is an apt moment to consider what it would take for machines to understand human languages. This paper considers whether either language models such as GPT-3 or chatbots might be able to understand language, focusing on the question of whether they could possess the relevant concepts. A significant obstacle is that systems of both kinds interact with the world only through text, and thus seem ill-suited to understanding utterances concerning the concrete (...) objects and properties which human language often describes. Language models cannot understand human languages because they perform only linguistic tasks, and therefore cannot represent such objects and properties. However, chatbots may perform tasks concerning the non-linguistic world, so they are better candidates for understanding. Chatbots can also possess the concepts necessary to understand human languages, despite their lack of perceptual contact with the world, due to the language-mediated concept-sharing described by social externalism about mental content. (shrink)

Can humans and artificial intelligences share concepts and communicate? Making AI Intelligible shows that philosophical work on the metaphysics of meaning can help answer these questions. Herman Cappelen and Josh Dever use the externalist tradition in philosophy to create models of how AIs and humans can understand each other. In doing so, they illustrate ways in which that philosophical tradition can be improved. The questions addressed in the book are not only theoretically interesting, but the answers have pressing practical implications. (...) Many important decisions about human life are now influenced by AI. In giving that power to AI, we presuppose that AIs can track features of the world that we care about (for example, creditworthiness, recidivism, cancer, and combatants). If AIs can share our concepts, that will go some way towards justifying this reliance on AI. This ground-breaking study offers insight into how to take some first steps towards achieving Interpretable AI. (shrink)

The use of language models in Web applications and other areas of computing and business have grown significantly over the last five years. One reason for this growth is the improvement in performance of language models on a number of benchmarks — but a side effect of these advances has been the adoption of a “bigger is always better” paradigm when it comes to the size of training, testing, and challenge datasets. Drawing on previous criticisms of this paradigm as applied (...) to large training datasets crawled from pre-existing text on the Web, we extend the critique to challenge datasets custom-created by crowdworkers. We present several sets of criticisms, where ethical and scientific issues in language model research reinforce each other: labour injustices in crowdwork, dataset quality and inscrutability, inequities in the research community, and centralized corporate control of the technology. We also present a new type of tool for researchers to use in examining large datasets when evaluating them for quality. (shrink)

It has been argued that ethical frameworks for data science often fail to foster ethical behavior, and they can be difficult to implement due to their vague and ambiguous nature. In order to overcome these limitations of current ethical frameworks, we propose to integrate the analysis of the connections between technical choices and sociocultural factors into the data science process, and show how these connections have consequences for what data subjects can do, accomplish, and be. Using healthcare as an example, (...) attention to sociocultural conversion factors relevant to health can help in navigating technical choices that require broader considerations of the sociotechnical system, such as metric tradeoffs in model validation, resulting in better ethical and technical choices. This approach promotes awareness of the ethical dimension of technical choices by data scientists and others, and that can foster the cultivation of 'ethical skills' as integral to data science. (shrink)

Artificial intelligence (AI) research enjoyed an initial period of enthusiasm in the 1970s and 80s. But this enthusiasm was tempered by a long interlude of frustration when genuinely useful AI applications failed to be forthcoming. Today, we are experiencing once again a period of enthusiasm, fired above all by the successes of the technology of deep neural networks or deep machine learning. In this paper we draw attention to what we take to be serious problems underlying current views of artificial (...) intelligence encouraged by these successes, especially in the domain of language processing. We then show an alternative approach to language-centric AI, in which we identify a role for philosophy. (shrink)

Most words in natural languages are polysemous; that is, they have related but different meanings in different contexts. This one‐to‐many mapping of form to meaning presents a challenge to understanding how word meanings are learned, represented, and processed. Previous work has focused on solutions in which multiple static semantic representations are linked to a single word form, which fails to capture important generalizations about how polysemous words are used; in particular, the graded nature of polysemous senses, and the flexibility and (...) regularity of polysemy use. We provide a novel view of how polysemous words are represented and processed, focusing on how meaning is modulated by context. Our theory is implemented within a recurrent neural network that learns distributional information through exposure to a large and representative corpus of English. Clusters of meaning emerge from how the model processes individual word forms. In keeping with distributional theories of semantics, we suggest word meanings are generalized from contexts of different word tokens, with polysemy emerging as multiple clusters of contextually modulated meanings. We validate our results against a human‐annotated corpus of polysemy focusing on the gradedness, flexibility, and regularity of polysemous sense individuation, as well as behavioral findings of offline sense relatedness ratings and online sentence processing. The results provide novel insights into how polysemy emerges from contextual processing of word meaning from both a theoretical and computational point of view. (shrink)

Spoken communication occurs in a “noisy channel” characterized by high levels of environmental noise, variability within and between speakers, and lexical and syntactic ambiguity. Given these properties of the received linguistic input, robust spoken word recognition—and language processing more generally—relies heavily on listeners' prior knowledge to evaluate whether candidate interpretations of that input are more or less likely. Here we compare several broad-coverage probabilistic generative language models in their ability to capture human linguistic expectations. Serial reproduction, an experimental paradigm where (...) spoken utterances are reproduced by successive participants similar to the children's game of “Telephone,” is used to elicit a sample that reflects the linguistic expectations of English-speaking adults. When we evaluate a suite of probabilistic generative language models against the yielded chains of utterances, we find that those models that make use of abstract representations of preceding linguistic context (i.e., phrase structure) best predict the changes made by people in the course of serial reproduction. A logistic regression model predicting which words in an utterance are most likely to be lost or changed in the course of spoken transmission corroborates this result. We interpret these findings in light of research highlighting the interaction of memory-based constraints and representations in language processing. (shrink)

This excerpted chapter of the book THE IMAGE OF LANGUAGE discusses the philosophical implications of geometric visualizations of the alphabetic patterning encoded in the orthography of words (a project showing examples of the visualizations is included). Reference pages are also included.

The goal of creating Artificial General Intelligence (AGI) – or in other words of creating Turing machines (modern computers) that can behave in a way that mimics human intelligence – has occupied AI researchers ever since the idea of AI was first proposed. One common theme in these discussions is the thesis that the ability of a machine to conduct convincing dialogues with human beings can serve as at least a sufficient criterion of AGI. We argue that this very ability (...) should be accepted also as a necessary condition of AGI, and we provide a description of the nature of human dialogue in particular and of human language in general against this background. We then argue that it is for mathematical reasons impossible to program a machine in such a way that it could master human dialogue behaviour in its full generality. This is (1) because there are no traditional explicitly designed mathematical models that could be used as a starting point for creating such programs; and (2) because even the sorts of automated models generated by using machine learning, which have been used successfully in areas such as machine translation, cannot be extended to cope with human dialogue. If this is so, then we can conclude that a Turing machine also cannot possess AGI, because it fails to fulfil a necessary condition thereof. At the same time, however, we acknowledge the potential of Turing machines to master dialogue behaviour in highly restricted contexts, where what is called “narrow” AI can still be of considerable utility. (shrink)

La description en langue naturelle est l’artefact permettant de débuter un processus d’automatisation. La tâche principale de l’ingénieur du logiciel, c’est de combler le clivage entre langue naturelle et langue de la machine. Après avoir présenté quelques ontologies définies pour les processus d’automatisation, quelques pour et quelques contre l’emploi d’ontologies dans le génie logiciel sont présentées. Des indications pour dépasser cette simple opposition sont ensuite décrites. Des évaluations sur le réductionnisme dans les ontologies en ce qui concerne les possibles interactions (...) entre humains, machines et réalité muette terminent la présentation. (shrink)

This paper attempts to describe and address a specific puzzle related to compositionality in artificial networks such as Deep Neural Networks and machine learning in general. The puzzle identified here touches on a larger debate in Artificial Intelligence related to epistemic opacity but specifically focuses on computational applications of human level linguistic abilities or properties and a special difficulty with relation to these. Thus, the resulting issue is both general and unique. A partial solution is suggested.

Появление человека, говорящего о себе Ἐγώ εἰμι, люди воспринимают в той же логике абсурда, к которой они привыкли. То, что кто-то может не играть и не носить маску, а реально быть, жить настоящей, а не выдуманной жизнью, для них немыслимо, невозможно, невыносимо и недопустимо. Но такой человек был, есть, и будет, и именно он преображает всё остальное человечество своим Ἐγώ εἰμι.

Частным аспектом предлагаемой реформы интернета является метаномические правила референцирования и адресации виртуальных объектов с целью приближения их к естественным языкам, и создания их логической системы. Однако реформа интернета и преобразование его в средство общения и служения обществу требует также других мер. К этим мерам относится передача определённых имён в неотчуждаемое владение, чтобы их собственники безусловно и беспрепятственно могли осуществлять их право публикации, т.е. публичного высказывания и выражения их мыслей, что также важно для документографии. Другой мерой должно стать упразднение всей сложившейся (...) системы управления интернетом, т.е. бюрократии, после чего техническим службам будут делегированы обязанности по обеспечению его функционирования с учётом высказанной критики. (shrink)

Paul Pietroski has developed a powerful minimalist and internalist alternative to standard compositional semantics, where meanings are identified with instructions to fetch or assemble human concepts in specific ways. In particular, there appears to be no need for Fregean Function Application, as natural language composition only involves processes of combining monadic or dyadic concepts, and Pietroski’s theory can then, allegedly, avoid both singular reference and truth conditions. He also has a negative agenda, purporting to show, roughly, that the vocabulary of (...) standard truth conditional semantics is far too powerful to plausibly describe the linguistic competence of mere human minds. In this paper, I explain some of the basics of Pietroski’s compositional semantics and argue that his major objection to standard compositionality is inconclusive, because a similar argument can be mounted against his own minimalist theory. I argue that we need a clear distinction between the language of the theorist---theoretical notation---and the language whose nature we are trying to explain. The theoretical notation should in fact be as expressively powerful as possible. It does not follow that the notation cannot be used to explain mere human linguistic competence, even if human minds are limited in various ways. (shrink)

Recursion: A Computational Investigation into the Representation and Processing of Language. By Lobina David.