While the PREDICATE(x) structure requires close coordination of subject and predicate, both represented in consciousness, the cognitive (ventral), and sensorimotor (dorsal) pathways operate in parallel. Sensorimotor information is unconscious and can contradict cognitive spatial information. A more likely origin of linguistic grammar lies in the mammalian action planning process. Neurological machinery evolved for planning of action sequences becomes applied to planning communicatory sequences.

In January 2019, What is Peppa?, a promotional video for a Chinese New Year movie, received widespread attention in China immediately after its release. This paper explains the success of the video from the perspective of visual framing, and employs Systemic Visual Grammar to analyze how visual semiotics are applied to frame prominent topics so as to achieve promotional purposes. The results show that: (i) visual semiotics are used to frame the topic of empty (...) nesters, implying that this issue brings negative consequences and evoking the audience’s empathy and concern; (ii) visuals frame the topic of family love, in which the main protagonist’s actions are highlighted; and (iii) the topic of family reunion is mainly framed and realized by delicate compositional arrangements. Using various visual semiotics at the denotative, stylistic-semantic, connotative, and ideological levels, this video establishes both visual and emotional communication between the main character and the audience, making the promotional purpose more successful. The results highlight and specify the important roles of visual frames in promotional videos, and the integration of Peppa with traditional Chinese culture, love, and family reunion represents a visual approach to glocalization. (shrink)

Formal systems are standardly envisaged in terms of a grammar specifying well-formed formulae together with a set of axioms and rules. Derivations are ordered lists of formulae each of which is either an axiom or is generated from earlier items on the list by means of the rules of the system; the theorems of a formal system are simply those formulae for which there are derivations. Here we outline a set of alternative and explicitly visual ways of envisaging (...) and analyzing at least simple formal systems using fractal patterns of infinite depth. Progressively deeper dimensions of such a fractal can be used to map increasingly complex wffs or increasingly complex 'value spaces', with tautologies, contradictions, and various forms of contingency coded in terms of color. This and related approaches, it turns out, offer not only visually immediate and geometrically intriguing representations of formal systems as a whole but also promising formal links (1) between standard systems and classical patterns in fractal geometry, (2) between quite different kinds of value spaces in classical and infinite-valued logics, and (3) between cellular automata and logic. It is hoped that pattern analysis of this kind may open possibilities for a geometrical approach to further questions within logic and metalogic. (shrink)

Journal Name: Semiotica - Journal of the International Association for Semiotic Studies / Revue de l'Association Internationale de Sémiotique Volume: 2013 Issue: 195 Pages: 127-167.

Cognitive Science, Volume 46, Issue 2, February 2022.

Number morphology (e.g., singular vs. plural) is a part of the grammar that captures numerical information. Some languages have morphological Number values, which express few (paucal), two (dual), three (trial) and sometimes (possibly) four (quadral). Interestingly, the limit of the attested morphological Number values matches the limit of non‐verbal numerical cognition. The latter is based on two systems, one estimating approximate numerosities and the other computing exact numerosities up to three or four. We compared the literature on non‐verbal number (...) systems with data on Number morphology from 218 languages. Our observations suggest that non‐verbal numerical cognition is reflected as a core part of language. (shrink)

The evolution of Intelligent Tutoring System (ITS) is the result of the amount of research in the field of education and artificial intelligence in recent years. English is the third most common languages in the world and also is the internationally dominant in the telecommunications, science and trade, aviation, entertainment, radio and diplomatic language as most of the areas of work now taught in English. Therefore, the demand for learning English has increased. In this paper, we describe the design of (...) an Intelligent Tutoring System for teaching English language grammar to help students learn English grammar easily and smoothly. The system provides all topics of English grammar and generates a series of questions automatically for each topic for the students to solve. The system adapts with all the individual differences of students and begins gradually with students from easier to harder level. The intelligent tutoring system was given to a group of students of all age groups to try it and to see the impact of the system on students. The results showed a good satisfaction of the students toward the system. (shrink)

The two contrasting theoretical approaches to visual perception, the constructivist and the ecological, are briefly presented and illustrated through their analyses of space and size perception. Earlier calls for their reconciliation and unification are reviewed. Neurophysiological, neuropsychological, and psychophysical evidence for the existence of two quite distinct visual systems, the ventral and the dorsal, is presented. These two perceptual systems differ in their functions; the ventral system's central function is that of identification, while the dorsal system is mainly (...) engaged in the visual control of motor behavior. The strong parallels between the ecological approach and the functioning of the dorsal system, and between the constructivist approach and the functioning of the ventral system are noted. It is also shown that the experimental paradigms used by the proponents of these two approaches match the functions of the respective visual systems. A dual-process approach to visual perception emerges from this analysis, with the ecological-dorsal process transpiring mainly without conscious awareness, while the constructivist-ventral process is normally conscious. Some implications of this dual-process approach to visual-perceptual phenomena are presented, with emphasis on space perception. Key Words: constructivist; dual-process approach; ecological; size perception; space perception; two visual systems; visual perception theories. (shrink)

Frost's article advocates for universal models of reading and critiques recent models that concentrate in what has been described as “cracking the orthographic code.” Although the challenge to develop models that can account for word recognition beyond Indo-European languages is welcomed, we argue that reading models should also be constrained by general principles of visual processing and object recognition.

Argues for a category of “cognitive feelings”, which are representationally significant, but are not part of the content of the states they accompany. The feeling of pastness in episodic memory, of familiarity (missing in Capgras syndrome), and of motivation (that accompanies desire) are examples. The feeling of presence that accompanies normal visual states is due to such a cognitive feeling; the “two visual systems” are partially responsible for this feeling.

Relational Grammar (RG) was introduced in the 1970s as a theory of grammatical relations and relation change, for example, passivization, dative shift, and raising. Furthermore, the idea behind RG was that transformations as originally designed in generative grammar were unable to capture the common kernel of, e.g., passivization across languages. The researchconducted within RG has uncovered a wealth of phenomena for which it could produce a satisfactory analysis. Although the theory of Government and Binding has answered some of (...) the complaints, still it left many phenomena unaccounted for. Referent Systems (RSs) have been introduced by Vermeulen (1995) to overcome certain weaknesses of Dynamic Semantics. Their usefulness has not yet been realized in semantical theory. We shall show here that their significance cannot be overestimated. Namely, we will show in this paper that there exists a fundamental affinity to RG. Both handle the relation between an argument and a functor by means of a shared relational sign, which is unique for each argument. This assignment can be changed. What is interesting is that the notion of a chômeur, which is central to RG, finds a natural treatment in RSs. This coincidence is in our view not accidental but reveals some fundamental properties of the human language faculty. (shrink)

Molyneux’s question famously asks about whether a newly sighted subject might immediately recognize, by sight alone, shapes that were already familiar to her from a tactile point of view. This paper addresses three crucial points concerning this puzzle. First, the presence of two different questions: the classic one concerning visual recognition and another one concerning vision-for-action. Second, the explicit distinction, reported in the literature, between ocular and cortical blindness. Third, the importance of making reference to our best neuroscientific account (...) on vision, ‘the two visual systems model’, in order to better address Molyneux’s problem. Then, by offering a new, deeper analysis of the relation between, and, this paper suggests that the subjects of Molyneux’s two different questions show the same visual impairment as brain-damaged subjects with different lesions of the visual cortex. In particular, the subject of the first question shows the same impairment in visual recognition as a visual agnosic subject, while the subject of the second question shows the same visual impairment in visuomotor processing as an optic ataxic subject. These impairments still hold even if ocular processing is restored. Therefore, I suggest the following. For the first classic question, the required experimental setting cannot be properly reached. By contrast, concerning the second question, based on the interpretation we select, either the answer is negative, or, as with the first question, the experimental setting cannot be properly reached. This proposal constitutes, with the other approaches offered in the literature, a further attempt to tackle the enormous complexity of Molyneux’s puzzle. (shrink)

This paper provides a précis of Ernst Cassirer's concept of art as a symbolic form. It does so, though, in a specific respect. It points to the fact that Cassirer's concept of "symbolic form" is two-sided. On the one hand, the concept captures general cultural phenomena that are not only meaningful but also manifest the way man makes sense of the world; thus myth, religion, and art are considered general symbolic forms. On the other hand, it captures the formal structures (...) and semiotic tools thanks to which meaning is constructed within each general symbolic form (Cassirer called these structures "modes of objectivation"); thus, in art, perspective or the golden section are well-known examples of symbolic forms, now in a narrow sense, i.e. they are means to configure parts into an organized, meaningful whole. The paper will comment on art along both these two dimensions, but its main goal is to provide with concrete examples of aesthetic symbolic forms in the narrow sense in order to show how conceptual meaning can be inscribed in the space of aesthetic intuition. (shrink)

This paper provides a précis of Ernst Cassirer’s concept of art as a symbolic form. It does so, though, in a specific respect. It points to the fact that Cassirer’s concept of “symbolic form” is two-sided. On the one hand, the concept captures general cultural phenomena that are not only meaningful but also manifest the way man makes sense of the world; thus myth, religion, and art are considered general symbolic forms. On the other hand, it captures the formal structures (...) and semiotic tools thanks to which meaning is constructed within each general symbolic form ; thus, in art, perspective or the golden section are well-known examples of symbolic forms, now in a narrow sense, i.e. they are means to configure parts into an organized, meaningful whole. The paper will comment on art along both these two dimensions, but its main goal is to provide with concrete examples of aesthetic symbolic forms in the narrow sense in order to show how conceptual meaning can be inscribed in the space of aesthetic intuition. (shrink)

According to the two visual systems model, the visual processing of objects divides into semantic and pragmatic processing. We provide various criteria for this distinction. Further, we argue that both the semantic and pragmatic processing of visual information about objects should be divided into low-level processing and high-level processing. Finally, we re-evaluate the contribution of the human parietal lobe to the concious visual perception of spatial relations among objects.

Taking as its starting point significant similarities between a formal language model—Grammar Systems—and a grammatical theory—Autolexical Syntax—in this paper we suggest the application of the former to the topic of the latter. To show the applicability of Grammar Systems Theory to grammatical description, we introduce a formal-language-theoretic framework for the architecture of natural language grammar: Linguistic Grammar Systems. We prove the adequacy of this model by highlighting its features (modularity, parallelism, interaction) and by showing the similarity (...) between this framework and accepted and well-known grammatical models (e.g. Autolexical Syntax). (shrink)

The concept of judicial objectivity is a cornerstone of modern legal systems. This article discusses the interplay between the lexical uses of the concept of judicial objectivity in cases that review the judicial impartiality of the court. The data for this project is retrieved from a large sample of cases from Hungary, Italy, Lithuania, Slovakia, Slovenia, Spain and the UK. The analysis of the data shows that in the case of alleged judicial bias, the concept of objectivity is referred to (...) in order to justify a series of judicial activities. In particular, the study provides a strong indication of what Legrand called ‘pre-judices’, which are the cultural aspects that are embedded in the process of the professional socialisation of each legal system. (shrink)

The parallel drawn by Norman between the dorsal and ventral systems and direct and indirect approaches is based on two misrepresentations of the direct approach – that it is concerned only with the unconscious control of action, and that it cannot explain learning. We propose a way of understanding the visual system differences from within the direct approach.

Harmonic Grammar (HG) is a model of linguistic constraint interaction in which well-formedness is calculated as the sum of weighted constraint violations. We show how linear programming algorithms can be used to determine whether there is a weighting for a set of constraints that fits a set of linguistic data. The associated software package OT-Help provides a practical tool for studying large and complex linguistic systems in the HG framework and comparing the results with those of OT. We describe (...) the translation from Harmonic Grammars to systems solvable by linear programming, and we illustrate the usefulness of OT-Help with a set of studies of the predictions HG makes for phonological typology. (shrink)

According to Pylyshyn, the early visual system is able to categorize perceptual inputs into shape classes based on visual similarity criteria; it is also suggested that written words may be categorized within early vision. This speculation is contradicted by the fact that visually unrelated exemplars of a given letter (e.g., a/A) or word (e.g., read/READ) map onto common visual categories.

The behavioral immune system (BIS) includes perceptual mechanisms for detecting cues of contamination. Former studies have indicated that moisture has a disgusting property. Therefore, moisture could be a target for detecting contamination cues by the BIS. We conducted two experiments to examine the psychophysical basis of moisture perception and clarify the relationship between the perception of moisture and the BIS. We assumed that the number of high luminance areas in a visual image provided optical information that would enable the (...) visual perception of moisture. In two experiments, we presented eight images of dough that contained different amounts of moisture as experimental stimuli. The amount of moisture shown in the images was increased in eight steps, from 28.6% to 42.9% of the total weight of the dough. In Experiment 1, the images were randomly presented on a computer display, and the participants (n = 22) were asked to rank the images in the order of the visually perceived moisture content. In Experiment 2, the participants (n = 15) completed pairwise comparisons based on the perceived moistness of the images. Furthermore, to examine the BIS responses, the participants rated the strength of disgust evoked by the stimuli, their motivation to avoid touching the stimuli, and the estimated magnitude of the risk of contamination by physical contact with the stimuli. The results indicated that the moisture content and the numbers of high luminance areas in the images accurately predicted the perception of moisture, suggesting that the detection of visual moisture was highly accurate, and the optical information served as an essential perceptual cue for detecting moisture. On the other hand, the BIS responses peaked in response to stimuli having approximately 33% to 39% moisture content. These results show that objects containing a moderate amount of moisture could be the target of visually detecting pathogens by the BIS. (shrink)

In this chapter we consider computer tools for architectural design based on shape grammar design systems, and evaluate the advantages and disadvantage of handing over these tools to inhabitants for the design of their apartments. This evaluation is qualitative by considering the values of inhabitants, architects, and cities that are affected by this hand-over. Shape grammar design systems when applied to architecture enable computer tools to generate new designs and adjustments of existing designs of apartments on the basis (...) of design rules. First, focussing on individual housing, it is argued in this chapter that the use of shape grammar design systems by inhabitants for designing their apartment realises the values of customisation and inhabitant autonomy without compromising design quality and structural safety. Second, focussing on cities, it is argued that a wide-spread use of these grammar design systems creates for cities a bottom-up inhabitant-led renewal of neighbourhoods and urban structures that maintains the social fabric in neighbourhoods and the architectural identity of cities. Values that are less realised by the hand-over are financial feasibility and ecological sustainability. Third, shifting to philosophy of technology, we present shape grammar design systems as a technology for design for values in architecture that allows for flexibility in the values designed for over the longer time periods characteristic to architecture. These systems are a technology that enables the incorporation of values of inhabitants, architects, and cities by the designs of apartments, and they are a technology that enables inhabitants to adjust their apartments through time to their developing needs and wishes. (shrink)

The analysis of works of visual art illustrates typical groups of elements and interrelations, which form semiotic systems of these works. Specific systems of connotations and their relations with semantic structures, paradigmatics, and typical signal structures are described. Like in linguistic texts, different levels are formed in complex images. The following basic level types are distinguished: sems and other units of semantic level; signs subdivided into: icons of represented objects and connotative sign formations; representamens of basic signs as interpreted (...) by Charles Peirce, including those of connotations, and signals referred to as basic perceptive integer units forming an individual level. (shrink)

The following analysis shows how developments in epistemic logic can play a nontrivial role in cognitive neuroscience. We argue that the striking correspondence between two modes of identification, as distinguished in the epistemic context, and two cognitive systems distinguished by neuroscientific investigation of the visual system (the "where" and "what" systems) is not coincidental, and that it can play a clarificatory role at the most fundamental levels of neuroscientific theory.

This paper concerns local yet systematic problems of contrastive underdetermination of model choice in cognitive neuroscience debates about the so-called two visual systems hypothesis. The underdetermination problem is systematically generated by the way certain assumptions about the representationalist nature of computation are translated into experimental practice. The problem is that behavioural data underdetermine the choice between competing representational models. In this paper, I diagnose how these assumptions generate underdetermination problems in the choice between competing functional models of perception–action. Using (...) the tools of philosophy of science, I describe the type of underdetermination and sketch a possible cure. (shrink)

This article examines the connecting lines between the Chilean Project Cybersyn’s interface design, the German Hochschule für Gestaltung Ulm and its cybernetically inspired approaches towards information design, and later developments in interaction design and the emerging field of Human–Computer Interaction in the USA. In particular, it first examines how early works of designers Tomàs Maldonado and Gui Bonsiepe on operative communication, that is, language-independent pictogram systems and visual grammars for computational systems, were intertwined with attempts to ground industrial design (...) in a scientific methodology, to address an era of computing machines, and to develop the concept of the interface as a heuristic for a renovated design thinking. It thereby also reconstructs further historical vanishing lines—e.g. the pictorial grammar of Otto Neurath’s ISOTYPE—of the development of the ‘ulm model’ of design. Second, the article explores how an apprehension of first-order cybernetics in West Germany—e.g. represented by hfg ulm staff like Max Bense or Abraham Moles, merged with Cybersyn’s second-order cybernetics ideas, as represented by Stafford Beer’s Viable System Model. And third, it asks about a further conceptual turn regarding an understanding of design which resulted in a focus on communicative interaction, e.g. in the later works of Fernando Flores and Terry Winograd on HCI, or in Beer’s Team Syntegrity approach. As an effect, the text will explore a specific and international network of cybernetic thinking between Latin America, Europe, and North America which emerged around Project Cybersyn, and which was occupied with questions of HCI, a democratization of design, and intelligence amplification. (shrink)

This article explores verbal and visual language use in Zimbabwean contraceptive promotional brochures distributed from the early to mid-1980s. Drawing on recent work in critical discourse analysis of text and visual design, the article uses multimodal discourse analysis and draws from Halliday’s Systemic Functional Grammar’s transitivity analysis to analyze family planning pamphlets, focusing on the discursive construction of women as contraceptive users. The article argues that the salience of the language of risk and vulnerability, which is (...) textually and visually deployed throughout the pamphlets, discursively constructs risk as a feature of unequal power relations. The article further argues that underlying the overarching discourse on risk are multiple ‘silences’ that discursively construct an ideological difference consisting of oppositional binaries between ‘us’ and ‘them’ in terms of power relations. The differentiation of social groups reflects ‘hidden’ social inequalities in the text and visual images. (shrink)

This commentary on Jacob and Jeannerod’s Ways of Seeing evaluates the conclusions that the authors draw from the two visual systems hypothesis about the nature and phenomenology of visual experience.

To see whether the mental and the neural have common attributes that could resolve some of the traditional dichotomies, we review neuroscientific data on the visual system. The results show that neuronal and perceptual function share a parallel and hierarchical architecture which is manifest not only in the anatomy and physiology of the visual system, but also in normal perception and in the deficits caused by lesions in different parts of the system. Based on the description of parallel (...) hierarchical levels of active information processing in the visual brain, we suggest a concept of dissociable levels of perception, advocating that the phenomenal perception and recognition is realized in the functional integrity of a network of reciprocal cortico-cortical connections. The properties shared by neuronal and perceptional functions provide a basis for a neuromental monism in which both functions are attributed a causal role. (shrink)

The Visual World Paradigm (VWP) presents listeners with a challenging problem: They must integrate two disparate signals, the spoken language and the visual context, in support of action (e.g., complex movements of the eyes across a scene). We present Impulse Processing, a dynamical systems approach to incremental eye movements in the visual world that suggests a framework for integrating language, vision, and action generally. Our approach assumes that impulses driven by the language and the visual context (...) impinge minutely on a dynamical landscape of attractors corresponding to the potential eye-movement behaviors of the system. We test three unique predictions of our approach in an empirical study in the VWP, and describe an implementation in an artificial neural network. We discuss the Impulse Processing framework in relation to other models of the VWP. (shrink)

Norman's aim to reconcile two longstanding and seemingly opposed philosophies of perception, the constructivist and the ecological, by casting them as approaches to complementary subsystems within the visual brain is laudable. Unfortunately, Norman overreaches in attempting to equate direct perception with dorsal/unconscious visual processing and indirect perception with ventral/conscious visual processing. Even a cursory review suggests that the functional and neural segregation of direct and indirect perception is not as clear as the target article would suggest.

Incidence and prevalence rates of dengue have increased over the years, and the disease is quickly becoming cause for concern within the public health community. Globally, 128 countries and slightly under four billion people are at risk of contracting dengue. In Sri Lanka, more than half of dengue cases originate in Colombo, which in previous years, used a manual pen-and-paper data management system, which meant that it was not possible to obtain or provide up-to-date information about the severity and spread (...) of dengue. In 2015, two versions of a mobile application called Mo-Buzz Dengue were developed and launched in Colombo, Sri Lanka in order to overcome the challenges of the traditional management system by capitalizing on the rising affordability and ubiquity of mobile phone technology. To keep up with the dynamic nature of disease outbreaks, real-time data need to be visualized in a manner which facilitates discerning and comprehending these patterns. Hence, we used health maps in Mo-Buzz to effectively present this information. The first version of Mo-Buzz was for public health inspectors, digitized data management as well as provided educational materials. The second version of Mo-Buzz was a source of information for the general public, a crowdsourcing platform to provide information relating to dengue transmission, and for health authorities to alert users to dengue-specific developments in their area. This paper illustrates the design considerations of the Mo-Buzz disease surveillance system for the general public. A draft scaled-down version of the PHI system was used to obtain feedback and make incremental design enhancements. Additionally, similar health maps were evaluated in terms of capability and usability. These findings were applied to identify future enhancements to the health map of Mo-Buzz Dengue. (shrink)