This is a philosophical study by Lithuanian authors on issues related to how to teach philosophy, especially moral philosophy, through films, paintings, images, etc. The topics include multimodality as a synthesis; semiotics and language and image; cinema and philosophical education; postructuralism; film education; value education through spiritual cinema; Eastern Ethics for Western students through multimodal education; philosophy for children; sound and multimodality; Pedagogy of aesthetic to eco-pedagogy, etc.

Music can be interpreted by attributing syntactic relationships to sequential musical events, and, computationally, such musical interpretation represents an analogous combinatorial task to syntactic processing in language. While this perspective has been primarily addressed in the domain of harmony, we focus here on rhythm in the Western tonal idiom, and we propose for the first time a framework for modeling the moment‐by‐moment execution of processing operations involved in the interpretation of music. Our approach is based on (1) a music‐theoretically motivated (...) grammar formalizing the competence of rhythmic interpretation in terms of three basic types of dependency (preparation, syncopation, and split; Rohrmeier, 2020), and (2) psychologically plausible predictions about the complexity of structural integration and memory storage operations, necessary for parsing hierarchical dependencies, derived from the dependency locality theory (Gibson, 2000). With a behavioral experiment, we exemplify an empirical implementation of the proposed theoretical framework. One hundred listeners were asked to reproduce the location of a visual flash presented while listening to three rhythmic excerpts, each exemplifying a different interpretation under the formal grammar. The hypothesized execution of syntactic‐processing operations was found to be a significant predictor of the observed displacement between the reported and the objective location of the flashes. Overall, this study presents a theoretical approach and a first empirical proof‐of‐concept for modeling the cognitive process resulting in such interpretation as a form of syntactic parsing with algorithmic similarities to its linguistic counterpart. Results from the present small‐scale experiment should not be read as a final test of the theory, but they are consistent with the theoretical predictions after controlling for several possible confounding factors and may form the basis for further large‐scale and ecological testing. (shrink)

In this paper, based on computer reading and processing of music frequency, amplitude, timbre, image pixel, color filling, and so forth, a method of image style transfer guided by music feature data is implemented in real-time playback, using existing music files and image files, processing and trying to reconstruct the fluent relationship between the two in terms of auditory and visual, generating dynamic, musical sound visualization with real-time changes in the visualization. Although recommendation systems have been well developed in (...) real applications, the limitations of CF algorithms are slowly coming to light as the number of people increases day by day, such as the data sparsity problem caused by the scarcity of rated items, the cold start problem caused by new items and new users. The work is dynamic, with real-time changes in music and sound. Taking portraits as an experimental case, but allowing users to customize the input of both music and image files, this new visualization can provide users with a personalized service of mass customization and generate personalized portraits according to personal preferences. At the same time, we take advantage of the BP neural network’s ability to handle complex nonlinear problems and construct a rating prediction model between the user and item attribute features, referred to as the PSO-BP rating prediction model, by combining the features of global optimization of particle swarm optimization algorithm, and make further improvements based on the traditional collaborative filtering algorithm. (shrink)

The interocular suppression technique termed continuous flash suppression (CFS) has become an immensely popular tool for investigating visual processing outside of awareness. The emerging picture from studies using CFS is that extensive processing of a visual stimulus, including its semantic and affective content, occurs despite suppression from awareness of that stimulus by CFS. However, the current implementation of CFS in many studies examining processing outside of awareness has several drawbacks that may be improved upon for future studies (...) using CFS. In this paper, we address some of those shortcomings, particularly ones that affect the assessment of unawareness during CFS, and ones to do with the use of ‘visible’ conditions that are often included as a comparison to a CFS condition. We also discuss potential biases in stimulus processing as a result of spatial attention and feature-selective suppression. We suggest practical guidelines that minimize the effects of those limitations in using CFS to study visual processing outside of awareness. (shrink)

TheConceptual Feature framework predicts that word meaning is represented within a high-dimensional semantic space bounded by weighted contributions of perceptual, affective, and encyclopedic information. The ACF, like latent semantic analysis, is amenable to distance metrics between any two words. We applied predictions of the ACF framework to abstract words using eyetracking via an adaptation of the classical “visual word paradigm”. Healthy adults selected the lexical item most related to a probe word in a 4-item written word array comprising the (...) target and three distractors. The relation between the probe and each of the four words was determined using the semantic distance metrics derived from ACF ratings. Eye movement data indicated that the word that was most semantically related to the probe received more and longer fixations relative to distractors. Importantly, in sets where participants did not provide an overt behavioral response, the fixation rates were nonetheless significantly higher for targets than distractors, closely resembling trials where an expected response was given. Furthermore, ACF ratings which are based on individual words predicted eye fixation metrics of probe-target similarity at least as well as latent semantic analysis ratings which are based on word co-occurrence. The results provide further validation of Euclidean distance metrics derived from ACF ratings as a measure of one facet of the semantic relatedness of abstract words and suggest that they represent a reasonable approximation of the organization of abstract conceptual space. The data are also compatible with the broad notion that multiple sources of information shape the organization of abstract concepts. While the adapted “VWP” is potentially a more metacognitive task than the classical visual world paradigm, we argue that it offers potential utility for studying abstract word comprehension. (shrink)

The Abstract Conceptual Feature (ACF) framework predicts that word meaning is represented within a high‐dimensional semantic space bounded by weighted contributions of perceptual, affective, and encyclopedic information. The ACF, like latent semantic analysis, is amenable to distance metrics between any two words. We applied predictions of the ACF framework to abstract words using eyetracking via an adaptation of the classical “visual word paradigm” (VWP). Healthy adults (n = 20) selected the lexical item most related to a probe word in (...) a 4‐item written word array comprising the target and three distractors. The relation between the probe and each of the four words was determined using the semantic distance metrics derived from ACF ratings. Eye movement data indicated that the word that was most semantically related to the probe received more and longer fixations relative to distractors. Importantly, in sets where participants did not provide an overt behavioral response, the fixation rates were nonetheless significantly higher for targets than distractors, closely resembling trials where an expected response was given. Furthermore, ACF ratings which are based on individual words predicted eye fixation metrics of probe‐target similarity at least as well as latent semantic analysis ratings which are based on word co‐occurrence. The results provide further validation of Euclidean distance metrics derived from ACF ratings as a measure of one facet of the semantic relatedness of abstract words and suggest that they represent a reasonable approximation of the organization of abstract conceptual space. The data are also compatible with the broad notion that multiple sources of information (not restricted to sensorimotor and emotion information) shape the organization of abstract concepts. While the adapted “VWP” is potentially a more metacognitive task than the classical visual world paradigm, we argue that it offers potential utility for studying abstract word comprehension. (shrink)

Though emotional faces preferentially reach awareness, the present study utilised both objective and subjective indices of awareness to determine whether they enhance subjective awareness and “blindsight”. Under continuous flash suppression, participants localised a disgusted, fearful or neutral face (objective index), and rated their confidence (subjective index). Psychopathic traits were also measured to investigate their influence on emotion perception. As predicted, fear increased localisation accuracy, subjective awareness and “blindsight” of upright faces. Coldhearted traits were inversely related to subjective awareness, but (...) not “blindsight”, of upright fearful faces. In a follow-up experiment using inverted faces, increased localisation accuracy and awareness, but not “blindsight”, were observed for fear. Surprisingly, awareness of inverted fearful faces was positively correlated with coldheartedness. These results suggest that emotion enhances both pre-conscious processing and the qualitative experience of awareness, but that pre-conscious and conscious processing of emotional faces rely on at least partially dissociable cognitive mechanisms. (shrink)

Illusions that produce perceptual suppression despite constant retinal input are used to manipulate visual consciousness. Here we report on a powerful variant of existing techniques, Continuous Flash Suppression. Distinct images flashed successively around 10 Hz into one eye reliably suppress an image presented to the other eye. Compared to binocular rivalry, the duration of perceptual suppression increased more than 10-fold. Using this tool we show that the strength of the negative afterimage of an adaptor was reduced by half (...) when it was perceptually suppressed by input from the other eye. The more likely the adaptor was completely suppressed, the larger the reduction of the afterimage intensity. Paradoxically, trial-to-trial visibility of the adaptor did not correlate with the degree of suppression. Our results imply that formation of afterimages involves neuronal structures that access input from both eyes, but that do not correspond directly to the neuronal correlates of perceptual awareness. (shrink)

3D FORMOTION, a unified cortical model of motion integration and segmentation, explains how brain mechanisms of form and motion processing interact to generate coherent percepts of object motion from spatially distributed and ambiguous visual information. The same cortical circuits reproduce motion-induced distortion of position maps, including both flash-lag and flash-drag effects.

Although the condition known as synaesthesia is currently undergoing a scientific resurgence, to date the literature has largely focused on the heterogeneous nature of synaesthesia across individuals. In order to provide a better understanding of synaesthesia, however, general characteristics need to be investigated. Synaesthetic experiences are often described as occurring ‘internally’ or in the ‘mind’s eye’, which is remarkably similar to how we would describe our experience of visual mental imagery. We assessed the role of visual imagery in (...) synaesthesia by sampling a large group of synaesthetes and found that they report experiencing more vivid mental images than controls. These findings have important implications for our general understanding of synaesthesia and, in particular, emphasize the need to control for visual imagery in behavioural and neuroimaging paradigms. (shrink)

Humans coordinate their focus of attention with others, either by gaze following or prior agreement. Though the effects of joint attention on perceptual and cognitive processing tend to be examined in purely visual environments, they should also show in multisensory settings. According to a prevalent hypothesis, joint attention enhances visual information encoding and processing, over and above individual attention. If two individuals jointly attend to the visual components of an audiovisual event, this should affect the weighing of (...) visual information during multisensory integration. We tested this prediction in this preregistered study, using the well-documented sound-induced flash illusions, where the integration of an incongruent number of visual flashes and auditory beeps results in a single flash being seen as two (fission illusion) and two flashes as one (fusion illusion). Participants were asked to count flashes either alone or together, and expected to be less prone to both fission and fusion illusions when they jointly attended to the visual targets. However, illusions were as frequent when people attended to the flashes alone or with someone else, even though they responded faster during joint attention. Our results reveal the limitations of the theory that joint attention enhances visual processing as it does not affect temporal audiovisual integration. (shrink)