The purpose of this study is to propose new similarity measures namely rough variational coefficient similarity measure under the rough neutrosophic environment. The weighted rough variational coefficient similarity measure has been also defined. The weighted rough variational coefficient similarity measures between the rough ideal alternative and each alternative are xxxxx calculated to find the best alternative. The ranking order of all the alternatives can be determined by using the numerical values of similarity measures. Finally, an illustrative example has been provided (...) to show the effectiveness and validity of the proposed approach. Comparisons of decision results of existing rough similarity measures have been provided. (shrink)

This paper is devoted to present Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) method for multi-attribute group decision making under rough neutrosophic environment. The concept of rough neutrosophic set is a powerful mathematical tool to deal with uncertainty, indeterminacy and inconsistency. In this paper, a new approach for multi-attribute group decision making problems is proposed by extending the TOPSIS method under rough neutrosophic environment. Rough neutrosophic set is characterized by the upper and lower approximation operators (...) and the pair of neutrosophic sets that are characterized by truth-membership degree, indeterminacy membership degree, and falsity membership degree. In the decision situation, ratings of alternatives with respect to each attribute are characterized by rough neutrosophic sets that reflect the decision makers’ opinion. Rough neutrosophic weighted averaging operator has been used to aggregate the individual decision maker’s opinion into group opinion for rating the importance of attributes and alternatives. Finally, a numerical example has been provided to demonstrate the applicability and effectiveness of the proposed approach. (shrink)

Humans communicate with different modalities. We offer an account of multi-modal meaning coordination, taking speech-gesture meaning coordination as a prototypical case. We argue that temporal synchrony (plus prosody) does not determine how to coordinate speech meaning and gesture meaning. Challenging cases are asynchrony and broadcasting cases, which are illustrated with empirical data. We propose that a process algebra account satisfies the desiderata. It models gesture and speech as independent but concurrent processes that can communicate flexibly with each other (...) and exchange the same information more than once. The account utilizes the ψ-calculus, allowing for agents, input-output-channels, concurrent processes, and data transport of typed λ-terms. A multi-modal meaning is produced integrating speech meaning and gesture meaning into one semantic package. Two cases of meaning coordination are handled in some detail: the asynchrony between gesture and speech, and the broadcasting of gesture meaning across several dialogue contributions. This account can be generalized to other cases of multi-modal meaning. (shrink)

Multi-modal integration, which combines multiple neurophysiological signals, is gaining more attention for its potential to supplement single modality’s drawbacks and yield reliable results by extracting complementary features. In particular, integration of electroencephalography and functional near-infrared spectroscopy is cost-effective and portable, and therefore is a fascinating approach to brain-computer interface. However, outcomes from the integration of these two modalities have yielded only modest improvement in BCI performance because of the lack of approaches to integrate the two different features. In (...) addition, mismatch of recording locations may hinder further improvement. In this literature review, we surveyed studies of the integration of EEG/fNIRS in BCI thoroughly and discussed its current limitations. We also suggested future directions for efficient and successful multi-modal integration of EEG/fNIRS in BCI systems. (shrink)

We define a multi-modal version of Computation Tree Logic ( ctl ) by extending the language with path quantifiers E δ and A δ where δ denotes one of finitely many dimensions, interpreted over Kripke structures with one total relation for each dimension. As expected, the logic is axiomatised by taking a copy of a ctl axiomatisation for each dimension. Completeness is proved by employing the completeness result for ctl to obtain a model along each dimension in turn. (...) We also show that the logic is decidable and that its satisfiability problem is no harder than the corresponding problem for ctl. We then demonstrate how Normative Systems can be conceived as a natural interpretation of such a multi-dimensional ctl logic. (shrink)

My essay, “Multi-modal argumentation” was published in the journal, _Philosophy of the Social Sciences,_ in 1994. This information appeared again in my book, _Coalescent argumentation_ in 1997. In the ensuing twenty years, there have been many changes in argumentation theory, and I would like to take this opportunity to examine my now middle-aged theory in light of the developments in our discipline. I will begin by relating how a once keen intended lawyer and then formal logician ended up (...) in argumentation theory. (If you do not care to read this bit of autobiography, skip to Section 2). (shrink)

Human instructors often refer to objects and actions involved in a task description using both linguistic and non-linguistic means of communication. Hence, for robots to engage in natural human-robot interactions, we need to better understand the various relevant aspects of human multi-modal task descriptions. We analyse reference resolution to objects in a data collection comprising two object manipulation tasks and find that 78.76% of all referring expressions to the objects relevant in Task 1 are verbally underspecified and 88.64% (...) of all referring expressions are verbally underspecified in Task 2. The data strongly suggests that a language processing module for robots must be genuinely multi-modal, allowing for seamless integration of information transmitted in the verbal and the visual channel, whereby tracking the speaker’s eye gaze and gestures as well as object recognition are necessary preconditions. (shrink)

My essay, “Multi-modal argumentation” was published in the journal, _Philosophy of the Social Sciences,_ in 1994. This information appeared again in my book, _Coalescent argumentation_ in 1997. In the ensuing twenty years, there have been many changes in argumentation theory, and I would like to take this opportunity to examine my now middle-aged theory in light of the developments in our discipline. I will begin by relating how a once keen intended lawyer and then formal logician ended up (...) in argumentation theory. (If you do not care to read this bit of autobiography, skip to Section 2). (shrink)

My essay, “Multi-modal argumentation” was published in the journal, _Philosophy of the Social Sciences,_ in 1994. This information appeared again in my book, _Coalescent argumentation_ in 1997. In the ensuing twenty years, there have been many changes in argumentation theory, and I would like to take this opportunity to examine my now middle-aged theory in light of the developments in our discipline. I will begin by relating how a once keen intended lawyer and then formal logician ended up (...) in argumentation theory. (If you do not care to read this bit of autobiography, skip to Section 2). (shrink)

The article investigates the problem of the existence of the so-called multi-modal argu­ments – persuasive structures, where, along with written or spoken words, there are non-verbal elements that also perform persuasive functions. Such arguments are considered neither to be fully translatable into words, nor not to be total aliens in the argumentation studies. Along with the problem of translating the non-verbal component of a multi-modal argument, the question of their functional status in the structure of the (...) argument is also discussed. It is proposed to consider such elements as premises, the connection of which with the conclusion is explained through the description of the mode (whether it is an action, an image or a recorded audio message) in which their propositional con­tent is actualized. It is argued that the mode of the actualization of propositional content of the argument is no less significant than the content itself. On the basis of this claim it is proposed to consider “classical” textual arguments as a form of multi-modal arguments. (shrink)

The main stream of formal and informal logic as well as more recent work in discourse analysis provides a way of understanding certain arguments that particularly lend themselves to rational analysis. I argue, however, that these, and allied modes of analysis, be seen as heuristic models and not as the only proper mode of argument. This article introduces three other modes of argumen tation that emphasize distinct aspects of human communication, but that, at the same time, must be considered for (...) the full understanding of argumentation. These modes are (1) the emotional, which relates to the realm of feelings, (2) the visceral, which stems from the area of the physical, and (3) the kisceral, which covers the intuitive and non-sensory arenas. At its most extreme the view holds that arguments may be given (almost) wholly within one mode and not be at all susceptible to those methods of argument analysis previously used. A more cautious statement allows that any interactive argument will (possibly) contain elements from various modes, and that to attempt to reduce these all to the rational is prejudiced reductionism. (shrink)

Face recognition is impaired in patients with prosopagnosia, which may occur as a side effect of neurosurgical procedures. Face selective regions on the ventral temporal cortex have been localized with electrical cortical stimulation, electrocorticography, and functional magnetic resonance imagining. This is the first group study using within-patient comparisons to validate face selective regions mapping, utilizing the aforementioned modalities. Five patients underwent surgical treatment of intractable epilepsy and joined the study. Subdural grid electrodes were implanted on their ventral temporal cortices to (...) localize seizure foci and face selective regions as part of the functional mapping protocol. Face selective regions were identified in all patients with fMRI, four patients with ECoG, and two patients with ECS. From 177 tested electrode locations in the region of interest, which is defined by the fusiform gyrus and the inferior temporal gyrus, 54 face locations were identified by at least one modality in all patients. fMRI mapping showed the highest detection rate, revealing 70.4% for face selective locations, whereas ECoG and ECS identified 64.8 and 31.5%, respectively. Thus, 28 face locations were co-localized by at least two modalities, with detection rates of 89.3% for fMRI, 85.7% for ECoG and 53.6 % for ECS. All five patients had no face recognition deficits after surgery, even though five of the face selective locations, one obtained by ECoG and the other four by fMRI, were within 10 mm to the resected volumes. Moreover, fMRI included a quite large volume artifact on the ventral temporal cortex in the ROI from the anatomical structures of the temporal base. In conclusion, ECS was not sensitive in several patients, whereas ECoG and fMRI even showed activation within 10 mm to the resected volumes. Considering the potential signal drop-out in fMRI makes ECoG the most reliable tool to identify face selective locations in this study. A multimodal approach can improve the specificity of ECoG and fMRI, while simultaneously minimizing the number of required ECS sessions. Hence, all modalities should be considered in a clinical mapping protocol entailing combined results of co-localized face selective locations. (shrink)

Multi-modal metaphor is a new perspective in metaphor research developed in modern times. Beyond the metaphor research of language, it combines text, image, sound, and other modes and provides new insights and perspectives for metaphor research. Food advertisements often combine sound, images, and other forms to promote the products and increase consumers’ desire to buy, and they often contain metaphors of multiple modes. However, under the perspective of cross-cultural research, when the same food brand is advertised in different (...) countries, the multi-modal metaphors are varied to appeal to different audiences. This article compares food advertisements in China and in the U.S. from the perspective of multi-modal metaphors, and analyzes the varied applications arising from different cultural influences. The research may act as a reference for advertising strategies on cross-cultural occasions. (shrink)

Intellectual humility can be broadly construed as being conscious of the limits of one’s existing knowledge and capable to acquire more knowledge, which makes it a key virtue of the information age. However, the claim “I am (intellectually) humble” seems paradoxical in that someone who has the disposition in question would not typically volunteer it. There is an explanatory gap between the meaning of the sentence and the meaning the speaker ex- presses by uttering it. We therefore suggest analyzing intellectual (...) humility semantically, using a psycholexical approach that focuses on both synonyms and antonyms of ‘intellectual humili- ty’. We present a thesaurus-based methodology to map the semantic space of intellectual hu- mility and the vices it opposes as a heuristic to support philosophical and psychological anal- ysis of this disposition. We performed the mapping both in English and German in order to test for possible cultural differences in the understanding of intellectual humility. In both lan- guages, we find basically the same three semantic dimensions of intellectual humility (sensi- bility, discreetness, and knowledge dimensions) as well as three dimensions of its related vic- es (self-overrating, other-underrating and dogmatism dimensions). The resulting semantic clusters were validated in an empirical study with English (n=276) and German (n=406) par- ticipants. We find medium to high correlations (0.54-0.72) between thesaurus similarity and perceived similarity, and we can validate the labels of the three dimensions identified in the study. But we also find indications of the limitations of the thesaurus methodology in terms of cluster plausibility. We conclude by discussing the importance of these findings for construct- ing psychometric scales for intellectual humility. (shrink)

(1996). Multi‐modal thinking in soft systems methodology's rich pictures. World Futures: Vol. 47, Unity and Diversity in Contemporary Systems Tinking: Systematic Pictures at an Exhibition, pp. 79-92.

A narrow focus on the jaw (or on motor generators) does not account for individual and language-specific differences in babbling and early speech. Furthermore, data from Yoshinaga-Itano's laboratory support earlier findings that show glottal rather than oral stops in deaf infants' babbling: audition is crucial for developing normal syllables.

We define a multi-modal version of Computation Tree Logic (CTL) by extending the language with path quantifiers $E^\delta $ and $E^\delta $ where δ denotes one of finitely many dimensions, interpreted over Kripke structures with one total relation for each dimension. As expected, the logic is axiomatised by taking a copy of a CTL axiomatisation for each dimension. Completeness is proved by employing the completeness result for CTL to obtain a model along each dimension in turn. We also (...) show that the logic is decidable and that its satisfiability problem is no harder than the corresponding problem for CTL. We then demonstrate how Normative Systems can be conceived as a natural interpretation of such a multi-dimensional CTL logic. (shrink)

We define a multi-modal version of Computation Tree Logic (ctl) by extending the language with path quantifiers E δ and A δ where δ denotes one of finitely many dimensions, interpreted over Kripke structures with one total relation for each dimension. As expected, the logic is axiomatised by taking a copy of a ctl axiomatisation for each dimension. Completeness is proved by employing the completeness result for ctl to obtain a model along each dimension in turn. We also (...) show that the logic is decidable and that its satisfiability problem is no harder than the corresponding problem for ctl. We then demonstrate how Normative Systems can be conceived as a natural interpretation of such a multi-dimensional ctl logic. (shrink)

Social interaction, especially for older people living alone is a challenge currently facing human-robot interaction (HRI). There has been little research on user preference towards HRI interfaces. In this paper, we took both objective observations and participants’ opinions into account in studying older users with a robot partner. The developed dual-modal robot interface offered older users options of speech or touch screen to perform tasks. Fifteen people aged from 70 to 89 years old, participated. We analyzed the spontaneous actions (...) of the participants, including their attentional activities and conversational activities, the temporal characteristics of these social behaviours, as well as questionnaires. It has been revealed that social engagement with the robot demonstrated by older people was no different from what might be expected towards a human partner. This study is an early attempt to reveal the social connections between human beings and a personal robot in real life. (shrink)

Conceived by Johan van Benthem and Yde Venema, arrow logic started as an attempt to give a general account of the logic of transitions. The generality of the approach provided a wide application area ranging from philosophy to computer science. The book gives a comprehensive survey of logical research within and around arrow logic. Since the natural operations on transitions include composition, inverse and identity, their logic, arrow logic can be studied from two different perspectives, and by two (complementary) methodologies: (...) modal logic and the algebra of relations. Some of the results in this volume can be interpreted as price tags. They show what the prices of desirable properties, such as decidability, (finite) axiomatisability, Craig interpolation property, Beth definability etc. are in terms of semantic properties of the logic. The research program of arrow logic has considerably broadened in the last couple of years and recently also covers the enterprise to explore the border between decidable and undecidable versions of other applied logics. The content of this volume reflects this broadening. The editors included a number of papers which are in the spirit of this generalised research program. (shrink)

(1996). Knowledge elicitation using a multi‐modal approach. World Futures: Vol. 47, Unity and Diversity in Contemporary Systems Tinking: Systematic Pictures at an Exhibition, pp. 93-101.

We study prefixed tableaux for first-order multi-modal logic, providing proofs for soundness and completeness theorems, a Herbrand theorem on deductions describing the use of Herbrand or Skolem terms in place of parameters in proofs, and a lifting theorem describing the use of variables and constraints to describe instantiation. The general development applies uniformly across a range of regimes for defining modal operators and relating them to one another; we also consider certain simplifications that are possible with restricted (...) modal theories and fragments. (shrink)

Spatial objects may not only be perceived visually but also by touch. We report recent experiments investigating to what extent prior object knowledge acquired in either the haptic or visual sensory modality transfers to a subsequent visual learning task. Results indicate that even mental object representations learnt in one sensory modality may attain a multi-modal quality. These findings seem incompatible with picture-based reasoning schemas but leave open the possibility of modality-specific reasoning mechanisms.

We define a multi-modal version of Computation Tree Logic (ctl) by extending the language with path quantifiers E δ and A δ where δ denotes one of finitely many dimensions, interpreted over Kripke structures with one total relation for each dimension. As expected, the logic is axiomatised by taking a copy of a ctl axiomatisation for each dimension. Completeness is proved by employing the completeness result for ctl to obtain a model along each dimension in turn. We also (...) show that the logic is decidable and that its satisfiability problem is no harder than the corresponding problem for ctl. We then demonstrate how Normative Systems can be conceived as a natural interpretation of such a multi-dimensional ctl logic. (shrink)

The paper aims at providing the multi-modal propositional logic LTK with a sound and complete axiomatisation. This logic combines temporal and epistemic operators and focuses on m odeling the behaviour of a set of agents operating in a system on the background of a temporal framework. Time is represented as linear and discrete, whereas knowledge is modeled as an S5-like modality. A further modal operator intended to represent environment knowledge is added to the system in order to (...) achieve the expressive power sufficient to describe the piece of information available to the agents at each moment in the flow of time. (shrink)

For a robot to be capable of development it must be able to explore its environment and learn from its experiences. It must find opportunities to experience the unfamiliar in ways that reveal properties valid beyond the immediate context. In this paper, we develop a novel method for using the rhythm of everyday actions as a basis for identifying the characteristic appearance and sounds associated with objects, people, and the robot itself. Our approach is to identify and segment groups of (...) signals in individual modalities based on their rhythmic variation, then to identify and bind causally-related groups of signals across different modalities. By including proprioception as a modality, this cross-modal binding method applies to the robot itself, and we report a series of experiments in which the robot learns about the characteristics of its own body. (shrink)

In this paper I question the primacy of argumentation relying solely on logic by showing how the body and mind are deeply connected and as a result how communication and argumentation are a product of this mind/body connection. In particular, I explore the physicality of argumentation through the research and writings on gestures and the embodied mind. Michael Gilbert’s theory of multi-modal argumentation provides the general approach for this elaboration.

Thirty years after its initial characterization and more than 1000 publications listed in PubMed describing its properties, the small (ca15 kDa) protein profilin continues to surprise us with new, recently discovered functions. Originally described as an actin‐binding protein, profilin has now been shown to interact with more than a dozen proteins in mammalian cells. Some of the more recently described and intriguing interactions are within neurons involving a neuronal profilin family member. Profilin is now regarded as a regulator of various (...) cellular processes such as cytoskeletal dynamics, membrane trafficking and nuclear transport. Profilin is a necessary element in key steps of neuronal differentiation and synaptic plasticity, and embodies properties postulated for a synaptic tag. These findings identify profilin as an important factor linking cellular and behavioural plasticity in neural circuits. BioEssays 30:994–1002, 2008. © 2008 Wiley Periodicals, Inc. (shrink)

This paper discusses how an understanding of Jung's psychological types is important for the relevance of Gilbert's multi-modal argumentation theory. Moreover, it highlights how the types have been confirmed by contemporary neuroscience and cognitive psychology. Based on Gilbert's approach, I extend multi-modal argumentation to the area of legal argumentation. It seems that when we leave behind the traditional fortress of “logical” legal argumentation, we "discover" alternate modes that have always been present, concealed in the theoretically underestimated (...) rhetorical skills of arguers. (shrink)

In this paper I question the primacy of argumentation relying solely on logic by showing how the body and mind are deeply connected and as a result how communication and argumentation are a product of this mind/body connection. In particular, I explore the physicality of argumentation through the research and writings on gestures and the embodied mind. Michael Gilbert’s theory of multi-modal argumentation provides the general approach for this elaboration.

In this paper I question the primacy of argumentation relying solely on logic by showing how the body and mind are deeply connected and as a result how communication and argumentation are a product of this mind/body connection. In particular, I explore the physicality of argumentation through the research and writings on gestures and the embodied mind. Michael Gilbert’s theory of multi-modal argumentation provides the general approach for this elaboration.

Agitation is one of the most common behavioural and psychological symptoms in people living with dementia. This behaviour can cause tremendous stress and anxiety on family caregivers and healthcare providers. Direct observation of PLwD is the traditional way to measure episodes of agitation. However, this method is subjective, bias-prone and timeconsuming. Importantly, it does not predict the onset of the agitation. Therefore, there is a need to develop a continuous monitoring system that can detect and/or predict the onset of agitation. (...) In this study, a multi-modal sensor platform with video cameras, motion and door sensors, wristbands and pressure mats were set up in a hospital-based dementia behavioural care unit to develop a predictive system to identify the onset of agitation. The research team faced several barriers in the development and initiation of the study, namely addressing concerns about the study ethics, logistics and costs of study activities, device design for PLwD and limitations of its use in the hospital. In this paper, the strategies and methodologies that were implemented to address these challenges are discussed for consideration by future researchers who will conduct similar studies in a hospital setting. (shrink)