In robotics research with language-based interaction, simplifications are made, such that a given event can be described in a unique manner, where there is a direct mapping between event representations and sentences that can describe these events. However, common experience tells us that the same physical event can be described in multiple ways, depending on the perspective of the speaker. The current research develops methods for representing events from multiple perspectives, and for choosing the perspective that will be used for (...) generating a linguistic construal, based on attentional processes in the system. The multiple perspectives are based on the principle that events can be considered in terms of the force driving the event, and the result obtained from the event, based on the theory of Gärdenfors. In addition, within these perspectives a further refinement can be made with respect to the agent, object, and recipient perspectives. We develop a system for generating appropriate construals of meaning, and demonstrate how this can be used in a realistic dialogic interaction between a behaving robot and a human interlocutor. (shrink)

Do children’s single words related to motion and change also encode aspects of environmental events highlighted by Talmy’s motion event analysis? If so, these meanings may predict children’s early verb meanings. Analyzing the kinds of meanings expressed in single “dynamic event words” through motion event semantics yields links between early true verbs in sentences and the semantics encoded in these single words. Dynamic event words reflect the sense of temporal and spatial reversibility established in the late sensorimotor period. We propose (...) that these dynamic meanings provide the semantic foundation for the most common verbs included in early sentences, and thus a bootstrap to full development of the verb repertoire. In this study, we followed the spoken language development of five children. We identified dynamic event words as encoding dynamic change in the following dimensions: spatial direction in relation to self; vertical spatial direction; figure/ground relationships; and temporal event sequences. Verbs continuing the semantics previously identified in dynamic event words occurred early and dominated the verb repertoire through 24 months of age. (shrink)

Verb extension is a crucial gauge of the acquisition of verb meaning. In English, studies suggest that young children show conservative extension. An important test of whether an early conservative extension is a general phenomenon or a function of the input language is made possible by Chinese, a language in which verbs are more frequent and acquired earlier. This study tested whether 3-year-old Chinese children extended a group of familiar verbs that specify various ways to carry objects. Shown videos that (...) portrayed typical, mid-typical, or atypical carrying actions, children were asked to judge whether they were examples of specific Chinese carry verbs. Children’s verb extensions were mostly limited to typical exemplars, suggesting that an early conservative extension may be universal. Furthermore, extension breadth was related to the onset of verb production: verbs acquired earlier elicited more extension judgments than those acquired later. (shrink)

This review covers experimental approaches to sound-symbolism—from infants to adults, and from Sapir’s foundational studies to twenty-first century product naming. It synthesizes recent behavioral, developmental, and neuroimaging work into a systematic overview of the cross-modal correspondences that underpin iconic links between form and meaning. It also identifies open questions and opportunities, showing how the future course of experimental iconicity research can benefit from an integrated interdisciplinary perspective. Combining insights from psychology and neuroscience with evidence from natural languages provides us with (...) opportunities for the experimental investigation of the role of sound-symbolism in language learning, language processing, and communication. The review finishes by describing how hypothesis-testing and model-building will help contribute to a cumulative science of sound-symbolism in human language. (shrink)

Tense/aspect morphology on verbs is often thought to depend on event features like telicity, but it is not known how speakers identify these features in visual scenes. To examine this question, we asked Japanese speakers to describe computer‐generated animations of simple actions with variation in visual features related to telicity. Experiments with adults and children found that they could use goal information in the animations to select appropriate past and progressive verb forms. They also produced a large number of different (...) verb forms. To explain these findings, a deep‐learning model of verb production from visual input was created that could produce a human‐like distribution of verb forms. It was able to use visual cues to select appropriate tense/aspect morphology. The model predicted that video duration would be related to verb complexity, and past tense production would increase when it received the endpoint as input. These predictions were confirmed in a third study with Japanese adults. This work suggests that verb production could be tightly linked to visual heuristics that support the understanding of events. (shrink)