Based on the concept of data physicalization, we developed Vital + Morph, an interactive surface for remote connection and awareness of clinical data. It enables users located in remote places to monitor and feel the vital signs measured from a hospitalized person through shape-change. We propose shape-changing interfaces as a way of making data physicalization a richer, intriguing and memorable experience that communicates complex information and insights about data. To demonstrate and validate our proposed concept, we developed an exploratory study (...) about the design and its implications. For evaluating the social impact of shape-changing interfaces in the context of remote monitoring, we presented Vital + Morph in several Media Art festivals. We collected and analyzed the feedback from the visitors during the exhibitions, and discussed the possibilities of the proposed system. A preliminary evaluation shows how shape-changing displays are perceived by users, which establishes not only the potential benefits but also highlights the concerns that several users have raised. Through this study, we aim to contribute to the design of remote monitoring systems by providing a novel approach for displaying clinical data that consider the richness of the physical world. In today’s information-driven society, we should not just focus on how abstract data are collected and analyzed, but also on how it can be presented and incorporated into our daily lives. (shrink)

The Bird Song Diamond project is a series of multifaceted and multidisciplinary installations with the aim of bringing contemporary research on bird communication to a large public audience. Using art and technology to create immersive experiences, BSD allows large audiences to embody bird communication rather than passively observe. In particular, BSD Mimic, a system for mimicking bird song, asks participants to grapple with both audition and vocalization of birdsong. The use of interactive installations for public outreach provides unique experiences to (...) a diverse audience, while providing direct feedback for artists and researchers interested in the success of such outreach. By following an iterative design process, both artists and researchers have been able to evaluate the effectiveness of each installation for promoting audience engagement with the subject matter. The execution and evaluation of each iteration of BSD is described throughout the paper. In addition, the process of interdisciplinary collaboration in our project has led to a more defined role of the artist as a facilitator of specialists. BSD Mimic has also led to further questions about the nature of audience collaboration for an engaged experience. (shrink)

Assistive Device Art derives from the integration of Assistive Technology and Art, involving the mediation of sensorimotor functions and perception from both, psychophysical methods and conceptual mechanics of sensory embodiment. This paper describes the concept of ADA and its origins by observing the phenomena that surround the aesthetics of prosthesis-related art. It also analyzes one case study, the Echolocation Headphones, relating its provenience and performance to this new conceptual and psychophysical approach of tool design. This ADA tool is designed to (...) aid human echolocation. They facilitate the experience of sonic vision, as a way of reflecting and learning about the construct of our spatial perception. Echolocation Headphones are a pair of opaque goggles which disable the participant’s vision. This device emits a focused sound beam which activates the space with directional acoustic reflection, giving the user the ability to navigate and perceive space through audition. The directional properties of parametric sound provide the participant a focal echo, similar to the focal point of vision. This study analyzes the effectiveness of this wearable sensory extension for aiding auditory spatial location in three experiments; optimal sound type and distance for object location, perceptual resolution by just noticeable difference, and goal-directed spatial navigation for open pathway detection, all conducted at the Virtual Reality Lab of the University of Tsukuba, Japan. The Echolocation Headphones have been designed for a diverse participant base. They have both the potential to aid auditory spatial perception for the visually impaired and to train sighted individuals in gaining human echolocation abilities. Furthermore, this Assistive Device artwork instigates participants to contemplate on the plasticity of their sensorimotor architecture. (shrink)

The idMirror project consists of a tablet computer, specially equipped with a small mirror and a newly developed android app. The Android application uses face recognition to detect the location of the user’s face in relation to the device and based on this renders a computer graphic at the location of his or her reflection. The goal of the idMirror project setting as a research tool was to make an exploratory study on cultural differences at exhibition venues. For this study, (...) we have analyzed 150 participants’ face images aged between 18 and 75; among them, 50 participants’ face images collected in Europe, 50 participants’ face images collected in the USA, and 50 participants’ face images collected in Japan. We found global exhibitions a good research platform for random sampling of the subjects. For the study, we examined the first 50 participants at each exhibition and we found some significant differences. Through the explanatory study in the form of an art installation, we wanted to learn if the facial expression upon one’s own self-observation is a function of gender and place of exhibition setting origin. (shrink)

In this study, we propose the Ankle-Worn Sensor Sleeve to help people maintain their health. Furthermore, our approach uses this sensor sleeve to improve walking motivation by making the walking motion more sensible. In this research, we pursue the design of a wearable device that users can wear as a “shoe accessory,” with the aim of promoting people’s walking motivation. This device is ankle-worn and generates electricity using the physical flexion and extension of the ankle, detects and acquires the amount (...) of electricity generated, and uses the resulting power to produce sound and light feedback while walking. The Sleeve is designed to support health problems, such as locomotive syndrome and dementia, which are caused by physical inactivity. This article presents the results of a questionnaire survey conducted on 172 people who experienced or observed the device during exhibitions. The results reveal that this device increased people’s interest and motivation to walk, including those who did not like to walk. (shrink)