Abstract

Building animated conversational agents requires developing a fine-grained analysis of the motions and meanings available to interlocutors in face-to-face conversation and implementing strategies for using these motions and meanings to communicate effectively. In this paper, we describe our research on signaling uncertainty on an animated face as an end-to-end case study of this process. We sketch our efforts to characterize people’s facial displays of uncertainty in face-to-face conversation in ways that allow us to simulate those behaviors in an animated agent. Our work has led to new insights into the structure, timing, expressive content and communicative function of facial actions that we must take into account to explain our empirical findings and to build agents that reproduce people’s effective use of the face in managing the dynamics of conversation.