A Novel User Emotional Interaction Design Model Using Long and Short-Term Memory Networks and Deep Learning

Frontiers in Psychology 12 (2021)
  Copy   BIBTEX

Abstract

Emotional design is an important development trend of interaction design. Emotional design in products plays a key role in enhancing user experience and inducing user emotional resonance. In recent years, based on the user's emotional experience, the design concept of strengthening product emotional design has become a new direction for most designers to improve their design thinking. In the emotional interaction design, the machine needs to capture the user's key information in real time, recognize the user's emotional state, and use a variety of clues to finally determine the appropriate user model. Based on this background, this research uses a deep learning mechanism for more accurate and effective emotion recognition, thereby optimizing the design of the interactive system and improving the user experience. First of all, this research discusses how to use user characteristics such as speech, facial expression, video, heartbeat, etc., to make machines more accurately recognize human emotions. Through the analysis of various characteristics, the speech is selected as the experimental material. Second, a speech-based emotion recognition method is proposed. The mel-Frequency cepstral coefficient of the speech signal is used as the input of the improved long and short-term memory network. To ensure the integrity of the information and the accuracy of the output at the next moment, ILSTM makes peephole connections in the forget gate and input gate of LSTM, and adds the unit state as input data to the threshold layer. The emotional features obtained by ILSTM are input into the attention layer, and the self-attention mechanism is used to calculate the weight of each frame of speech signal. The speech features with higher weights are used to distinguish different emotions and complete the emotion recognition of the speech signal. Experiments on the EMO-DB and CASIA datasets verify the effectiveness of the model for emotion recognition. Finally, the feasibility of emotional interaction system design is discussed.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 91,202

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Exploring emotional response to gesture in product interaction using Laban’s movement analysis.Andrew Wodehouse & Marion Sheridan - 2014 - Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systemsinteraction Studies / Social Behaviour and Communication in Biological and Artificial Systemsinteraction Studies 15 (2):321-342.
La sparizione del design. Parte II: Less is Less.Lorenzo Marras & Andrea Mecacci - 2014 - Aisthesis: Pratiche, Linguaggi E Saperi Dell’Estetico 7 (1):153-175.
How do users know what to say?Nicole Yankelovich - 1996 - Interactions 3 (6):32-43.
Reader as user: Applying interface design techniques to the Web.Karen McGrane Chauss - 1996 - Kairos: A Journal of Rhetoric, Technology, and Pedagogy 1 (2).
Control and Ownership of Neuroprosthetic Speech.Hannah Maslen & Stephen Rainey - 2020 - Philosophy and Technology 34 (3):425-445.

Analytics

Added to PP
2021-04-21

Downloads
19 (#753,814)

6 months
7 (#350,235)

Historical graph of downloads
How can I increase my downloads?

Author Profiles

Citations of this work

No citations found.

Add more citations

References found in this work

Add more references