Torre, Ilaria, Carrigan, Emma, Domijan, Katarina, McDonnell, Rachel and Harte, Naomi (2021) The Effect of Audio-Visual Smiles on Social Influence in a Cooperative Human–Agent Interaction Task. ACM Transactions on Computer-Human Interaction, 28 (6). pp. 1-38. ISSN 1073-0516
Preview
KatarinaDomijanSmiles2021.pdf
Download (8MB) | Preview
Abstract
Emotional expressivity is essential for human interactions, informing both perception and decision-making. Here, we examine whether creating an audio-visual emotional channel mismatch influences decision-making in a cooperative task with a virtual character. We created a virtual character that was either congruent in its emotional expression (smiling in the face and voice) or incongruent (smiling in only one channel). People (N = 98) evaluated the character in terms of valence and arousal in an online study; then, visitors in a museum played the “lunar survival task” with the character over three experiments (N = 597, 78, 101, respectively). Exploratory results suggest that multi-modal expressions are perceived, and reacted upon, differently than unimodal expressions, supporting previous theories of audio-visual integration.
Item Type: | Article |
---|---|
Additional Information: | Cite as: Torre, I., Carrigan, E., Domijan, K., McDonnell, R. & Harte, N. 2021, "The Effect of Audio-Visual Smiles on Social Influence in a Cooperative Human–Agent Interaction Task", ACM transactions on computer-human interaction, vol. 28, no. 6, pp. 1-38. |
Keywords: | artificial agent; Computer and Information Sciences; Computer Sciences; |
Academic Unit: | Faculty of Science and Engineering > Mathematics and Statistics Faculty of Science and Engineering > Research Institutes > Hamilton Institute |
Item ID: | 17906 |
Identification Number: | 10.1145/3469232 |
Depositing User: | Katarina Domijan |
Date Deposited: | 30 Nov 2023 14:36 |
Journal or Publication Title: | ACM Transactions on Computer-Human Interaction |
Publisher: | Association for Computing Machinery |
Refereed: | Yes |
Related URLs: | |
URI: | https://mu.eprints-hosting.org/id/eprint/17906 |
Use Licence: | This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here |
Repository Staff Only (login required)
Downloads
Downloads per month over past year