Analysis of Facial Emotion Recognition in Video Chatting
ISBN 978-3-319-94600-9
DOI 10.1007/978-3-319-94601-6_23
PUBLISHER. Springer
AUTHOR/S/. Qiuwen Li & Young Ae Kim
CATEGORIES. Human Interaction, Emotional Design
KEYWORDS. Human Interaction, Sensing Emotions, Positive Emotion, Negative Emotion
ABSTRACT.
In this research, we evaluated challenges and effectiveness between two primary emotions: happiness and sadness in video chatting. This study analyzed the emotional influences of voice and music on video chatting and its effectiveness on sensing others emotional energy. Participants were from 18–42 years old and 98% of participants are in between 18–32 years old. A series of visual stimuli were created with four models were from Gen Z; Millennial; Gen X; and Baby Boomer. In addition, the research examines the comfort level with different relationships (e.g. friends; acquaintances; and strangers) in the video chatting environment.
Six emotions as basic: anger, disgust, fear, happiness, sadness and surprise.
Methods.
PARTICIPANTS.
Participants were 51 college students (20 men, 31 women) and 18 years of age (mean age = 25) or older from two universities (University of South Dakota and South Dakota State University) locat-ed in South Dakota. There were volunteer participants and no credit and compensation were given for participating this study.
SURVEY VOCAL STIMULI.
Happiness (Positive) “I am so excited!”
Sadness (Negative) “You hurt my feeling!”
SURVEY MUSICAL STIMULI.
Happiness (Positive)
Sadness (Negative)
PROCEDURE.
A total of 103 survey questions are divided into four sections - 1) background information (7 questions), 2) emotional response (80 questions), 3) internet usage (9 questions), and 4) the comfort level in the video chat based on different relationships (14 questions).
Survey Visual Stimuli
What we found.
The impact of Visual Stimuli both static image and video to sense the feeling of others.
The study found that both static images and videos helps participants to sense the feeling of others and taking them on as own significantly. The main effect of both visual stimuli yielded an F(1, 50) = 0.009, p < .02, indicating a statistical significance. In particular, video stimuli help participants to understand others feeling with 93% of chance, which is easier than static stimuli with 88% correctly reading others feeling. In sum, participants correctly read the feeling of others regardless of the visual stimuli type; however, the video stimuli help participants to sense the feeling of others at much better rate.
The impact of Music with Visual Stimuli to sense the feeling of others.
The study found that both negative and positive music were influenced participants for their decision making to understand others feeling. The main effect for music on sensing the feeling of others with static image yielded an F ratio of F(1, 50) = 0.3, p < .001 and with video yielded an F ratio of F(1, 50) = 0.3, p < .001, indicating a statistical significance. The interaction of music and visual stimuli was significant and the result indicated that the music influenced to sense the feeling of others for all participants. For example, the music was distracted participants from reading correct feeling of others when sad music with positive visual stimuli displayed together. However, the video stimuli help to read the feeling of others with music influences whether it is a sad music (negative) or happy music (positive) than the static image with music. In sum, the music distorts the perception of reading feeling of others when the expression of visual stimuli (e.g. happy) is opposite of the musical expression (e.g. sad) and increases the perception of reading feeling of others when the expression of visual stimuli (e.g. happy) is same as the musical expression (e.g. happy).
The impact of Voice with Visual Stimuli to sense the feeling of others.
The study found that both negative and positive voice were influenced participants for their decision making to understand others feeling. The main effect for voice on sensing the feeling of others with static image yielded an F ratio of F(1, 50) = 0.15, p < .001 and with video yielded an F ratio of F(1, 50) = 0.2, p < .001, indicating a statistical significance. The interaction of voice and visual stimuli was significant and the result indicated that the voice influenced to sense the feeling of others for all participants. For example, the voice was distracted participants from reading correct feeling of others when sad music with positive visual stimuli displayed together. However, the video stimuli help to read the feeling of others with voice influences whether it is a sad voice (negative) or happy voice (positive) than the static image with voice. In sum, the voice distorts the perception of reading feeling of others when the expression of visual stimuli (e.g. happy) is opposite of the voice expression (e.g. sad) and increases the perception of reading feeling of others when the expression of visual stimuli (e.g. happy) is same as the voice expression (e.g. happy).
The Internet: transforming society and shaping the future through chat.
- Dave Barry
Things to think about.
01.
Our present result may be considered direct evidence that individuals can be interrupted and encouraged to read sensing the feeling of others by positive and negative vocal and musical influences.
02.
An individual can sense better the feeling of others with video stimuli than static image.
How are you feeling today?
References.
Baumgardner, S.R., & Crothers, M.K. (2009). Positive Psychology. Pearson Education, Inc.
Cacioppo, J. T., Hawkley, L. C., & Thisted, R. A. (2010). Perceived social isolation makes me sad: 5-year cross-lagged analyses of loneliness and depressive symptomatology in the Chicago Health, Aging, and Social Relations Study. Psychology and aging, 25(2), 453–463.
Catherine Collin. (2016). The Psychology Book: Big Ideas Simply Explained. New York : DK Publishing.
Darwin, C., & Prodger, P. (1998). The expression of the emotions in man and animals. Oxford University Press, USA.
Ekman, P., Davidson, R. J., & Friesen, W. V. (1990). The Duchenne smile: Emotional expression and brain physiology: II. Journal of personality and social psychology, 58(2), 342.
Gabrielsson, A. (2001). Emotions in strong experiences with music. In P. N. Juslin & J. A. Sloboda (Eds.), Music and emotion: Theory and research (pp. 431–449). New York: Oxford University Press.
Hatfield, E., Cacioppo, J. T., & Rapson, R. L. (1993). Emotional contagion. Current directions in psychological science, 2(3), 96-99.
Henry, J. D., Von Hippel, W., Molenberghs, P., Lee, T., & Sachdev, P. S. (2016). Clinical assessment of social cognitive function in neurological disorders. Nature Reviews Neurology, 12(1), 28–39.
Hallock, J. (2003). Colour assignment.
Jeremy K. Fox. (2004). Factors of Emotion Recognition in Faces: Three Perspectives, Retrieved from http://www.jyi.org
Larsen, J. T., McGraw, A. P., & Cacioppo, J. T. (2001). Can people feel happy and sad at the same time?. Journal of personality and social psychology, 81(4), 684-696.
Lee Rainie, Kathryn Zickuhr, 2010. Video calling and video chat [Web blog post]. from http://www.pewinternet.org/2010/10/13/video-calling-and-video-chat/
Lisa Feldman Barrett, 2017. How To Understand Emotions? [Web video]. from https://www.youtube.com/watch?v=GV7ui_KQXcE
Morland, R.L.,& Beach,S.R.(1992). Exposure effects in the classroom: The development of affinity among students.Journal of Experimental Social Psychology,28,255-276.
Petra Rattue (Tuesday 14 February 2012). Sad Music Can Bring On Real Sadness [Web blog post]. from https://www.medicalnewstoday.com/articles/241653.php
Rozin, P., Berman, L., & Royzman, E. (2010). Biases in use of positive and negative words across twenty natural languages. Cognition and Emotion, 24(3), 536-538.
Robert Soussignan. (2002). A Test of the Facial Feedback Hypothesis. American Psychological Association.
Russell, J. A., & Carroll, J. M. (1999). On the bipolarity of positive and negative affect. Psychological bulletin, 125(1), 3-30.