Face and Mind: Can We Access Other Minds through Simulated Expressions?

CHEN Wei

Journal of South China normal University (Social Science Edition) > 2022 > (6): 35-48.

CHEN Wei. Face and Mind: Can We Access Other Minds through Simulated Expressions?[J]. Journal of South China normal University (Social Science Edition), 2022, (6): 35-48.

Citation:

CHEN Wei. Face and Mind: Can We Access Other Minds through Simulated Expressions?[J]. Journal of South China normal University (Social Science Edition), 2022, (6): 35-48.

Citation:

CHEN Wei. Face and Mind: Can We Access Other Minds through Simulated Expressions?[J]. Journal of South China normal University (Social Science Edition), 2022, (6): 35-48.

PDF (2008 KB)

Face and Mind: Can We Access Other Minds through Simulated Expressions?

CHEN Wei^{1, 2}

More Information

Received Date: September 29, 2022
Available Online: January 05, 2023

Graphical Abstract

Abstract

Abstract

Face is mirror of the mind. Since Darwin's time, the idea of facial expressions as an important window to read the mind has been systematically examined by philosophy, psychology and neuroscience. What are the mechanisms in which facial expre-ssions are produced and recognized? How much knowledge about the mental states of others can we actually obtain from facial expre-ssions? Is it really possible to reach others by automatically imitating their facial expressions? Empathetic conceptual history and cutting-edge advances in the field of mirror neurons have spawned the embodied simulation hypothesis, revealing the neural basis of facial mimicry and sharing in the motor system. Effective facial expression recognition cannot be achieved by visual analysis alone, but also requires a motor simulation mechanism-an unconscious, covert imitation of observed facial postures and movements. Although it remains controversial whether facial mimicry is a sufficient requisite for expression recognition, reflections on the instability of the effect of embodied simulation, as well as cultural diversity and the constitutive thesis of emotion, will provide new perspectives to advance understanding in this area.
- facial expressions,
- mirror neuron,
- mind-reading,
- automatic mimicry,
- embodied simulation

FullText(HTML)

References (70)

References

[1]	SHAKESPEARE W. Macbeth·K. Muir[M]. London: Arden Shakespeare, 1962: 1.
[2]	DARWIN C. The expression of emotions in man and animals[M]. Chicago & London: John Murray/University of Chicago Press, 1965: 1-407.
[3]	NIEDENTHAL P M, MERMILLOD M, MARINGER M, et al. The simulation of smiles (SIMS) model: embodied simulation and the meaning of facial expression[J]. Behavioral and brain science, 2010, 33(6): 417-480. doi: 10.1017/S0140525X10000865
[4]	HAIDT J. The righteous mind: why good people are divided by politics and religion[M]. New York: Pantheon/Random House, 2013: 535-537.
[5]	THMASELLO M. What is it like to be a chimpanzee?[EB/OL]. (2022-04-06)[2022-06-10]. https://doi.org/10.1007/s11229-022-03574-5.
[6]	VISCHER R. Vber das optische formgefühl: ein beitrag zur ästhetik[M]. Leipzig: Hermann Credner, 1873: 21.
[7]	LIPPS T. Leitfaden der psychologie[M]. Leipzig: Verlag Von Wilhelm Engelmann, 1909: 222-230.
[8]	LIPPS T. Das Wissen von fremden Ichen[M]//Psychologische Untersuchungen I. Leipzig: Engelmann, 1907.
[9]	LIPPS T. Die ethischen Grundfragen[M]. Hamburg: Leopold Voss Verlag, 1905: 17.
[10]	COPLAN A, GOLDIE P. Introduction[M]. Oxford: Oxford University Press, 2011: xi-xlvii.
[11]	TICHENER E. Lectures on the experimental psychology of the thought processes[M]. New York: Macmillan, 1909: 21.
[12]	GALLESE V, GOLDMAN A. Mirror neurons and the simulation theory of mind-reading[J]. Trends in cognitive sciences, 1998, 2(12): 493-501. doi: 10.1016/S1364-6613(98)01262-5
[13]	GOLDMAN A I, SRIPADA C. Simulationist models of face-based emotion recognition[J]. Cognition, 2005, 94: 193-213. doi: 10.1016/j.cognition.2004.01.005
[14]	ORLOWSKA A B, KRUMHUBER E G, RYCHLOWSKA M, et al. Dynamics matter: recognition of reward, affiliative, and dominance smiles from dynamic vs. static displays[J]. Frontiers in psychology, 2018, 9: 938. doi: 10.3389/fpsyg.2018.00938
[15]	WOOD A, RYCHLOWSKA M, KORB S, et al. Fashioning the face: sensorimotor simulation contributes to facial expression recognition[J]. Trends in cognitive sciences, 2016, 20(3): 227-240. doi: 10.1016/j.tics.2015.12.010
[16]	WELLMAN H M. The child's theory of mind[M]. Cambridge: MIT Press, 1990: 4.
[17]	FRITH C, FRITH U. Theory of mind[J]. Current biology, 2005, 15(17): 644-645. doi: 10.1016/j.cub.2005.08.041
[18]	RUBA A L, MELTZOFF A N, REPACHOLI B M. How do you feel? Preverbal infants match negative emotions to events[J]. Developmental psychology, 2019, 55(6): 1138-1149. doi: 10.1037/dev0000711
[19]	DE WAAL F B M, PRESTON S D. Mammalian empathy: behavioral manifestations and neural basis[J]. Nature reviews neuroscience, 2017, 8: 498-509.
[20]	GOLDMAN A I. Simulating minds: the philosophy, psychology, and neuroscience of mindreading[M]. Oxford: Oxford University Press, 2006: 127.
[21]	EKMAN P. Emotions revealed: understanding faces and feelings[M]. London: Weidenfeld and Nicolson, 2003: 12-14.
[22]	MATSUMOTO D, WILLINGHAM B. Spontaneous facial expressions of emotion of congenitally and noncongenitally blind individuals[J]. Journal of personality and social psychology, 2009, 96(1): 1-10. doi: 10.1037/a0014037
[23]	RIZZOLATTI G, CRAIGHERO L. The mirror-neuron system[J]. Annual review of neuroscience, 2004, 27(1): 169-192. doi: 10.1146/annurev.neuro.27.070203.144230
[24]	DECETY J, GRÈZES J. Neural mechanisms subserving the perception of human actions[J]. Trends in cognitive science, 1999, 3: 172-178. doi: 10.1016/S1364-6613(99)01312-1
[25]	RIZZOLATTI G, FOGASSI L, GALLESE V. Neurophysiological mechanisms underlying the understanding and imitation of action[J]. Nature reviews neuroscience, 2001, 2(9): 661-670. doi: 10.1038/35090060
[26]	GALLESE V, SINIGAGLIA C. What is so special about embodied simulation[J]. Trends in cognitive science, 2011, 15(11): 512-519. doi: 10.1016/j.tics.2011.09.003
[27]	GALLESE V, GARUANA F. Embodied simulation: beyond the expression/experience dualism of emotions[J]. Trends in cognitive sciences, 2016, 20(6): 397-398. doi: 10.1016/j.tics.2016.03.010
[28]	GALLESE V. Embodied simulation: from neurons to phenomenal experience[J]. Phenomenology and the cognitive sciences, 2005, 4(1): 23-48. doi: 10.1007/s11097-005-4737-z
[29]	WICKER B, KEYSERS C, PLAILLY J, et al. Both of us disgusted in my insula: the common neural basis of seeing and feeling disgust[J]. Neuron, 2003, 40: 655-664. doi: 10.1016/S0896-6273(03)00679-2
[30]	HENNENLOTTER A, DRESEL C, CASTROP F, et al. The link between facial feedback and neural activity within central circuitries of emotion: new insights from Botulinum Toxin-induced denervation of frown muscles[J]. Cerebral cortex, 2009, 19: 537-542. doi: 10.1093/cercor/bhn104
[31]	LESLIE K R, JOHNSON-FREY S H, GRAFTON S T. Functional imaging of face and hand imitation: towards a motor theory of empathy[J]. Neuroimage, 2004, 21: 601-607. doi: 10.1016/j.neuroimage.2003.09.038
[32]	ATKINSON A. Face processing and empathy[M]//Empathy in mental illness. Cambridge: Cambridge University Press, 2007: 360-385.
[33]	CARR L, IACOBONI M, DUBEAU M C, et al. Neural mechanisms of empathy in humans: a relay from neural systems for imitation to limbic areas[J]. Proceedings of the national academy of sciences USA, 2003, 100: 5497-5502. doi: 10.1073/pnas.0935845100
[34]	IPSER A, COOK R. Inducing a concurrent motor load reduces categorization precision for facial expressions[J]. Journal of experimental psychology: human perception and performance, 2016, 42(5): 706-718. doi: 10.1037/xhp0000177
[35]	ADOLPHS R. The social brain: neural basis of social knowledge[J]. Annual review of psychology, 2009, 60: 693-716. doi: 10.1146/annurev.psych.60.110707.163514
[36]	MONTGOMERY K J, HAXBY J V. Mirror neuron system differentially actisssvated by facial expressions and social hand gestures: a functional magnetic resonance imaging study[J]. Journal of cognitive neuroscience, 2008, 20(10): 1866-1877. doi: 10.1162/jocn.2008.20127
[37]	DIMBERG U, THUNBERG M. Rapid facial reactions to emotional facial expressions[J]. Scandinavian journal of psychology, 1998, 39(1): 39-45. doi: 10.1111/1467-9450.00054
[38]	MOJZISCH A, SCHILBACH L, HELMERT J, et al. The effects of self-involvement on attention, arousal, and facial expression during social interaction with virtual others: a psychophysiological study[J]. Social neuroscience, 2006, 1: 184-195. doi: 10.1080/17470910600985621
[39]	HESS U, BOURGEOIS P. You smile-I smile: emotion expression in social interaction[J]. Biological psychology, 2010, 84(3): 514-520. doi: 10.1016/j.biopsycho.2009.11.001
[40]	LEE T W, JOSEPHS O, DOLAN R J, et al. Imitating expressions: emotion-specific neural substrates in facial mimicry[J]. Social cognitive and affective neuroscience, 2007, 1(2): 122-135.
[41]	SCHILBACH L, EICKHOFF S B, MOJZISCH A, et al. What's in a smile? Neural correlates of facial embodiment during social interaction[J]. Social neuroscience, 2008, 3(1): 37-50. doi: 10.1080/17470910701563228
[42]	BATE S, COOK S, MOLE J, et al. First report of generalized face processing difficulties in Mobius sequence[J]. Current science, 2013, 8(4): 1435-1439.
[43]	NICOLINI Y, MANINI B, DE STEFANI E, et al. Autonomic responses to emotional stimuli in children affected by facial palsy: the case of Moebius syndrome[J]. Neural plasticity, 2019(3): 1-13.
[44]	RICCIARDI L, VISCO-COMANDINI F, ERRO R, et al. Facial emotion recognition and expression in Parkinson's disease: an emotional mirror mechanism?[J]. PLoS One, 2017, 12(1): e0169110. doi: 10.1371/journal.pone.0169110
[45]	TRINKLER I, DEVIGNEVIELLE S, ACHAIBOU A, et al. Embodied emotion impairment in Huntington's disease[J]. Cortex, 2017, 92: 44-56. doi: 10.1016/j.cortex.2017.02.019
[46]	ADOLPHS R, DAMASIO H, TRANEL D, et al. A role for somatosensory cortices in the visual recognition of emotion as revealed by 3-D lesion mapping[J]. Journal of neuroscience, 2000, 20: 2683-2690. doi: 10.1523/JNEUROSCI.20-07-02683.2000
[47]	KORB S, WOOD A, BANKS C A, et al. Asymmetry of facial mimicry and emotion perception in patients with unilateral facial paralysis[J]. JAMA facial plastic surgery, 2016, 18(3): 222-227. doi: 10.1001/jamafacial.2015.2347
[48]	PONARI M, CONSON M, D' AMICO N P, et al. Mapping correspondence between facial mimicry and emotion recognition in healthy subjects[J]. Emotion, 2012, 12(6), 1398-1403. doi: 10.1037/a0028588
[49]	RYCHLOWSKA M, CANADAS E, WOOD A, et al. Blocking mimicry makes true and false smiles look the same[J]. PLoS One, 2014, 9(3): e90876. doi: 10.1371/journal.pone.0090876
[50]	BAUMEISTER J C, PAPA G, FORONI F. Deeper than skin deep-the effect of botulinum toxin-a on emotion processing[J]. Toxicon, 2016, 118: 86-90. doi: 10.1016/j.toxicon.2016.04.044
[51]	DE STEFANI E, ARDIZZI M, NICOLINI Y, et al. Children with facial paralysis due to Moebius syndrome exhibit reduced autonomic modulation during emotion processing[J]. Journal of neurodevelopmental disorders, 2019, 11: 12. doi: 10.1186/s11689-019-9272-2
[52]	HATFIELD E, CACIOPPO J T, RAPSON R L. Emotional contagion[J]. Current directions in psychological science, 1993, 2: 96-99. doi: 10.1111/1467-8721.ep10770953
[53]	WINGENBACH T S H, BRONSNAN M, PFALTZ M C, et al. Incongruence between observers' and observed facial muscle activation reduces recognition of emotional facial expressions from video stimuli[J]. Frontiers in psychology, 2018, 9: 864. doi: 10.3389/fpsyg.2018.00864
[54]	HESS U, HOUDE S, FISCHER A. Do we mimic what we see or what we know?[M]//Collective emotions. Oxford: Oxford University Press, 2014: 94-107.
[55]	VANNUSCORPS G, CARAMAZZA A. Impaired short-term memory for hand postures in individuals born without hands[J]. Cortex, 2016, 83: 136-138. doi: 10.1016/j.cortex.2016.07.019
[56]	FISCHER A, HESS U. Mimicking emotions[J]. Current opinion in psychology, 2017, 17: 151-155. doi: 10.1016/j.copsyc.2017.07.008
[57]	PAPEO L, LINGNAU A, AGOSTA S, et al. The origin of word-related motor activity[J]. Cerebral cortex, 2015, 25: 1668-1675. doi: 10.1093/cercor/bht423
[58]	WOLPERT D M, DOYA K, KAWATO M. A unifying computational framework for motor control and social interaction[J]. Philosophical transactions of the royal society of London. Series B: biological sciences, 2003, 358: 593-602. doi: 10.1098/rstb.2002.1238
[59]	ORLOV T, MAKIN T R, ZOHARY E. Topographic representation of the human body in the occipitotemporal cortex[J]. Neuron, 2010, 68: 586-600. doi: 10.1016/j.neuron.2010.09.032
[60]	MCGURK H, MACDONALD J. Hearing lips and seeing voices[J]. Nature, 1976, 264: 746-748. doi: 10.1038/264746a0
[61]	COLLIGNON O, GIRARD S, GOSSELIN F, et al. Audio-visual integration of emotion expression[J]. Brain research, 2008, 1242: 126-135. doi: 10.1016/j.brainres.2008.04.023
[62]	VANNUSCORPS G, ANDRES M, CARAMAZZA A. Efficient recognition of facial expressions does not require motor simulation[J]. eLife, 2020, 9: e54687. doi: 10.7554/eLife.54687
[63]	PARACAMPO R, TIDONI E, BORGOMANERI S, et al. Sensorimotor network crucial for inferring amusement from smiles[J]. Cerebral cortex, 2017, 27 (11): 5116-5129.
[64]	LOMORIELLO A S, CAPERNA G, DE STEFANI E, et al. The intensity of emotion: altered motor simulation impairs processing of facial expressions in congenital facial palsy[EB/OL]. (2020-10-08)[2022-06-19]. https://psyarxiv.com/fze8c/.
[65]	陈巍. 如何理解直接社会感知中的"直接"要义[J]. 自然辩证法通讯, 2021(11): 24-31. https://www.cnki.com.cn/Article/CJFDTOTAL-ZRBT202111003.htm
[66]	KRUEGER J. Direct social perception[M]//Oxford handbook of 4E cognition. Oxford: Oxford University Press, 2018: 301-321.
[67]	CHAN D W. Perception and judgment of facial expressions among the Chinese[J]. International journal of psychology, 1985, 20(6): 681-692.
[68]	JACK R E, CALDARA R, SCHYNS P G. Internal representations reveal cultural diversity in expectations of facial expressions of emotion[J]. Journal of experimental psychology, 2012, 141(1): 19-25. doi: 10.1037/a0023463
[69]	JACK R E, GARROD O G, YU H, et al. Facial expressions of emotion are not culturally universal[J]. Proceedings of the national academy of sciences of the United States of America, 2012, 109(19), 7241-7244. doi: 10.1073/pnas.1200155109
[70]	COWEN A S, KELTNER D, SCHROFF F, et al. Sixteen facial expressions occur in similar contexts worldwide[J]. Nature, 2021, 589(7841): 251-257. doi: 10.1038/s41586-020-3037-7

Cited By

Cited by

Periodical cited type(6)

1.	杨一格，黄甫全，梁梓珊. AI主讲课程开发的教师减负效应：一项试验研究. 华东师范大学学报(教育科学版). 2024(02): 46-62 .
2.	陈昕昕，王祖浩. 科学实践的国际经验：理论与实践. 中国教育科学(中英文). 2023(01): 84-95 .
3.	倪欣语，燕红，江帆，马琼芳，张超凡，宋丽文. 自然教育活动类型及策划初探. 吉林林业科技. 2022(03): 42-45 .
4.	杜小双. 教师学习与改变研究的复杂理论转向——基于三种教师学习模型的对比分析. 教育学术月刊. 2021(04): 82-89 .
5.	姚红，王栋. 反思性实践视角谈大学法语教育改革. 牡丹江教育学院学报. 2021(10): 33-36 .
6.	张成林. 小学对分课堂的哲学阐释. 教学与管理. 2020(23): 1-3 .

Other cited types(8)

Get Citation

PDF

XML

Article views (242) PDF downloads (178) Cited by(14)

Turn off MathJax

Article Contents

Abstract

References

Face and Mind: Can We Access Other Minds through Simulated Expressions?

Abstract

References

Cited by

Periodical cited type(6)

Other cited types(8)

Catalog

Export File

Citation

Format

Content