Metrika članka

  • citati u SCindeksu: 0
  • citati u CrossRef-u:0
  • citati u Google Scholaru:[=>]
  • posete u poslednjih 30 dana:0
  • preuzimanja u poslednjih 30 dana:0
članak: 1 od 1  
International Journal of Cognitive Research in Science, Engineering and Education / IJCRSEE
2019, vol. 7, br. 2, str. 41-51
jezik rada: engleski
vrsta rada: originalan članak
doi:10.5937/IJCRSEE1902041S

Creative Commons License 4.0
Towards emotion recognition in texts: A sound-symbolic experiment
(naslov ne postoji na srpskom)
New Bulgarian University, Department of Computer Science, Bulgaria

e-adresa: vslavova@nbu.bg

Sažetak

(ne postoji na srpskom)
The purpose of this study is to investigate the relationship between the phonetic content of prose texts in English and the emotion that the texts inspire, namely - the effect of vowel-consonant bi-phones on subjects' evaluation of positive or negative emotional valence when reading. The methodology is based on data from an experiment where the participants, native speakers of three different languages, evaluated the valence invoked in them by one-page texts from English books. The sub-lexical level of the texts was obtained using phonetic transcriptions of the words and their further decomposition into vowel-consonant bi-phones. The statistical investigation relies on density-measures of the investigated bi-phones over each text as a whole. The result shows that there exists a correlation between the obtained sub-lexical representation and the valence perceived by the readers. Concerning the type of the consonants in the bi-phones (abrupt or sonorant), the influence of the abrupt bi-phones is stronger. However, sub-sets of both types of bi-phones showed relatedness with the emotional valence conveyed by the texts. In conclusion, the speech, expressed in written form, is laden with emotional valence even when the words' lexicological meaning is not taken into consideration and the words are apprehended as mere phonetic constructs. This prompts hypothesizing that words' semantics itself is partly underpinned by some mental emotion-related level of conceptualization, influenced by sounds. For practical purposes, the result suggests that based on the syllabic content of a text it should be possible to predict the valence that the text would inspire in its readers.

Ključne reči

Emotional sound-symbolism; Text emotion recognition; Emotion and cognition

Reference

Abbassi, E., Kahlaoui, K., Wilson, M.A., Joanette, Y. (2011) Processing the emotions in words: The complementary contributions of the left and right hemispheres. Cognitive, Affective, & Behavioral Neuroscience, 11(3): 372-385
Adelman, J.S., Estes, Z., Cossu, M. (2018) Emotional sound symbolism: Languages rapidly signal valence via phonemes. Cognition, 175: 122-130
Aryani, A., Kraxenberger, M., Ullrich, S., Jacobs, A.M., Conrad, M. (2016) Measuring the basic affective tone of poems via phonological saliency and iconicity. Psychology of Aesthetics, Creativity, and the Arts, 10(2): 191-204
Aryani, A., Jacobs, A.M., Conrad, M. (2013) Extracting salient sublexical units from written texts: 'Emophon,' a corpus-based approach to phonological iconicity. Frontiers in Psychology, 4, 654
Brandt, P.A., Bennett, A. (2015) It's Five O'Clock': Microprosody and Enunciation. Available at SSRN 2566228. Retrieved from: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2566228
Buechel, S., Hahn, U. (2017) EmoBank: Studying the Impact of Annotation Perspective and Representation Format on Dimensional Emotion Analysis. u: The 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers, April, Proceedings of, pp. 578-585
Burton, N.L. (2015) Heaven and hell: The psychology of the emotions. Kent, UK: Acheron Press
D'anselmo, A., Prete, G., Zdybek, P., Tommasi, L., Brancucci, A. (2019) Guessing meaning from word sounds of unfamiliar languages: A cross-cultural sound symbolism study. Frontiers in Psychology, 10, 593
de Saussure, F. (1916/1983) Course in general linguistics. London: Duckworth, Translated by Roy Harris
Edmiston, P., Perlman, M., Lupyan, G. (2018) Repeated imitation makes human vocalizations more word-like. Proceedings of the Royal Society B: Biological Sciences, 285(1874): 20172709-20172709
Ekman, P. (1999) Basic emotions: Handbook of cognition and emotion. 45-60
Fantz, R.L., Miranda, S.B. (1975) Newborn Infant Attention to Form of Contour. Child Development, 46(1), 224
Gökgöz, K. (2018) Syllables in TİD. Dilbilim Araştırmaları Dergisi, 29(1): 29-49
Hamann, S. (2012) Mapping discrete and dimensional emotions onto the brain: Controversies and consensus. Trends in Cognitive Sciences, 16(9): 458-466
Imai, M., Kita, S. (2014) The sound symbolism bootstrapping hypothesis for language acquisition and language evolution. Philosophical Transactions of the Royal Society B: Biological Sciences, 369(1651): 20130298-20130298
Itô, J. (2018) Syllable Theory in Prosodic Phonology. Routledge
Jakobson, R. (1960) Linguistics and poetics. u: Style in language, MA: MIT Press, 350-377
Jones, J.M., Vigliocco, G. (2017) Iconicity in Word Learning: What Can We Learn from Cross-Situational Learning Experiments?. u: The Annual Meeting of the Cognitive Society 2017, Proceedings of, Retrieved from: https://pdfs.semanticscholar.org/ac61/7f1f53f8cc4df37b315edb4672df86294109.pdf
Kawahara, S., Shinohara, K.P.R., Kleinginna, A.M. (2012) A tripartite trans-modal relationship among sounds, shapes and emotions: A case of abrupt modulation. u: The Annual Meeting of the Cognitive Science Society, Proceedings of, (p. Vol 34, No 34). Retrieved from https://pdfs.semanticscholar.org/3408/1ce795c89940e8fdd2a23b97a6aa834319dc. pdf
Kleinginna, P.R., Kleinginna, A.M. (1981) A Categorized List of Emotion Definitions, with Suggestions for a Consensual Definition. Motivation and Emotion, 5(4), 981
Köhler, W. (1929) Gestalt Psychology. New York, NY: Liveright
Leder, H., Tinio, P.P.L., Bar, M. (2011) Emotional Valence Modulates the Preference for Curved Objects. Perception, 40(6): 649-655
Macoir, J., Hudon, C., Tremblay, M., Laforce, R.Jr., Wilson, M.A. (2019) The contribution of semantic memory to the recognition of basic emotions and emotional valence: Evidence from the semantic variant of primary progressive aphasia. Social Neuroscience, 1-12
Maddock, R.J., Garrett, A.S., Buonocore, M.H. (2003) Posterior cingulate cortex activation by emotional words: fMRI evidence from a valence decision task. Human Brain Mapping, 18(1): 30-41
Mandelker, A. (1983) Russian Formalism and the Objective Analysis of Sound in Poetry. Slavic and East European Journal, 27(3): 327-327
Marinkovic, K., Dhond, R.P., Dale, A.M., Glessner, M., Carr, V., Halgren, E. (2003) Spatiotemporal dynamics of modality-specific and supramodal word processing. Neuron, 38(3): 197-198
Origlia, A., Cutugno, F., Galatà, V. (2014) Continuous emotion recognition with phonetic syllables. Speech Communication, 57: 155-169
Perlman, M., Dale, R., Lupyan, G. (2015) Iconicity can ground the creation of vocal symbols. Royal Society Open Science, 2(8): 150152-150152
Russell, J.A. (2003) Core affect and the psychological construction of emotion. Psychological Review, 110(1): 145-172
Russell, J.A., Mehrabian, A. (1977) Evidence for a three-factor theory of emotions. Journal of Research in Personality, 11(3): 273-294
Saarimäki, H., Gotsopoulos, A., Jääskeläinen, I.P., Lampinen, J., Vuilleumier, P., Hari, R., Sams, M., Nummenmaa, L. (2015) Discrete neural signatures of basic emotions. Cerebral Cortex, 26(6): 2563-2573
Scherer, K.R. (2000) A cross-cultural investigation of emotion inferences from voice and speech: Implications for speech technology. u: Sixth International Conference on Spoken Language Processing, Retrieved from: https://www.iscaspeech.org/archive/archive_papers/icslp_2000/i00_2379.pdf
Scherer, K.R., Banse, R., Wallbott, H.G. (2001) Emotion Inferences from Vocal Expression Correlate Across Languages and Cultures. Journal of Cross-Cultural Psychology, 32(1): 76-92
Shklovsky, V. (1990) Theory of Prose. Elmwood Park, IL: Dalkey Archive, transl. B. Sher
Sidhu, D.M., Pexman, P.M. (2018) Five mechanisms of sound symbolic association. Psychonomic bulletin & review, 25(5), 1619-1643
Trotsky, L. (1957) Literature and Revolution. New York, NY: Russell and Russell
Ullrich, S., Aryani, A., Kraxenberger, M., Jacobs, A.M., Conrad, M. (2017) On the relation between the general affective meaning and the basic sublexical, lexical, and inter-lexical features of poetic texts: A case study using 57 poems of HM Enzensberger. Frontiers in Psychology, 7, 2073
van Orden, G.C., Johnston, J.C., Hale, B.L. (1988) Word identification in reading proceeds from spelling to sound to meaning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 14(3): 371-386
Whissell, C. (1999) Phonosymbolism and the Emotional Nature of Sounds: Evidence of the Preferential Use of Particular Phonemes in Texts of Differing Emotional Tone. Perceptual and Motor Skills, 89(1): 19-48
Winter, B. (2016) Taste and smell words form an affectively loaded and emotionally flexible part of the English lexicon. Language, Cognition and Neuroscience, 31(8): 975-988
Winter, B., Perlman, M., Perry, L.K., Lupyan, G. (2017) Which words are most iconic?. Interaction Studies, 18(3): 443-464