In this study, 56 musical excerpts were analyzed according to the MIDI information, using simple algorithm to get five musical features of each
excerpts. In the experiment, 17 participants were invited to listening musical pieces, and were asked to report their affections after each song. EEG
(Electroencephalogrphy) was recorded during listening. EEG was
pre-processed and decomposed into independent brain processes with ICA (independent component analysis).
As the results shown, the estimated musical features compared with results of Gomez & Danuser indicated that we can simulate simple features, such as mode, tempo, pitch range, without more details about human
perceptions. Some discrepancies exist on more complex features involved advanced musical analysis.
EEG results show that the asymmetric on lateral frontal lobe which react to pleasantness, there are left frontal-alpha, right frontal-gamma. The
frontal lobe also distinguished levels of arousal on alpha band and valence on gamma band. That somato-motor region also activated during musical listening revealed that people had motivation or imagery to dance with musical sounds. And in the occipital also had some information related to arousal.
This study confirms that the asymmetry plays an important role in valence processing. Beside, multiple brain regions are involved in emotions induced by music.
30
The future work may investigate the relationship between EEG and multi-scaled valence and arousal reported by subjects. In this way, the difficult might be the data of grouped subjects may cause the correlation to be much small as the reason of some individual differences.
31
References
[1] P. N. Juslin and P. Laukka, "Expression, perception, and induction of musical emotions: A review and a questionnaire study of
everyday listening," Journal of New Music Research, vol. 33, pp. 217-238, Sep 2004.
[2] P. N. Juslin and D. Vastfjall, "Emotional responses to music: the need to consider underlying mechanisms," Behavioral and Brain
Sciences, vol. 31, pp. 559-75; discussion 575-621, Oct 2008.
[3] A. Gabrielsson and E. Lindstrom, "The influence of musical structure on emotional expression," in Music and emotion: theory
and research, P. N. J. J. A. Sloboda, Ed., ed London: Oxford University Press, 2001, pp. 223-248.
[4] G. A. and J. P, "Emotional expression in music," in Handbook of affective sciences, R. Davidson, K. R. Scherer, and H. H.
Goldsmith, Eds., ed New York: Oxford University Press, 2003, pp. 503-534.
[5] Y. H. Yang and H. H. Chen, "Music Emotion Ranking," 2009 Ieee International Conference on Acoustics, Speech, and Signal
Processing, Vols 1- 8, Proceedings, pp. 1657-1660, 2009.
[6] L. Lu, D. Liu, and H. J. Zhang, "Automatic mood detection and tracking of music audio signals," Ieee Transactions on Audio
Speech and Language Processing, vol. 14, pp. 5-18, Jan 2006.
[7] P. Gomez and B. Danuser, "Relationships between musical structure and psychophysiological measures of emotion," Emotion, vol.
7, pp. 377-87, May 2007.
[8] D. Vaitl and W. S. Vehrs, S., "Promts-Leitmotif-Emotion: play it again, Richard Wagner," in The sturcture of emotion:
psychophysiology, cognitive, and clinical aspects, N. B. A. Ohman, Ed., ed, 1993, pp. 169-89.
[9] I. Nyklicek, J. F. Thayer, and L. J. P. van Doornen, "Cardiorespiratory differentiation of musically-induced emotions," Journal of
Psychophysiology, vol. 11, pp. 304-321, 1997.
[10] L. O. Lundqvist, F. Carlsson, P. Hilmersson, and P. N. Juslin, "Emotional responses to music: experience, expression, and
physiology," Psychology of Music, vol. 37, pp. 61-90, 2008.
[11] C. L. Krumhansl, "An exploratory study of musical emotions and psychophysiology," Canadian Journal of Experimental
Psychology, vol. 51, pp. 336-52, Dec 1997.
[12] D. L. Barrett, "Physiological reactions to music and acoustic stimuli," in Handbook of music psychology, D. A. Hodges, Ed., 2nd
ed: IMR Press, 1996, pp. 343-85.
[13] A. J. Blood and R. J. Zatorre, "Intensely pleasurable responses to music correlate with activity in brain regions implicated in
reward and emotion," Proceedings of the National Academy of Sciences of the United States of America, vol. 98, pp. 11818-11823,
32 Sep 25 2001.
[14] A. J. Blood, R. J. Zatorre, P. Bermudez, and A. C. Evans, "Emotional responses to pleasant and unpleasant music correlate with
activity in paralimbic brain regions," Nature Neuroscience, vol. 2, pp. 382-387, Apr 1999.
[15] S. Brown, M. J. Martinez, and L. M. Parsons, "Passive music listening spontaneously engages limbic and paralimbic systems,"
Neuroreport, vol. 15, pp. 2033-2037, Sep 15 2004.
[16] V. Menon and D. J. Levitin, "The rewards of music listening: Response and physiological connectivity of the mesolimbic
system," Neuroimage, vol. 28, pp. 175-184, Oct 15 2005.
[17] S. Koelsch, T. Fritz, D. Y. Von Cramon, K. Muller, and A. D. Friederici, "Investigating emotion with music: An fMRI study,"
Human Brain Mapping, vol. 27, pp. 239-250, Mar 2006.
[18] J. J. B. Allen, J. A. Coan, and M. Nazarian, "Issues and assumptions on the road from raw signals to metrics of frontal EEG
asymmetry in emotion," Biological Psychology, vol. 67, pp. 183-218, Oct 2004.
[19] W. Heller, D. L. Lindsay, J. Metz, and D. M. Farnum, "Individual-Differences in Right-Hemisphere Activation Are Associated
with Arousal and Autonomic Response to Lateralized Stimuli," Journal of Clinical and Experimental Neuropsychology, vol. 13,
pp. 95-95, Jan 1991.
[20] L. A. Schmidt and L. J. Trainor, "Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions,"
Cognition & Emotion, vol. 15, pp. 487-500, Jul 2001.
[21] L. I. Aftanas, N. V. Reva, A. A. Varlamov, S. V. Pavlov, and V. P. Makhnev, "Analysis of Evoked EEG Synchronization and
Desynchronization in Conditions of Emotional Activation in Humans: Temporal and Topographic Characteristics," Neuroscience
and Behavioral Physiology, vol. 34, pp. 859-867, 2004.
[22] D. Sammler, M. Grigutsch, T. Fritz, and S. Koelsch, "Music and emotion: Electrophysiological correlates of the processing of
pleasant and unpleasant music," Psychophysiology, vol. 44, pp. 293-304, Mar 2007.
[23] M. Sarlo, G. Buodo, S. Poli, and D. Palomba, "Changes in EEG alpha power to different disgust elicitors: the specificity of
mutilations," Neuroscience Letters, vol. 382, pp. 291-296, Jul 2005.
[24] M. Balconi and C. Lucchiari, "Consciousness and arousal effects on emotional face processing as revealed by brain oscillations. A
gamma band analysis," International Journal of Psychophysiology, vol. 67, pp. 41-46, 2008.
[25] E. Basar, C. Basar-Eroglu, S. Karakas, and M. Schurmann, "Oscillatory brain theory: A new trend in neuroscience - The role of
oscillatory processes in sensory and cognitive functions," Ieee Engineering in Medicine and Biology Magazine, vol. 18, pp. 56-66,
May-Jun 1999.
33
[26] D. J. L. Schutter, P. Putman, E. Hermans, and J. van Honk, "Parietal electroencephalogram beta asymmetry and selective attention
to angry facial expressions in healthy human subjects," Neuroscience Letters, vol. 314, pp. 13-16, Nov 13 2001.
[27] Y. P. Lin, J. R. Duann, J. H. Chen, and T. P. Jung, "Electroencephalographic dynamics of musical emotion perception revealed by
independent spectral components," Neuroreport, vol. 21, pp. 410-5, Apr 21 2010.
[28] S. Vieillard, I. Peretz, N. Gosselin, S. Khalfa, L. Gagnon, and B. Bouchard, "Happy, sad, scary and peaceful musical excerpts for
research on emotions," Cognition & Emotion, vol. 22, pp. 720-752, 2008.
[29] P. Gomez and B. Danuser, "Affective and physiological responses to environmental noises and music," Int J Psychophysiol, vol.
53, pp. 91-103, Jul 2004.
[30] M. M. Bradley and P. J. Lang, "Measuring emotion: The self-assessment manikin and the semantic differential," Journal of
Behavior Therapy and Experimental Psychiatry, vol. 25, pp. 49-59, 1994.
[31] M. Zentner, D. Grandjean, and K. R. Scherer, "Emotions evoked by the sound of music: Characterization, classification, and
measurement," Emotion, vol. 8, pp. 494-521, Aug 2008.
[32] A. Delorme and S. Makeig, "EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent
component analysis," Journal of Neuroscience Methods, vol. 134, pp. 9-21, Mar 15 2004.
[33] S. Makeig, J. Onton, M. Westerfield, and J. Townsend, "Imaging human EEG dynamics using independent component analysis,"
Neuroscience and Biobehavioral Reviews, vol. 30, pp. 808-822, 2006.
[34] M. Hirata, S. Koreeda, K. Sakihara, A. Kato, T. Yoshimine, and S. Yorifuji, "Effects of the emotional connotations in words on the
frontal areas - A spatially filtered MEG study," Neuroimage, vol. 35, pp. 420-429, Mar 2007.
[35] C. M. Sander Koelstra, Mohammad Soleymani, Jong-Seok Lee, Ashkan Yazdani, Touradj Ebrahimi, Thierry Pun, Anton Nijholt,
Ioannis Patras, "DEAP: A Database for Emotion Analysis Using Physiological Signals," IEEE Transactions on Affective
Computing, 06 Jun. 2011.
[36] R. J. Zatorre, J. L. Chen, and V. B. Penhune, "When the brain plays music: auditory-motor interactions in music perception and
production," Nature Reviews Neuroscience, vol. 8, pp. 547-558, Jul 2007.
[37] Y. P. Lin, C. H. Wang, T. P. Jung, T. L. Wu, S. K. Jeng, J. R. Duann, and J. H. Chen, "EEG-Based Emotion Recognition in Music
Listening," Ieee Transactions on Biomedical Engineering, vol. 57, pp. 1798-1806, Jul 2010.
[38] E. T. G. T. Toussaint, "On the relation between rhythm complexity measures and human rhythmic performance," presented at the
C3S2E '08 Proceedings, New York, NY, USA, 2008.
34