Affect, Attitude and Evaluation of Multisensory Performances

Abstract

The EU-IST project MEGA (Multisensory Expressive Gesture Applications; see www.megaproject.org) addresses innovative technologies for multimodal interactive systems in artistic scenarios. Basic research on expressive communication in music, gesture and dance has been focused by EU-IST-funded European researchers in psychology, technology and computer engineering. The output from this cooperation with artists has also revealed ideas and innovations for applications in social, artistic and communicative entertainment. However, even the most careful basic research and computer engineering could never estimate the real efficiency and benefit of such new expressive applications. The purpose of this article, therefore, is to get feedback from the audience and the artists/ performers/ players at three public MEGA events: the interactive music concert Allegoria dell'opinione verbale, a dance performance by Groove Machine and a public game (Ghost in the Cave). General attitude, perceived communication/affect and practical efficiency were evaluated by questionnaires. Results showed that: (a) the performers were able to control the expressive output within the application, (b) the audience was positive to each event, (c) information about or explicit engagement in the application revealed even more positive judgments, and (d) aesthetic and expressive qualities were transmitted through the MEGA output. This article suggests that real-time transmission of expressive and emotional content is very promising for social, artistic and communicative applications.

Acknowledgements

This work was supported by the EU-IST-funded MEGA project through a grant to Antonio Camurri. We would like to thank everyone attached to any of the public multisensory activities, including, first of all, the different European research groups: DIST-Laboratory of Musical Informatics, University of Genoa; DEI-University of Padova; IPEM-University of Ghent; KTH- Royal Institute of Technology; Uppsala University, Department of Psychology; Telenor-Octaga in Norway; Generalmusic; Consorzio Pisa Ricerche; and Eidomedia. Special thanks to Roberto Doati, Francesca Faiella and Gianni Revello for their contribution to the experiment at the Allegoria dell'opinione verbale concert. Special thanks to the dancer, from the dance company Bounce and the DJ, for their contribution to the Groove Machine. We would also like to acknowledge that all senior high schools in Stockholm and its surrounding area had the opportunity to visit KTH during one week in October 2003. They were offered a number of activities where Ghost in the Cave was one. Ten groups consisting of approximately 250 15 year-olds and their teachers visited the Ghost event during three days. The analysis of these performances will be published elsewhere.

Notes

¹Octagon is a MPEG4 and VRML compliant player, see www.octaga.com.

²See http://pure-data.sourceforge.net/.

³The calibration was done only once before the actual event. An individual calibration was not found to be necessary.