143
Views
0
CrossRef citations to date
0
Altmetric
Research Article

The virtual drum circle: polyrhythmic music interactions in mixed reality

, ORCID Icon, ORCID Icon, &
Received 11 Oct 2022, Accepted 10 Mar 2024, Published online: 15 Apr 2024

References

  • Agawu, K. (2006). Structural analysis or cultural analysis? Competing perspectives on the “standard pattern” of West African rhythm. Journal of the American Musicological Society, 59(1), 1–46. https://doi.org/10.1525/jams.2006.59.1.1
  • Aron, A., Aron, E. N., & Smollan, D. (1992). Inclusion of other in the self scale and the structure of interpersonal closeness. Journal of Personality and Social Psychology, 63(4), 596. https://doi.org/10.1037/0022-3514.63.4.596
  • Atmaca, S., Sebanz, N., & Knoblich, G. (2011). The joint flanker effect: Sharing tasks with real and imagined co-actors. Experimental Brain Research, 211(3), 371–385. https://doi.org/10.1007/s00221-011-2709-9
  • Baker, C. (2017). Virtual, artificial and mixed reality: New frontiers in performance. In 2017 23rd International Conference on Virtual System & Multimedia (VSMM) (pp. 1–10). IEEE.
  • Bates, D., Mächler, M., Bolker, B., & Walker, S. (2014). Fitting linear mixed-effects models using lme4. arXiv Preprint arXiv:1406.5823.
  • Berthaut, F. (2020). 3D interaction techniques for musical expression. Journal of New Music Research, 49(1), 60–72. https://doi.org/10.1080/09298215.2019.1706584
  • Blascovich, J., Loomis, J., Beall, A. C., Swinth, K. R., Hoyt, C. L., & Bailenson, J. N. (2002). Target ARTICLE: Immersive virtual environment technology as a methodological tool for social psychology. Psychological Inquiry, 13(2), 103–124. https://doi.org/10.1207/S15327965PLI1302_01
  • Bolt, N. K., & Loehr, J. D. (2017). The predictability of a partner’s actions modulates the sense of joint agency. Cognition, 161, 60–65. https://doi.org/10.1016/j.cognition.2017.01.004
  • Brown, S. C., & Knox, D. (2017). Why go to pop concerts? The motivations behind live music attendance. Musicae Scientiae, 21(3), 233–249. https://doi.org/10.1177/1029864916650719
  • Burger, B., Thompson, M. R., Luck, G., Saarikallio, S. H., & Toiviainen, P. (2014). Hunting for the beat in the body: On period and phase locking in music-induced movement. Frontiers in Human Neuroscience, 8, 903. https://doi.org/10.3389/fnhum.2014.00903
  • Çamci, A., & Hamilton, R. (2020). Audio-first VR: New perspectives on musical experiences in virtual environments. Journal of New Music Research, 1–7. https://doi.org/10.1080/09298215.2019.1707234
  • Carrer, L. R. J., Pompéia, S., & Miranda, M. C. (2022). Sensorimotor synchronization with music and metronome in school-aged children. Psychology of Music, 51(2), 523–540.
  • Chafe, C., Caceres, J.-P., & Gurevich, M. (2010). Effect of temporal separation on synchronization in rhythmic performance. Perception, 39(7), 982–992. https://doi.org/10.1068/p6465
  • Chang, A., Kragness, H. E., Livingstone, S. R., Bosnyak, D. J., & Trainor, L. J. (2019). Body sway reflects joint emotional expression in music ensemble performance. Scientific Reports, 9(1), 1–11. https://doi.org/10.1038/s41598-018-37186-2
  • Chang, A., Livingstone, S. R., Bosnyak, D. J., & Trainor, L. J. (2017). Body sway reflects leadership in joint music performance. Proceedings of the National Academy of Sciences, 114(21), E4134–E4141. https://doi.org/10.1073/pnas.1617657114
  • Chauvigné, L. A. S., Walton, A., Richardson, M. J., & Brown, S. (2019). Multi-person and multisensory synchronization during group dancing. Human Movement Science, 63, 199–208. https://doi.org/10.1016/j.humov.2018.12.005
  • Christensen, R. H. B. (2015). Analysis of ordinal data with cumulative link models—estimation with the R-package ordinal. R-Package Version, 28, 145.
  • Cipresso, P., Giglioli, I. A. C., Raya, M. A., & Riva, G. (2018). The past, present, and future of virtual and augmented reality research: A network and cluster analysis of the literature. Frontiers in Psychology, 9, 2086. https://doi.org/10.3389/fpsyg.2018.02086
  • D’Amario, S., Daffern, H., & Bailes, F. (2018). Synchronization in singing duo performances: The roles of visual contact and leadership instruction. Frontiers in Psychology, 9, 1208. https://doi.org/10.3389/fpsyg.2018.01208
  • D’Ausilio, A., Novembre, G., Fadiga, L., & Keller, P. E. (2015). What can music tell us about social interaction? Trends in Cognitive Sciences, 19(3), 111–114. https://doi.org/10.1016/j.tics.2015.01.005
  • de Borst, A. W., & de Gelder, B. (2015). Is it the real deal? Perception of virtual characters versus humans: An affective cognitive neuroscience perspective. Frontiers in Psychology, 6, 576. https://doi.org/10.3389/fpsyg.2015.00576
  • De Bruyn, L., Leman, M., Moelants, D., Demey, M., & De Smet, F. (2008). Measuring and quantifying the impact of social interaction on listeners’ movement to music. In K.  Jensen (Ed.), Proceedings of the 2008 Computers in Music Modeling and Retrieval and Network for Cross-Disciplinary Studies of Music and Meaning Conference (pp. 298–305).
  • De Jaegher, H., & Di Paolo, E. (2007). Participatory sense-making. Phenomenology and the Cognitive Sciences, 6(4), 485–507. https://doi.org/10.1007/s11097-007-9076-9
  • Dell’Anna, A., Buhmann, J., Six, J., Maes, P.-J., & Leman, M. (2020). Timing markers of interaction quality during semi-hocket singing. Frontiers in Neuroscience, 14, 619. https://doi.org/10.3389/fnins.2020.00619
  • Dell’Anna, A., Leman, M., & Berti, A. (2021). Musical interaction reveals music as embodied language. Frontiers in Neuroscience, 818.
  • Demos, A. P., Chaffin, R., Begosh, K. T., Daniels, J. R., & Marsh, K. L. (2012). Rocking to the beat: Effects of music and partner’s movements on spontaneous interpersonal coordination. Journal of Experimental Psychology: General, 141(1), 49–53. https://doi.org/10.1037/a0023843
  • Demos, A. P., Chaffin, R., & Logan, T. (2018). Musicians body sway embodies musical structure and expression: A recurrence-based approach. Musicae Scientiae, 22(2), 244–263. https://doi.org/10.1177/1029864916685928
  • De Oliveira, E. C., Bertrand, P., Lesur, M. E. R., Palomo, P., Demarzo, M., Cebolla, A., Baños, R., & Tori, R. (2016). Virtual body swap: A new feasible tool to be explored in health and education. In 2016 XVIII Symposium on Virtual and Augmented Reality (SVR) (pp. 81–89).
  • Desmet, F., Leman, M., Lesaffre, M., & De Bruyn, L. (2009). Statistical analysis of human body movement and group interactions in response to music. In Andreas Fink, Berthold Lausen, Wilfried Seidel, & Alfred Ultsch (Eds.), Advances in data analysis, data handling and business intelligence (pp. 399–408). Springer.
  • Dotov, D., Bosnyak, D., & Trainor, L. J. (2021). Collective music listening: Movement energy is enhanced by groove and visual social cues. Quarterly Journal of Experimental Psychology, 74(6), 1037–1053. https://doi.org/10.1177/1747021821991793
  • Dotov, D., Delasanta, L., Cameron, D. J., Large, E. W., & Trainor, L. (2022). Collective dynamics support group drumming, reduce variability, and stabilize tempo drift. Elife, 11, e74816. https://doi.org/10.7554/eLife.74816
  • Drioli, C., Allocchio, C., & Buso, N. (2013). Networked performances and natural interaction via LOLA: Low latency high quality A/V streaming system. In P. Nesi (Ed.), Lecture notes in computer science (Vol. 7990, pp. 240–250). Springer: Springer Berlin Heidelberg.
  • Eerola, T., Jakubowski, K., Moran, N., Keller, P. E., & Clayton, M. (2018). Shared periodic performer movements coordinate interactions in duo improvisations. Royal Society Open Science, 5(2), 171520. https://doi.org/10.1098/rsos.171520
  • Engel, A. K., Friston, K. J., & Kragic, D. (2016). The pragmatic turn: Toward action-oriented views in cognitive science (Vol. 18). MIT Press.
  • Engeser, S., & Rheinberg, F. (2008). Flow, performance and moderators of challenge-skill balance. Motivation and Emotion, 32(3), 158–172. https://doi.org/10.1007/s11031-008-9102-4
  • Friedman, D., Pizarro, R., Or-Berkers, K., Neyret, S., Pan, X., & Slater, M. (2014). A method for generating an illusion of backwards time travel using immersive virtual reality–an exploratory study. Frontiers in Psychology, 5, 943. https://doi.org/10.3389/fpsyg.2014.00943
  • Gonzalez-Sanchez, V. E., Zelechowska, A., & Jensenius, A. R. (2018). Correspondences between music and involuntary human micromotion during standstill. Frontiers in Psychology, 9, 1382.
  • Goupil, L., Wolf, T., Saint-Germier, P., Aucouturier, J.-J., & Canonne, C. (2021). Emergent shared intentions support coordination during collective musical improvisations. Cognitive Science, 45(1), e12932. https://doi.org/10.1111/cogs.12932
  • Grinsted, A., Moore, J. C., & Jevrejeva, S. (2004). Application of the cross wavelet transform and wavelet coherence to geophysical time series. Nonlinear Processes in Geophysics, 11(5/6), 561–566. https://doi.org/10.5194/npg-11-561-2004
  • Hale, J., & Hamilton, A. F. D. C. (2016). Testing the relationship between mimicry, trust and rapport in virtual reality conversations. Scientific Reports, 6(1), 1–11. https://doi.org/10.1038/srep35295
  • Hamilton, R. (2019). Coretet: A 21st century virtual interface for musical expression. In Richard Kronland-Martinet, Sølvi Ystad, & Mitsuko Aramaki (Eds.), 14th International Symposium on Computer Music Multidisciplinary Research (pp. 1010–1021). Springer.
  • Harrar, V., Harris, L. R., & Spence, C. (2017). Multisensory integration is independent of perceived simultaneity. Experimental Brain Research, 235(3), 763–775. https://doi.org/10.1007/s00221-016-4822-2
  • Heggli, O. A., Cabral, J., Konvalinka, I., Vuust, P., & Kringelbach, M. L. (2019). A Kuramoto model of self-other integration across interpersonal synchronization strategies. PLoS Computational Biology, 15(10).
  • Herrera, F., Bailenson, J., Weisz, E., Ogle, E., & Zaki, J. (2018). Building long-term empathy: A large-scale comparison of traditional and virtual reality perspective-taking. PLoS One, 13(10), e0204494. https://doi.org/10.1371/journal.pone.0204494
  • Kawase, S. (2014). Gazing behavior and coordination during piano duo performance. Attention, Perception, & Psychophysics, 76(2), 527–540. https://doi.org/10.3758/s13414-013-0568-0
  • Keller, P. E. (2014). Ensemble performance: Interpersonal alignment of musical expression. In D. Fabian, R. Timmers, & E. Schubert (Eds.), Expressiveness in music performance: Empirical approaches across styles and cultures (pp. 260–282). Oxford University Press.
  • Kelso, J. A. S. (2009). Coordination dynamics. In R. A. Meyers (Ed.), Encyclopedia of complexity and systems science (pp. 1537–1565). Springer.
  • Kilteni, K., Groten, R., & Slater, M. (2012). The sense of embodiment in virtual reality. Presence: Teleoperators and Virtual Environments, 21(4), 373–387. https://doi.org/10.1162/PRES_a_00124
  • Koban, L., Ramamoorthy, A., & Konvalinka, I. (2019). Why do we fall into sync with others? Interpersonal synchronization and the brain’s optimization principle. Social Neuroscience, 14(1), 1–9. https://doi.org/10.1080/17470919.2017.1400463
  • Konvalinka, I., Vuust, P., Roepstorff, A., & Frith, C. D. (2010). Follow you, follow me: Continuous mutual prediction and adaptation in joint tapping. Quarterly Journal of Experimental Psychology, 63(11), 2220–2230. https://doi.org/10.1080/17470218.2010.497843
  • Kothgassner, O. D., & Felnhofer, A. (2020). Does virtual reality help to cut the Gordian knot between ecological validity and experimental control? Annals of the International Communication Association, 44(3), 210–218. https://doi.org/10.1080/23808985.2020.1792790
  • Leman, M. (2007). Embodied music cognition and mediation technology. MIT Press.
  • Leman, M. (2021). Co-regulated timing in music ensembles: A Bayesian listener perspective. Journal of New Music Research, 50(2), 121–132. https://doi.org/10.1080/09298215.2021.1907419
  • Leow, L.-A., Parrott, T., & Grahn, J. A. (2014). Individual differences in beat perception affect gait responses to low-and high-groove music. Frontiers in Human Neuroscience, 8, 811.
  • Loehr, J. D. (2022). The sense of agency in joint action: An integrative review. Psychonomic Bulletin & Review, 1–29.
  • Loveridge, B. (2020). Networked music performance in virtual reality: Current perspectives. Journal of Network Music and Arts, 2(1), 2.
  • Lüdecke, D. (2017). sjPlot: Data visualization for statistics in social science. https://CRAN.R-project.org/package=sjPlot
  • Metzinger, T. K. (2018). Why is virtual reality interesting for philosophers? Frontiers in Robotics and AI, 5, 101. https://doi.org/10.3389/frobt.2018.00101
  • Milgram, P., & Kishino, F. (1994). Taxonomy of mixed reality visual displays. IEICE Transactions on Information and Systems, E77-D(12), 1321–1329.
  • Milward, S. J., & Sebanz, N. (2016). Mechanisms and development of self–other distinction in dyads and groups. Philosophical Transactions of the Royal Society B: Biological Sciences, 371(1686), 20150076. https://doi.org/10.1098/rstb.2015.0076
  • Miura, A., Kudo, K., & Nakazawa, K. (2013). Action–perception coordination dynamics of whole-body rhythmic movement in stance: A comparison study of street dancers and non-dancers. Neuroscience Letters, 544, 157–162. https://doi.org/10.1016/j.neulet.2013.04.005
  • Miyata, K., Varlet, M., Miura, A., Kudo, K., & Keller, P. E. (2017). Modulation of individual auditory-motor coordination dynamics through interpersonal visual coupling. Scientific Reports, 7(1), 1–11. https://doi.org/10.1038/s41598-016-0028-x
  • Møller, C., Stupacher, J., Celma-Miralles, A., & Vuust, P. (2021). Beat perception in polyrhythms: Time is structured in binary units. PLoS One, 16(8), e0252174. https://doi.org/10.1371/journal.pone.0252174
  • Moore, E., Schaefer, R. S., Bastin, M. E., Roberts, N., & Overy, K. (2017). Diffusion tensor MRI tractography reveals increased fractional anisotropy (FA) in arcuate fasciculus following music-cued motor training. Brain and Cognition, 116, 40–46. https://doi.org/10.1016/j.bandc.2017.05.001
  • Müllensiefen, D., Gingras, B., Musil, J., & Stewart, L. (2014). The musicality of non-musicians: An index for assessing musical sophistication in the general population. PLoS One, 9(2), e89642. https://doi.org/10.1371/journal.pone.0089642
  • Naveda, L., & Leman, M. (2010). The spatiotemporal representation of dance and music gestures using topological gesture analysis (TGA). Music Perception, 28(1), 93–111. https://doi.org/10.1525/mp.2010.28.1.93
  • Overy, K., & Molnar-Szakacs, I. (2009). Being together in time: Musical experience and the mirror neuron system. Music Perception, 26(5), 489–504. https://doi.org/10.1525/mp.2009.26.5.489
  • Pai, Y. S., Hajika, R., Gupta, K., Sasikumar, P., & Billinghurst, M. (2020). NeuralDrum: Perceiving brain synchronicity in XR drumming. In SIGGRAPH Asia 2020 Technical Communications (pp. 1–4). Publisher ACM.
  • Palmer, C., Spidle, F., Koopmans, E., & Schubert, P. (2019). Ears, heads, and eyes: When singers synchronise. Quarterly Journal of Experimental Psychology, 72(9), 2272–2287. https://doi.org/10.1177/1747021819833968
  • Pan, X., & Hamilton, A. F. d. C. (2018). Why and how to use virtual reality to study human social interaction: The challenges of exploring a new research landscape. British Journal of Psychology, 109(3), 395–417. https://doi.org/10.1111/bjop.12290
  • Parsons, T. D., Gaggioli, A., & Riva, G. (2017). Virtual reality for research in social neuroscience. Brain Sciences, 7(4), 42. https://doi.org/10.3390/brainsci7040042
  • Petrini, K., Dahl, S., Rocchesso, D., Waadeland, C. H., Avanzini, F., Puce, A., & Pollick, F. E. (2009). Multisensory integration of drumming actions: Musical expertise affects perceived audiovisual asynchrony. Experimental Brain Research, 198(2-3), 339–352. https://doi.org/10.1007/s00221-009-1817-2
  • Powers, A. R., Hillock, A. R., & Wallace, M. T. (2009). Perceptual training narrows the temporal window of multisensory binding. The Journal of Neuroscience, 29(39), 12265–12274. https://doi.org/10.1523/JNEUROSCI.3501-09.2009
  • Repp, B. H. (2006). Musical synchronization. In Eckart Altenmuller, Mario Wiesendanger, & Jurg Kesselring (Eds.), Music, motor control, and the brain (pp. 55–76). Oxford University Press. https://doi.org/10.1093/acprof:oso/9780199298723.003.0004
  • Repp, B. H., & Su, Y. H. (2013). Sensorimotor synchronization: A review of recent research (2006–2012). Psychonomic Bulletin & Review, 20(3), 403–452. https://doi.org/10.3758/s13423-012-0371-2
  • Richardson, M. J., Harrison, S. J., Kallen, R. W., Walton, A., Eiler, B. A., Saltzman, E., & Schmidt, R. C. (2015). Self-organized complementary joint action: Behavioral dynamics of an interpersonal collision-avoidance task. Journal of Experimental Psychology: Human Perception and Performance, 41(3), 665. https://doi.org/10.1037/xhp0000041
  • Rose, D., Ott, L., Guérin, S. M. R., Annett, L. E., Lovatt, P., & Delevoye-Turrell, Y. N. (2021). A general procedure to measure the pacing of body movements timed to music and metronome in younger and older adults. Scientific Reports, 11(1), 1–16. https://doi.org/10.1038/s41598-020-79139-8
  • Schlagowski, R., Gupta, K., Mertes, S., Billinghurst, M., Metzner, S., & André, E. (2022). Jamming in MR: Towards real-time music collaboration in mixed reality. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 854–855). IEEE. https://doi.org/10.1109/VRW55335.2022.00278
  • Schultz, B. G., & Palmer, C. (2019). The roles of musical expertise and sensory feedback in beat keeping and joint action. Psychological Research, 83(3), 419–431. https://doi.org/10.1007/s00426-019-01156-8
  • Schwartz, J.-L., & Savariaux, C. (2014). No, there is no 150 ms lead of visual speech on auditory speech, but a range of audiovisual asynchronies varying from small audio lead to large audio lag. PLoS Computational Biology, 10(7), e1003743. https://doi.org/10.1371/journal.pcbi.1003743
  • Sebanz, N., & Knoblich, G. (2021). Progress in joint-action research. Current Directions in Psychological Science, 30(2), 138–143. https://doi.org/10.1177/0963721420984425
  • Senel, G., & Slater, M. (2020). Conversation with your future self about nicotine dependence. In Patrick Bourdot, Victoria Interrante, Regis Kopper, Anne-Hélène Olivier, Hideo Saito, & Gabriel Zachmann (Eds.), International Conference on Virtual Reality and Augmented Reality (pp. 216–223). Springer International Publishing: Springer. https://doi.org/10.1007/978-3-030-62655-6_14.
  • Stupacher, J., Maes, P.-J., Witte, M., & Wood, G. (2017). Music strengthens prosocial effects of interpersonal synchronization – if you move in time with the beat. Journal of Experimental Social Psychology, 72, 39–44. https://doi.org/10.1016/j.jesp.2017.04.007
  • Tarr, B., Launay, J., & Dunbar, R. I. M. (2014). Music and social bonding: “Self-other” merging and neurohormonal mechanisms. Frontiers in Psychology, 5, 1096. https://doi.org/10.3389/fpsyg.2014.01096
  • Tarr, B., Slater, M., & Cohen, E. (2018). Synchrony and social connection in immersive virtual reality. Scientific Reports, 8(1), 1–8. https://doi.org/10.1038/s41598-018-21765-4
  • Toiviainen, P., Luck, G., & Thompson, M. R. (2010). Embodied meter: Hierarchical eigenmodes in music-induced movement. Music Perception, 28(1), 59–70. https://doi.org/10.1525/mp.2010.28.1.59
  • Turchet, L., Garau, N., & Conci, N. (2022). Networked musical XR: Where’s the limit? A preliminary investigation on the joint use of point clouds and low-latency audio communication. In Proceedings of the 17th International Audio Mostly Conference (pp. 226–230). ACM. https://doi.org/10.1145/3561212.3561237
  • Turchet, L., Hamilton, R., & Camci, A. (2021). Music in extended realities. IEEE Access, 9, 15810–15832. https://doi.org/10.1109/ACCESS.2021.3052931
  • Van Kerrebroeck, B., Caruso, G., & Maes, P.-J. (2021). A methodological framework for assessing social presence in music interactions in virtual reality. Frontiers in Psychology, 12, 663725. https://doi.org/10.3389/fpsyg.2021.663725
  • Van Noorden, L., & Moelants, D. (1999). Resonance in the perception of musical pulse. Journal of New Music Research, 28(1), 43–66. https://doi.org/10.1076/jnmr.28.1.43.3122
  • Vroomen, J., & Keetels, M. (2010). Perception of intersensory synchrony: A tutorial review. Attention, Perception, & Psychophysics, 72(4), 871–884. https://doi.org/10.3758/APP.72.4.871
  • Vuoskoski, J. K., Thompson, M. R., Spence, C., & Clarke, E. F. (2016). Interaction of sight and sound in the perception and experience of musical performance. Music Perception: An Interdisciplinary Journal, 33(4), 457–471. https://doi.org/10.1525/mp.2016.33.4.457
  • Walton, A. E., Washburn, A., Langland-Hassan, P., Chemero, A., Kloos, H., & Richardson, M. J. (2018). Creating time: Social collaboration in music improvisation. Topics in Cognitive Science, 10(1), 95–119. https://doi.org/10.1111/tops.12306
  • Warren, W. H. (2006). The dynamics of perception and action. Psychological Review, 113(2), 358–389. doi:10.1037/0033-295X.113.2.358

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.