564
Views
0
CrossRef citations to date
0
Altmetric
Research Article

The Stretchy Strap: supporting encumbered interaction with guitars

, , , &
Pages 19-40 | Received 29 Mar 2022, Accepted 27 Sep 2023, Published online: 10 Nov 2023

References

  • Alfaras, M., Tsaknaki, V., Sanches, P., Windlin, C., Umair, M., Sas, C., & Höök, K. (2020). From Biodata to Somadata. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–14. https://doi.org/10.1145/3313831.3376684
  • Andersen, K., & Gibson, D. (2017). The instrument as the source of new in new music. Design Issues, 33(3), 37–55. https://doi.org/10.1162/DESI_a_00450
  • Andersen, K., & Wakkary, R. (2019). The magic machine workshops: Making personal design knowledge. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1–13. https://doi.org/10.1145/3290605.3300342
  • Asplund, S., & Jonsson, M. (2018). SWAY - Designing for balance and posture awareness. Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction, 470–475. https://doi.org/10.1145/3173225.3173262
  • Avila, J. M., Tsaknaki, V., Karpashevich, P., Windlin, C., Valenti, N., Höök, K., McPherson, A., & Benford, S. (2020). Soma design for NIME. Proceedings of the 2020 International Conference on New Interfaces for Musical Expression (NIME'20), 489–494. https://doi.org/10.5281/zenodo.4813491
  • Avila, J. P. M., Greenhalgh, C., Hazzard, A., Benford, S., & Chamberlain, A. (2019a). Encumbered interaction: A study of musicians preparing to perform. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1–13. https://doi.org/10.1145/3290605.3300706
  • Avila, J. P. M., Hazzard, A., Greenhalgh, C., & Benford, S. (2019b). Augmenting guitars for performance preparation. Proceedings of the 14th International Audio Mostly Conference: A Journey in Sound, 69–75. https://doi.org/10.1145/3356590.3356602
  • Benford, S., Hazzard, A., Chamberlain, A., Glover, K., Greenhalgh, C., Xu, L., Hoare, M., & Darzentas, D. (2016). Accountable artefacts: The case of the Carolan guitar. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 1163–1175. https://doi.org/10.1145/2858036.2858306
  • Bianchi-Berthouze, N., Cairns, P., Cox, A., Jennett, C., & Kim, W. W. (2006). On posture as a modality for expressing and recognizing emotions. 8.
  • Bigoni, F., & Erkut, C. (2020). Dogdog: Soma-based interface design for an improvising musician. Proceedings of the 7th International Conference on Movement and Computing, 1–4. https://doi.org/10.1145/3401956.3404242
  • Borst, J. P., Taatgen, N. A., & van Rijn, H. (2015). What Makes Interruptions Disruptive?: A Process-Model Account of the Effects of the Problem State Bottleneck on Task Interruption and Resumption. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI ‘15, 2971–2980. https://doi.org/10.1145/2702123.2702156
  • Brown, D., Renney, N., Stark, A., Nash, C., & Mitchell, T. (2016). Leimu: Gloveless Music Interaction Using a Wrist Mounted Leap Motion. 5.
  • Cai, C. J., Carney, M., Zada, N., & Terry, M. (2021). Breakdowns and breakthroughs: Observing musicians’ responses to the COVID-19 pandemic. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 1–13. https://doi.org/10.1145/3411764.3445192
  • Chang, M., Truong, A., Wang, O., Agrawala, M., & Kim, J. (2019). How to design voice based navigation for how-to videos. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1–11. Association for Computing Machinery, New York, NY, USA, Paper 701, 1–11. https://doi.org/10.1145/3290605.3300931
  • Cotton, K., Sanches, P., Tsaknaki, V., & Karpashjevich, P. (2021). The body electric: A NIME designed through and with the somatic experience of singing. International Conference on New Interfaces for Musical Expression, https://doi.org/10.21428/92fbeb44.ec9f8fdd
  • Delfa, L., Baytas, J., Patibanda, M. A., Ngari, R., Khot, H., Mueller, R. A., & Floyd, F. (2020). Drone Chi: Somaesthetic Human-Drone interaction. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–13. https://doi.org/10.1145/3313831.3376786
  • Dourish, P. (2004). Where the action is: The foundations of embodied interaction. MIT press.
  • Emmerson, S. (2016). ‘Losing touch?': the human performer and electronics. In Music, Electronic Media and Culture (pp. 194–216). Routledge.
  • Feldenkrais, M. (2011). Embodied wisdom: The collected papers of Moshe Feldenkrais. North Atlantic Books.
  • Friedman, B. (1996). Value-sensitive design. Interactions, 3(6), 16–23. https://doi.org/10.1145/242485.242493
  • Furniss, P., & Dudas, R. (2014). Transcription, adaptation and maintenance in live electronic performance with acoustic instruments. Computer Music Association.
  • Green, L. (2017). How popular musicians learn: A way ahead for music education. Routledge.
  • Greenhalgh, C., Benford, S., Hazzard, A., & Chamberlain, A. (2017). Playing fast and loose with music recognition. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 4302–4313. https://doi.org/10.1145/3025453.3025900
  • Höök, K. (2018). Designing with the body: Somaesthetic interaction design. MIT Press.
  • Höök, K., Benford, S., Tennent, P., Tsaknaki, V., Alfaras, M., Avila, J. M., Li, C., Marshall, J., Roquet, C. D., Sanches, P., Ståhl, A., Umair, M., Windlin, C., & Zhou, F. (2021). Unpacking non-dualistic design: The soma design case. ACM Transactions on Computer-Human Interaction, 28(6), 1–36. https://doi.org/10.1145/3462448
  • Höök, K., Caramiaux, B., Erkut, C., Forlizzi, J., Hajinejad, N., Haller, M., Hummels, C., Isbister, K., Jonsson, M., & Khut, G. (2018). Embracing first-person perspectives in soma-based design. Informatics, 5(1), 8. https://doi.org/10.3390/informatics5010008
  • Hopkin, B., & Landman, Y. (2012). Nice noise: Modifications and preparations for guitar. Experimental Musical Instruments.
  • Ingold, T. (2019). Thinking in the World: A Reader (pp. 202). United Kingdom: Bloomsbury Publishing.
  • Janssen, C. P., Gould, S. J. J., Li, S. Y. W., Brumby, D. P., & Cox, A. L. (2015). Integrating knowledge of multitasking and interruptions across different perspectives and research methods. International Journal of Human-Computer Studies, 79, 1–5. https://doi.org/10.1016/j.ijhcs.2015.03.002
  • Kjeldsen, R., & Hartman, J. (2001). Design issues for vision-based computer interaction systems. Proceedings of the 2001 Workshop on Percetive User Interfaces - PUI ‘01, 1. https://doi.org/10.1145/971478.971511
  • Ko, C., & Oehlberg, L. (2020). Touch Responsive Augmented Violin Interface System II: Integrating Sensors into a 3D Printed Fingerboard. 6.
  • Kristoffersen, M. M., & Engum, T. (2018). The Whammy Bar as a Digital Effect Controller.
  • Leman, M., Lesaffre, M., & Maes, P.-J. (2017). Introduction: What is embodied music interaction? In The Routledge companion to embodied music interaction (pp. 1–10). Routledge. https://doi.org/10.4324/9781315621364-1
  • Lepri, G., & McPherson, A. (2019). Making up instruments: Design fiction for value discovery in communities of musical practice. Proceedings of the 2019 on Designing Interactive Systems Conference, 113–126. https://doi.org/10.1145/3322276.3322353
  • Lim, Y., Stolterman, E., Jung, H., & Donaldson, J. (2007). Interaction gestalt and the design of aesthetic interactions. Proceedings of the 2007 Conference on Designing Pleasurable Products and Interfaces - DPPI ‘07, 239. https://doi.org/10.1145/1314161.1314183
  • Loke, L., & Schiphorst, T. (2018). The somatic turn in human-computer interaction. Interactions, 25(5), 54–5863. https://doi.org/10.1145/3236675
  • Lucero, A., Vaajakallio, K., & Dalsgaard, P. (2012). The dialogue-labs method: Process, space and materials as structuring elements to spark dialogue in co-design events. CoDesign, 8(1), 1–23. https://doi.org/10.1080/15710882.2011.609888
  • MacConnell, D., Trail, S., Tzanetakis, G., Driessen, P., Page, W., & Wellington, N. (2013). Reconfigurable autonomous novel guitar effects (range). In Proceedings of the international conference on sound and music computing. Sweden: Stockholm.
  • Magnusson, T. (2009). Of epistemic tools: Musical instruments as cognitive extensions. Organised Sound, 14(2), 168–176. https://doi.org/10.1017/S1355771809000272
  • Mainsbridge, M. (2022). Feeling movement in live electronic music: An embodied autoethnography. In Proceedings of the 8th International Conference on Movement and Computing (MOCO '22). Association for Computing Machinery, New York, NY, USA, Article 13, 1–7. https://doi.org/10.1145/3537972.3537989
  • Márquez Segura, E., Turmo Vidal, L., Rostami, A., & Waern, A. (2016). Embodied sketching. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 6014–6027. https://doi.org/10.1145/2858036.2858486
  • Marshall, J., & Tennent, P. (2013). Mobile interaction does not exist. CHI ‘13 Extended Abstracts on Human Factors in Computing Systems on - CHI EA ‘13, 2069. https://doi.org/10.1145/2468356.2468725
  • Marshall, M. T., & Wanderley, M. M. (2011). Examining the effects of embedded vibrotactile feedback on the feel of a digital musical instrument. In Proceedings of the 11th International Conference on New Interfaces for Musical Expression (NIME'11).
  • Masu, R., Bettega, M., Correia, N. N., Romão, T., & Morreale, F. (2019, October 23). ARCAA: A framework to analyse the artefact ecology in computer music performance [Conference Proceedings]. University of Greenwich; ACM. https://doi.org/10.1145/3359852.3359870
  • McPherson, A., & Zappi, V. (2015). An environment for submillisecond-latency audio and sensor processing on BeagleBone Black. In Audio Engineering Society Convention 138. Audio Engineering Society.
  • McPherson, A. P., Gierakowski, A., & Stark, A. M. (2013). The space between the notes: Adding expressive pitch control to the piano keyboard. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI ‘13, 2195, https://doi.org/10.1145/2470654.2481302
  • Morreale, F., Guidi, A., & McPherson, A. (2019). Magpick: An augmented guitar pick for nuanced control. New Interfaces for Musical Expression.
  • Morrison, C., Huckvale, K., Corish, B., Dorn, J., Kontschieder, P., O’Hara, K., Team, A. M., Criminisi, A., & Sellen, A. (2016). Assessing multiple sclerosis with kinect: Designing computer vision systems for real-world use. Human–Computer Interaction, 31(3–4), 191–226. https://doi.org/10.1080/07370024.2015.1093421
  • Newton, D., & Marshall, M. T. (2011). Examining How musicians create augmented musical instruments. In Proceedings of the 11th International Conference on New Interfaces for Musical Expression (NIME11). Chicago.
  • Ng, A., Brewster, S. A., & Williamson, J. H. (2014). Investigating the effects of encumbrance on one- and two- handed interactions with mobile devices. Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems - CHI ‘14, 1981–1990. https://doi.org/10.1145/2556288.2557312
  • Nijs, L. (2017). The merging of musician and musical instrument: Incorporation, presence, and levels of embodiment. In Marc Leman, Micheline Lesaffre, & Pieter-Jan Maes (Eds.), The Routledge companion to embodied music interaction (pp. 49–57). Routledge.
  • Olwal, A., Starner, T., & Mainini, G. (2020). E-Textile microinteractions: Augmenting twist with flick, slide and grasp gestures for soft electronics. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–13. https://doi.org/10.1145/3313831.3376236
  • Oulasvirta, A., & Bergstrom-Lehtovirta, J. (2011). Ease of juggling: Studying the effects of manual multitasking. Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems - CHI ‘11, 3103. https://doi.org/10.1145/1978942.1979402
  • Sagayam, K. M., & Hemanth, D. J. (2017). Hand posture and gesture recognition techniques for virtual reality applications: A survey. Virtual Reality, 21(2), 91–107. https://doi.org/10.1007/s10055-016-0301-0
  • San Juan, C. A. M. (2020). The guitar as a laboratory for experimentation. Revista Vórtex, 8(3), 1–10.
  • Schleicher, D., Jones, P., & Kachur, O. (2010). Bodystorming as embodied designing. Interactions, 17(6), 47–51. https://doi.org/10.1145/1865245.1865256
  • Shusterman, R. (2008). Body consciousness: A philosophy of mindfulness and somaesthetics. Cambridge University Press.
  • Shusterman, R. (2012). Thinking through the body: Essays in somaesthetics. Cambridge University Press. https://doi.org/10.1017/CBO9781139094030
  • Sudnow, D., & Dreyfus, H. L. (2001). Ways of the hand: A rewritten account.
  • Tanaka, A., & Parkinson, A. (2016). Haptic wave: A cross-modal interface for visually impaired audio producers. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2150–2161. https://doi.org/10.1145/2858036.2858304
  • Tapparo, C. S., & Zappi, V. (2022, June 16). Bodily Awareness Through NIMEs: Deautomatising Music Making Processes. NIME 2022.
  • Tennent, P., Höök, K., Benford, S., Tsaknaki, V., Ståhl, A., Dauden Roquet, C., Windlin, C., Sanches, P., Marshall, J., Li, C., Martinez Avila, J. P., Alfaras, M., Umair, M., & Zhou, F. (2021). Articulating soma experiences using trajectories. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, https://doi.org/10.1145/3411764.3445482
  • Tuncer, S., Lindwall, O., & Brown, B. (2021). Making time: Pausing to coordinate video instructions and practical tasks. Symbolic Interaction, 44(3), 603–631. https://doi.org/10.1002/symb.516
  • Turchet, L. (2017). The hyper-mandolin. Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences - AM ‘17, 1–8. https://doi.org/10.1145/3123514.3123539
  • Turchet, L., & Barthet, M. (2019). An ubiquitous smart guitar system for collaborative musical practice. Journal of New Music Research, 48(4), 352–365. https://doi.org/10.1080/09298215.2019.1637439
  • Turchet, L., Fischione, C., & Barthet, M. (2017). Towards the internet of musical things. In Proceedings of the 14th Sound and Music Computing (pp. 13–20). Espoo, Finland.
  • Van Schaik, P., Bettany-Saltikov, J. A., & Warren, J. G. (2002). Clinical acceptance of a low-cost portable system for postural assessment. Behaviour & Information Technology, 21(1), 47–57. https://doi.org/10.1080/01449290110107236
  • Vets, T., Degrave, J., Nijs, L., Bressan, F., & Leman, M. (2017). PLXTRM: Prediction-Led eXtended-guitar tool for real-time music applications and live performance. Journal of New Music Research, 46(2), 187–200. https://doi.org/10.1080/09298215.2017.1288747
  • Vogl, A., Parzer, P., Babic, T., Leong, J., Olwal, A., & Haller, M. (2017). StretchEBand: Enabling fabric-based interactions through rapid fabrication of textile stretch sensors. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2617–2627. https://doi.org/10.1145/3025453.3025938
  • Vyas, D. (2007). Artefact ecologies: Supporting embodied meeting practices with distance access. 117–122.
  • Wang, B., Yang, M. Y., & Grossman, T. (2021). Soloist: Generating mixed-initiative tutorials from existing guitar instructional videos through audio processing. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 1–14. https://doi.org/10.1145/3411764.3445162
  • Wilde, D., Vallgårda, A., & Tomico, O. (2017). Embodied design ideation methods: Analysing the power of estrangement. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 5158–5170. https://doi.org/10.1145/3025453.3025873
  • Windlin, C., Ståhl, A., Sanches, P., Tsaknaki, V., Karpashevich, P., Balaam, M., & Höök, K. (2019). Soma Bits-Mediating Technology to Orchestrate Bodily Experiences. RTD 2019-Research through Design Conference 2019, the Science Centre, Delft, on 19th to 22nd March 2019.
  • Wobbrock, J. O. (2019). Situationally aware mobile devices for overcoming situational impairments. Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems, 1–18. https://doi.org/10.1145/3319499.3330292
  • Wolf, K., Mayer, S., & Meyer, S. (2016). Microgesture detection for remote interaction with mobile devices. Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct - MobileHCI ‘16, 783–790. https://doi.org/10.1145/2957265.2961865
  • Wolf, K., Naumann, A., Rohs, M., & Müller, J. (2011). A taxonomy of microinteractions: Defining microgestures based on ergonomic and scenario-Dependent requirements. In P. Campos, N. Graham, J. Jorge, N. Nunes, P. Palanque, & M. Winckler (Eds.), Human-Computer interaction – INTERACT 2011 (Vol. 6946) (pp. 559–575). Springer. https://doi.org/10.1007/978-3-642-23774-4_45
  • Young, D. (2002). The Hyperbow Controller: Real-Time Dynamics Measurement of Violin Performance. 6.