Using Multisensory Haptic Integration to Improve Monitoring in the Intensive Care Unit

References

• Akamatsu, M. , Sato, S. , & MacKenzie, I. S. (1994). Multimodal mouse: A mouse-type device with tactile and force display. Presence: Teleoperators & Virtual Environments , 3(1), 73–80.
   Google Scholar
• Alirezaee, P. , Girgis, R. , Kim, T. , Schlesinger, J. J. , & Cooperstock, J. R. (2017, June). Did you feel that? Developing novel multimodal alarms for high consequence clinical environments. In M. Schedel & M. Ballora (Eds.), ICAD 2017. Proceedings of the 23rd International Conference on Auditory Display (pp.175–181). State College, PA.
   Google Scholar
• Allman, B. L. , Keniston, L. P. , & Meredith, M. A. (2008). Subthreshold auditory inputs to extrastriate visual neurons are responsive to parametric changes in stimulus quality: Sensory-specific versus non-specific coding. Brain Research , 1242, 95–101.
   Web of Science ®Google Scholar
• Alpert, G. F. , Hein, G. , Tsai, N. , Naumer, M. J. , & Knight, R. T. (2008). Temporal characteristics of audiovisual information processing. Journal of Neuroscience , 28(20), 5344–5349.
   Web of Science ®Google Scholar
• Amlôt, R. , Walker, R. , Driver, J. , & Spence, C. (2003). Multimodal visual–somatosensory integration in saccade generation. Neuropsychologia , 41(1), 1–15.
   PubMed Web of Science ®Google Scholar
• Bliss, J. P. , Gilson, R. D. , & Deaton, J. E. (1995). Human probability matching behaviour in response to alarms of varying reliability. Ergonomics , 38(11), 2300–2312.
   PubMed Web of Science ®Google Scholar
• Burdick, K. J. , Jorgensen, S. K. , Combs, T. N. , Holmberg, M. O. , Kultgen, S. P. , & Schlesinger, J. J. (2019). SAVIOR ICU: Sonification and vibrotactile interface for the operating room and intensive care unit. Journal of Clinical Monitoring and Computing . Advance Online Publication. doi: 10.1007/s10877-019-00381-1.
   Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed. ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Cvach, M. M. , Frank, R. J. , Doyle, P. , & Stevens, Z. K. (2014). Use of pagers with an alarm escalation system to reduce cardiac monitor alarm signals. Journal of Nursing Care Quality , 29(1), 9–18.
   Web of Science ®Google Scholar
• Delft Design Labs . (2018). CareTunes . Music as a nurses’ monitoring tool. Retrieved from https://delftdesignlabs.org/projects/caretunes/
   Google Scholar
• Diederich, A. , & Colonius, H. (2004). Bimodal and trimodal multisensory enhancement: Effects of stimulus onset and intensity on reaction time. Perception & Psychophysics , 66(8), 1388–1404.
   PubMedGoogle Scholar
• Diederich, A. , Colonius, H. Bimodal and trimodal multisensory enhancement: Effects of stimulus onset and intensity on reaction time. Perception & Psychophysics 66, 1388–1404 (2004). doi:doi.10.3758/BF03195006 8
   PubMedGoogle Scholar
• Diederich, A. , & Colonius, H. (2009). Crossmodal interaction in speeded responses: Time window of integration model. Progress in Brain Research , 174, 119–135.
   Web of Science ®Google Scholar
• Edworthy, J. R. , Schlesinger, J. J. , McNeer, R. R. , Kristensen, M. S. , & Bennett, C. L. (2017). Classifying alarms: Seeking durability, credibility, consistency, and simplicity. Biomedical Instrumentation & Technology , 51(s2), 50–57.
   Google Scholar
• Forster B. , Cavina-Pratesi C. , Aglioti S. M. , Berlucchi G. Redundant target effect and intersensory facilitation from visual-tactile interactions in simple reaction time. Exp Brain Res . 2002;143(4):480‐487. doi: 10.1007/s00221-002-1017-9
   Web of Science ®Google Scholar
• Gay-Betton, D. M. , Alirezaee, P. , Cooperstock, J. R. , & Schlesinger, J. J. (2017, October). HAPTIC: Haptic anatomical positioning to improve clinical monitoring. In E. Ozcan & M. B. Alonso (Eds.), Proceedings of the Conference on Design and Semantics of Form and Movement-Sense and Sensitivity, DeSForM 2017 . Eindhoven, Netherlands.
   Google Scholar
• Ghose, D. , Maier, A. , Nidiffer, A. , & Wallace, M. T. (2014). Multisensory response modulation in the superficial layers of the superior colliculus. Journal of Neuroscience , 34(12), 4332–4344.
   Web of Science ®Google Scholar
• Gilman, S. (2002). Joint position sense and vibration sense: Anatomical organisation and assessment. Journal of Neurology, Neurosurgery, and Psychiatry , 73(5), 473–477.
   PubMed Web of Science ®Google Scholar
• Greer, J. M. , Burdick, K. J. , Chowdhury, A. R. , & Schlesinger, J. J. (2018). Dynamic Alarm Systems for Hospitals (DASH). Ergonomics in Design , 26(4), 14–19.
   Web of Science ®Google Scholar
• Hart, S. G. (2006, October). NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 50, No. 9, pp. 904–908). Los Angeles, CA.
   Google Scholar
• Hecht, D. , Reiner, M. , & Halevy, G. (2006). Multimodal virtual environments: Response times, attention, and presence. Presence: Teleoperators and Virtual Environments , 15(5), 515–523.
   Web of Science ®Google Scholar
• Hoonakker, P. , Carayon, P. , Gurses, A. P. , Brown, R. , Khunlertkit, A. , McGuire, K. , & Walker, J. M. (2011). Measuring workload of ICU nurses with a questionnaire survey: The NASA Task Load Index (TLX). IIE Transaction on Healthcare Systems Engineering , 1(2), 131–143.
   PubMedGoogle Scholar
• Johnson, A. , McBeath, M. K. , & Patten, K. J. (2014). Drumming and tempo: The effects of loudness change on tempo perception and action. Paper presented at the 2014 Auditory Perception, Cognition, and Action Meeting , Long Beach, CA.
   Google Scholar
• Jones LA. Tactile communication systems optimizing the display of information. Prog Brain Res. 2011;192:113–128. doi:10.1016/B978-0-444-53355-5.00008-7.
   Google Scholar
• Katzman, N. , Gellert, M. , Schlesinger, J. J. , Oron-Gilad, T. , Cooperstock, J. R. , & Bitan, Y. (2019, November). Evaluation of tactile cues for simulated patients’ status under high and low workload. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 63, No. 1, pp. 658–662). Los Angeles, CA.
   Google Scholar
• Kim, R. S. , Seitz, A. R. , & Shams, L. (2008). Benefits of stimulus congruency for multisensory facilitation of visual learning. PloS One , 3(1), e1532.
   Web of Science ®Google Scholar
• Kohn, L. T. , Corrigan, J. , & Donaldson, M. S. (2000). To err is human: Building a safer health system (Vol. 6). Washington, DC: National Academy Press.
   Google Scholar
• Kolodzey, L. , Grantcharov, P. D. , Rivas, H. , Schijven, M. P. , & Grantcharov, T. P. (2017). Wearable technology in the operating room: A systematic review. BMJ Innovations , 3(1), 55–63.
   Google Scholar
• Kristensen, M.S., Edworthy, J., Özcan Vieira, E., & Denham, S. (2015). Alarm fatigue in the perception of medical soundscapes. In: Proceedings of EuroNoise 2015, 10th European Congress and Exposition on Noise Control Engineering, Maastricht (The Netherlands) 31 May-3 June 2015.
   Google Scholar
• Lattal, K. M. , Mullen, M. T. , & Abel, T. (2003). Extinction, renewal, and spontaneous recovery of a spatial preference in the water maze. Behavioral Neuroscience , 117(5), 1017.
   Web of Science ®Google Scholar
• Luo, C. , Guo, Z. W. , Lai, Y. X. , Liao, W. , Liu, Q. , Kendrick, K. M. , … Li, H. (2012). Musical training induces functional plasticity in perceptual and motor networks: Insights from resting-state FMRI. PloS One , 7(5), e36568.
   PubMed Web of Science ®Google Scholar
• MacIntyre, N. R. , & Day, S. (1992). Essentials for ventilator-alarm systems. Respiratory Care , 37(9), 1108–1112.
   Google Scholar
• MacLean, K. E. (2009). Putting haptics into the ambience. IEEE Transactions on Haptics , 2(3), 123–135.
   Web of Science ®Google Scholar
• Martin, A. , & Voix, J. (2017). In-ear audio wearable: Measurement of heart and breathing rates for health and safety monitoring. IEEE Transactions on Biomedical Engineering , 65(6), 1256–1263.
   Web of Science ®Google Scholar
• Martuzzi, R. , Murray, M. M. , Michel, C. M. , Thiran, J. P. , Maeder, P. P. , Clarke, S. , & Meuli, R. A. (2007). Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cerebral Cortex , 17(7), 1672–1679.
   Web of Science ®Google Scholar
• McGaugh, J. L. (2000). Memory–A century of consolidation. Science , 287(5451), 248–251.
   PubMed Web of Science ®Google Scholar
• McNeer, R. R. , Horn, D. B. , Bennett, C. L. , Edworthy, J. R. , & Dudaryk, R. (2018). Auditory icon alarms are more accurately and quickly identified than current standard melodic alarms in a simulated clinical setting. Anesthesiology: The Journal of the American Society of Anesthesiologists , 129(1), 58–66.
   Web of Science ®Google Scholar
• Melara, R. D. , & Marks, L. E. (1990). Interaction among auditory dimensions: Timbre, pitch, and loudness. Perception & Psychophysics , 48(2), 169–178.
   PubMedGoogle Scholar
• Merchel, S. , & Altinsoy, M. E. (2014). The influence of vibrations on musical experience. Journal of the Audio Engineering Society , 62(4), 220–234.
   Web of Science ®Google Scholar
• Meredith, M. A. (2002). On the neuronal basis for multisensory convergence: A brief overview. Cognitive Brain Research , 14(1), 31–40.
   Google Scholar
• Misdariis, N., Minard, A., Susini, P. et al. Environmental Sound Perception: Metadescription and Modeling Based on Independent Primary Studies. J AUDIO SPEECH MUSIC PROC. 2010, 362013 (2010). https://doi.org/10.1155/2010/362013.
   Google Scholar
• Occelli, V. , Spence, C. , & Zampini, M. (2011). Audiotactile interactions in temporal perception. Psychonomic Bulletin & Review , 18(3), 429–454.
   Web of Science ®Google Scholar
• Pantev, C. , Lappe, C. , Herholz, S. C. , & Trainor, L. (2009). Auditory‐somatosensory integration and cortical plasticity in musical training. Annals of the New York Academy of Sciences , 1169(1), 143–150.
   Google Scholar
• Patten, K. J. (2017). Natural correlations of spectral envelope and their contribution to auditory scene analysis . Arizona State University.
   Google Scholar
• Patten, K. J. , McBeath, M. K. , & Baxter, L. C. (2019). Harmonicity: Behavioral and neural evidence for functionality in auditory scene analysis. Auditory, Perception, & Cognition , 1(3–4), 150–172.
   Google Scholar
• Patterson, R. , Winterbottom, M. D. , & Pierce, B. J. (2006). Perceptual issues in the use of head-mounted visual displays. Human Factors , 48(3), 555–573.
   PubMed Web of Science ®Google Scholar
• Qutub, H. O. , & El-Said, K. F. (2009). Assessment of ambient noise levels in the intensive care unit of a university hospital. Journal of Family & Community Medicine , 16(2), 53.
   Google Scholar
• Salzer, Y. , Aisenberg, D. , Oron-Gilad, T. , & Henik, A. (2014). In touch with the Simon effect. Experimental Psychology , 61(3), 165–179.
   PubMed Web of Science ®Google Scholar
• Schlesinger, J. J. , Baum Miller, S. H. , Nash, K. , Bruce, M. , Ashmead, D. , Shotwell, M. S. , … Weinger, M. B. (2018). Acoustic features of auditory medical alarms—An experimental study of alarm volume. The Journal of the Acoustical Society of America , 143(6), 3688–3697.
   Web of Science ®Google Scholar
• Schlesinger, J. J. , Stevenson, R. A. , Shotwell, M. S. , & Wallace, M. T. (2014). Improving pulse oximetry pitch perception with multisensory perceptual training. Anesthesia and Analgesia , 118(6), 1249–1253.
   Web of Science ®Google Scholar
• Schroeder, C. E. , Lindsley, R. W. , Specht, C. , Marcovici, A. , Smiley, J. F. , & Javitt, D. C. (2001). Somatosensory input to auditory association cortex in the macaque monkey. Journal of Neurophysiology , 85(3), 1322–1327.
   PubMed Web of Science ®Google Scholar
• Seitz, A. R. , & Dinse, H. R. (2007). A common framework for perceptual learning. Current Opinion in Neurobiology , 17(2), 148–153.
   PubMed Web of Science ®Google Scholar
• Sendelbach, S. , & Funk, M. (2013). Alarm fatigue: A patient safety concern. AACN Advanced Critical Care , 24(4), 378–386.
   PubMedGoogle Scholar
• Shams, L. , & Seitz, A. R. (2008). Benefits of multisensory learning. Trends in Cognitive Sciences , 12(11), 411–417.
   PubMed Web of Science ®Google Scholar
• Stanford, T. R. , Quessy, S. , & Stein, B. E. (2005). Evaluating the operations underlying multisensory integration in the cat superior colliculus. Journal of Neuroscience , 25(28),6499 –6508. doi:10.1523/JNEUROSCI.5095-04.2005
   Web of Science ®Google Scholar
• Stein, B. E.,Meredith, M. A. (1993). The merging of senses Cambridge, MA: MIT Press.
   Google Scholar
• Stein B. E. , Magalhaes-Castro B. , Kruger L. Relationship between visual and tactile representations in cat superior colliculus. Journal of Neurophysiology . 1976;39(2):401‐419. doi: 10.1152/jn.1976.39.2.401
   Web of Science ®Google Scholar
• Wallace, M. T. , Wilkinson, L. K. , & Stein, B. E. (1996). Representation and integration of multiple sensory inputs in primate superior colliculus. Journal of Neurophysiology , 76(2), 1246–1266.
   PubMed Web of Science ®Google Scholar
• Wilken, M., Hüske-Kraus, D., Klausen, A., Koch, C., Schlauch, W., & Röhrig, R. (2017). Alarm Fatigue: Causes and Effects. Studies in health technology and informatics, 243, 107–111.
   Google Scholar
• Wilson, E. C. , Braida, L. D. , & Reed, C. M. (2010). Perceptual interactions in the loudness of combined auditory and vibrotactile stimuli. The Journal of the Acoustical Society of America , 127(5), 3038–3043.
   Web of Science ®Google Scholar