Enhancing Mobile Phones for People With Visual Impairments Through Haptic Icons: The Effect of Learning Processes

References

• Ballesteros , S. , Bardisa , D. , Millar , S. and Reales , J. M. 2005 . The haptic test battery: A new instrument to test tactual abilities in blind and visually impaired and sighted children . The British Journal of Visual Impairment , 23 ( 1 ) : 11 – 24 .
   Google Scholar
• Brewster , S. A. and Brown , L. M. 2004 . “ Non-visual information display using Tactons ” . In CHI 2004: Extended abstracts on Human factors in computing systems , Edited by: Dykstra-Erickson , E. and Tscheligi , M. 787 – 788 . New York : ACM .
   Google Scholar
• Brown , L. M and Brewster , S.A. 2006 . “ Tactile crescendos and sforzandos: Applying musical techniques to tactile icon design ” . In CHI 2004: Extended abstracts on Human factors in computing systems , Edited by: Olson , G. M. and Jeffries , R. 610 – 615 . New York : ACM .
   Google Scholar
• Brown , L. M. , Brewster , S. A. and Purchase , H. C. 2005 . “ A first investigation into the effectiveness of Tactons ” . In Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems , Edited by: Bicchi , A. and Bergamasco , M. 167 – 176 . Washington , DC : IEEE .
   Google Scholar
• Brown , L. M. and Kaaresoja , T. 2006 . “ Feel who's talking: Using tactons for mobile phone alerts ” . In Proceedings of the Conference on Human Factors in Computing Systems , Edited by: Grinter , R. 604 – 609 . New York : ACM . T. Rodden, P. Aoki, E. Cutrell, R. Jeffries & G. Olsen (Eds.)
   Google Scholar
• Caldwell , B. , Cooper , M. , Reid , L. G. and Vanderheiden , G. 2008 . Web content accessibility guidelines (WCAG) 2.0. W3C Recommendation. World Wide Web Consortium (W3C).
   Google Scholar
• Chan , A. , MacLean , K. and McGrenere , J. 2005 . “ Learning and identifying haptic icons under workload ” . In Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems , Edited by: Bicchi , A. and Bergamasco , M. 432 – 439 . Washington , DC : IEEE .
   Google Scholar
• Chan , A. , MacLean , K. E. and McGrenere , J. 2008 . Designing haptic icons to support collaborative turn-taking . International Journal of Human Computer Studies , 66 ( 5 ) : 333 – 355 .
   Web of Science ®Google Scholar
• Cohen , L. G. , Celnik , P. , Pascual-Leone , A. , Corwell , B. , Falz , L. , Dambrosia , J. , … and Hallett , M. 1997 . Functional relevance of cross-modal plasticity in blind humans . Nature , 389 : 180 – 183 .
   PubMed Web of Science ®Google Scholar
• Enriquez , M. and MacLean , K. E. 2008 . “ The role of choice in longitudinal recall of meaningful tactile signals ” . In J. Weisenberger, A. Okamura & K. MacLean (Eds.), Proceedings of the IEEE Symposium on Haptic Interfaces for Virtual Environments and Teleoperator Systems , 49 – 56 . Washington , DC : IEEE .
   Google Scholar
• Gallace , A. and Spence , C. 2009 . The cognitive and neural correlates of tactile memory . Psychological Bulletin , 135 ( 3 ) : 380 – 406 .
   PubMed Web of Science ®Google Scholar
• Gallace , A. , Tan , H. Z. and Spence , C. 2007 . The body surface as a communication system: The state of the art after 50 years . Presence , 16 ( 6 ) : 655 – 676 .
   Google Scholar
• Ghiani , G. , Leporini , B. and Paternò , F. 2009 . Vibrotactile feedback to aid blind users of mobile guides . Journal of Visual Languages and Computing , 20 ( 5 ) : 305 – 317 .
   Web of Science ®Google Scholar
• Heller , M. A. 2000 . Touch, representation and blindness , Oxford, UK : Oxford University Press .
   Google Scholar
• Hoggan , E. and Brewster , S. A. 2007 . “ Designing audio and tactile crossmodal icons for mobile devices ” . In D. W. Massaro, K. Takeda, D. Roy, & A. Potamianos (Eds.), Proceedings of ACM International Conference on Multimodal Interfaces , 162 – 169 . New York : ACM .
   Google Scholar
• Hoggan , E. and Brewster , S. A. 2010 . “ CrossTrainer: Testing the use of multimodal interfaces in situ ” . In E. D. Mynatt, D. Schoner, G. Fitzpatrick, S. E. Hudson, K. Edwards & T. Rodden (Eds.), Proceedings of the 28th International Conference on Human Factors in Computing Systems, CHI 2010 , 333 – 342 . Atlanta , GA : ACM .
   Google Scholar
• Hoggan , E. , Crossan , A. , Brewster , S. and Kaaresoja , T. 2009 . “ Audio or tactile feedback: Which modality when? ” . In D. R. Olsen Jr., R. B. Arthur, K. Hinckley, M. Ringel Morris, S. E. Hudson & S. Greenberg (Eds.), Proceedings of the 27th International Conference on Human Factors in Computing Systems , 2253 – 2256 . New York : ACM .
   Google Scholar
• IMMERSION (2010). Haptics White Paper: Improving the Mobile User Experience through Touch. Retrieved March 10, 2011, from http://immersion.org/docs/Haptics_Improving-Mobile-UE_jun10v2.pdf (http://immersion.org/docs/Haptics_Improving-Mobile-UE_jun10v2.pdf)
   Google Scholar
• Jones , L.A. , Kunkel , J. and Piateski , E. 2009 . Vibrotactile pattern recognition on the arm and back . Perception , 38 : 52 – 68 .
   PubMed Web of Science ®Google Scholar
• Krishna , S. , Bala , S. , McDaniel , T. , McGuire , S. and Panchanathan , S. 2010 . “ VibroGlove: An assistive technology aid for conveying facial expressions ” . In E. D. Mynatt, D. Schoner, G. Fitzpatrick, S. E. Hudson, W. K. Edwards & T. Rodden (Eds.), Proceedings of the 28th of the International Conference on Human Factors in Computing Systems, CHI 2010, Extended Abstracts , 3637 – 3642 . New York : ACM .
   Google Scholar
• Lai , H. and Chen , Y. 2006 . A study on the blind's sensory ability . International Journal of Industrial Ergonomics , 36 : 565 – 570 .
   Web of Science ®Google Scholar
• MacLean , K. E. 2008 . Foundations of transparency in tactile information design . IEEE Transactions on Haptics , 1 ( 2 ) : 84 – 95 .
   Google Scholar
• MacLean , K. E. and Enriquez , M. 2003 . “ Perceptual design of haptic icons ” . In I. Oakley, S. O'Modhrain & F. Newell (Eds.), Proceedings of EuroHaptics , 351 – 363 . Washington , DC : IEEE .
   Google Scholar
• MacLean , K. and Hayward , V. 2008 . Do-it-yourself haptics, part II: Interaction design . IEEE Robotics and Automation , 15 ( 1 ) : 104 – 119 .
   Web of Science ®Google Scholar
• Moreno , R. and Mayer , R. 1999 . Cognitive principles of multimedia learning: The role of modality and contiguity . Journal of Educational Psychology , 91 : 358 – 368 .
   Web of Science ®Google Scholar
• Paivio , A. 1986 . Mental representations: A dual coding approach , New York : Oxford University Press .
   Google Scholar
• Rantala , J. , Raisamo , R. , Lylykangas , J. , Surakka , V. , Raisamo , J. , Salminen , K. , Pakkanen , T. and Hippula , A. 2009 . Methods for presenting Braille characters on a mobile device with a touchscreen and tactile feedback . IEEE Transactions on Haptics , 2 ( 1 ) : 28 – 39 .
   Google Scholar
• Rovers , A. F. and Van Essen , H. A. 2004 . Design and evaluation of hapticons for enriched instant messaging . Virtual Reality , 9 : 177 – 191 .
   Google Scholar
• Réhman , S. and Liu , L. 2010 . “ iFeeling: Vibrotactile rendering of human emotions on mobile phones ” . In Mobile Multimedia Processing, Lecture Notes in Computer Science , Edited by: Jiang , X. , Ma , M. and Chen , C. Vol. 5960 , 1 – 20 . Berlin , , Germany : Springer Verlag .
   Google Scholar
• Ryu , J. , Chun , J. , Park , G. , Choi , S. and Han , S. H. 2010 . Vibrotactile feedback for information delivery in the vehicle . IEEE Transactions on Haptics , 3 ( 2 ) : 138 – 149 .
   PubMed Web of Science ®Google Scholar
• Stephan , K. L. , Smith , S. E. , Martin , R. L. , Parker , S. P. A. and McAnally , K. I. 2006 . Learning and retention of associations between auditory icons and denotative referents: Implications for the design of auditory warnings . Human Factors , 48 ( 2 ) : 288 – 299 .
   PubMed Web of Science ®Google Scholar
• Swerdfeger , B. 2009 . A first and second longitudinal study of haptic icon learnability: The impact of rhythm and melody. (Unpublished MsC thesis.) , University of British Columbia, Vancouver, Canada .
   Google Scholar
• Swerdfeger , B. , Fernquist , J. , Hazelton , T. and MacLean , K. E. 2009 . “ Exploring melodic variance in rhythmic haptic stimulus design ” . In Proceedings of Graphics Interface (GI ′09) , Edited by: Gooch , A. and Tory , M. 133 – 140 . Toronto : ACM .
   Google Scholar
• Ternes , D. and MacLean , K. E. 2008 . “ Designing large sets of haptic icons with rhythm ” . In Proceedings of the 6th International Conference on Haptics: Perception, Devices and Scenarios, Lecture Notes in Computer Science , Edited by: Ferre , M. Vol. 5024 , 199 – 208 . Berlin , , Germany : Springer Verlag .
   Google Scholar
• Tullis , T. and Albert , W. 2008 . Measuring the user experience: Collecting, analyzing, and presenting usability metrics , San Francisco , CA : Morgan Kaufman .
   Google Scholar
• Van Erp , J. B. F. , Kyung , K. , Kassner , S. , Carter , J. , Brewster , S. A. , Weber , G. and Andrew , I. 2010 . “ Setting the standards for haptic and tactile interactions: ISO's work ” . In Haptics: Generating and Perceiving Tangible Sensations, International Conference, EuroHaptics 2010, Lecture Notes in Computer Science 6192 , Edited by: Kappers , A. M. L. 353 – 358 . Berlin , , Germany : Springer Verlag . J. B. F. van Erp, W. M. Bergmann Tiest & F. C. T. van der Helm (Eds.)
   Google Scholar
• Waraich , P. and D'Angiulli , A. 2002 . Enhanced tactile encoding and memory recognition in congenital blindness . International Journal of Rehabilitation Research , 25 : 143 – 145 .
   PubMed Web of Science ®Google Scholar