Making Graph-Based Diagrams Work in Sound: The Role of Annotation

REFERENCES

• Allen , G. L. 1999 . Cognitive abilities in the service of wayfinding: A functional approach . The Professional Geographer , 51 : 555 – 561 .
   Web of Science ®Google Scholar
• Alliance for Technology Access . 2000 . Computer and web resources for people with disabilities: A guide to exploring today's assistive technologies, , 3rd ed. Alameda , CA : Hunter House. .
   Google Scholar
• American Foundation for the Blind . 2008 . Statistics and sources for professionals Retrieved from http://www.afb.org/Section.asp?SectionID=15&DocumentID=1367
   Google Scholar
• Asakawa , C. and Takagi , H. 2000 . “ Annotation-based transcoding for nonvisual web access ” . In Assets 1900: Proceedings of the Fourth International ACM Conference on Assistive Technologies New York , NY : ACM. .
   Google Scholar
• Bennett , D. J. 2002 . Effects of navigation and position on task when presenting diagrams to blind people using sound . Lecture Notes in Artificial Intelligence , 2317 : 161 – 175 .
   Google Scholar
• Bennett , D. J. 2002 . Presenting Diagrams in Sound for Blind People York , , UK : University of York. . (Unpublished doctoral thesis)
   Google Scholar
• Berners-Lee , T. 1999 . Weaving the web San Francisco , CA : Harpur. .
   Google Scholar
• Bernstein , M. 1988 . The bookmark and the compass: Orientation tools for hypertext users . ACM SIGOIS Bulletin , 9 : 34 – 45 .
   Google Scholar
• Blenkhorn , P. and Evans , D. G. 1998 . Using speech and touch to enable blind people to access schematic diagrams . Journal of Network and Computer Applications , 21 : 17 – 29 .
   Web of Science ®Google Scholar
• Boechler , P. M. 2001 . How spatial is hyperspace? Interacting with hypertext documents: Cognitive processes and concepts . Cyberpsycology & Behaviour , 4 : 23 – 46 .
   PubMedGoogle Scholar
• Braille Institute of America . 2010 . Facts about sight loss and definitions of blindness Retrieved from http://www.brailleinstitute.org/facts_about_sight_loss
   Google Scholar
• Brewster , S. A. , Capriotti , A. and Hall , C. V. 1998 . Using compound earcons to represent hierarchies . HCI Letters , 1 : 6 – 8 .
   Google Scholar
• Brewster , S. A. , Raty , V-P. and Kortekangas , A. Earcons as a method of providing navigational cues in a menu hierarchy . Proceedings of HCI1996 (Imperial College, London, UK) . Heidelberg , , Germany : Springer. .
   Google Scholar
• Brown , A. , Pettifer , S. and Stevens , R. D. Evaluation of a nonvisual molecule browser . Proceedings of the Sixth International ACM SIGACCESS Conference on Computers and Accessibility . New York , NY : ACM. .
   Google Scholar
• Brown , A. , Stevens , R. D. and Pettifer , S. Audio representation of graphs: A quick look . Proceedings of the International Conference on Auditory Displays 2006 . Retrieved from http://www.icad.org
   Google Scholar
• Brown , L. M. , Brewster , S. A. , Ramloll , R. , Burton , M. and Riedel , B. 2003 . “ Design guidelines for audio presentation of graphs and tables. ” . In ICAD 2003 Workshop on Auditory Displays in Assistive Technologies Retrieved from http://www.icad.org
   Google Scholar
• Chen , C. 2006 . CLC-4-TTS and Fire Vox: Enabling the Visually Impaired to Surf the Internet . The University of Texas at Austin Undergraduate Research Journal , 5 : 32 – 42 .
   Google Scholar
• Department of Health . 2003 . Registered blind and partially sighted people year ending 31 march 2003 Retrieved from http://www.dh.gov.uk.en/Publicationsandstatistics/Statistics/StatisticalWorkAreas/Statisticalsocialcare/DH_4082697
   Google Scholar
• Goodwin , G. P. and Johnson-Laird , P. N. 2005 . Reasoning about relations . Phsycological Review , 112 : 468 – 493 .
   PubMed Web of Science ®Google Scholar
• Graves , M. F. , Cooke , C. L. and Laberge , M. J. 1983 . Effects of previewing difficult short stories on low ability junior high school students' comprehension, recall, and attitudes . Reading Research Quarterly , 18 : 262 – 276 .
   Web of Science ®Google Scholar
• Harper , S. and Patel , N. Gist summaries for visually impaired surfers . Assets 1905: Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility . New York , NY : ACM. .
   Google Scholar
• Hirtle , S. C. and Hudson , J. 1991 . Acquisition of spatial knowledge for routes . Journal of Environmental Psychology , 11 : 335 – 345 .
   Web of Science ®Google Scholar
• Holmqvist , K. , Holsanova , J. , Barthelson , M. and Lundqvist , D. 2003 . “ Reading or scanning? a study of newspaper and net paper reading. ” . In The mind's eye: cognitive and applied aspects of eye movement research Edited by: Holmqvist , K. 657 – 670 . Amsterdam , , The Netherlands : Elsevier Science. .
   Google Scholar
• Horstmann , M. , Lorenz , M. , Watkowski , A. , Ioannidis , G. , Herzog , O. , King , A. and Crombie , D. 2004 . Automated interpretation and accessible presentation of technical diagrams for blind people . New Review of Hypermedia and Multimedia , 10 : 141 – 163 .
   Google Scholar
• Ingram , R. and Benford , S. 1996 . The application of legibility techniques to enhance information visualisations . The Computer Journal , 39 : 819 – 839 .
   Web of Science ®Google Scholar
• International Council of Ophthalmology . 2002 . Visual standards—Aspects and ranges of vision loss Retrieved from http://www.icoph.org/pdf/visualstandardsreport.pdf
   Google Scholar
• Johnson-Laird , P. N. 2004 . “ The history of mental models ” . In Psychology of reasoning: Theoretical and historical perspectives Edited by: Manktelow , K. and Chung , M. C. 179 – 212 . New York , NY : Psychology Press. .
   Google Scholar
• Kennel , A. R. Audiograf: A diagram-reader for the blind . Proceedings of the Second Annual ACM Conference on Assistive Technologies . New York : ACM. .
   Google Scholar
• Kildal , J. and Brewster , S. A. Explore the matrix: Browsing numerical data tables using sound . Proceedings of the International Conference on Auditory Displays 2005 .
   Google Scholar
• Kildal , J. and Brewster , S. A. 2006a . “ Non-visual overviews of complex data sets ” . In CHI 1906: CHI 1906 Extended Abstracts on Human Factors in Computing Systems New York , NY : ACM. .
   Google Scholar
• Kildal , J. and Brewster , S. A. Providing a size-independent overview of non-visual tables . Proceedings of the International Conference on Auditory Displays 2006 .
   Google Scholar
• Kirkpatrick , A. , Rutter , R. , Heilmann , C. , Thatcher , J. and Waddell , C. 2006 . Web accessibility: Web standards and regulatory compliance New York , NY : Springer Verlag. .
   Google Scholar
• Larkin , J. H. and Simon , H. A. 1987 . Why a diagram is (sometimes) worth 10000 words . Cognitive Science , 11 : 65 – 99 .
   Web of Science ®Google Scholar
• Lynch , K. 1960 . The image of the city Cambridge , MA : MIT Press. .
   Google Scholar
• Marshall , C. C. Annotation: From paper books to the digital library . DL 1997: Proceedings of the Second ACM International Conference on Digital Libraries . New York , NY : ACM. .
   Google Scholar
• Marshall , C. C. Toward an ecology of hypertext annotation . Proceedings of the Ninth ACM Conference on Hypertext and Hypermedia: Links, Objects, Time and Space—Structure in Hypermedia Systems . New York , NY : ACM. .
   Google Scholar
• McGookin , D. K. , Kildal , J. and Brewster , S. A. New views on haptic graph visualisation . Proceedings of the CHI-2005 workshop “Hands on Haptics: Exploring Non-Visual Visualisation Using the Sense of Touch” . New York , NY : ACM. .
   Google Scholar
• Metatla , O. , Bryan-Kinns , N. and Stockman , A. Using hierarchies to support non-visual access to relational diagrams . Proceedings of BCS HCI1907 . Swinton , , UK : British Computer Society. .
   Google Scholar
• Metatla , O. , Bryan-Kinns , N. and Stockman , A. Constructing relational diagrams in audio: The multiple perspective hierarchical approach . Assets 1908: Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility . New York , NY : ACM. .
   Google Scholar
• Michon , P-E. and Denis , M. 2001 . When and why are visual landmarks used in giving directions? . Lecture Notes in Computer Science , 2205 : 292 – 305 .
   Google Scholar
• Miller , G. A. 1956 . The magical number seven plus or minus two . Psychological Review , 63 : 81 – 97 .
   PubMed Web of Science ®Google Scholar
• Neuman , S. B. , Burden , D. and Holden , E. 1990 . Enhancing children's comprehension of a televised story through previewing . Journal of Educational Research , 83 : 258 – 265 .
   Web of Science ®Google Scholar
• Palmer , S. E. 1977 . Hierarchical structure in perceptual representation . Cognitive Psychology , 9 : 441
   Web of Science ®Google Scholar
• Passini , R. 1984 . Wayfinding in architecture New York , NY : Van Nostrand Reinhold. .
   Google Scholar
• Petrie , H. , Morley , S. , McNally , P. , O'Neill , A. and Majoe , D. Initial design and evaluation of an interface to hypermedia systems for blind users . HYPERTEXT 1997: Proceedings of the Eighth ACM Conference on Hypertext . New York , NY : ACM. .
   Google Scholar
• Petrie , H. , Schlieder , C. , Blenkhorn , P. , Evans , G. , King , A. , O'Neill , A. and Alafaci , M. 2002 . Tedub: A system for presenting and exploring technical drawings for blind people . Lecture Notes in Computer Science , 2398 : 537 – 539 .
   Google Scholar
• Ramen , T. V. 2008 . “ Specialized browsers ” . In Web accessibility: A foundation for research Edited by: Harper , S. and Yesilada , Y. 195 – 213 . Heidleberg , , Germany : Springer-Verlag. .
   Google Scholar
• Raubal , M. and Winter , W. 2002 . Enriching wayfinding instructions with local landmarks . Lecture Notes in Computer Science , 2478 : 243 – 259 .
   Google Scholar
• RNIB . 2006 . Statistics—numbers of people with sight problems in the UK Retrieved from http://www.rnib.org.uk/xpedio/groups/public/documents/PublicWebsite/public_researchstats.hcsp
   Google Scholar
• Rotard , M. , Knoedler , S. and Ertl , T. A tactile web browser for the visually disabled . Proceedings of the Sixteenth ACM Conference on Hypertext and Hypermedia . New York : ACM. .
   Google Scholar
• Roth , P. , Richoz , D. , Petrucci , L. and Pun , T. An audio-haptic tool for non-visual image representation . Proceedings of the Sixth International Symposium on Signal Processing and Its Applications . Los Alamitos , CA : IEEE. .
   Google Scholar
• Scaife , M. and Rogers , Y. 1996 . External cognition: How do graphical representations work? . International Journal of Human-Computer Studies , 45 : 185 – 213 .
   Web of Science ®Google Scholar
• Schroeder , F. K. 1994 . Braille Usage: Perspectives of Legally Blind Adults and Policy Implications for School Administrators Albuquerque : University of New Mexico. . (Unpublished doctoral thesis)
   Google Scholar
• Shneiderman , B. The eyes have it: A task by data type taxonomy for information visualization . Proceedings of the IEEE Symposium on Visual Languages . Los Alamitos , CA : IEEE. .
   Google Scholar
• Siegel , A. W. and White , S. H. 1975 . “ The development of spatial representation of large-scale environments ” . In Advances in child development and behavior Edited by: Reese , H. W. Vol. 10 , 9 – 55 . New York , NY : Academic. .
   Google Scholar
• Smith , A. C. , Francioni , J. M. , Anwar , M. , Cook , J. S. , Hossain , A. and Fayezur , M. R. Nonvisual tool for navigating hierarchical structures . Proceedings of the Sixth International ACM SIGACCESS Conference on Computers and Accessibility . New York , NY : ACM. .
   Google Scholar
• Sorrows , M. E. and Hirtle , S. C. 1999 . The nature of landmarks for real and electronic spaces . Lecture Notes in Computer Science , 1661 : 37 – 50 .
   Google Scholar
• Stanovich , K. E. 1980 . Toward an interactive-compensatory model of individual differences in the development of individual reading fluency . Reading Research Quarterly , 16 : 32 – 71 .
   Web of Science ®Google Scholar
• Steck , S. D. and Mallot , H. A. 2000 . The role of global and local landmarks in virtual environment navigation . Presence: Teleoperators & Virtual Environments , 9 : 69 – 83 .
   Web of Science ®Google Scholar
• Stein , L. 2001 . Genome annotation: From sequence to biology . Nature Reviews Genetics , 2 : 493 – 503 .
   PubMed Web of Science ®Google Scholar
• Stevens , R. D. , Edwards , A. D. N. and Harling , P. A. 1997 . Access to mathematics for visually disabled students through multi-modal interaction . Human-Computer Interaction , 12 : 47 – 92 .
   Web of Science ®Google Scholar
• Takagi , H. , Asakawa , C. , Fukuda , K. and Maeda , J. Site-wide annotation: reconstructing existing pages to be accessible . Assets 1902: Proceedings of the Fifth International ACM Conference on Assistive Technologies . New York , NY : ACM. .
   Google Scholar
• Taylor , H. A. and Tversky , B. 1992 . Spatial mental models derived from survey and route descriptions . Journal of Memory and Language , 31 : 261 – 292 .
   Web of Science ®Google Scholar
• Trumble , W. R. and Stevenson , A. , eds. 2002 . Shorter Oxford English dictionary, , 5th ed. Oxford , , UK : Oxford University Press. .
   Google Scholar
• Wall , S. and Brewster , S. 2005 . Providing external memory aids in haptic visualisations for blind users . International Journal of Disability and Human Development , 4 : 331 – 338 .
   Google Scholar
• Wall , S. and Brewster , S. Feeling what you hear: Tactile feedback for navigation of audio graphs . Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . New York , NY : ACM. .
   Google Scholar
• Wolfe , J. L. Effects of annotations on student readers and writers . DL 1900: Proceedings of the Fifth ACM Conference on Digital Libraries . New York , NY : ACM. .
   Google Scholar
• Yesilada , Y. 2005 . Annotation and transformation of web pages to improve mobility for visually impaired users UK : The University of Manchester. . (Unpublished doctoral thesis).
   Google Scholar
• Yesilada , Y. , Harper , S. , Goble , C. and Stevens , R. Screen readers cannot see (ontology based semantic annotation for visually impaired web travellers) . Web Engineering—4th International Conference, ICWE 2004 Proceedings (LNCS 3140) . Edited by: Koch , N. , Fraternali , P. and Wirsing , M. Heidleberg , , Germany : Springer. .
   Google Scholar
• Yesilada , Y. , Stevens , R. and Goble , C. A foundation for tool based mobility support for visually impaired web users . Proceedings of the Twelfth International Conference on World Wide Web . New York , NY : ACM. .
   Google Scholar
• Yesilada , Y. , Stevens , R. , Goble , C. and Hussein , S. Rendering tables in audio: The interaction of structure and reading styles . Proceedings of the Sixth International ACM SIGACCESS Conference on Computers and Accessibility . New York , NY : ACM. .
   Google Scholar
• Yu , W. and Brewster , S. A. 2003 . Evaluation of multimodal graphs for blind people . Journal of Universal Access in the Information Society , 2 : 105 – 124 .
   Google Scholar
• Yu , W. , Kuber , R. , Murphy , E. , Strain , P. and McAllister , G. 2006 . A novel multimodal interface for improving visually impaired people's web accessibility . Virtual Reality , 9 : 133 – 148 .
   Google Scholar
• Zahn , C. T. 1971 . Graph-theoretical methods for detecting and describing gestalt clusters . IEEE Transactions on Computers , 100 : 68 – 86 .
   Google Scholar
• Zhao , H. , Plaisant , C. and Shneiderman , B. Isonic: Interactive sonification for non-visual data exploration . Assets 1905: Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility . New York , NY : ACM. .
   Google Scholar
• Zhao , H. , Plaisant , C. , Shneiderman , B. and Duraiswami , R. Sonification of geo-referenced data for auditory information seeking: Design principle and pilot study . Proceedings of ICAD 04—Tenth Meeting of the International Conference on Auditory Display . Retrieved from http://www.icad.org
   Google Scholar
• Zhao , H. , Plaisant , C. , Shneiderman , B. and Lazar , J. 2008 . Data sonification for users with visual impairment: A case study with georeferenced data . ACM Transactions on Computer-Human Interaction , 15 : 1 – 28 .
   Web of Science ®Google Scholar