Does textual feedback hinder spoken interaction in natural language?

References

• Allwood , J. , Traum , D. and Jokinen , K. 2000 . Cooperation, dialogue and ethics . International Journal of Human-Computer Studies , 53 : 871 – 914 .
   Web of Science ®Google Scholar
• Amalberti , R. , Carbonell , N. and Falzon , P. 1993 . User representations of computer systems in human-computer speech interaction . International Journal of Man-Machine Studies , 38 : 547 – 566 .
   Google Scholar
• Baber , C. 1993 . “ Developing interactive speech technology ” . In Interactive speech technology , Edited by: Baber , C. and Noyes , J. M. 1 – 18 . London : Taylor and Francis .
   Google Scholar
• Baber , C. , Johnson , G. I. and Cleaver , D. 1997 . Factors affecting users' choice of words in speech-based interaction with public technology . International Journal of Speech Technology , 2 : 45 – 59 .
   Google Scholar
• Baber , C. 1992 . Feedback requirements for automatic speech recognition in the process control room . International Journal of Man-Machine Studies , 37 : 703 – 719 .
   Google Scholar
• Baber , C. 1996 . Workload and the use of automatic speech recognition: The effects of time and resource demands . Speech Communication , 20 : 37 – 53 .
   Web of Science ®Google Scholar
• Baker , K. 2004 . Constraining user response via multimodal dialogue interface . International Journal of Speech Technology , 7 : 251 – 258 .
   Google Scholar
• Beccue , B. , Vila , J. and Whitley , L. 2001 . The effects of adding audio instructions to a multimedia computer based training . Journal of Educational Multimedia and Hypermedia , 10 : 47 – 67 .
   Google Scholar
• Bernsen , N. O. and Dybkjær , L. 2000 . From single word to natural dialogue . Advances in Computers , 52 : 269 – 329 .
   Google Scholar
• Branigan , H. P. . Syntactic alignment between computers and people: The role of belief about mental states . Proceedings of the 25th annual conference of the Cognitive Science Society . Boston, Massachusetts, USA. Edited by: Alterman , R. and Kirsh , D. pp. 186 – 191 . Mahwah, NJ : Lawrence Erlbaum Associates .
   Google Scholar
• Bubb-Lewis , C. and Scerbo , M. W. 2002 . The effects of communication modes on performance and discourse organization with an adaptive interface . Applied Ergonomics , 33 : 15 – 26 .
   PubMedGoogle Scholar
• Carbonell , N. 2003 . Towards the design of usable multimodal interaction languages . Universal Access in the Information Society , 2 : 143 – 159 .
   Google Scholar
• Chafe , W. L. 1982 . “ Integration and involvement in speaking, writing, and oral literature ” . In Spoken and written language , Edited by: Tannen , D. 35 – 53 . Norwood, New Jersey : ABLEX Publishing Corporation .
   Google Scholar
• Cohen , M. , Giangola , J. P. and Balogh , J. 2004 . Voice user interface design , Boston : Addison-Wesley .
   Google Scholar
• Deng , L. and Huang , X. 2004 . Challenges in adopting speech recognition . Communication of the ACM , 47 ( 1 ) : 69 – 75 .
   Google Scholar
• Estève , Y. . Conceptual decoding for spoken dialog systems . Proceeding of European conference on speech communication and technology, EUROSPEECH03 . pp. 3033 – 3036 . Geneva, , Switzerland : ISCA .
   Google Scholar
• Fang , X. 2006 . A study of the feasibility and effectiveness of dual-modal information presentations . International Journal Human-Computer Interaction , 20 : 3 – 17 .
   Web of Science ®Google Scholar
• Hart , S. G. and Staveland , L. E. 1988 . “ Development of a multi-dimensional workload rating scale: Results of empirical and theoretical research ” . In Human mental workload , Edited by: Hancock , P. A. and Meshkati , N. 139 – 183 . Amsterdam, , The Netherlands : Elsevier .
   Google Scholar
• Hegarty , M. 1999 . Multimedia instruction: Lessons from evaluation of a theory-based design . Journal of Educational Multimedia and Hypermedia , 8 : 119 – 150 .
   Google Scholar
• Helleberg , J. and Wickens , C. D. . Effects of data link modality on pilot attention and communications effectiveness . Proceedings of the 11th international symposium on aviation psychology . Edited by: Jensen , R. Columbus, Ohio : Ohio State University .
   Google Scholar
• Hone , K. S. and Baber , C. 2001 . Designing habitable dialogues for speech-based interaction with computers . International Journal of Human-Computer Studies , 54 : 637 – 662 .
   Google Scholar
• Howell , D. C. 1997 . Statistical methods for psychology , Fourth edition , New York : Thomson Brooks/Cole .
   Google Scholar
• Jacko , J. A. 2005 . Empirical validation of the Windows accessibility settings and multimodal feedback for a menu selection task for users with diabetic retinopathy . Behaviour & Information Technology , 24 : 419 – 434 .
   Web of Science ®Google Scholar
• Kalyuga , S. , Chandler , P. and Sweller , J. 2004 . Effects of redundant on-screen text in multimedia technical instruction . Human Factors , 46 : 567 – 581 .
   PubMed Web of Science ®Google Scholar
• Kieras , D. and Polson , P. G. 1985 . An approach to the formal analysis of user complexity . International Journal of Man-Machine Studies , 22 : 365 – 394 .
   Google Scholar
• Le Bigot , L. , Rouet , J.-F. and Jamet , E. 2007a . Effects of speech and text-based interaction modes in natural language human-computer dialogue . Human Factors , 49 : 1045 – 1053 .
   PubMed Web of Science ®Google Scholar
• Le Bigot , L. 2006 . Mode and modal transfer effects on performance and discourse organization with an information retrieval dialogue system in natural language . Computers in Human Behavior , 22 : 467 – 500 .
   Google Scholar
• Le Bigot , L. 2007b . Effect of modality on collaboration with a dialogue system . International Journal of Human-Computer Studies , 65 : 983 – 991 .
   Web of Science ®Google Scholar
• Lee , K. W. and Lai , J. 2005 . Speech versus touch: A comparative study of the use of speech and DTMF keypad for navigation . International Journal Human-Computer Interaction , 19 : 343 – 360 .
   Web of Science ®Google Scholar
• Levow , G. A. . Understanding recognition failures in spoken corrections in human-computer dialogue . Proceedings of ESCA workshop on dialogue and prosody . Eindhoven, The Netherlands. Edited by: Swerts , M. and Terken , J. pp. 193 – 198 . Eindhoven University of Technology .
   Google Scholar
• Mayer R. E The Cambridge handbook of multimedia learning Cambridge University Press Cambridge 2005
   Google Scholar
• Mayer , R. E. and Johnson , C. 2008 . Revising the redundancy principle in multimedia learning . Journal of Educational Psychology , 100 : 380 – 386 .
   Web of Science ®Google Scholar
• Murray , A. C. , Jones , D. M. and Frankish , C. R. 1996 . Dialogue design in speech-mediated data-entry: the role of syntactic constraints and feedback . International Journal of Human-Computer Studies , 45 : 263 – 286 .
   Google Scholar
• Najjar , L. J. 1998 . Principles of educational multimedia user interface design . Human Factors , 40 : 311 – 323 .
   Web of Science ®Google Scholar
• Oviatt , S. L. 2008 . “ Multimodal interfaces ” . In Handbook of human-computer interaction , second edition , Edited by: Sears , A. and Jacko , J. 413 – 432 . Mahwah, NJ : Lawrence Erlbaum Assoc .
   Google Scholar
• Oviatt , S. L. , Cohen , P. R. and Wang , M. 1994 . Toward interface design for human language technology: Modality and structure as determinants of linguistic complexity . Speech Communication , 15 : 283 – 300 .
   Google Scholar
• Oviatt , S. L. and Lunsford , R. 2005 . Multimodal interfaces for cell phones and mobile technology . International Journal of Speech Technology , 8 : 127 – 132 .
   Google Scholar
• Oviatt , S. L. , MacEachern , M. and Levow , G.-A. 1998 . Predicting hyperarticulate speech during human-computer error resolution . Speech Communication , 24 : 87 – 110 .
   Google Scholar
• Paas , F. , Renkl , A. and Sweller , J. 2003 . Cognitive load theory and instructional design: Recent developments . Educational Psychologist , 38 : 1 – 4 .
   Web of Science ®Google Scholar
• Parush , A. 2005 . Speech-based interaction in a multitask condition: Impact of prompt modality . Human Factors , 47 : 591 – 597 .
   PubMedGoogle Scholar
• Raymond , C. . Belief confirmation in spoken dialog systems using confidence measures . IEEE workshop on automatic speech recognition and understanding ASRU03 . St Thomas, US Virgin Islands. pp. 150 – 155 . New York : IEEE .
   Google Scholar
• Raymond , C. . Semantic interpretation with error correction . Proceeding of IEEE international conference on acoustics, speech and signal processing, ICASSP05 . Philadelphia, USA. pp. 29 – 32 . New York : IEEE .
   Google Scholar
• Rugelbak , J. and Hamnes , K. 2003 . Multimodal interaction – will users tap and speak simultaneously? . Telektronikk , 2 : 118 – 124 .
   Google Scholar
• Sadek , D. . Design considerations on dialogue systems: From theory to technology – the case of Artimis . Proceedings of the ESCA TR workshop on interactive dialogue for multimodal systems IDS′99 . Klöster Irsee, Germany: ESCA. pp. 1 – 15 .
   Google Scholar
• Seagull , F. J. , Wickens , C. D. and Loeb , R. G. . When is less more? Attention and workload in auditory, visual, and redundant patient-monitoring conditions . Proceedings of the 45th annual meeting of the Human Factors and Ergonomics Society . Santa Monica, CA : Human Factors & Ergonomics Society .
   Google Scholar
• Sheeder , T. and Balogh , J. 2003 . Say it like you mean: Priming for structure in caller responses to a spoken dialog system . International Journal of Speech Technology , 6 : 103 – 111 .
   Google Scholar
• Stent , A. J. , Huffman , M. K. and Brennan , S. E. 2008 . Adapting speaking after evidence of misrecognition: Local and global hyperarticulation . Speech Communication , 50 : 163 – 178 .
   Google Scholar
• Sweller , J. 1999 . Instruction design in technical areas , Camberwell, , Australia : ACER .
   Google Scholar
• Tergan , S. O. 1997 . Misleading theoretical assumptions in hypertext/hypermedia research . Journal of Educational Multimedia and Hypermedia , 6 : 257 – 283 .
   Google Scholar
• Vitense , H. S. , Jacko , J. A. and Emery , V. K. 2003 . Multimodal feedback: An assessment of performance and mental workload . Ergonomics , 46 : 68 – 87 .
   PubMed Web of Science ®Google Scholar
• Walker , M. A. 2004 . Generation and evaluation of user-tailored responses in multimodal dialogue . Cognitive Science , 28 : 811 – 840 .
   Google Scholar
• Wickens , C. D. 1984 . “ Processing resources in attention ” . In Varieties of attention , Edited by: Parasuraman , R. and Davies , D. R. 63 – 102 . London : Academic Press .
   Google Scholar
• Zhang , W. 1999 . Voice recognition-based human-computer interface design . Computers & Industrial Engineering , 37 : 305 – 308 .
   Web of Science ®Google Scholar
• Zoltan-Ford , E. 1991 . How to get people to say and type what computers can understand . International Journal of Man-Machine Studies , 34 : 527 – 547 .
   Google Scholar