17 Ways to Say Yes:
Toward Nuanced Tone of Voice in AAC and Speech Technology

References

• Adobe. (2015). Color CC. Retrieved from https://color.adobe.com/Sea-Wolf-color-theme-782171/
   Google Scholar
• Alm, N., & Newell, A. (1996). Being an interesting conversation partner. In S. von Tetzchner & M. Jensen (Eds.), Augmentative and alternative communication: European perspectives (pp. 171–181). London, UK: Whurr Publishers.
   Google Scholar
• Astrinaki, M., d’Alessandro, N., Picart, B., Drugman, T., & Dutoit, T. (2012, December). Reactive and continuous control of HMM-based speech synthesis. Paper presented at the Institute for Electrical and Electronics Engineers (IEEE) Workshop on Spoken Language Technology, Miami, FL.
   Google Scholar
• Bunnell, H. T., & Pennington, A. C. (2010). Advances in computer speech synthesis and implications for assistive technology. In J. Mullennix & S. Stern (Eds.), Computer synthesized speech technologies: Tools for aiding impairment (pp. 71–91). New York, NY: IGI Global.
   Google Scholar
• Beukelman, D. (1989). There are some things you just can't say with your right hand. Augmentative and Alternative Communication, 5(4), 257–258.
   Google Scholar
• Blackstone, S., Williams, M., & Wilkins, D. (2007). Key principles underlying research and practice in AAC. Augmentative and Alternative Communication, 23(3), 191–203.
   PubMed Web of Science ®Google Scholar
• Buchenau, M., & Fulton Suri, J. (2000, August). Experience prototyping. In Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques (pp. 424–433). ACM.
   Google Scholar
• Campbell, N. (2005). Getting to the heart of the matter: Speech as the expression of affect, rather than just text or language. Language Resources & Evaluation, 39(1), 109–118.
   Google Scholar
• Clark, H. H. (1996). Using language (Vol. 4). Cambridge, UK: Cambridge University Press.
   Google Scholar
• Clark, R., & King S. (2006, September). Joint prosodic and segmental unit selection speech synthesis. Paper presented at the 9th International Conference on Spoken Language Processing (INTERSPEECH), Pittsburgh, PA.
   Google Scholar
• Cook, A. (2013). Studying interaction design by designing interactions with tone of voice (Unpublished doctoral dissertation). University of Dundee, Dundee, UK.
   Google Scholar
• Crystal, D. (1969). Prosodic systems and intonation in English. Cambridge, UK: Cambridge University Press.
   Google Scholar
• Crystal, D. (1975). The English tone of voice: Essays in intonation, prosody and paralanguage. London, UK: Edward Arnold.
   Google Scholar
• Crystal, D. (1995). The Cambridge encyclopedia of the English language. Cambridge, UK: Cambridge University Press.
   Google Scholar
• Dunne, A., & Raby, F. (2001). Design noir: The secret life of electronic objects. Basel, Switzerland: Birkhäuser.
   Google Scholar
• Flach, G. (2001). Interface design for speech synthesis systems. In É. Keller, G. Bailly, A. Monaghan, J. Terken, & M. Huckvale (Eds.), Improvements in speech synthesis. COST 258: The naturalness of synthetic speech, (pp. 383–390). Chichester, UK: Wiley.
   Google Scholar
• Fox, A. (2000). Prosodic features and prosodic structure: The phonology of suprasegmentals. Oxford, UK: Oxford University Press.
   Google Scholar
• Fukasawa, N. (2007). Naoto Fukasawa. London, UK: Phaidon.
   Google Scholar
• Gaver, W., Dunne, A., & Pacenti, E. (1999). Cultural probes. Interactions, 6(1), 21–29.
   Google Scholar
• Goodwin, C. (1995). Co-constructing meaning in conversations with an aphasic man. Research on Language and Social Interaction, 28(3), 233–260.
   Google Scholar
• Hammett, D. (1929). The Maltese falcon. New York, NY: Alfred A. Knopf.
   Google Scholar
• Hennig, S. (2013). Candidacy of biosignals as an implicit input method for expressive speech synthesis (Unpublished doctoral dissertation). Genoa, Italy: Italian Institute of Technology.
   Google Scholar
• Hennig, S., Székely, É, Carson-Berndsen, J., & Chellali, R. (2012, July). Listener evaluation of an expressiveness scale in speech synthesis for conversational phrases: Implications for AAC. Paper presented at the biennial conference of the International Society for Augmentative and Alternative Communication (ISAAC), Pittsburgh, PA.
   Google Scholar
• Higginbotham, J. (2010)Humanizing vox artificialis: The role of speech synthesis in augmentative and alternative communication. In J. Mullennix, & S. Stern (Eds.), Computer synthesized speech technologies: Tools for aiding impairment (pp. 50–70). New York, NY: Medical Information Science Reference.
   Google Scholar
• Holmes, J., & Holmes, W. (2001). Speech synthesis and recognition. London, UK: Taylor & Francis.
   Google Scholar
• Jakobson, R. (1960). Closing statement: Linguistics and poetics. In T. Sebeok (Ed.), Style in language (pp. 350–377). Cambridge, MA: MIT Press.
   Google Scholar
• Jones, D. (1936). An outline of English phonetics. Cambridge, UK: Heffer.
   Google Scholar
• Jreige, C., Patel, R., & Bunnell, H. T. (2009). VocaliD: Personalizing text-to-speech synthesis for individuals with severe speech impairment. In Proceedings of the 11th international Association for Computing Machinery Special Interest Group on Accessible Computing (ACM SIGACCESS) conference on Computers and accessibility (pp. 259–260). ACM.
   Google Scholar
• Kiely, O. (2010). Pattern. London, UK: Conran Octopus.
   Google Scholar
• Light, J. (1989). Toward a definition of communicative competence for individuals using augmentative and alternative communication systems. Augmentative and Alternative Communication, 5(2), 137–144.
   Google Scholar
• Light, J., & Drager, K. (2007). AAC technologies for young children with complex communication needs: State of the science and future research directions. Augmentative and Alternative Communication, 23(3), 204–216.
   PubMedGoogle Scholar
• Light, J., Drager K., & Nemser, J. (2004). Enhancing the appeal of AAC technologies for young children: Lessons from the toy manufacturers. Augmentative and Alternative Communication, 20(3), 137–149.
   Google Scholar
• Light, J., & McNaughton, D. (2014). Communicative competence for individuals who require augmentative and alternative communication: A new definition for a new era of communication? Augmentative and Alternative Communication, 30(1), 1–18.
   PubMedGoogle Scholar
• Light, J., & McNaughton, D. (2012). The changing face of augmentative and alternative communication: Past, present and future challenges. Augmentative and Alternative Communication, 28(4), 197–204.
   PubMedGoogle Scholar
• McLeod, R. (2010). Speech Hedge. Retrieved from http://vimeo.com/14582462
   Google Scholar
• Neurath, O. (1936). International picture language. London, UK: Kegan Paul.
   Google Scholar
• Norman, D. (2011). Living with complexity. Cambridge, MA: MIT Press.
   Google Scholar
• Pieraccini, R. (2012). The voice in the machine: Building computers that understand speech. Cambridge, MA: MIT Press.
   Google Scholar
• Portnuff, C. (2006, August). Augmentative and alternative communication: A user's perspective. Lecture delivered at the Oregon Health and Science University. Retrieved from http://aac-rerc.psu.edu/index-8121.php.html
   Google Scholar
• Pullin, G. (2009). Design meets disability. Cambridge, MA: MIT Press.
   Google Scholar
• Pullin, G. (2012, June). I think we need to talk about tone of voice. Paper presented at the Augmentative and Alternative Communication Rehabilitation Engineering Research Centers (AAC-RERC) State of the science conference, Baltimore, MD.
   Google Scholar
• Pullin, G. (2013). 17 ways to say yes, exploring tone of voice in augmentative communication and designing new interactions with speech synthesis (Unpublished doctoral dissertation). University of Dundee, Dundee, UK.
   Google Scholar
• Pullin, G., & Cook, A. (2008, August). Six speaking chairs to provoke discussion about expressive AAC. Paper presented at the biennial conference of the International Society for Augmentative and Alternative Communication (ISAAC), Montréal, Canada.
   Google Scholar
• Pullin, G., & Cook, A. (2010). Six speaking chairs (not directly) for people who cannot speak. Interactions, 17(5), 38–24. New York, NY: ACM.
   Google Scholar
• Pullin, G., Cook, A., & McLeod, R. (2010, July). Insights from the Six Speaking Chairs. Paper presented at the biennial conference of the International Society for Augmentative and Alternative Communication (ISAAC), Barcelona, Spain.
   Google Scholar
• Ridley, L. (2012). Voice by choice. Retrieved March 24, 2015, from http://www.youtube.com/watch?v = CMm_XL3Ipbo
   Google Scholar
• Robillard, A. (1994). Communication problems in the intensive care unit. Qualitative Sociology, 17(4), 383–395.
   Google Scholar
• Scherer, K. (2005). What are emotions? And how can they be measured? Social Science Information, 44(4), 693–727.
   Google Scholar
• Schröder, M. (2001, September). Emotional speech synthesis: A review. Paper presented at Eurospeech, Aalborg, Denmark.
   Google Scholar
• Shaw, G. B. (1916). Androcles and the lion, Overruled, Pygmalion. London, UK: Constable.
   Google Scholar
• Székely, É., Ahmed, Z., Hennig, S., Cabral, J. P., & Carson-Berndsen, J. (2014). Predicting synthetic voice style from facial expressions. An application for augmented conversations. Speech Communication, 57, 63–75.
   Google Scholar
• Todman, J. (2000). Rate and quality of conversations using a text-storage AAC system: Single case training study. Augmentative and Alternative Communication, 16(3), 164–179.
   Google Scholar
• Waller, A., Black, R., Martin, C., Pullin, G., & Abel, E. (2008, August). Say what Simon says: “Playing” a new approach for phonemic speech output. Paper presented at the biennial conference of the International Society for Augmentative and Alternative Communication (ISAAC), Montréal, Canada.
   Google Scholar
• Yamagishi, J., Veaux, C., King, S., & Renals, S. (2012). Speech synthesis technologies for individuals with vocal disabilities: Voice banking and reconstruction. Acoustical Science and Technology, 33(1), 1–5.
   Google Scholar