Gaze Patterns and the Temporal Organization of Multiple Activities in Mobile Smartphone Uses

REFERENCES

• Aaltonen, T., Arminen, I., & Raudakoski, R. (2014). Photo sharing as a joint activity. In P. Haddington, M. Neville, T. Heinemann, & M. Rauniomaa (Eds.), Interacting with objects: Language, materiality and social activity (pp. 125–144). Amsterdam, the Netherlands: John Benjamins.
   Google Scholar
• Akkil, D., Kangas, J., Rantala, J., Isokoski, P., Spakov, O., & Raisamo, R. (2015). Glance awareness and gaze interaction in smartwatches. Proceedings of the CHI 2015 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Bell, G., & Dourish, P. (2007). Yesterday’s tomorrows: Notes on ubiquitous computing’s dominant vision. Personal & Ubiquitous Computing, 11(2), 133–143. doi:10.1007/s00779-006-0071-x
   Web of Science ®Google Scholar
• Brown, B., & Laurier, E. (2012). The normal natural troubles of driving with GPS. Proceedings of the CHI 2012 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Brown, B., McGregor, M., & Laurier, E. (2013). iPhone in vivo: Video analysis of mobile device use. Proceedings of the CHI 2013 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Brown, B., McGregor, M., & McMillan, D. (2015). Searchable objects: Search in everyday conversations. Proceedings of the CSCW 2015 Conference on Computer Supported Cooperative Work and Social Computing. New York, NY: ACM.
   Google Scholar
• Drewes, H., De Luca, A., & Schmidt, A. (2007). Eye-gaze interaction for mobile phones. Proceedings of the 2007 Conference on Mobile Technology, Applications, and Systems and the Symposium on Computer Human Interaction in Mobile Technology. New York, NY: ACM.
   Google Scholar
• Esbjornsson, M., Juhlin, O., & Weilenmann, A. (2007). Drivers using mobile phones in traffic: An ethnographic study of interactional adaptation. International Journal of Human Computer Interaction, 22(1–2), 37–58. doi:10.1080/10447310709336954
   Web of Science ®Google Scholar
• Gaver, W. W. (1991). Technology affordances. Proceedings of the CHI 1991 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Gibson, J. J. (1979). The ecological approach to visual perception. Boston, MA: Houghton-Mifflin.
   Google Scholar
• Goodwin, C. (1996). Transparent vision. In E. Ochs, E. A. Schegloff, & S. A. Thompson (Eds.), Interaction and grammar (pp. 370–404). Cambridge, UK: Cambridge University Press.
   Google Scholar
• Haddington, P., & Rauniomaa, M. (2011). Technologies, multitasking and driving: attending to and preparing for a mobile phone conversation in a car. Human Communication Research, 37, 223–254. doi:10.1111/hcre.2011.37.issue-2
   Web of Science ®Google Scholar
• Harrison, C., Amento, B., Kuznetsov, S., & Bell, R. (2007). Rethinking the progress bar. Proceedings of the ACM Symposium on User Interface Software and Technology. New York, NY: ACM.
   Google Scholar
• Isomorsu, M., Marika, T., Soili, V., & Kuutti, K. (2007). Experimental evaluation of five methods for collecting emotions in field settings with mobile applications. International Journal of Human-Computer Studies, 65(4), 404–418. doi:10.1016/j.ijhcs.2006.11.007
   Web of Science ®Google Scholar
• Kane, S. K., Wobbrock, J. O., & Smith, I. E. (2008). Getting off the treadmill: Evaluating walking user interfaces for mobile devices in public spaces. Proceedings of the Mobile HCI 2008 Conference on Human-Computer Interaction With Mobile Devices and Services. New York, NY: ACM.
   Google Scholar
• Kaptelinin, V., & Nardi, B. (2012). Affordances in HCI: Toward a mediated action perspective. Proceedings of the CHI 2012 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Kenyon, S. (2010). What do we mean by multitasking? Exploring the need for methodological clarification in time use research. International Journal of Time Use Research, 7(1), 42–60. doi:10.13085/eIJTUR.7.1.42-60
   Google Scholar
• Kern, D., Marshall, P., & Schmidt, A. (2010). Gazemarks- gaze-based visual placeholders to ease attention switching. Proceedings of the CHI 2010 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Lahlou, S. (2006). The activity from the point of view of the actor and the problem of inter-subjectivity: Eight years of work with miniature cameras affixed to actors’ heads’ subcam. Communications, 80, 209–234. doi:10.3406/comm.2006.2384
   Google Scholar
• Lahlou, S. (2011). How can we capture the subject’s perspective? An evidence-based approach for the social scientist. Social Science Information, 50, 607–655. doi:10.1177/0539018411411033
   Web of Science ®Google Scholar
• Latour, B. (1999). Pandora’s hope. Essays on the reality of science studies. Cambridge, MA: Harvard University Press.
   Google Scholar
• Laurier, E. (2002). Notes on dividing the attention of a car driver. Retrieved from https://archive.cs.st-andrews.ac.uk/STSE-Handbook/Other/Team%20Ethno/Issue1/Laurier/gooddriv.html
   Google Scholar
• Laurier, E., Brown, B., & McGregor, M. (2015). Mediated pedestrian mobility: Walking and the map app. Mobilities, 11(1), 117–134. doi:10.1080/17450101.2015.1099900
   Web of Science ®Google Scholar
• Laurier, E., Lorimer, H., Brown, B., Jones, O., Juhlin, O., Noble, A., … Weilenmann, A. (2008). Driving and passengering. Notes on the ordinary organization of car travel. Mobilities, 3(1), 3–23. doi:10.1080/17450100701797273
   Web of Science ®Google Scholar
• Lerner, G., & Raymond, G. (2017). On the practical re-intentionalization of body behavior. Action pivots in the progressive realization of embodied conduct. In G. Raymond, G. Lerner, & J. Heritage (Eds.), Enabling human conduct: Studies of talk-in-interaction in the honor of Emanuel A. Schegloff (pp. 299–313). Amsterdam, The Netherlands: John Benjamins.
   Google Scholar
• Mariakakis, A., Goel, M., Tanvir Islam Aumi, M., Patel, S., & Wobbrock, J. (2015). SwitchBack: Using focus and saccade tracking to guide user’s attention for mobile task resumption. Proceedings of the CHI 2015 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Mark, G., Christensen, U., & Shafae, M. (2001). A methodology using a microcamera for studying mobile IT usage and person mobility. Proceedings of the CHI 2001 Workshop on Mobile Communication: Understanding Users, Adoption and Design. New York, NY: ACM.
   Google Scholar
• Mondada, L. (2012). ‘Talking and driving’. Multiactivity in the car. Semiotica, 191, 223–256.
   Web of Science ®Google Scholar
• Morel, J., & Licoppe, C. (2011). Studying mobile video telephony. In M. Büscher, J. Urry, & K. Witchger (Eds.), Mobile methods (pp. 164–182). London, UK: Routledge.
   Google Scholar
• Omodei, M. M., McLennan, J., & Whitford, P. (1998). Improving decision making in complex natural settings: Using a head-mounted video camera to improve performance of competitive orienteers. International Journal of Sport Psychology, 29(2), 115–131.
   Google Scholar
• Oulasvirta, A., Tamminen, S., Roto, V., & Kuolahti, J. (2005). Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI. Proceedings of the CHI 2005 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Pink, S. (2007). Visual anthropology. London, UK: Sage.
   Google Scholar
• Pizza, S., Brown, B., McMillan, D., & Lampinen, A. (2016). Smartwatch. In vivo. Proceedings of the CHI 2016 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Porcheron, M., Fischer, J., & Sharples, S. (2016). Using mobile phones in pub talk. Proceedings of CSCW 2016 Conference on Computer Supported Cooperative Work. New York: ACM Press.
   Google Scholar
• Raclaw, J., Robles, J. S., & DiDomenico, S. M. (2016). Providing epistemic support for assessments through mobile-supported sharing activities. Research on Language and Social Interaction, 49, 362–379. doi:10.1080/08351813.2016.1199089
   PubMed Web of Science ®Google Scholar
• Reeves, S., & Brown, B. (2016). Embeddedness and sequentiality in social media. Proceedings of CSCW 2016 Conference on Computer Supported Cooperative Work. New York, NY: ACM.
   Google Scholar
• Relieu, M. (2009). Mobile phone “work”: Disengaging and engaging mobile phone activities with concurrent activities. In R. Ling & S. Campbell (Eds.), The reconstruction of space and time: mobile communication practices (pp. 215–230). New Brunswick, NJ: Transaction.
   Google Scholar
• Rooksby, J., Smith, T. E., Morrison, A., Rost, M., & Chalmers, M. (2015). Configuring attention in the multiscreen living room. Proceedings of ECSCW 2015 European Conference on Computer Supported Cooperative Work. Berlin, Germany: Springer.
   Google Scholar
• Sacks, H., Schegloff, E. A., & Jefferson, G. (1974). A simplest systematics for the organization of turn-taking for conversation. Language, 50, 696–735. doi:10.1353/lan.1974.0010
   Web of Science ®Google Scholar
• Schegloff, E. A. (1984). On some gestures’ relation to talk. In J. Maxwell Atkinson & J. Heritage (Eds.), Structures of social action: Studies in conversation analysis (pp. 266–295). Cambridge, UK: Cambridge University Press.
   Google Scholar
• Shell, J., Vertegaal, R., & Skaburkis, A. W. (2003). EyePliances: Attention-seeking devices that respond to visual attention. Proceedings of the CHI 2003 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Silbert, L., & Jacob, R. (2000). Evaluation of eye gaze interaction. Proceedings of the CHI 2000 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Tossell, C., Kortum, P., Rahmati, A., Shepard, C., & Lin, Z. (2012). Characterizing web use on smartphones. Proceedings of the CHI 2012 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Weilenmann, A., & Larsson, C. (2001). Local use and sharing of mobile phones. In B. Brown, N. Green, & R. Harper (Eds.), Wireless world: Social and interactional aspects of the mobile age (pp. 92–107). London, UK: Springer.
   Google Scholar
• Xu, P., Sugano, Y., & Bulling. (2016). Spatio-temporal modeling and prediction of visual attention in graphical user interfaces. Proceedings of the CHI 2016 Conference on Human Factors in Computer Systems. New York, NY: ACM.
   Google Scholar
• Yilmaz, A., Javed, O., & Shah, M. (2006). Object tracking: A survey. ACM Computing Surveys, 38(4), 1–45. doi:10.1145/1177352.1177355
   Web of Science ®Google Scholar
• Zouinar, M., Relieu, M., Salembier, P., & Calvet, G. (2004). Observation and capture of multimodal interaction in mobile situations. Proceedings of the UbiMob 2004 Conference on Mobility and Ubiquity Computing. New York, NY: ACM.
   Google Scholar