Semi-Automated, Large-Scale Evaluation of Public Displays

ABSTRACT

This article presents a scalable, semi-automated process for studying the usage of public displays. The process consists of gathering anonymous interaction and skeletal data of passersby during public display deployment and programmatically analyzing the data. This article demonstrates the use of the process with the analysis of the Information Wall, a gesture-controlled public information display. Information Wall was deployed in a university campus for one year and collected an extensive data set of more than 100 000 passersby. The main benefits of the process include (1) gathering of large data sets without considerable use of resources, (2) fast, semi-automated data analysis, and (3) applicability to studying the effects of long-term public display deployments. In analyzing the usage and passersby data of the Information Wall in our validation study, the main findings uncovered using the method were (i) most users were first-time users exploring the system, and not many returned to use the system again, and (ii) many users were accompanied by passive users who observed interaction from further away, which could suggest a case of multi-user interaction blindness. In the past, logged data has mainly been used as a supporting method for in situ observations and interviews, and its use has required a considerable amount of manual work. In this article, we argue that logged data analysis can be automated to complement other methods, particularly in the evaluation of long-term deployments.

Notes

1. https://youtu.be/YPhIqw5Vrz8.

2. https://developer.microsoft.com/en-us/windows/kinect.

3. https://3dtools.codeplex.com/.

Additional information

Notes on contributors

Ville Mäkelä

All authors are, or have been affiliated with the Tampere Unit for Computer-Human Interaction (TAUCHI) at the University of Tampere, Finland.

Ville Mäkelä is a Ph.D. candidate at TAUCHI. His research interests include cross-device interaction, mid-air gestures, public displays, augmented and virtual reality, and wearables. He received his M.Sc. in interactive technology from the University of Tampere in 2013. Contact him at [email protected].

Tomi Heimonen

Tomi Heimonen, previously with TAUCHI, is currently an assistant professor at the Department of Computing and New Media Technologies at University of Wisconsin-Stevens Point. His research interests include pervasive computing and information visualization. He received his Ph.D. in interactive technology from the University of Tampere in 2012. Contact him at [email protected].

Markku Turunen

Markku Turunen is a professor of Interactive Technology at TAUCHI. His research interests include, e.g., multimodal systems, novel user interfaces, and evaluation methods for mobile and pervasive computing applications. He received his Ph.D. in computer science from the University of Tampere in 2004. Contact him at [email protected].