Toolkit Support for Integrating Physical and Digital Interactions

REFERENCES

• Back , M. , Cohen , J. , Gold , R. , Harrison , S. and Minneman , S. 2001 . Listen reader: An electronically augmented paper-based book. . CHI Letters , 3 ( 1 ) : 23 – 29 .
   Google Scholar
• Ballagas , R. , Ringel , M. , Stone , M. and Borchers , J. 2003 . iStuff: A physical user interface toolkit for ubiquitous computing environments. . CHI Letters , 5 ( 1 ) : 537 – 544 .
   Google Scholar
• Ballagas , R. , Szybalski , A. and Fox , A. 2004 . “ The patch panel: Enabling control-flow interoperability in ubicomp environments. ” . In Proceedings of Percom 2004: IEEE International Conference on Pervasive Computing and Communications. Los Alamitos, CA : IEEE Computer Society. .
   Google Scholar
• Beck , K. 2000 . extreme programming eXplained: mbrace change Reading, MA : Addison-Wesley. .
   Google Scholar
• Beckmann , C. and Dey , A. K. 2003 . SiteView: Tangibly programming active environments with predictive visualization. . Proceedings of Fifth International Conference on Ubiquitous Computing , 2003 New York: Springer.
   Google Scholar
• Bradski , G. 2001 . Open source computer vision library Retrieved from http://www. intel.com/research/mrl/research/opencv
   Google Scholar
• Brooks , F. P. 1987 . Essence and accidents of software engineering. . IEEE Computer , 20 ( 4 ) : 10 – 19 .
   Web of Science ®Google Scholar
• Burnett , M. , Sheretov , A. , Ren , B. and Rothermel , G. 2002 . Testing homogeneous spreadsheet grids with the “What you see is what you test” methodology. . IEEE Transactions on Software Engineering , 28 ( 6 ) : 576 – 594 .
   Web of Science ®Google Scholar
• Canny , J. F. 1986 . A computational approach to edge detection. . Transactions on Pattern Analysis and Machine Intelligence , 8 ( 6 ) : 679 – 698 .
   PubMed Web of Science ®Google Scholar
• Carter , S. , Mankoff , J. , Klemmer , S. R. and Matthews , T. 2008 . Exiting the cleanroom: On ecological validity and ubiquitous computing. . Human-Computer Interaction , 23 ( 1 ) : 47 – 99 .
   Web of Science ®Google Scholar
• Chang , S.-K. , ed. 1990 . Principles of visual programming systems Englewood Cliffs, NJ : Prentice Hall. .
   Google Scholar
• Clarke , S. 2001 . “ Evaluating a new programming language. ” . In Proceedings of Workshop of the Psychology of Programming Interest Group Poole, , UK : Bournemouth University. .
   Google Scholar
• Clarke , S. 2004 . Measuring API usability. . Dr. Dobbs Journal , 29 : S6 – S9 .
   Google Scholar
• De Guzman , E. and Hsieh , G. 2003 . Function composition in physical chaining applications Berkeley, CA : UC Berkeley. .
   Google Scholar
• De Guzman , E. S. , Ramírez , A. and Klemmer , S. R. 2003 . ObjectClassifierViews: Support for visual programming of image classifiers Berkeley, CA : UC Berkeley. .
   Google Scholar
• Détienne , F. 2001 . Software design–Cognitive aspects Edited by: Bott , F. London : Springer Verlag .
   Google Scholar
• Dey , A. K. , Salber , D. and Abowd , G. D. 2001 . A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. . Human-Computer Interaction , 16 ( 2–4 ) : 97 – 166 .
   Web of Science ®Google Scholar
• Fails , J. A. and Olsen , D. R. 2003 . A design tool for camera-based interaction. . CHI Letters , 5 ( 1 ) : 449 – 456 .
   Google Scholar
• Fishkin , K. P. 2004 . A taxonomy for and analysis of tangible interfaces. . Personal and Ubiquitous Computing , 8 ( 5 ) : 347 – 358 .
   Web of Science ®Google Scholar
• Fitzmaurice , G. W. , Ishii , H. and Buxton , W. 1995 . “ Bricks: Laying the foundations for graspable user interfaces. ” . In Proceedings of CHI: Human Factors in Computing Systems New York : Addison-Wesley. .
   Google Scholar
• Forsyth , D. A. and Ponce , J. 2003 . Computer vision: A modern approach Upper Saddle River, NJ : Prentice Hall. .
   Google Scholar
• Freeman , W. T. , Miyake , Y. , Tanaka , K.-i. , Anderson , D. B. Beardsley , P. A. 1998 . Computer vision for interactive computer graphics. . IEEE Computer Graphics and Applications , 18 ( 3 ) : 42 – 53 .
   Web of Science ®Google Scholar
• Gamma , E. , Helm , R. , Johnson , R. and Vlissides , J. 1995 . Design patterns: Elements of reusable object-oriented software New York : Addison-Wesley. .
   Google Scholar
• Goldberg , A. 1977 . Smalltalk in the classroom (No. SSL 77-2) Palo Alto, CA : Xerox Palo Alto Research Center .
   Google Scholar
• Gorbet , M. , Orth , M. and Ishii , H. 1998 . “ Triangles: Tangible interface for manipulation and exploration of digital information topography. ” . In Proceedings of CHI: ACM Conference on Human Factors in Computing Systems New York : ACM Press. .
   Google Scholar
• Grasso , A. , Karsenty , A. and Susani , M. 2000 . “ Augmenting paper for community information sharing. ” . In Proceedings of DARE 2000: Designing Augmented Reality Environments New York : ACM Press. .
   Google Scholar
• Green , T. R. G. and Petre , M. 1996 . Usability analysis of visual programming environments. . Journal of Visual Languages and Computing , 7 ( 2 ) : 131 – 174 .
   Web of Science ®Google Scholar
• Greenberg , S. and Fitchett , C. 2001 . Phidgets: Easy development of physical interfaces through physical widgets. . CHI Letters , 3 ( 2 ) : 209 – 218 .
   Google Scholar
• Heiner , J. M. , Hudson , S. E. and Tanaka , K. 1999 . Linking and messaging from real paper in the paper PDA. . CHI Letters , 1 ( 1 ) : 179 – 186 .
   Google Scholar
• Holmquist , L. E. , Redström , J. and Ljungstrand , P. 1999 . “ Token-based access to digital information. ” . In Proceedings of Handheld and Ubiquitous Computing. First International Symposium, HUC'99 New York : Springer. .
   Google Scholar
• Hong , J. I. and Landay , J. A. 2000 . SATIN: A toolkit for informal ink-based applications. . CHI Letters , 2 ( 2 ) : 63 – 72 .
   Google Scholar
• Horn , B. K. P. 1986 . “ Binary images: Topological properties. In ” . In Robot vision 65 – 89 . Cambridge, MA : MIT Press. .
   Google Scholar
• Ishii , H. and Ullmer , B. 1997 . “ Tangible bits: Towards seamless interfaces between people, bits and atoms. ” . In Proceedings of CHI: Human Factors in Computing Systems New York : ACM Press. .
   Google Scholar
• Jacob , R. , Ishii , H. , Pangaro , G. and Patten , J. 2002 . A tangible interface for organizing information using a grid. . CHI Letters , 4 ( 1 ) : 339 – 346 .
   Google Scholar
• Johnson , W. , Jellinek , H. L. K. Jr. , Rao , R. and Card , S. 1993 . “ Bridging the paper and electronic worlds: The paper user interface. ” . In Proceedings of INTERCHI: Human Factors in Computing Systems New York : ACM Press. .
   Google Scholar
• Jones , S. P. , Blackwell , A. and Burnett , M. 2003 . “ A User-centred approach to functions in Excel. ” . In Proceedings of SIGPLAN International Conference on Functional Programming. New York : ACM Press. .
   Google Scholar
• Kato , H. , Billinghurst , M. and Poupyrev , I. 2000 . ARToolKit Retrieved from http://www.hitl.washington.edu/artoolkit/
   Google Scholar
• Kelley , J. F. 1984 . An iterative design methodology for user-friendly natural language office information applications. . ACM Transactions on Office Information Systems , 2 ( 1 ) : 26 – 41 .
   Web of Science ®Google Scholar
• Klemmer , S. R. , Everitt , K. and Landay , J. A. 2008 . Integrating physical and digital interactions on walls for fluid design collaboration. . Human-Computer Interaction , 23 ( 2 ) : 138 – 213 .
   Web of Science ®Google Scholar
• Klemmer , S. R. , Graham , J. , Wolff , G. J. and Landay , J. A. 2003 . Books with voices: Paper transcripts as a tangible interface to oral histories. . CHI Letters , 5 ( 1 ) : 89 – 96 .
   Google Scholar
• Klemmer , S. R. , Li , J. , Lin , J. and Landay , J. A. 2004 . Papier-Mâché: Toolkit support for tangible input. . CHI Letters , 6 ( 1 ) : 399 – 406 .
   Google Scholar
• Klemmer , S. R. , Sinha , A. K. , Chen , J. , Landay , J. A. , Aboobaker , N. and Wang , A. 2000 . SUEDE: A Wizard of Oz prototyping tool for speech user interfaces. . CHI Letters , 2 ( 2 ) : 1 – 10 .
   Google Scholar
• Krasner , G. E. and Pope , S. T. 1988 . A description of the model-view-controller user interface paradigm in the Smalltalk-80 system. . Object Oriented Programming , 1 ( 3 ) : 26 – 49 .
   Google Scholar
• Landay , J. A. and Myers , B. A. 1993 . “ Extending an existing user interface toolkit to support gesture recognition. ” . In Proceedings of Adjunct Proceedings of INTERCHI '93: Human Factors in Computing Systems New York : ACM Press. .
   Google Scholar
• Lange , B. M. , Jones , M. A. and Meyers , J. L. 1998 . “ Insight lab: An immersive team environment linking paper, displays, and data. ” . In Proceedings of CHI: Human Factors in Computing Systems New York : ACM Press. .
   Google Scholar
• Lederer , S. and Heer , J. 2004 . “ All together now: Visualizing local and remote actors of localized activity. ” . In Proceedings of Extended Abstracts of CHI: Conference on Human Factors in Computing Systems New York : ACM Press. .
   Google Scholar
• Liblit , B. , Aiken , A. , Zheng , A. X. and Jordan , M. I. 2003 . “ Bug isolation via remote program sampling. ” . In Proceedings of PLDI: SIGPLAN 2003 Conference on Programming Language Design and Implementation New York : Association for Computer Machinery. .
   Google Scholar
• MacIntyre , B. , Gandy , M. , Dow , S. and Bolter , J. D. 2004 . DART: A toolkit for rapid design exploration of augmented reality experiences. . CHI Letters , 6 ( 2 ) : 197 – 206 .
   Google Scholar
• Mackay , W. E. , Fayard , A.-L. , Frobert , L. and Médini , L. 1998 . “ Reinventing the familiar: Exploring an augmented reality design space for air traffic control. ” . In Proceedings of CHI: Human Factors in Computing Systems New York : ACM Press. .
   Google Scholar
• Mackay , W. E. and Pagani , D. 1994 . Video mosaic: Laying out time in a physical space. . Proceedings of Multimedia , 2 : 165 – 172 .
   Google Scholar
• Mankoff , J. , Hudson , S. E. and Abowd , G. D. 2000 . Providing integrated toolkit-level support for ambiguity in recognition-based interfaces. . CHI Letters , 2 ( 1 ) : 368 – 375 .
   Google Scholar
• Matthews , T. , Dey , A. K. , Mankoff , J. , Carter , S. and Rattenbury , T. 2004 . A toolkit for managing user attention in peripheral displays. . CHI Letters , 6 ( 2 ) : 247 – 256 .
   Google Scholar
• McGee , D. R. , Cohen , P. R. , Wesson , R. M. and Horman , S. 2002 . Comparing paper and tangible, multimodal tools. . CHI Letters , 4 ( 1 ) : 407 – 414 .
   Google Scholar
• McGrath , J. E. 1994 . “ Methodology matters: Doing research in the behavioral and social sciences. ” . In Readings in human-computer interaction: Toward the year 2000, , 2nd edition. Edited by: Baecker , R. M. , Buxton , W. , Grudin , J. and Greenberg , S. San Francisco : Morgan Kaufmann .
   Google Scholar
• Moran , T. P. , Saund , E. , van Melle , W. , Gujar , A. , Fishkin , K. P. and Harrison , B. L. 1999 . Design and technology for Collaborage: Collaborative collages of information on physical walls. . CHI Letters , 1 ( 1 ) : 197 – 206 .
   Google Scholar
• Myers , B. A. 1990 . A new model for handling input. . ACM Transactions on Information Systems , 8 ( 3 ) : 289 – 320 .
   Web of Science ®Google Scholar
• Myers , B. , Hudson , S. E. and Pausch , R. 2000 . Past, present, and future of user interface software tools. . ACM Transactions on Computer-Human Interaction , 7 ( 1 ) : 3 – 28 .
   Google Scholar
• Myers , B. A. , McDaniel , R. G. , Miller , R. C. , Ferrency , A. S. Faulring , A. 1997 . The amulet environment: New models for effective user interface software development. . IEEE Transactions on Software Engineering , 23 ( 6 ) : 347 – 365 .
   Web of Science ®Google Scholar
• Myers , B. A. and Rosson , M. B. 1992 . “ Survey on user interface programming. ” . In Proceedings of CHI: Human Factors in Computing Systems New York : ACM Press. .
   Google Scholar
• Nelson , L. , Ichimura , S. , Pedersen , E. R. and Adams , L. 1999 . “ Palette: A paper interface for giving presentations. ” . In Proceedings of CHI: Human Factors in Computing Systems. New York : ACM Press. .
   Google Scholar
• Norman , D. A. 1983 . “ Some observations on mental models. ” . In Human-computer interaction in the new millennium Edited by: Gentner , D. and Stevens , A. L. 7 – 14 . Hillsdale, NJ : Erlbaum. .
   Google Scholar
• Norman , D. 1990 . The design of everyday things New York : Doubleday. .
   Google Scholar
• Pane , J. 2002 . A Programming System for Children that is Designed for Usability. Unpublished doctoral dissertation, Carnegie Mellon University, Pittsburgh, Pennsylvania.
   Google Scholar
• Poynor , R. 1995 . The hand that rocks the cradle. . I.D. , 42 : 60 – 65 .
   Google Scholar
• Rekimoto , J. and Ayatsuka , Y. 2000 . “ CyberCode: Designing augmented reality environments with visual tags. ” . In Proceedings of Designing Augmented Reality Environments (DARE 2000) New York : ACM Press. .
   Google Scholar
• Rekimoto , J. and Saitoh , M. 1999 . “ Augmented surfaces: a spatially continuous work space for hybrid computing environments. ” . In Proceedings of CHI: Human Factors in Computing Systems New York : ACM Press. .
   Google Scholar
• Rekimoto , J. , Ullmer , B. and Oba , H. 2001 . DataTiles: A modular platform for mixed physical and graphical interactions. . CHI Letters , 3 ( 1 ) : 269 – 276 .
   Google Scholar
• Rodden , K. and Blackwell , A. 2002 . “ Class libraries: A challenge for programming usability research. ” . In Proceedings of Workshop of the Psychology of Programming Interest Group Isleworth, , UK : Brunel University College. .
   Google Scholar
• Sellen , A. J. and Harper , R. 2001 . The myth of the paperless office Cambridge, MA : MIT Press. .
   Google Scholar
• Shaer , O. , Leland , N. , Calvillo-Gamez , E. H. and Jacob , R. J. K. 2004 . The TAC paradigm: Specifying tangible user interfaces. . Personal and Ubiquitous Computing , 8 ( 5 ) : 359 – 369 .
   Web of Science ®Google Scholar
• Shneiderman , B. 1986 . “ Empirical studies of programmers: The territory, paths, and destinations. ” . In Proceedings of First Workshop on Empirical Studies of Programmers Norwood, NJ : Ablex. .
   Google Scholar
• Stifelman , L. , Arons , B. and Schmandt , C. 2001 . The audio notebook: Paper and pen interaction with structured speech. . CHI Letters , 3 ( 1 ) : 182 – 189 .
   Google Scholar
• Szekely , P. 1996 . “ Retrospective and challenges for model-based interface development. ” . In Proceedings of Eurographics Workshop on Design, Specification and Verification of Interactive Systems New York : ACM Press. .
   Google Scholar
• Ullmer , B. and Ishii , H. 1997 . “ The metaDESK: Models and prototypes for tangible user interfaces. ” . In Proceedings of UIST: User Interface Software and Technology New York : ACM Press. .
   Google Scholar
• Ullmer , B. and Ishii , H. 2001 . “ Emerging frameworks for tangible user interfaces. ” . In Human-computer interaction in the new millennium Edited by: Carroll , J. M. 579 – 601 . New York : Addison-Wesley. .
   Google Scholar
• Ullmer , B. , Ishii , H. and Glas , D. 1998 . “ mediaBlocks: Physical containers, transports, and controls for online media. ” . In Proceedings of SIGGRAPH 98: 25th International Conference on Computer Graphics and Interactive Technique New York : ACM Press. .
   Google Scholar
• Underkoffler , J. and Ishii , H. 1999 . “ Urp: A luminous-tangible workbench for urban planning and design. ” . In Proceedings of CHI: ACM Conference on Human Factors in Computing Systems New York : ACM Press. .
   Google Scholar
• Underkoffler , J. , Ullmer , B. and Ishii , H. 1999 . “ Emancipated pixels: Real-world graphics in the luminous room. ” . In Proceedings of SIGGRAPH: Computer Graphics and Interactive Techniques. New York : ACM Press. .
   Google Scholar
• University of Virginia. 1995 . Alice: Rapid prototyping for virtual reality. . IEEE Computer Graphics and Applications , 15 ( 3 ) : 8 – 11 .
   Google Scholar
• Want , R. , Fishkin , K. P. , Gujar , A. and Harrison , B. L. 1999 . “ Bridging physical and virtual worlds with electronic tags. ” . In Proceedings of CHI: Human Factors in Computing Systems New York : ACM Press. .
   Google Scholar
• Wellner , P. 1993 . Interacting with paper on the DigitalDesk. . Communications of the ACM , 36 : 87 – 96 .
   Web of Science ®Google Scholar