580
Views
11
CrossRef citations to date
0
Altmetric
Articles

An Empirical Study of Tagging for Personal Information Organization: Performance, Workload, Memory, and Consistency

Pages 821-863 | Published online: 25 Jul 2011

REFERENCES

  • Abrams , D. , Baecker , R. and Chignell , M. Information archiving with bookmarks: Personal Web space construction and organization . Proceedings of the SIGCHI conference on Human factors in computing systems . Los Angeles, CA. pp. 41 – 48 . ACM Press .
  • Adar , E. , Karger , D. and Stein , L. A. 1999 . “ Haystack: Per-user information environments ” . In Proceedings of the Eighth International Conference on Information and Knowledge Management , 413 – 422 . New York, , US : ACM New York .
  • Agarawala , A. and Balakrishnan , R. Keepin' it real: Pushing the desktop metaphor with physics, piles and the pen . Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . pp. 1283 – 1292 .
  • Ahn, J., Brusilovsky, P., & Farzan, R. (2005). Investigating users' needs and behavior for social search. Proceedings of Workshop on New Technologies for Personalized Information Access (PIA 2005) (pp. 1–12). Edinburgh, Scotland, UK. http:// wwwiti.cs.unimagdeburg.de/iti_dke/Events/2005/pia2005/docs/AhnBruFar05.pdf (http:// wwwiti.cs.unimagdeburg.de/iti_dke/Events/2005/pia2005/docs/AhnBruFar05.pdf) (Accessed: July 2011 ).
  • Akritas , M. , Arnold , S. and Brunner , E. 1997 . Nonparametric hypotheses and rank statistics for unbalanced factorial designs . Journal of the American Statistical Association , 92 : 258 – 265 .
  • Ames , M. and Naaman , M. Why we tag: motivations for annotation in mobile and online media . Proceedings of the 2007 SIGCHI Conference on Human Factors in Computing Systems . pp. 971 – 980 .
  • Anderson , J. 2000 . Learning and memory: An integrated approach , New York, NY : Wiley .
  • Anderson , J. and Reder , L. 1979 . “ An elaborative processing explanation of depth of processing ” . In Levels of processing in human memory , Edited by: Cermak , L. and Craik , F. I. M. 385 – 403 . Hillsdale, NJ : Erlbaum .
  • Barreau , D. and Nardi , B. A. 1995 . Finding and reminding: File organization from the desktop . ACM SIGCHI Bulletin , 27 ( 3 ) : 39 – 43 .
  • Barsalou , L. 1991 . Deriving categories to achieve goals . The Psychology of Learning and Motivation: Advances in Research and Theory , 27 : 1 – 64 .
  • Bateman, S. (2007). Collaborative Tagging: Folksonomy, Metadata, Visualization, E-Learning (Master thesis). University of Saskatchewan http://library2.usask.ca/theses/available/etd-12112007-221606/unrestricted/scott_bateman_thesis.pdf (http://library2.usask.ca/theses/available/etd-12112007-221606/unrestricted/scott_bateman_thesis.pdf) (Accessed: July 2011 ).
  • Beale , R. and Edmondson , W. Multiple carets, multiple screens and multi-tasking: new behaviours with multiple computers . Proceedings of the 21st British CHI Group Annual Conference on HCI 2007: People and Computers XXI . Vol. 1 , pp. 55 – 64 . Swinton, UK : British Computer Society .
  • Binkowski , P. 2006 . The effect of social proof on tag selection in social bookmarking applications University of North Carolina at Chapel Hill Unpublished master's thesis
  • Boardman , R. and Sasse , M. A. “Stuff goes into the computer and doesn't come out”: A cross-tool study of personal information management . Proceedings of the 2004 SIGCHI conference on Human Factors in Computing Systems . pp. 583 – 590 . New York, US : ACM New York .
  • Borlund , P. and Ingwersen , P. 1997 . The development of a method for the evaluation of interactive information retrieval systems . Journal of Documentation , 53 : 225 – 250 .
  • Bower , G. H. , Clark , M. C. , Lesgold , A. M. and Winzenz , D. 1969 . Hierarchical retrieval schemes in recall of categorical word lists . Journal of Verbal Learning and Verbal Behaviors , 8 : 323 – 343 .
  • Bradshaw , G. and Anderson , J. 1982 . Elaborative encoding as an explanation of levels of processing . Journal of Verbal Learning and Verbal Behavior , 21 : 165 – 174 .
  • Braly , M. and Froh , G. Social bookmarking in the Enterprise . Poster session presented at the 17th Annual ASIS&T SIG/CR Classification Research Workshop . Austin, TX. March .
  • Bransford , J. , Franks , J. , Morris , C. and Stein , B. 1979 . “ Some general constraints on learning and memory research ” . In Levels of processing in human memory , Edited by: Cermak , L. and Craik , F. I. M. 331 – 354 . Hillsdale, NJ : Erlbaum .
  • Brooks, C. H., & Montanez, N. (2006). Improved annotation of the blogosphere via autotagging and hierarchical clustering. Proceedings of the 15th International Conference on World Wide Web. New York, US: ACM New York http://portal.acm.org/citation.cfm?doid=1135777.1135869 (http://portal.acm.org/citation.cfm?doid=1135777.1135869) (Accessed: July 2011 ).
  • Budiu , R. , Pirolli , P. and Hong , L. Remembrance of things tagged: How tagging effort affects tag production and human memory . Paper presented at the Proceedings of the 27th International Conference on Human Factors in Computing Systems . Boston, MA. pp. 615 – 624 .
  • Campbell, K. E. (2006). A phenomenological framework for the relationship between the semantic Web and user-centered tagging systems. In J. Furnas & J. T. Tennis (Eds.), Proceedings 17th Workshop of the American Society for Information Science and Technology Special Interest Group in Classification Research, November 4, 2006. Austin, Texas http://arizona.openrepository.com/arizona/bitstream/10150/105357/1/campbell.pdf (http://arizona.openrepository.com/arizona/bitstream/10150/105357/1/campbell.pdf)
  • Casali , J. G. and Wierwille , W. W. 1984 . On the measurement of pilot perceptual workload: A comparison of assessment techniques addressing sensitivity and intrusion issues . Ergonomics , 27 : 1033 – 1050 .
  • Cattuto , C. , Schmitz , C. , Baldassarri , A. , Servedio , V. D. P. , Loreto , V. Hotho , A. 2007 . Network properties of folksonomies . AI Communications Journal , 20 : 245 – 262 .
  • Choy , S. and Lui , A. 2006 . “ Web information retrieval in collaborative tagging systems ” . In Proceedings of web intelligence , 352 – 355 . Washington, DC : IEEE Computer Society .
  • Civan , A. , Jones , W. , Klasnja , P. and Bruce , H. 2009 . Better to organize personal information by folders or by tags?: The devil is in the details . Proceedings of the American Society for Information Science and Technology , 45 ( 1 ) : 1 – 13 .
  • Cook , J. R. 1991 . The cognitive and social factors in the design of computerized tasks , West Lafayette : Unpublished doctorial dissertation, Purdue University .
  • Craik , F. I. M. and Lockhart , R. S. 1972 . Levels of processing: A framework for memory research . Journal of Verbal Learning and Verbal Behavior , 11 : 671 – 684 .
  • Dourish , P. , Edwards , W. K. , LaMarca , A. , Lamping , J. , Petersen , K. Salisbury , M. 2000 . Extending document management systems with user-specific active properties . ACM Transactions on Information Systems (TOIS) , 18 : 140 – 170 .
  • Dumais , S. T. and Jones , W. P. 1985 . “ A comparison of symbolic and spatial filing ” . In Proceedings of the SIGCHI conference on Human factors in computing systems , 127 – 130 . New York, , US : ACM New York .
  • Fertig , S. , Freeman , E. and Gelernter , D. Lifestreams: An alternative to the desktop metaphor . Conference companion on human factors in computing systems: Common ground . pp. 410 – 411 . New York, US : ACM New York .
  • Fitts , P. 1954 . The information capacity of the human motro system in controlling the amplitude of movement . Journal of Experimental Psychology , 47 : 381 – 391 .
  • Freeman , L. , Romney , A. and Freeman , S. 1987 . Cognitive structure and informant accuracy . American Anthropologist , 89 : 310 – 325 .
  • Gillie , T. and Broadbent , D. 1989 . What makes interruptions disruptive? A study of length, similarity, and complexity . Psychological Research , 50 : 243 – 250 .
  • Golder , S. A. and Huberman , B. A. 2006 . Usage patterns of collaborative tagging systems . Journal of Information Science , 32 : 198 – 208 .
  • Gonçalves , D. and Jorge , J. A. Describing documents: What can users tell us? . Proceedings of the 9th International Conference on Intelligent User Interfaces . pp. 247 – 249 . New York, US : ACM New York .
  • Grudin , J. Enterprise knowledge management and emerging technologies . Proceedings of the 39th Annual Hawaii International Conference on System Sciences . Washington, DC. Vol. 3 , pp. 57 IEEE Computer Society .
  • Guy, M., & Tonkin, E. (2006). Folksonomies: Tidying up tags. D-Lib Magazine, 12(1). http://www.dlib.org/dlib/january06/guy/01guy.html (http://www.dlib.org/dlib/january06/guy/01guy.html) (Accessed: July 2011 ).
  • Halvey, M., & Keane, M. (2007). An assessment of tag presentation techniques. Proceedings of the 16th International Conference on World Wide Web (pp. 1313–1314). New York, US: ACM New York http://portal.acm.org/citation.cfm?doid=1242572.1242826; (http://portal.acm.org/citation.cfm?doid=1242572.1242826;) (Accessed: July 2011 ).
  • Hart , S. G. , Mcpherson , D. and Loomis , L. L. Proceedings of the 14th Annual Conference on Manual Control . Time estimation as a secondary task to measure workload: Summary of Research . pp. 693 – 712 . Washington, D. C. : NASA .
  • Hart , S. G. and Staveland , L. E. 1988 . Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research . Human Mental Workload , 1 : 139 – 183 .
  • Hasher , L. and Zacks , R. T. 1979 . Automatic and effortful processes in memory . Journal of Experimental Psychology: General , 108 : 356 – 388 .
  • Hassan-Montero , Y. and Herrero-Solana , V. Improving tag-clouds as visual informatin retreival interfaces . Paper presented at the International Conference on Multidisciplinary Information Sciences & Technologies . October . pp. 25 – 28 . Mérida, Spain
  • Hurwitz , F. I. 1969 . A study of indexer consistency . American Documentation , 20 ( 1 ) : 92 – 94 .
  • Jacko , J. and Salvendy , G. 1996 . Hierarchical menu design: Breadth, depth, and task complexity . Perceptual and Motor Skills , 82 : 1187 – 1201 .
  • Janecek , P. 2007 . Faceted classification in web information architecture A framework for using semantic web tools The Authors Mohammad Nasir Uddin, Department of Library and Information Science, University of Rajshahi, Rajshahi, Bangladesh . The Electronic Library , 25 : 219 – 233 .
  • Jones , W. P. and Dumais , S. T. 1986 . The spatial metaphor for user interfaces: experimental tests of reference by location versus name . ACM Transactions on Information Systems (TOIS) , 4 ( 1 ) : 42 – 63 .
  • Jones , W. , Dumais , S. and Bruce , H. 2002 . Once found, what then? A study of “keeping” behaviors in the personal use of Web information . Proceedings of the American Society for Information Science and Technology , 39 ( 1 ) : 391 – 402 .
  • Jones, W., Phuwanartnurak, A. J., Gill, R., & Bruce, H. (2005). Don't take my folders away!: Organizing personal information to get things done. In CHI ‘05 Extended Abstracts on Human Factors in Computing Systems. Retrieved from http://portal.acm.org/citation.cfm?id=1056808.1056952 (http://portal.acm.org/citation.cfm?id=1056808.1056952) (Accessed: July 2011 ).
  • Kiger , J. I. 1984 . The depth/breadth tradeoff in the design of menu-driven interfaces . International Journal of Man-Machine Studies , 20 : 201 – 203 .
  • King , D. and Bryant , E. 1971 . The evaluation of information services and products , Washington, DC : Information Resources Press .
  • Kipp , M. and Campbell , D. 2006 . Patterns and inconsistencies in collaborative tagging systems: An examination of tagging practices . Proceedings of the American Society for Information Science and Technology , 43 ( 1 ) : 1 – 18 .
  • Kreifeldt , J. and McCarthy , M. 1981 . “ Interruption as a test of the user-computer interface ” . In Proceedings of the 17th Annual Conference on Manual Control. California Institute of Technology , 655 – 667 . Jet Propulsion Laboratory, California Institute of Technology, JPL Publication 81–95 .
  • Kwasnik , B. H. 1991 . The importance of factors that are not document attributes in the organization of personal documents . Journal of Documentation , 47 : 389 – 398 .
  • Lansdale , M. 1988 . The psychology of personal information management . Applied Ergonomics , 19 ( 1 ) : 55 – 66 .
  • Lansdale , M. W. 1991 . Remembering about documents: Memory for appearance, format, and location . Ergonomics , 34 : 1161 – 1178 .
  • Leonard , L. 1975 . Inter-indexer consistency and retrieval effectiveness: measurement of relationships , University of Illinois at Urbana-Champaign . Unpublished master's thesis
  • Li, R., Bao, S., Yu, Y., Fei, B., & Su, Z. (2007). Towards effective browsing of large scale social annotations. Proceedings of the 16th international conference on World Wide Web (pp. 943–952). New York, US: ACM New York http://portal.acm.org/citation.cfm?id=1242700 (http://portal.acm.org/citation.cfm?id=1242700) (Accessed: July 2011 ).
  • Lin , X. 1997 . Map displays for information retrieval . Journal of the American Society for Information Science , 48 : 40 – 54 .
  • Liu , Y. and Wickens , C. Patterns of task interference when human functions as a controller or a monitor . Paper presented at the Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics . Beijing and Shenyang, China.
  • Liu , Y. and Wickens , C. D. 1994 . Mental workload and cognitive task automaticity: An evaluation of subjective and time estimation metrics . Ergonomics , 37 : 1843 – 1854 .
  • Macgregor , G. and McCulloch , E. 2006 . Collaborative tagging as a knowledge organisation and resource discovery tool . Library Review , 55 : 291 – 300 .
  • Malone , T. W. 1983 . How do people organise their desks? Implications for the design of office information systems . ACM Transactions on Office Information Systems , 1 ( 1 ) : 99 – 112 .
  • Mander , R. , Salomon , G. and Wong , Y. Y. A “pile” metaphor for supporting casual organization of information . Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . pp. 627 – 634 .
  • Mandler , G. 1967 . Organization and memory . The Psychology of Learning and Motivation , 1 : 327 – 372 .
  • Mandler , J. M. , Seegmiller , D. and Day , J. 1977 . On the coding of spatial information. Memory . Cognition , 5 ( 1 ) : 10 – 16 .
  • Marlow , C. , Naaman , M. , Boyd , D. and Davis , M. HT06, tagging paper, taxonomy, Flickr, academic article, to read . Proceedings of the Seventeenth Conference on Hypertext and Hypermedia . pp. 31 – 40 .
  • Mathes, A. (2004). Folksonomies - Cooperative Classification and Communication Through Shared Metadata. Computer Mediated Communication (LIS590CMC) http://www.adammathes.com/academic/computer-mediated-communication/folksonomies.html (http://www.adammathes.com/academic/computer-mediated-communication/folksonomies.html) (Accessed: July 2011 ).
  • Michlmayr , E. and Cayzer , S. Learning user profiles from tagging data and leveraging them for personal (ized) information access . Paper presented at the the Workshop on Tagging and Metadata for Social Information Organization, 16th International World Wide Web Conference . Banff, Alberta, Canada. May 2007 .
  • Mika , P. 2007 . Ontologies are us: A unified model of social networks and semantics . Web Semantics: Science, Services and Agents on the World Wide Web , 5 ( 1 ) : 5 – 15 .
  • Miller , D. P. 1981 . The depth/breadth tradeoff in hierarchical computer menus . Proceedings of the Human Factors Society , : 296 – 300 .
  • Nardi , B. , Anderson , K. and Erickson , T. 1995 . Filing and finding computer files . Proceedings of the East-West HCI. , : 162 – 179 .
  • Nardi, B., & Barreau, D. (1997). “Finding and reminding” revisited: Appropriate metaphors for file organization at the desktop. SIGCHI Bulletin, 29(1). http://homepages.cwi.nl/~steven/sigchi/bulletin/1997.1/nardi.html (http://homepages.cwi.nl/~steven/sigchi/bulletin/1997.1/nardi.html) (Accessed: July 2011 ).
  • Naumann , F. and Rolker , C. Assessment methods for information quality criteria . Proceedings of 5th International Conference on Information Quality . pp. 148 – 162 .
  • Nielsen, M. (2007). Functionality in a second generation tag cloud (Master thesis). Gjøvik University College http://www.hig.no/content/download/9053/122120/file/Nielsen%20-%20Functionality%20in%20a%20second%20generation%20tag%20cload.pdf (http://www.hig.no/content/download/9053/122120/file/Nielsen%20-%20Functionality%20in%20a%20second%20generation%20tag%20cload.pdf) (Accessed: July 2011 ).
  • Pak , R. , Pautz , S. and Iden , R. 2007 . Information organization and retrieval: A comparison of taxonomical and tagging systems . Cognitive Technology , 12 ( 1 ) : 31 – 44 .
  • Pak , R. , Rogers , W. A. and Fisk , A. D. 2006 . Spatial ability subfactors and their influences on a computer-based information search task . Human Factors , 48 ( 1 ) : 154 – 165 .
  • Pak , R. , Pautz , S. and Iden , R. 2007 . Information organization and retrieval: A comparison of taxonomical and tagging systems . Cognitive Technology , 12 : 31 – 44 .
  • Quan , D. , Bakshi , K. , Huynh , D. and Karger , D. 2003 . “ User interfaces for supporting multiple categorization ” . In Human-computer interaction: INTERACT ‘03 , Edited by: Rauterberg , M. , Menozzi , M. and Wesson , J. 228 – 235 . Amsterdam, , the Netherlands : IOS Press .
  • Rader , E. and Wash , R. Influences on tag choices in del.icio.us . Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work . pp. 239 – 248 .
  • Ravasio , P. , Schär , S. G. and Krueger , H. 2004 . In pursuit of desktop evolution: User problems and practices with modern desktop systems . ACM Transactions on Computer-Human Interaction (TOCHI) , 11 : 156 – 180 .
  • Rivadeneira, A., Gruen, D., Muller, M., & Millen, D. (2007). Getting our head in the clouds: toward evaluation studies of tagclouds. Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 995–998). New York, US: ACM New York http://portal.acm.org/citation.cfm?doid=1240624.1240775 (http://portal.acm.org/citation.cfm?doid=1240624.1240775) (Accessed: July 2011 ).
  • Robertson , G. , Czerwinski , M. , Larson , K. , Robbins , D. C. , Thiel , D. and Van Dantzich , M. Data mountain: Using spatial memory for document management . Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology . pp. 153 – 162 .
  • Rodgers , D. 1961 . A study of inter-indexer consistency , Washington, DC : General Electric Co .
  • Schrammel, J., Leitner, M., & Tscheligi, M. (2009). Semantically structured tag clouds: an empirical evaluation of clustered presentation approaches. Proceedings of the 27th international conference on Human factors in computing systems. New York, US: ACM New York http://portal.acm.org/citation.cfm?id=1519010 (http://portal.acm.org/citation.cfm?id=1519010) (Accessed: July 2011 ).
  • Seagull , F. J. and Walker , N. 1992 . The effects of hierarchical structure and visualization ability on computerized information retrieval . International Journal of Human-Computer Interaction , 4 : 369 – 385 .
  • Sen , S. , Lam , S. K. , Rashid , A. M. , Cosley , D. , Frankowski , D. Osterhouse , J. Tagging, communities, vocabulary, evolution . Proceedings of the 20th Anniversary Conference on Computer Supported Cooperative Work . pp. 181 – 190 .
  • Shirky, C. (2005). Ontology is Overrated: Categories, Links, and Tags. Economics & Culture, Media & Community http://shirky.com/writings/ontology_overrated.html (http://shirky.com/writings/ontology_overrated.html) (Accessed: July 2011 ).
  • Sinha, R. (2005). A cognitive analysis of tagging http://www.rashmisinha.com/archives/05_09/tagging-cognitive.html (http://www.rashmisinha.com/archives/05_09/tagging-cognitive.html) (Accessed: March 2005 ).
  • Snowberry , K. , Pakinson , S. R. and Sisson , N. 1983 . Computer display menus . Ergonomics , 26 : 699 – 712 .
  • Soergel , D. 1994 . Indexing and retrieval performance: The logical evidence . Journal of the American Society for Information Science , 45 : 589 – 599 .
  • Stanney , K. and Salvendy , G. 1995 . Information visualization: Assisting low spatial individuals with information access tasks through the use of visual mediators . Ergonomics , 38 : 1184 – 1198 .
  • Stuart , G. W. , Bossomaier , T. R. J. and Johnson , S. 1993 . Preattentive processing of object size . Implications for theories of size perception. Perception , 22 : 1175 – 1193 .
  • Thom-Santelli , J. and Muller , M. 2007 . The wisdom of my crowd: Motivation and audience in enterprise social tagging , Sanibel Island, FL : Poster presented at GROUP .
  • Toda , H. , Kataoka , R. and Oku , M. 2007 . Search result clustering using informatively named entities . International Journal of Human–Computer Interaction , 23 : 3 – 23 .
  • Tulving , E. 1962 . Subjective organization in free recall of unrelated words . Psychological Review , 69 : 344 – 354 .
  • Veres , C. 2006 . The language of folksonomies: What tags reveal about user classification . Lecture Notes in Computer Science , 3999 : 58 – 69 .
  • Vidulich , M. and Tsang , P. Assessing subjective worload assessment: A comparison of SWAT and the NASA-Bipolar methods . Paper presented at the Human Factors Society 20th Annual Meeting . Santa Monica, CA. September .
  • Wash , R. and Rader , E. Public bookmarks and private benefits: An analysis of incentives in social computing . Proceedings of the 2007 Annual Meeting of American Society for Information Science and Technology . pp. 1 – 13 .
  • Whittaker , S. and Sidner , C. Email overload: Exploring personal information management of email . Proceedings of the 1996 SIGCHI Conference on Human Factors in Computing Systems: Common Ground . pp. 276 – 283 .
  • Wu , X. , Zhang , L. and Yu , Y. Exploring social annotations for the semantic web . Proceedings of the 15th International Conference on World Wide Web . pp. 417 – 426 .
  • Xu, Z., Fu, Y., Mao, J., & Su, D. (2006). Towards the semantic web: Collaboratie tag suggestions. Proceedings of Workshop on Collaborative Web Tagging, Edinburgh, Scotland: http://www.semanticmetadata.net/hosted/taggingws-www2006-files/13.pdf (http://www.semanticmetadata.net/hosted/taggingws-www2006-files/13.pdf) (Accessed: July 2011 ).
  • Zaphiris , P. Depth vs breadth in the arragement of web links . Proceedings of the 44th Annual Meeting of the Human Factors and Ergonomics Society . pp. 139 – 144 .
  • Zeldman, J. (2005, June, 5). Remove forebrain and serve: Tag clouds II http://www.zeldman.com/daily/0505a.shtml (http://www.zeldman.com/daily/0505a.shtml) (Accessed: July 2011 ).

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.