745
Views
14
CrossRef citations to date
0
Altmetric
Articles

A foundational observation method for studying design situations

, , &
Pages 187-219 | Received 17 Jan 2012, Accepted 14 Feb 2015, Published online: 23 Mar 2015

References

  • Adair, J. G. 1984. “The Hawthorne Effect: A Reconsideration of the Methodological Artifact.” Journal of Applied Psychology 69 (2): 334–345. doi: 10.1037/0021-9010.69.2.334
  • Adelman, L. 1991. “Experiments, Quasi-Experiments, and Case Studies: A Review of Empirical Methods for Evaluating Decision Support Systems.” IEEE Transactions on Systems, Man, and Cybernetics 21 (2): 293–301. doi: 10.1109/21.87078
  • Adler, N. E., and J. M. Ostrove. 2006. “Socioeconomic Status and Health: What We Know and What We Don't.” Annals of the New York Academy of Sciences 896 (1): 3–15. doi: 10.1111/j.1749-6632.1999.tb08101.x
  • Austin, S., J. Steele, S. Macmillan, P. Kirby, and R. Spence. 2001. “Mapping the Conceptual Design Activity of Interdisciplinary Teams.” Design Studies 22 (3): 211–232. doi: 10.1016/S0142-694X(00)00026-0
  • Ball, L. J., and T. C. Ormerod. 2000. “Putting Ethnography to Work: The Case for a Cognitive Ethnography of Design.” International Journal of Human-Computer Studies 53 (1): 147–168. doi: 10.1006/ijhc.2000.0372
  • Balogun, J. 2006. “Managing Change: Steering a Course between Intended Strategies and Unanticipated Outcomes.” Long Range Planning 39 (1): 29–49. doi: 10.1016/j.lrp.2005.02.010
  • Barnes, B. R. 2010. “The Hawthorne Effect in Community Trials in Developing Countries.” International Journal of Social Research Methodology 13 (4): 357–370. doi: 10.1080/13645570903269096
  • Bedny, G. Z., and S. R. Harris. 2005. “The Systemic-Structural Theory of Activity: Applications to the Study of Human Work.” Mind, Culture, and Activity 12 (2): 128–147. doi: 10.1207/s15327884mca1202_4
  • Bergstrom, M., A. Ericson, M. Larsson, H. Nergard, T. Larsson, and B. Renstrom. 2008. “Needs as a Basis for Design Rationale.” Proceedings DESIGN 2008, the 10th international design conference, Dubrovnik, Croatia, May 19–22.
  • Blandford, A., and S. Attfield. 2010. “Interacting with Information.” Synthesis Lectures on Human-Centered Informatics 3 (1): 1–99. doi: 10.2200/S00227ED1V01Y200911HCI006
  • Blessing, L. T. M., and A. Chakrabarti. 2009. DRM, a Design Research Methodology. New York: Springer.
  • Blessing, L. T. M., A. Chakrabarti, and K. M. Wallace. 1998. “An Overview of Descriptive Studies in Relation to a General Design Research Methodology.” In Designers – The Key to Successful Product Development, edited by E. Frankenberger, 42–56. Berlin: Springer-Verlag.
  • Bolton, G. E., and A. Ockenfels. 2014. “Does Laboratory Trading Mirror Behaviour in Real World Markets?: Fair Bargaining and Competitive Bidding on EBay.” Journal of Economic Behavior and Organisation 97: 143–154. doi: 10.1016/j.jebo.2013.11.003
  • Brennan, L., S. Castro, R. C. Brownson, J. Claus, and C. T. Orleans. 2011. “Accelerating Evidence Reviews and Broadening Evidence Standards to Identify Effective, Promising, and Emerging Policy and Environmental Strategies for Prevention of Childhood Obesity.” Annual Review of Public Health 32: 199–223. doi: 10.1146/annurev-publhealth-031210-101206
  • Briggs, R. O. 2006. “On Theory-Driven Design and Deployment of Collaboration Systems.” International Journal of Human-Computer Studies 64 (7): 573–582. doi: 10.1016/j.ijhcs.2006.02.003
  • Carrizosa, K., and S. Sheppard. 2000. “The Importance of Learning Styles in Group Design Work.” Frontiers in education conference, 2000, FIE 2000, 30th Annual, 1:T2B/12–T2B/17 vol. 1, October 18–21.
  • Cash, P. 2012. Characterising the Relationship between Practice and Laboratory-based Studies of Designers for Critical Design Situations. Bath: University of Bath, Dept. of Mechanical Engineering.
  • Cash, P., B. J. Hicks, and S. J. Culley. 2010. “An Information Requirement Strategy for Capturing and Analysing Design Activity and Behaviour.” Design 2010 international design conference, Dubrovnik, May 17–20.
  • Cash, P., B. J. Hicks, and S. J. Culley. 2013. “A Comparison of Designer Activity Using Core Design Situations in the Laboratory and Practice.” Design Studies 34 (5): 575–611. doi: 10.1016/j.destud.2013.03.002
  • Cash, P., B. J. Hicks, S. J. Culley, and F. Salustri. 2011. “Designer Behaviour and Activity: An Industrial Observation Method.” ICED 11 international conference on engineering design, Copenhagen, August 15–19.
  • Cave, P. R., and C. E. I. Noble. 1986. “Engineering Design Data Management.” 1st international conference on engineering management, theory and applications, Swansea, September 15–19.
  • Chenouard, R., P. Sebastian, and L. Granvilliers. 2007. “Solving an Air Conditioning System Problem in an Embodiment Design Context Using Constraint Satisfaction Techniques.” In Principles and Practice of Constraint Programming CP 2007: 13th International Conference, CP 2007, Providence, RI, USA, September 25–29, edited by Christian Bessiere, 18–32. Berlin: Springer.
  • Cook, D. L. 1962. “The Hawthorne Effect in Educational Research.” The Phi Delta Kappan 44 (3): 116–122.
  • Cooper, R. G., S. J. Edgett, and E. J. Kleinschmidt. 2002. “Optimizing the Stage-Gate Process: What Best-Practice Companies Do.” Research-Technology Management 45 (5): 21–27.
  • Cross, N. 2007. “Forty Years of Design Research.” Design Studies 28 (1): 1–4. doi: 10.1016/j.destud.2006.11.004
  • Cunningham, S. J. 2005. “Autoethnography: A Tool for Practice and Education.” 6th ACM SIGCHI international conference on computer-human interaction making CHI natural – CHINZ 05, 1, New Zealand, June 14–16.
  • D'Astous, P., F. Detienne, W. Visser, and P. N. Robillard. 2004. “Changing Our View on Design Evaluation Meetings Methodology: A Study of Software Technical Review Meetings.” Design Studies 25 (6): 625–655. doi: 10.1016/j.destud.2003.12.002
  • Devereaux, P. J., and S. Yusuf. 2003. “The Evolution of the Randomized Controlled Trial and Its Role in Evidence-based Decision Making.” Journal of Internal Medicine 254 (2): 105–113. doi: 10.1046/j.1365-2796.2003.01201.x
  • Diaper, G. 1990. “The Hawthorne Effect: A Fresh Examination.” Educational Studies; Dorchester-on-Thames 16 (3): 261–267. doi: 10.1080/0305569900160305
  • Dow, D., and S. Ferencikova. 2010. “More than Just National Cultural Distance: Testing New Distance Scales on FDI in Slovakia.” International Business Review 19 (1): 46–58. doi: 10.1016/j.ibusrev.2009.11.001
  • Dyba, T., and T. Dingsoyr. 2008. “Empirical Studies of Agile Software Development: A Systematic Review.” Information and Software Technology 50 (9–10): 833–859. doi: 10.1016/j.infsof.2008.01.006
  • Eisenhardt, K. M. 1989. “Building Theories from Case Study Research.” Academy of Management Review 14 (4): 532–550.
  • Falk, A., and J. Heckman. 2009. “Lab Experiments are a Major Source of Knowledge in the Social Sciences.” Science 326 (5952): 535–538. doi: 10.1126/science.1168244
  • Finger, S., and J. R. Dixon. 1989a. “A Review of Research in Mechanical Engineering Design. Part I: Descriptive, Prescriptive, and Computer-Based Models of Design Processes.” Research in Engineering Design 1 (1): 51–67. doi: 10.1007/BF01580003
  • Finger, S., and J. R. Dixon. 1989b. “A Review of Research in Mechanical Engineering Design. Part II: Representations, Analysis, and Design for the Life Cycle.” Research in Engineering Design 1 (2): 121–137. doi: 10.1007/BF01580205
  • Flay, B. R., A. Biglan, R. F. Boruch, F. G. Castro, D. Gottfredson, S. Kellam, E. K. Moscicki, S. Schinke, J. C. Valentine, and P. Ji. 2005. “Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination.” Prevention Science 6 (3): 151–175. doi: 10.1007/s11121-005-5553-y
  • Gallivan, M., and M. Srite. 2005. “Information Technology and Culture: Identifying Fragmentary and Holistic Perspectives of Culture.” Information and Organization 15 (4): 295–338. doi: 10.1016/j.infoandorg.2005.02.005
  • Glasgow, R. E., and K. M. Emmons. 2007. “How can We Increase Translation of Research into Practice? Types of Evidence Needed.” Annual Review of Public Health 28 (1): 413–433. doi: 10.1146/annurev.publhealth.28.021406.144145
  • Gorard, S., and T. D. Cook. 2007. “Where Does Good Evidence Come From?” International Journal of Research & Method in Education 30 (3): 307–323. doi: 10.1080/17437270701614790
  • Guzzo, R. A., and M. W. Dickson. 1996. “Teams in Organizations: Recent Research on Performance and Effectiveness.” Annual Review of Psychology 47 (1): 307–338. doi: 10.1146/annurev.psych.47.1.307
  • Haas, R. E., F. Weber, and K. S. Panwar. 2000. “Engineering Knowledge Management – Current Status and Future Challenges.” ICE 2000 international conference on concurrent enterprising, Toulouse, France, June 27–29.
  • Hagedorn, J., J. Hailpern, and K. G. Karahalios. 2008. “VCode and VData: Illustrating a New Framework for Supporting the Video Annotation Workflow.” Conference on advanced visual interfaces, 317–321. New York: ACM, May 28–30.
  • Hales, C. 1987. Analysis of the Engineering Design Process in an Industrial Context. Cambridge: University of Cambridge, Department of Engineering.
  • Hicks, B. J., S. J. Culley, R. D. Allen, and G. Mullineux. 2002. “A Framework for the Requirements of Capturing, Storing and Reusing Information and Knowledge in Engineering Design.” International Journal of Information Management 22 (4): 263–280. doi: 10.1016/S0268-4012(02)00012-9
  • Hofstede, G., G. J. Hofstede, and M. Minkov. 2010. Cultures and Organizations: Software of the Mind, Revised and Expanded. 3rd ed, 3 vols. New York: McGraw-Hill.
  • Holden, J. D. 2001. “Hawthorne Effects and Research into Professional Practice.” Journal of Evaluation in Clinical Practice 7 (1): 65–70. doi: 10.1046/j.1365-2753.2001.00280.x
  • Horvath, I. 2004. “A Treatise on Order in Engineering Design Research.” Research in Engineering Design 15 (3): 155–181. doi: 10.1007/s00163-004-0052-x
  • Howard, T. J. 2008. Information Management for Creative Stimuli in Engineering Design. University of Bath, Department of Mechanical Engineering.
  • Howard, T. J., S. J. Culley, and E. Dekoninck. 2010. “Reuse of Ideas and Concepts for Creative Stimuli in Engineering Design.” Journal of Engineering Design 22 (8): 565–581. doi: 10.1080/09544821003598573
  • Huet, G., S. J. Culley, C. McMahon, and C. Fortin. 2007. “Making Sense of Engineering Design Review Activities.” Artificial Intelligence for Engineering Design, Analysis and Manufacturing: AI EDAM 21 (3): 243–266. doi: 10.1017/S0890060407000261
  • Huet, G., C. McMahon, F. Sellini, S. J. Culley, and C. Fortin. 2007. “Knowledge Loss in Design Reviews.” In Advances in Integrated Design and Manufacturing in Mechanical Engineering II, edited by S. Tichkiewitch, M. Tollenaere, and P. Ray, 277–291. Dordrecht: Springer.
  • Jakesch, M., M. Zachhuber, H. Leder, M. Spingler, and C. C. Carbon. 2011. “Scenario-based Touching: On the Influence of Top-down Processes on Tactile and Visual Appreciation.” Research in Engineering Design 22 (3): 1–10. doi: 10.1007/s00163-010-0102-5
  • Janssen, O., E. Van de Vliert, and M. West. 2004. “The Bright and Dark Sides of Individual and Group Innovation: A Special Issue Introduction.” Journal of Organizational Behavior 25 (2): 129–145. doi: 10.1002/job.242
  • Kazdin, A. E. 1998. Research Design in Clinical Psychology. Needham Heights, MA: Allyn & Bacon.
  • Kim, M. J., and M. L. Maher. 2008. “The Impact of Tangible User Interfaces on Spatial Cognition during Collaborative Design.” Design Studies 29 (3): 222–253. doi: 10.1016/j.destud.2007.12.006
  • King, D. W., J. Casto, and H. Jones. 1994. Communication by Engineers: A Literature Review of Engineers' Information Needs, Seeking Processes, and Use. Washington, DC: Council on Library Resources.
  • Kitchenham, B. A. 1996. “Evaluating Software Engineering Methods and Tool Part 1: The Evaluation Context and Evaluation Methods.” ACM SIGSOFT Software Engineering Notes 21 (1): 11–14. doi: 10.1145/381790.381795
  • Kitchenham, B. A., S. L. Pfleeger, L. M. Pickard, P. W. Jones, D. C. Hoaglin, K. El-Emam, and J. Rosenberg. 2002. “Preliminary Guidelines for Empirical Research in Software Engineering.” IEEE Transactions on Software Engineering 28 (8): 721–734. doi: 10.1109/TSE.2002.1027796
  • Klein, H. K., and M. D. Myers. 1999. “A Set of Principles for Conducting and Evaluating Interpretive Field Studies in Information Systems.” MIS Quarterly 23 (1): 67–93. doi: 10.2307/249410
  • Kogut, B., and H. Singh. 1988. “The Effect of National Culture on the Choice of Entry Mode.” Journal of International Business Studies 19 (3): 411–432. doi: 10.1057/palgrave.jibs.8490394
  • Leonard, K., and M. C. Masatu. 2006. “Outpatient Process Quality Evaluation and the Hawthorne Effect.” Social Science & Medicine 63 (9): 2330–2340. doi: 10.1016/j.socscimed.2006.06.003
  • Lethbridge, T. C., S. E. Sim, and J. Singer. 2005. “Studying Software Engineers: Data Collection Techniques for Software Field Studies.” Empirical Software Engineering 10 (3): 311–341. doi: 10.1007/s10664-005-1290-x
  • Levitt, S. D., and J. A. List. 2007. “What Do Laboratory Experiments Measuring Social Preferences Reveal about the Real World?” The Journal of Economic Perspectives 21 (2): 153–174. doi: 10.1257/jep.21.2.153
  • Lewis, M., and J. Moultrie. 2005. “The Organisational Innovation Laboratory.” Creativity and Innovation Management 14 (1): 73–83. doi: 10.1111/j.1467-8691.2005.00327.x
  • LiveScribe. 2011. “LiveScribe: Never Miss a Word.” Accessed October 2011 http://www.livescribe.com/en-us/.
  • Malterud, K. 2001. “Qualitative Research: Standards, Challenges, and Guidelines.” The Lancet 358 (9280): 483–488. doi: 10.1016/S0140-6736(01)05627-6
  • ManicTime. 2011. “ManicTime – Time Management Software [Online].” Accessed October 2011. http://www.manictime.com/.
  • McAlpine, H. 2010. Improving the Management of Informal Engineering Information through Electronic Logbooks. University of Bath, Dept. Mechanical Engineering.
  • McAlpine, H., P. Cash, A. Storton, and S. J. Culley. 2011. “A Technology Selection Process for the Optimal Capture of Design Information.” ICORD 11 international conference on research into design, Bangalore, January 10–12.
  • McAlpine, H., B. J. Hicks, and S. J. Culley. 2009. “Comparing Formal and Informal Documents: Lessons for More Complete Design Records.” ICED 09 international conference on engineering design, Stanford University, Stanford, USA, August 24–27.
  • McAlpine, H., B. J. Hicks, G. Huet, and S. J. Culley. 2006. “An Investigation into the Use and Content of the Engineer's Logbook.” Design Studies 27 (4): 481–504. doi: 10.1016/j.destud.2005.12.001
  • McCandliss, B. D., M. Kalchman, and P. Bryant. 2003. “Design Experiments and Laboratory Approaches to Learning: Steps toward Collaborative Exchange.” Educational Researcher 32 (1): 14–16. doi: 10.3102/0013189X032001014
  • Panopto. 2012. “Panopto”. Panopto Europe Ltd. Accessed February 2012. www.panopto.com
  • Petre, M. 2004. “How Expert Engineering Teams Use Disciplines of Innovation.” Design Studies 25 (5): 477–493. doi: 10.1016/j.destud.2004.05.003
  • Pickett, K. E., and M. Pearl. 2001. “Multilevel Analyses of Neighbourhood Socioeconomic Context and Health Outcomes: A Critical Review.” Journal of Epidemiology and Community Health 55 (2): 111–122. doi: 10.1136/jech.55.2.111
  • Podsakoff, P. M., S. B. MacKenzie, J.-Y. Lee, and N. P. Podsakoff. 2003. “Common Method Biases in Behavioural Research: A Critical Review of the Literature and Recommended Remedies.” Journal of Applied Psychology 88 (5): 879–903. doi: 10.1037/0021-9010.88.5.879
  • Pope, C., and N. Mays. 1995. “Reaching the Parts Other Methods Cannot Reach: An Introduction to Qualitative Methods in Health and Health Services Research.” BMJ British Medical Journal 311 (6996): 42–45. doi: 10.1136/bmj.311.6996.42
  • Prudhomme, G., F. Pourroy, and K. Lund. 2007. “An Empirical Study of Engineering Knowledge Dynamics in a Design Situation.” Journal of Design Research 6 (3): 333–358. doi: 10.1504/JDR.2007.016388
  • Puttre, M. 1991. “Product Data Management.” Mechanical Engineering 113 (10): 81–83.
  • Robinson, M. A. 2010. “An Empirical Analysis of Engineers’ Information Behaviours.” Journal of the American Society for Information Science and Technology 61 (4): 640–658.
  • Robinson, H., J. Segal, and H. Sharp. 2007. “Ethnographically-Informed Empirical Studies of Software Practice.” Information and Software Technology 49 (6): 540–551. doi: 10.1016/j.infsof.2007.02.007
  • Robson, C. 2002. Real World Research. 2nd ed, 2 vols. Chichester: Wiley.
  • Scaravetti, D., and P. Sebastian. 2009. “Design Space Exploration in Embodiment Design: An Application to the Design of Aircraft Air Conditioners.” International Journal of Product Development 9 (1): 292–307. doi: 10.1504/IJPD.2009.026182
  • Schön, D. A. 1984. The Reflective Practitioner: How Professionals Think in Action. New York: Harper Torchbooks.
  • Seale, C. 1999. “Quality in Qualitative Research.” Qualitative Inquiry 5 (4): 465–478. doi: 10.1177/107780049900500402
  • Seale, C., and D. Silverman. 1997. “Ensuring Rigour in Qualitative Research.” European Journal of Public Health 7 (4): 379–384. doi: 10.1093/eurpub/7.4.379
  • Shalley, C. E., and L. L. Gilson. 2004. “What Leaders Need to Know: A Review of Social and Contextual Factors That Can Foster or Hinder Creativity.” The Leadership Quarterly 15 (1): 33–53. doi: 10.1016/j.leaqua.2003.12.004
  • Shavelson, R. J., D. C. Phillips, L. Towne, and M. J. Feuer. 2003. “On the Science of Education Design Studies.” Educational Researcher 32 (1): 25–28. doi: 10.3102/0013189X032001025
  • Shenkar, O. 2001. “Cultural Distance Revisited: Towards a More Rigorous Conceptualization and Measurement of Cultural Differences.” Journal of International Business Studies 32 (3): 519–535. doi: 10.1057/palgrave.jibs.8490982
  • Stewart, G. L. 2006. “A Meta-Analytic Review of Relationships between Team Design Features and Team Performance.” Journal of Management 32 (1): 29–55. doi: 10.1177/0149206305277792
  • Torlind, P., N. Sonalkar, M. Bergstrom, E. Blanco, B. J. Hicks, and H. McAlpine. 2009. “Lessons Learned and Future Challenges for Design Observatory Research.” ICED 09 international conference on engineering design. Stanford, CA, August 24–27.
  • Torlind, P., M. Stenius, M. Johanson, and P. Jeppsson. 1999. “Collaboration Environments for Distributed Engineering Development of a Prototype System.” Computer supported cooperative work in design (CSCWD) 99, Compiègne, France.
  • Veldman, J., and A. Alblas. 2012. “Managing Design Variety, Process Variety and Engineering Change: A Case Study of Two Capital Good Firms.” Research in Engineering Design 23 (4): 269–290. doi: 10.1007/s00163-012-0135-z
  • Visser, W. 2009. “Design: One, but in Different Forms.” Design Studies 30 (3): 187–223. doi: 10.1016/j.destud.2008.11.004
  • Wasiak, J., B. J. Hicks, L. Newnes, A. Dong, and L. Burrow. 2010. “Understanding Engineering Email: The Development of a Taxonomy for Identifying and Classifying Engineering Work.” Research in Engineering Design 21 (1): 43–64. doi: 10.1007/s00163-009-0075-4
  • Wild, P. J., S. J. Culley, C. McMahon, M. Darlington, and S. Liu. 2005. “Starting to Audit Documents in the Engineering Domain.” In In-Use, In-Situ: Extending Field Research Methods, edited by P. Amaldi, S. P. Gill, B. Fields, and W. Wong, 36–40. London: Higher Education Academy Information and Computer Sciences.
  • Wild, P. J., C. McMahon, M. Darlington, S. Liu, and S. J. Culley. 2010. “A Diary Study of Information Needs and Document Usage in the Engineering Domain.” Design Studies 31 (1): 46–73. doi: 10.1016/j.destud.2009.06.002
  • Wildemuth, B. M. 1993. “Post-Positivist Research: Two Examples of Methodological Pluralism.” The Library Quarterly 63 (4): 450–468. doi: 10.1086/602621

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.