108
Views
18
CrossRef citations to date
0
Altmetric
Original Article

Interactions Between System Evaluation And Theory Testing: A Demonstration of the Power of a Mulitfaceted Approach to Systems Research

, , , , &
Pages 207-235 | Published online: 08 Dec 2014

References

  • McGrath, J.E.; Martin, J.; and Kulka, R.A. Judgment Calls in Research. Beverly Hills, CA: Sage, 1982.
  • Miller, G.R., and Stiff, J.B. Deceptive Communication. Newbury Park, CA: Sage, 1993.
  • Mingers, J. Combining IS research methods: Towards a pluralist methodology. Information Systems Research, 12, 3 (September 2001), 240-259.
  • Mingers, J. The paucity of multimethod research: A review of the information systems literature. Information Systems Journal, 13, 3 (2003), 233-249.
  • Benbasat, I. An analysis of research methodologies. In W.F. McFarlan (ed.), Information Systems Research Challenge. Boston: Harvard Business School Press, 1984, pp. 47-85.
  • Black, T.R. Understanding Social Science Research. London: Sage, 2002.
  • Brooke, J. SUS: A "quick and dirty" usability scale. In P.W. Jordan, B. Thomas, B.A. Weerdmeester, and I.L. McClelland (eds.), Usability Evaluation in Industry. London: Taylor & Francis, 1996, pp. 189-194.
  • Cao, J.; Crews, J.M.; Lin, M.; Burgoon, J.K.; and Nunamaker, J.F., Jr. Can people be trained to better detect deception? Instructor-led vs. Web-based training. In D. Galletta and J. Ross (eds.), The Ninth Americas Conference on Information Systems. Atlanta: Association for Information Systems, 2003, pp. 599-607 (available at aisel.isworld.org/Publications/AMCIS/ 2003/03CA01.pdf).
  • Cao, J.; Crews, J.M.; Lin, M.; Burgoon, J.K.; and Nunamaker, J.F., Jr. Designing Agent99 Trainer: A learner-centered, Web-based training system for deception detection. In H. Chen, R. Miranda, D.D. Zeng, C. Demchak, J. Schroeder, and T. Madhusudan (eds.), The First NSF/NIJ Symposium on Intelligence and Security Informatics. Berlin and Heidelberg: Springer-Verlag, 2003, pp. 358-365.
  • Cao, J.; Crews, J.M.; Nunamaker, J.F., Jr.; Burgoon, J.K.; and Lin, M. User experience with Agent99 Trainer: A usability study. In R.H. Sprague Jr. (ed.), Proceedings of the Thirty-Seventh Annual Hawaii International Conference on System Sciences. Los Alamitos, CA: IEEE Computer Society Press, 2004, (available at csdl.computer.org/comp/proceedings/hicss/2004/ 2056/01/205610040babs.htm).
  • Cao, J.; Lin, M.; Deokar, A.; Burgoon, J.K.; Crews, J.M.; and Adkins, M. Computer-based training for deception detection: What users want. In H. Chen, R. Moore, D.D. Zeng, and J. Leavitt (eds.), The Second Symposium on Intelligence and Security Informatics. Berlin and Heidelberg: Springer-Verlag, 2004, pp. 163-175.
  • Davis, F.D. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13, 3 (1989), pp. 319-340.
  • Frank, M.G., and Feeley, T.H. To catch a liar: Challenges for research in lie detection training. Journal of Applied Communication Research, 31, 1 (February 2003), 58-75.
  • Galliers, R.D., and Land, F.F. Choosing appropriate information systems research methodologies. Communications of the ACM, 30, 11 (November 1987), 900-902.
  • George, J.F.; Biros, D.P.; Adkins, M.; Burgoon, J.K.; and Nunamaker, J.F., Jr. Testing various modes of computer-based training for deception detection. In H. Chen, R. Moore, D.D. Zeng, and J. Leavitt (eds.), The Second Symposium on Intelligence and Security Informatics. Berlin and Heidelberg: Springer-Verlag, 2004, pp. 411-417.
  • George, J.F.; Marett, K.; Burgoon, J.K.; Crews, J.M.; Cao, J.; Lin, M.; and Biros, D.P. Training to detect deception: An experimental investigation. In R.H. Sprague Jr. (ed.), Proceedings of the Thirty-Seventh Annual Hawaii International Conference on System Sciences. Los Alamitos, CA: IEEE Computer Society Press, 2004 (available at csdl.computer.org/comp/ proceedings/hicss/2004/2056/01/205610023aabs.htm).
  • George, J.F.; Biros, D.P.; Burgoon, J.K.; Nunamaker, J.F., Jr.; Lin, M.; Adkins, M.; Kruse, J.; Cao, J.; Marett, K.; and Crews, J.M. An experimental investigation of e-learning. Working Paper Series UNR001-2005, University of Nevada, Reno, 2005.
  • Hevner, A.R., and March, S.T. The information systems research cycle. IEEE Computer, 36, 11 (2003), 111-113.
  • Hevner, A.R.; March, S.T.; Park, J.; and Ram, S. Design science in information systems research. MIS Quarterly, 28, 1 (2004), 75-105.
  • Hirschheim, R. Information systems epistemology: An historical perspective. In R. Galliers (ed.), Information Systems Research: Issues, Methods and Practical Guidelines. Oxford: Blackwell Scientific, 1992, pp. 28-60.
  • Hirschheim, R., and Klein, H.K. Crisis in the IS field? A critical reflection on the state of the discipline. Journal of the AIS, 4, 5 (October 2003), 237-293.
  • Kaplan, B., and Duchon, D. Combining qualitative and quantitative methods in information systems research: A case study. MIS Quarterly, 12, 4 (December 1988), 570-586.
  • Keen, P. MIS research: Current status, trends and needs. In R. Buckingham, R. Hirschheim, F. Land, and C. Tully (eds.), Information Systems Education: Recommendations and Implementation. Cambridge: Cambridge University Press, 1987, pp. 1-13.
  • Lee, A.S. Integrating positivist and interpretive approaches to organizational research. Organization Science, 2, 4 (November 1991), 342-365.
  • Lewis, J. IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction, 7, 1 (1995), 57-78.
  • Lin, M.; Crews, J.M.; Cao, J.; Nunamaker, J.F., Jr.; and Burgoon, J.K. Agent99 Trainer: Designing a Web-based multimedia training system for deception detection knowledge transfer. In D. Galletta and J. Ross (eds.), The Ninth Americas Conference on Information Systems. Atlanta: Association for Information Systems, 2003, pp. 2564-2572 (available at aisel.isworld .org/Publications/AMCIS/2003/03HE12.pdf)
  • March, S.T., and Smith, G.F. Design and natural science research on information technology. Decision Support Systems, 15, 4 (1995), 251-266.
  • Markus, L.M. Electronic mail as the medium of managerial choice. Organization Science, 5, 4 (November 1994), 502-527.
  • Moore, G.C., and Benbasat, I. Development of an instrument to measure the perceptions of adopting an information technology innovation. Information Systems Research, 2, 3 (1991), 173-191.
  • Nandhakumar, J., and Jones, M. Too close for comfort? Distance and engagement in interpretive information systems research. Information Systems Journal, 7, 2 (1997), 109-131.
  • Nielsen, J. Usability Engineering. Boston: Academic Press, 1993.
  • Nunamaker, J.F., Jr. Build and learn, evaluate and learn. Informatica, 1, 1 (1992), 1-6.
  • Nunamaker, J.F., Jr.; Chen, M.; and Purdin, T.D.M. Systems development in information systems research. Journal of Management Information Systems, 7, 3 (Winter 1990-1991), 89- 106.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.