Applying the Geoscience Education Research Strength of Evidence Pyramid: Developing a Rubric to Characterize Existing Geoscience Teaching Assistant Training Studies

REFERENCES

• American Association for the Advancement of Science (AAAS) . 1990. Science for all Americans. New York: Oxford University Press.
   Google Scholar
• Andrews, T.M., Leonard, M.J., Colgrove, C.A., and Kalinowski, S.T. 2011. Active learning not associated with student learning in a random sample of college biology courses. CBE-Life Sciences Education , 10 (4):394–405.
   Google Scholar
• Bass, R. 1999. The scholarship of teaching: What's the problem? Inventio: Creative Thinking About Learning and Teaching , 1 (1):1–10.
   Google Scholar
• Bautista, N.U., Schussler, E.E., and Rybczynski, S.M. 2014. Instructional experiences of graduate assistants implementing explicit and reflective introductory biology laboratories. International Journal of Science Education , 36 (7):1184–1209.
   Google Scholar
• Bandura, A. 1997. Self-efficacy: The exercise of control . New York: Freeman and Company.
   Google Scholar
• Black, B., and Bonwell, C. 1991. The training of teaching assistants in departments of history. History Teacher , 24 (4):435–444.
   Google Scholar
• Bond-Robinson, J., and Rodriques, R.A.B. 2006. Catalyzing graduate teaching assistants' laboratory teaching through design research. Journal of Chemical Education , 83 (2):313.
   Google Scholar
• Brownell, S.E., and Tanner, K.D. 2012. Barriers to faculty pedagogical change: lack of training, time, incentives, and… tensions with professional identity? CBE-Life Sciences Education , 11 (4):339–346.
   Google Scholar
• Budd, D.A., van der Hoeven Kraft, K.J., McConnell, D.A., and Vislova, T. 2013. Characterizing teaching in introductory geology courses: Measuring classroom practices. Journal of Geoscience Education , 61 (4):461–475.
   Google Scholar
• Buskist, W. 2013. Preparing the new psychology professoriate to teach past, present, and future. Teaching of Psychology , 40 (4):333–339.
   Google Scholar
• Cohen, J. 1968. Weighted kappa: Nominal scale agreement with provisions for scaled disagreement or partial credit. Psychological Bulletin , 70 (4):213–220.
   PubMed Web of Science ®Google Scholar
• Cronbach, L.J. 1951 Coefficient alpha and the internal structure of tests, Psychometrika , 16 (3):297–333.
   Web of Science ®Google Scholar
• Dancy, M., and Henderson, C. 2010. Pedagogical practices and instructional change of physics faculty. American Journal of Physics , 78 (10):1056–1063.
   Google Scholar
• DeChenne, S.E., Enochs, L.G., and Needham, M. 2012. Science, technology, engineering, and mathematics graduate teaching assistants teaching self-efficacy. Journal of the Scholarship of Teaching and Learning , 12 (4):102–123.
   Google Scholar
• Dembo, M.H., and Gibson, S. 1985. Teachers' sense of efficacy: An important factor in school improvement. The Elementary School Journal , 86 (2):173–184.
   Web of Science ®Google Scholar
• Dotger, S. 2010. Offering more than “Here is the textbook”: Teaching assistants' perspectives on introductory science courses. Journal of College Science Teaching , 39 (3):71–76.
   Google Scholar
• Dotger, S. 2011. Exploring and developing graduate teaching assistants' pedagogies via lesson study. Teaching in Higher Education , 16 (2):157–169.
   Google Scholar
• Druger, M. 1997. Preparing the next generation of college science teachers: Offering pedagogical training to graduate teaching assistants as part of the college reform agenda. Journal of College Science Teaching , 26 (6):424–427.
   Google Scholar
• Ebert-May, D., Derting, T.L., Henkel, T.P., Middlemis Maher, J., Momsen, J.L., Arnold, B., and Passmore, H.A. 2015. Breaking the cycle: Future faculty begin teaching with learner-centered strategies after professional development. CBE–Life Sciences Education , 14 (2):1–12.
   Google Scholar
• Gibson, S., and Dembo, M.H. 1984. Teacher efficacy: A construct validation. Journal of Educational Psychology , 76 (4):569.
   Web of Science ®Google Scholar
• Gormally, C., Brickman, P., Hallar, B., and Armstrong, N. 2009. Effects of inquiry-based learning on students' science literacy skills and confidence. International Journal for the Scholarship of Teaching and Learning , 3(2):article 16, p. 24.
   Google Scholar
• Halpern, D.F., and Hakel, M.D. 2002. Learning that lasts a lifetime: Teaching for long term retention and transfer. New Directions for Teaching and Learning , 2002 (89):3–7.
   Google Scholar
• Hammrich, P.L. 1996. An example of a discipline-specific instructional program for graduate teaching assistants. Journal Graduate Teaching Assistant Development , 3 (2):53–57.
   Google Scholar
• Hardré, P. L. 2003. The effects of instructional training on university teaching assistants. Performance Improvement Quarterly , 16 (4):23–39.
   Google Scholar
• Hardré P. L. Chen C.H. 2005. A case study analysis of the role of instructional design in the development of teaching expertise. Performance Improvement Quarterly , 18 (1):34–58.
   Google Scholar
• Henderson, C., Beach, A., and Finkelstein, N. 2011. Facilitating change in undergraduate STEM instructional practices: An analytic review of the literature. Journal of Research in Science Teaching , 48 (8):952–984.
   Google Scholar
• Henderson, C., and Dancy, M.H. 2007. Barriers to the use of research-based instructional strategies: The influence of both individual and situational characteristics. Physical Review Special Topics–Physics Education Research , 3 (2):020102.
   Google Scholar
• Heppner, M.J. 1994. An empirical investigation of the effects of a teaching practicum on prospective faculty. Journal of Counseling and Development , 72 (5):500–507.
   Google Scholar
• Holmes, N.G., Ives, J., and Warren, M. 2013. Teaching assistant professional development by and for TAs. The Physics Teacher , 51 218–219.
   Web of Science ®Google Scholar
• Hughes, P.W., and Ellefson, M.R. 2013. Inquiry-based training improves teaching effectiveness of biology teaching assistants. PloS One , 8 (10):e78540.
   Google Scholar
• Kane, R., Sandretto, S., and Heath, C. 2002. Telling half the story: A critical review of research on the teaching beliefs and practices of university academics. Review of Educational Research , 72 (2):177–228.
   Web of Science ®Google Scholar
• Kendall, K.D., Niemiller, M.L., Dittrich-Reed, D., Chick, L.D., Wilmoth, L., Milt, A., Burt, M., Lopes, N., Cantwell, L., Rubio, L., Allison, A. and Schussler, E.E.. 2013. Departments can develop teaching identities of graduate students. CBE–Life Sciences Education , 12 (3):316–317.
   Google Scholar
• Kendall, K.D., and Schussler, E.E. 2012. Does instructor type matter? Undergraduate student perception of graduate teaching assistants and professors. CBE–Life Sciences Education , 11 (2):187–199.
   Google Scholar
• Komarraju, M. 2008. A social-cognitive approach to training teaching assistants. Teaching of Psychology , 35 (4):327–334.
   Google Scholar
• Krathwohl, D.R. 2002. A revision of Bloom's taxonomy: An overview. Theory into Practice , 41 (4):212–218.
   Web of Science ®Google Scholar
• Krystyniak, R.A., and Heikkinen, H.W. 2007. Analysis of verbal interactions during an extended, open inquiry general chemistry laboratory investigation. Journal of Research in Science Teaching , 44 (8):1160–1186.
   Google Scholar
• Kurdziel, J.P., and Libarkin, J.C. 2003. Research methodologies in science education: Training graduate teaching assistants to teach. Journal of Geoscience Education , 51 (3):347.
   Google Scholar
• Linenberger, K., Slade, M.C., Addis, E.A., Elliott, E.R., Mynhardt, G., and Raker, J.R. 2014. Training the foot soldiers of inquiry: Development and evaluation of a graduate teaching assistant learning community. Journal of College Science Teaching , 44 (1):97–107.
   Google Scholar
• Luft, J.A., Kurdziel, J.P., Roehrig, G.H., and Turner, J. 2004. Growing a garden without water: Graduate teaching assistants in introductory science laboratories at a doctoral/research university. Journal of Research in Science Teaching , 41 (3):211–233.
   Google Scholar
• Lund, T.J., Pilarz, M., Velasco, J.B., Chakraverty, D., Rosploch, K., Undersander, M., and Stains, M. 2015. The best of both worlds: Building on the COPUS and RTOP observation protocols to easily and reliably measure various levels of reformed instructional practice. CBE–Life Sciences Education , 14(2):article 18, p. 12.
   Google Scholar
• Macdonald H., Feig, A., Lukes, L., McNeal, K., Riggs, E., St. John, K. 2015. Synthesizing geoscience education research: Where are we? What is the path forward? Available at: http://serc.carleton.edu/earth_rendezvous/2015/morning_workshops/w3/index.html (accessed 10 October 2016).
   Google Scholar
• Manduca, C.A., Iverson, E.R., Luxenberg, M., Macdonald, R.H., McConnell, D.A., Mogk, D.W., and Tewksbury, B.J. 2017. Improving undergraduate STEM education: The efficacy of discipline-based professional development. Science Advances , 3 (2):e1600193.
   Web of Science ®Google Scholar
• Marsh, H.W. 1982. SEEQ: A reliable, valid, and useful instrument for collecting students; evaluations of university teaching. British Journal of Educational Psychology , 52 (1):77–95.
   Google Scholar
• McManus, D.A. 2002. Developing a teaching assistant preparation program in the School of Oceanography, University of Washington. Journal of Geoscience Education , 50 (2):158–168.
   Google Scholar
• National Research Council (NRC). 1996. National Science Education Standards. Washington, D.C.: National Academy Press.
   Google Scholar
• National Research Council (NRC) . 2000. Inquiry and the national science education standards. Washington DC: National Academies Press.
   Google Scholar
• National Research Council (NRC) . 2012. Discipline based education research: Understanding and improving learning in undergraduate science. Washington DC: National Academies Press.
   Google Scholar
• Oleson, A., and Hora, M.T. 2014. Teaching the way they were taught? Revisiting the sources of teaching knowledge and the role of prior experience in shaping faculty teaching practices. Higher Education , 68 (1):29–45.
   Google Scholar
• Nurrenbern, S.C., Mickiewicz, J.A., and Francisco, J.S. 1999. The impact of continuous instructional development on graduate and undergraduate students. Journal of Chemical Education , 76 (1):114–119.
   Google Scholar
• O'Neal, C., Wright, M., Cook, C., Perorazio, T., and Purkiss, J. 2007. The impact of teaching assistants on student retention in the sciences: Lessons for TA training. Journal of College Science Teaching , 36 (5):24–29.
   Google Scholar
• Rushin, J.W., De Saix, J., Lumsden, A., Streubel, D.P., Summers, G., and Bernson, C. 1997. Graduate teaching assistant training: A basis for improvement of college biology teaching and faculty development? The American Biology Teacher , 59 (2):86–90.
   Web of Science ®Google Scholar
• Ryker, K., and McConnell, D. 2014. Can graduate teaching assistants teach inquiry-based geology labs effectively? Journal of College Science Teaching , 44 (1):56–63.
   Google Scholar
• Ryker, K.D., and McConnell, D.A. 2017. Assessing inquiry in physical geology laboratory manuals. Journal of Geoscience Education , 65 (1):35–47.
   Google Scholar
• Sandi-Urena, S., and Gatlin, T. 2013. Factors contributing to the development of graduate teaching assistant self-image. Journal of Chemical Education , 90 (10):1303–1309.
   Google Scholar
• Schade, W. R., and Bartholomew, R. B. 1980. Analysis of geology teaching assistant reaction to a training program utilizing video-taped teaching episodes. Journal of Geological Education , 28 (2):96–102.
   Google Scholar
• Schussler, E.E., Read, Q., Marbach-Ad, G., Miller, K., and Ferzli, M. 2015. Preparing biology graduate teaching assistants for their roles as instructors: An assessment of institutional approaches. CBE–Life Sciences Education , 14(3):article 31, p. 11.
   Google Scholar
• Singer, S.R., Nielsen, N.R., and Schweingruber, H.A. 2012. Discipline based education research. Washington, DC: The National Academies.
   Google Scholar
• St. John, K., and McNeal, K. 2017. The strength of evidence pyramid: One approach for characterizing the strength of evidence of Geoscience Education Research (GER) community claims. Journal of Geoscience Education , 65 (4):363–372.
   Google Scholar
• Sundber, M.D., Armstrong, J.E., and Wischusen, E.W. 2005. A reappraisal of the status of introductory biology laboratory education in U.S. colleges and universities. The American Biology Teacher , 67 (9):526–529.
   Google Scholar
• Thornburg, N.A., Wood, F.E., and Davis, W.E. 2000. Keeping established teaching assistant training programs vital: What does it take? The Journal of Graduate Teaching Assistant Development , 7 (2):77–83.
   Google Scholar
• Travers, P.L., 1989. Better training for teaching assistants. College Teaching , 37:147–149.
   Google Scholar
• Turpen, C., and Finkelstein, N. D. 2009. Not all interactive engagement is the same: Variations in physics professors' implementation of peer instruction. Physical Review Special Topics–Physics Education Research , 5 (2):020101.
   Google Scholar
• White, P.J., Syncox, D., Heppleston, A., Isaac, S., and Alters, B. 2012. Putting research into practice: Pedagogy development workshops change the teaching philosophy of graduate students. The Canadian Journal of Higher Education , 42 (1):98–111.
   Google Scholar
• Wood, W.B. 2009. Innovations in teaching undergraduate biology and why we need them. Annual Review of Cell and Developmental Biology , 25:93–112
   PubMed Web of Science ®Google Scholar
• Yerrick, R., Parke, H., and Nugent, J. 1997. Struggling to promote deeply rooted change: The “filtering effect” of teachers' beliefs on understanding transformational views of teaching science. Science Education , 81 (2):137–159.
   Web of Science ®Google Scholar