References
- Ahmad, T., and Gilmour, S. G. (2010), “Robustness of Subset Response Surface Designs to Missing Observations,” Journal of Statistical Planning and Inference, 140, 92–103. https://www.sciencedirect.com/science/article/abs/pii/S0378375809001955. DOI: 10.1016/j.jspi.2009.06.011.
- Akhtar, M., and Prescott, P. (1986), “Response Surface Designs Robust to Missing Observations,” Communications in Statistics - Simulation and Computation, 15, 345–363. https://www.tandfonline.com/doi/abs/10.1080/03610918608812512. DOI: 10.1080/03610918608812512.
- American Statistical Association. (2014), “Curriculum Guidelines for Undergraduate Programs in Statistical Science,” available at https://www.amstat.org/asa/files/pdfs/EDU-guidelines2014-11-15.pdf.
- Anaconda. (2021), “On the Path to Impact,” 2021 State of Data Science Report, Web Article (last accessed April 14, 2022), https://www.anaconda.com/state-of-data-science-2021.
- Anderson-Cook, C. M. (1998), “Designing a First Experiment: A Project for Design of Experiment Courses,” The American Statistician, 52, 338–342. https://www.tandfonline.com/doi/abs/10.1080/00031305.1998.10480592. DOI: 10.1080/00031305.1998.10480592.
- Anderson-Cook, C. M., and Dorai-Raj, S. (2001), “An Active Learning in-Class Demonstration of Good Experimental Design,” Journal of Statistics Education, 9. DOI: 10.1080/10691898.2001.11910645.
- Anderson-Cook, C. M., and Lu, L. (2023), “Is Designed Data Collection Still Relevant in the Big Data Era?” Quality and Reliability Engineering International, 39, 1085–1101. DOI: 10.1002/qre.3326.
- Andrews, S. (2021), The Case Study Companion: Teaching, Learning and Writing Business Case Studies, Abingdon: Routledge.
- Antony, J. (2014), Design of Experiments for Engineers and Scientists, London: Elsevier.
- Antony, J., and Capon, N. (1998), “Teaching Experimental Design Techniques to Industrial Engineers,” International Journal of Engineering Education, 14, 335–343. https://enbis.org/wp-content/uploads/2018/09/3299_4928249026.pdf.
- Binnie, N. (2004), “Using EDA, ANOVA and Regression to Optimise Some Microbiology Data,” Journal of Statistics Education, 12, 2. DOI: 10.1080/10691898.2004.11910738.
- Blades, N. J., Schaalje, G. B., and Christensen, W. F. (2015), “The Second Course in Statistics: Design and Analysis of Experiments?,” The American Statistician, 69, 326–333. https://www.tandfonline.com/doi/abs/10.1080/00031305.2015.1086437. DOI: 10.1080/00031305.2015.1086437.
- Box, G. E. (1992), “Teaching Engineers Experimental Design with a Paper Helicopter,” Quality Engineering, 4, 453–459. https://www.tandfonline.com/doi/abs/10.1080/08982119208918925.
- Box, G. E., and Draper, N. R. (1987), Empirical Model-Building and Response Surfaces, New York: Wiley.
- Box, G. E., Hunter, J. S., and Hunter, W. G. (2005), “Statistics for Experimenters,” in Wiley Series in Probability and Statistics. Hoboken, NJ: Wiley.
- Bulmer, M. (2003), “Growing Virtual Plants for Teaching and Learning Statistics,” in Proceedings of the Apple University Consortium Academic and Developers Conference, pp. 3-1–3-7. Available at https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=f09b284b8cf5f5e9e73fad981425a9e5c769b77e.
- Bulmer, M. (2012), “Virtual Worlds for Teaching Statistics,” International Journal of Innovation in Science and Mathematics Education, 11. https://openjournals.library.sydney.edu.au/CAL/article/view/6061.
- Bulmer, M., and Haladyn, J. K. (2011), “Life on an Island: A Simulated Population to Support Student Projects in Statistics,” Technology Innovations in Statistics Education, 5. https://escholarship.org/uc/item/2q0740hv. DOI: 10.5070/T551000187.
- Campbell, D. T., and Stanley, J. C. (2015), Experimental and Quasi-Experimental Designs for Research, Ravenio Books.
- Carver, R., Everson, M., Gabrosek, J., Horton, N., Lock, R., Mocko, M., Rossman, A., Roswell, G. H., Velleman, P., Witmer, J., and Wood, B. (2016), “Guidelines for Assessment and Instruction in Statistics Education (GAISE) College Report 2016,” available at https://commons.erau.edu/publication/1083.
- Chance, B., and Peck, R. (2014), “From Curriculum Guidelines to Learning Objectives: A Survey of Five Statistics Programs,” arXiv preprint, https://arxiv.org/abs/1412.7261.
- Darius, P. L., Portier, K. M., and Schrevens, E. (2007), “Virtual Experiments and Their Use in Teaching Experimental Design,” International Statistical Review, 75, 281–294. https://onlinelibrary.wiley.com/doi/10.1111/j.1751-5823.2007.00028.x. DOI: 10.1111/j.1751-5823.2007.00028.x.
- Dasgupta, T., Pillai, N. S., and Rubin, D. B. (2015), “Causal Inference from 2K Factorial Designs by Using Potential Outcomes,” Journal of the Royal Statistical Society Series B: Statistical Methodology, 77, 727–753. https://www.jstor.org/stable/24775307.
- Davies, O. L. (1954), The Design and Analysis of Industrial Experiments, Oliver & Boyd.
- De Ketelaere, B., Siebertz, K., van Bebber, D., and Rutten, K. (2014), “The Garden Sprinkler: An Interactive Web-Based Application for Teaching Design of Experiments,” ICOTS9 Proceedings, https://iase-web.org/icots/9/proceedings/pdfs/ICOTS9_C266_RUTTEN.pdf.
- Dean, A., Voss, D., and Draguljić, D. (2017), Design and Analysis of Experiments (2nd ed.), Cham: Springer.
- Deming, S. N., and Morgan, S. L. (1983), “Teaching the Fundamentals of Experimental Design,” Analytica Chimica Acta, 150, 183–198. https://www.sciencedirect.com/science/article/abs/pii/S0003267000854707. DOI: 10.1016/S0003-2670(00)85470-7.
- Deming, S. N., and Morgan, S. L. (1993), Experimental Design: A Chemometric Approach, Amsterdam: Elsevier.
- Dunn, P. K. (2013), “Comparing the Lifetimes of Two Brands of Batteries,” Journal of Statistics Education, 21. https://www.tandfonline.com/doi/abs/10.1080/10691898.2013.11889666. DOI: 10.1080/10691898.2013.11889666.
- Easterling, R. G. (2004), “Teaching Experimental Design,” The American Statistician, 58, 244–252. https://www.tandfonline.com/doi/abs/10.1198/000313004X1477. DOI: 10.1198/000313004X1477.
- Espinosa, V., Dasgupta, T., and Rubin, D. B. (2016), “A Bayesian Perspective on the Analysis of Unreplicated Factorial Experiments Using Potential Outcomes,” Technometrics, 58, 62–73. https://www.tandfonline.com/doi/abs/10.1080/00401706.2015.1006337. DOI: 10.1080/00401706.2015.1006337.
- Fillebrown, S. (1994), “Using Projects in an Elementary Statistics Course for Non-Science Majors,” Journal of Statistics Education, 2. DOI: 10.1080/10691898.1994.11910470.
- Fisher, R. A. (1971), The Design of Experiments (9th ed.), New York: Hafner Press, MacMillan Publishing Co.
- Garvin, D. A. (2003), “Making the Case,” Harvard Magazine, 106, 56–65. https://sitios.itesm.mx/va/dide2/tecnicas_didacticas/casos/articulod.garvin.pdf.
- Gelman, A., and Vehtari, A. (2021), “What Are the Most Important Statistical Ideas of the past 50 Years?” Journal of the American Statistical Association, 116, 2087–2097. DOI: 10.1080/01621459.2021.1938081.
- Gelman, A., and Loken, E. (2013), “The Garden of Forking Paths: Why Multiple Comparisons Can Be a Problem, Even When There is no ‘Fishing Expedition’ or ‘p-hacking’ and the Research Hypothesis Was Posited Ahead of Time,” working paper, Columbia University, New York, available at http://stat.columbia.edu/∼gelman/research/unpublished/forking.pdf.
- Goh, T. N. (2001), “A Pragmatic Approach to Experimental Design in Industry,” Journal of Applied Statistics, 28, 391–398. https://www.tandfonline.com/doi/abs/10.1080/02664760120034126. DOI: 10.1080/02664760120034126.
- Goos, P., and Jones, B. (2011), Optimal Design of Experiments: A Case Study Approach, Chichester: Wiley.
- Goos, P., and Leemans, H. (2004), “Teaching Optimal Design of Experiments Using a Spreadsheet,” Journal of Statistics Education, 12(3). DOI: 10.1080/10691898.2004.11910631.
- Gramacy, R. B. (2020), “A Shiny Update to an Old Experiment Game,” The American Statistician, 74, 87–92. https://www.tandfonline.com/doi/abs/10.1080/00031305.2018.1505659. DOI: 10.1080/00031305.2018.1505659.
- Gunter, B. H., and Matey, J. R. (1993), “How Statistical Design Concepts Can Improve Experimentation in the Physical Sciences,” Computers in Physics, 7, 262–272. https://aip.scitation.org/doi/pdf/10.1063/1.4823173. DOI: 10.1063/1.4823173.
- Hane, E. N. (2007), “Use of an Inquiry-Based Approach to Teaching Experimental Design Concepts in a General Ecology Course,” Teaching Issues and Experiments in Ecology, 5, 1–19. https://www.esa.org/tiee/vol/v5/research/hane/pdf/Hane_2007.pdf.
- Hanrahan, G., and Lu, K. (2006), “Application of Factorial and Response Surface Methodology in Modern Experimental Design and Optimization,” Critical Reviews in Analytical Chemistry, 36, 141–151. https://www.tandfonline.com/doi/abs/10.1080/10408340600969478. DOI: 10.1080/10408340600969478.
- Hiebert, S. M. (2007), “Teaching Simple Experimental Design to Undergraduates: Do Your Students Understand the Basics?” Advances in Physiology Education, 31, 82–92. https://journals.physiology.org/doi/full/10.1152/advan.00033.2006. DOI: 10.1152/advan.00033.2006.
- Holland, P. W. (1986), “Statistics and Causal Inference,” Journal of the American Statistical Association, 81, 945–960. https://www.tandfonline.com/doi/abs/10.1080/01621459.1986.10478354. DOI: 10.1080/01621459.1986.10478354.
- Horton, N. J. (2015), “Challenges and Opportunities for Statistics and Statistical Education: Looking Back, Looking Forward,” The American Statistician, 69, 138–145. https://www.tandfonline.com/doi/abs/10.1080/00031305.2015.1032435. DOI: 10.1080/00031305.2015.1032435.
- Howley, P. P. (2003), “Teaching How to Calibrate a Process Using Experimental Design and Analysis: The Ballistat,” Journal of Statistics Education, 11. DOI: 10.1080/10691898.2003.11910709.
- Hunter, W. G. (1977), “Some Ideas about Teaching Design of Experiments, with 25 Examples of Experiments Conducted by Students,” The American Statistician, 31, 12–17. https://www.tandfonline.com/doi/abs/10.1080/00031305.1977.10479185. DOI: 10.1080/00031305.1977.10479185.
- Ilzarbe, L., Álvarez, M. J., Viles, E., and Tanco, M. (2008), “Practical Applications of Design of Experiments in the Field of Engineering: A Bibliographical Review,” Quality and Reliability Engineering International, 24, 417–428. https://onlinelibrary.wiley.com/doi/10.1002/qre.909. DOI: 10.1002/qre.909.
- Imhof, L. A., Song, D., and Wong, W. K. (2002), “Optimal Design of Experiments with Possibly Failing Trials,” Statistica Sinica, 12, 1145–1155. https://www.jstor.org/stable/24307020.
- Ioannidis, J. P. (2005), “Why Most Published Research Findings Are False,” PLoS Medicine, 2, e124. https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.0020124. DOI: 10.1371/journal.pmed.0020124.
- Jaeger, R. G., and Halliday, T. R. (1998), “On Confirmatory versus Exploratory Research,” Herpetologica, 54, S64–S66. https://www.jstor.org/stable/3893289.
- Jones, B., and Nachtsheim, C. J. (2011), “A Class of Three-Level Designs for Definitive Screening in the Presence of Second-Order Effects,” Journal of Quality Technology, 43, 1–15. https://www.tandfonline.com/doi/abs/10.1080/00224065.2011.11917841. DOI: 10.1080/00224065.2011.11917841.
- Jones-Farmer, L. A. (2019), “Leveraging Industrial Statistics in the Data Revolution: The Youden Memorial Address at the 63rd Annual Fall Technical Conference,” Quality Engineering, 31, 205–211. https://www.tandfonline.com/doi/abs/10.1080/08982112.2019.1572187. DOI: 10.1080/08982112.2019.1572187.
- Kenett, R. S., and Steinberg, D. M. (1987), “Some Experiences Teaching Factorial Design in Introductory Statistics Courses,” Journal of Applied Statistics, 14, 219–227. https://www.tandfonline.com/doi/abs/10.1080/02664768700000027. DOI: 10.1080/02664768700000027.
- Kohavi, R., Tang, D., and Xu, Y. (2020), Trustworthy Online Controlled Experiments: A Practical Guide to a/B Testing, Cambridge: Cambridge University Press.
- Kohavi, R., and Thomke, S. (2017), “The Surprising Power of Online Experiments,” Harvard Business Review, 95, 74–82. http://davidfrico.com/kohavi17.pdf.
- Kreutz, C., and Timmer, J. (2009), “Systems Biology: Experimental Design,” The FEBS Journal, 276, 923–942. https://febs.onlinelibrary.wiley.com/doi/full/10.1111/j.1742-4658.2008.06843.x. DOI: 10.1111/j.1742-4658.2008.06843.x.
- Kuehl, R. O. (2000), Design of Experiments: Statistical Principles of Research Design and Analysis, Pacific Grove, CA: Duxbury Press.
- Kuhnt, S., and Coleman, S. (2020), “Hands-On Projects for Teaching DoE” [Conference Presentation], ENBIS-20 Online, available for ENBIS Members at https://enbis.org/media-centre/sonja-kuhnt-shirley-coleman-hands-on-projects-for-teaching-doe/.
- Kuhnt, S., and Coleman, S. (2021), “Hands-On Projects for Teaching DoE” [Conference presentation], ENBIS-21 Online, available for ENBIS Members at https://enbis.org/media-centre/sonja-kuhnt-shirley-coleman-hands-on-projects-for-teaching-doe-2/.
- Kuiper, S. (2016), “Stat2Labs Front Page,” Stat2Labs, available at https://stat2labs.sites.grinnell.edu/.
- Larsen, N., Stallrich, J. W., Sengupta, S., Deng, A., Kohavi, R., and Stevens, N. T. (2022), “Statistical Challenges in Online Controlled Experiments: A Review of A/B Testing Methodology,” arXiv preprint arXiv:2212.11366.
- Lawson, J., Aggarwal, P., Leininger, T., and Fairchild, K. (2011), “Characterizing Variability in Smestad and Grätzel’s Nanocrystalline Solar Cells: A Collaborative Learning Experience in Experimental Design,” Journal of Statistics Education, 19, https://www.tandfonline.com/doi/abs/10.1080/10691898.2011.11889598. DOI: 10.1080/10691898.2011.11889598.
- Lazic, Z. R. (2006), Design of Experiments in Chemical Engineering: A Practical Guide, Weinheim: Wiley.
- Leardi, R. (2009), “Experimental Design in Chemistry: A Tutorial,” Analytica Chimica Acta, 652, 161–172. https://www.sciencedirect.com/science/article/abs/pii/S0003267009008058. DOI: 10.1016/j.aca.2009.06.015.
- Lin Ho, S., Lyn Nge, W., and Hong Chua, K. (2004), “The Catapult Project: An Innovative Approach for Learning Statistical Design of Experiments,” in 2004 IEEE International Engineering Management Conference (IEEE Cat. No. 04CH37574), 3, 1056–1060, https://ieeexplore.ieee.org/document/1408853.
- Lindquist, E. F. (1953), Design and Analysis of Experiments in Psychology and Education, Boston: Houghton Mifflin.
- Luca, M., and Bazerman, M. H. (2021), The Power of Experiments: Decision Making in a Data-Driven World, Cambridge, MA: MIT Press.
- Luna, J. C. (2022), “Top Programming Languages for Data Scientists in 2022,” Datacamp Data Science Blog, Web Article (last accessed April 14, (2022), https://www.datacamp.com/blog/top-programming-languages-for-data-scientists-in-2022.
- Lye, L. M. (2005), “Tools and Toys for Teaching Design of Experiments Methodology,” in 33rd Annual General Conference of the Canadian Society for Civil Engineering.
- MacKay, R. J., and Oldford, R. W. (2000), “Scientific Method, Statistical Method and the Speed of Light,” Statistical Science, 15, 254–278. https://www.jstor.org/stable/2676665. DOI: 10.1214/ss/1009212817.
- Mackisack, M. (1994), “What is the Use of Experiments Conducted by Statistics Students?” Journal of Statistics Education, 2, 1–15. https://www.tandfonline.com/doi/full/10.1080/10691898.1994.11910461.
- Mead, R., Curnow, R. N., and Hasted, A. M. (2017), Statistical Methods in Agriculture and Experimental Biology (3rd ed.), Boca Raton, FL: Chapman and Hall/CRC.
- Montgomery, D. C. (2019), Design and Analysis of Experiments (10th ed.), New York: Wiley.
- Muske, K. R., and Myers, J. A. (2007), “A Realistic Experimental Design and Statistical Analysis Project,” Chemical Engineering Education, 41, 31–38. https://journals.flvc.org/cee/article/view/122472.
- Nolan, D., and Speed, T. P. (1999), “Teaching Statistics Theory through Applications,” The American Statistician, 53, 370–375. https://www.tandfonline.com/doi/abs/10.1080/00031305.1999.10474492. DOI: 10.1080/00031305.1999.10474492.
- Núñez Ares, J., and Goos, P. (2020), “Enumeration and Multicriteria Selection of Orthogonal Minimally Aliased Response Surface Designs,” Technometrics, 62, 21–36. https://www.tandfonline.com/doi/abs/10.1080/00401706.2018.1549103. DOI: 10.1080/00401706.2018.1549103.
- Oehlert, G. W. (2010), A First Course in Design and Analysis of Experiments, Creative Commons License, available at http://users.stat.umn.edu/∼gary/book/fcdae.pdf.
- Open Science Collaboration. (2015), “Estimating the Reproducibility of Psychological Science,” Science (New York, N.Y.), 349, aac4716. https://www.science.org/doi/10.1126/science.aac4716. DOI: 10.1126/science.aac4716.
- Pashley, N. E., and Bind, M. A. C. (2022), “Causal Inference for Multiple Treatments Using Fractional Factorial Designs,” Canadian Journal of Statistics, 51, 444–468. https://onlinelibrary.wiley.com/doi/10.1002/cjs.11734. DOI: 10.1002/cjs.11734.
- Pearl, J., and Mackenzie, D. (2018), The Book of Why: The New Science of Cause and Effect, New York: Basic Books.
- Pollock, K. H., Ross-Parker, H. M., and Mead, R. (1979), “A Sequence of Games Useful in Teaching Experimental Design to Agriculture Students,” The American Statistician, 33, 70–76. https://www.tandfonline.com/doi/abs/10.1080/00031305.1979.10482663. DOI: 10.1080/00031305.1979.10482663.
- Pyott, L. (2021), “Tennis Anyone? Teaching Experimental Design by Designing and Executing a Tennis Ball Experiment,” Journal of Statistics and Data Science Education, 29, 22–26. DOI: 10.1080/10691898.2020.1854638.
- Reis, M., and Kenett, R. S. (2017), “A Structured Overview on the Use of Computational Simulators for Teaching Statistical Methods,” Quality Engineering, 29, 730–744. https://www.tandfonline.com/doi/abs/10.1080/08982112.2016.1272122. DOI: 10.1080/08982112.2016.1272122.
- Schrevens, E., Portier, K., Darius, P., Cooman, A., Tenorio, J., and Medina, A. (2004), “Simulation-Based Environments for Practicing Data-Collection Skills in Greenhouse Experimentation,” in International Conference on Sustainable Greenhouse,” Acta Horticulturae, pp. 871–876. https://www.actahort.org/books/691/691_108.htm. DOI: 10.17660/ActaHortic.2005.691.108.
- Settles, B. (2009), “Active Learning Literature Survey,” Computer Sciences Technical Report 1648, University of Wisconsin–Madison, available at https://minds.wisconsin.edu/handle/1793/60660.
- Siroker, D. (2010), “How Obama Raised $60 Million by Running a Simple Experiment,” Web Article (last accessed April 14, 2022), available at https://www.optimizely.com/insights/blog/how-obama-raised-60-million-by-running-a-simple-experiment/.
- Siroker, D., and Koomen, P. (2013), A/B Testing: The Most Powerful Way to Turn Clicks into Customers, Hoboken: Wiley.
- Stafford, R., Goodenough, A. E., and Davies, M. S. (2010), “Assessing the Effectiveness of a Computer Simulation for Teaching Ecological Experimental Design,” Bioscience Education, 15, 1–9. DOI: 10.3108/beej.15.1.
- Steiner, S. H., and MacKay, R. J. (2005), Statistical Engineering: An Algorithm for Reducing Variation in Manufacturing Processes, Milwaukee: ASQ Quality Press.
- Steiner, S. H., and MacKay, R. J. (2009), “Teaching Variation Reduction Using a Virtual Manufacturing Environment,” The American Statistician, 63, 361–365. https://www.tandfonline.com/doi/abs/10.1198/tast.2009.08042. DOI: 10.1198/tast.2009.08042.
- Steiner, S. H., Hamada, M., Giddings White, B. J., Kutsyy, V., Mosesova, S., and Salloum, G. (2007), “A Bubble Mixture Experiment Project for Use in an Advanced Design of Experiments Class,” Journal of Statistics Education, 15. DOI: 10.1080/10691898.2007.11889458.
- Stevens, N. T. (2020), “Discussion of ‘Statistics = Analytics?,” Quality Engineering, 32, 145–148. DOI: 10.1080/08982112.2019.1675172.
- Tanco, M., Viles, E., Ilzarbe, L., and Alvarez, M. J. (2009), “Implementation of Design of Experiments Projects in Industry,” Applied Stochastic Models in Business and Industry, 25, 478–505. https://onlinelibrary.wiley.com/doi/10.1002/asmb.779. DOI: 10.1002/asmb.779.
- Thomke, S. H. (2020), Experimentation Works: The Surprising Power of Business Experiments, Boston: Harvard Business Press.
- Wagenmakers, E. J., Wetzels, R., Borsboom, D., van der Maas, H. L., and Kievit, R. A. (2012), “An Agenda for Purely Confirmatory Research,” Perspectives on Psychological Science: a Journal of the Association for Psychological Science, 7, 632–638. https://journals.sagepub.com/doi/pdf/10.1177/1745691612463078. DOI: 10.1177/1745691612463078.
- Wasserstein, R. L., and Lazar, N. A. (2016), “The ASA Statement on p-Values: context, Process, and Purpose,” The American Statistician, 70, 129–133. DOI: 10.1080/00031305.2016.1154108.
- Wasserstein, R. L., Schirm, A. L., and Lazar, N. A. (2019), “Moving to a World beyond ‘p < 0”’ The American Statistician, 73, 1–19. DOI: 10.1080/00031305.2019.1583913.
- Wongoutong, C. (2022), “Imputation Methods for Missing Response Values in the Three Parts of a Central Composite Design with Two Factors,” Journal of Statistical Computation and Simulation, 92, 2273–2289. DOI: 10.1080/00949655.2022.2027424.
- Woodard, V. (2023), “Five Hands-on Experiments for a Design of Experiments Course,” Journal of Statistics and Data Science Education. DOI: 10.1080/26939169.2023.2195889.
- Wu, C. J., and Hamada, M. S. (2011), Experiments: Planning, Analysis, and Optimization (2nd ed.), Hoboken: Wiley.
- Zolman, J. F. (1999), “Teaching Experimental Design to Biologists,” The American Journal of Physiology, 277, S111–S118. https://journals.physiology.org/doi/abs/10.1152/advances.1999.277.6.s111. DOI: 10.1152/advances.1999.277.6.S111.