Integrating Data Science Ethics Into an Undergraduate Major: A Case Study

References

• Aust, F., and Barth, M. (2021), “papaja: Prepare Reproducible APA Journal Articles with R Markdown,” R package version 0.1.0.9997. Available at https://github.com/crsh/papaja.
   Google Scholar
• Baumer, B. S. (2015), “A Data Science Course for Undergraduates: Thinking with Data,” The American Statistician, 69, 334–342. DOI: https://doi.org/10.1080/00031305.2015.1081105.
   Web of Science ®Google Scholar
• Baumer, B. S., Kaplan, D. T. and Horton, N. J. (2021), Modern Data Science with R (2nd ed.), Boca Raton, FL: Chapman and Hall/CRC Press.
   Google Scholar
• Bender, E. M., Gebru, T., McMillan-Major, A., and Shmitchell, S. (2021), “On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?, in FAccT ’21: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, pp. 610–623.
   Google Scholar
• Benjamin, R. (2019), Race After Technology: Abolitionist Tools for the New Jim Code, Cambridge: Polity. DOI: https://doi.org/10.1093/sf/soz162.
   Google Scholar
• Blair, J. R., Jones, L., Leidig, P., Murray, S., Raj, R. K. and Romanowski, C. J. (2021), “Establishing ABET A accreditation Criteria for Data Science, in Proceedings of the 52nd ACM Technical Symposium on Computer Science Education, pp. 535–540.
   Google Scholar
• Bloom, B. S., Engelhart, M. D., Furst, E. J., Hill, W. H., and Krathwohl, D. R. (1956), Taxonomy of Educational Objectives, Handbook 1: Cognitive Domain), New York: McKay.
   Google Scholar
• Bruce, K. B. (2018), “Five Big Open Questions in Computing Education,” ACM Inroads, 9, 77–80. DOI: https://doi.org/10.1145/3230697.
   Google Scholar
• Burton, E., Goldsmith, J., and Mattei, N. (2018), ‘How to Teach Computer Ethics Through Science Fiction,” Communications of the ACM, 61, 54–64. DOI: https://doi.org/10.1145/3154485.
   Web of Science ®Google Scholar
• Cai, F. (2020), “Yann LeCun Quits Twitter Amid Acrimonious Exchanges on AI bias,” Synced: AI Technology & Industry Review. Available at https://syncedreview.com/2020/06/30/yann-lecun-quits-twitter-amid-acrimonious-exchanges-on-ai-bias/.
   Google Scholar
• Canney, N., and Bielefeldt, A. (2015), “A Framework for the Development of Social Responsibility in Engineers,” International Journal of Engineering Education, 31, 414–424.
   Web of Science ®Google Scholar
• Carter, L., and Crockett, C. (2019), “An Ethics Curriculum for CS with Flexibility and Continuity, in 2019 IEEE Frontiers in Education Conference (FIE), IEEE, pp. 1–9. DOI: https://doi.org/10.1109/FIE43999.2019.9028356.
   Google Scholar
• Chivukula, S. S., Li, Z., Pivonka, A. C., Chen, J., and Gray, C. M. (2021), “Surveying the Landscape of Ethics-Focused Design Methods,” arXiv preprint arXiv:2102.08909. Available at https://arxiv.org/abs/2102.08909.
   Google Scholar
• Committee on Professional Ethics. (2018a), ACM Code of Ethics and Professional Conduct, New York: Association for Computing Machinery, Inc. https://www.acm.org/binaries/content/assets/about/acm-code-of-ethics-booklet.pdf.
   Google Scholar
• Committee on Professional Ethics. (2018b), “Ethical Guidelines for Statistical Practice,” Technical Report, American Statistical Association. Available at http://www.amstat.org/asa/files/pdfs/EthicalGuidelines.pdf.
   Google Scholar
• Committee on Science, Engineering, and Public Policy. (2009), On Being a Scientist: A Guide to Responsible Conduct in Research (3rd ed.), Washington, DC: National Academies Press.
   Google Scholar
• Conway Center for Innovation and Entrepreneurship. (2019), “One Data Scientist’s Experience Innovating at [company],” The Jill Ker Conway Innovation and Entrepreneurship Center. Article is no longer available online.
   Google Scholar
• Davies, H. (2015), “Ted Cruz Campaign Using Firm that Harvested Data on Millions of Unwitting Facebook Users,” The Guardian. https://www.theguardian.com/us-news/2015/dec/11/senator-ted-cruz-president-campaign-facebook-user-data
   Google Scholar
• D’Ignazio, C., and Klein, L. F. (2020), “Data Feminism, Boston: MIT Press.
   Google Scholar
• Donoho, D. (2017), “50 Years of Data Science,” Journal of Computational and Graphical Statistics, 26, 745–766. https://amstat.tandfonline.com/doi/full/10.1080/10618600.2017.1384734.
   Web of Science ®Google Scholar
• Dwork, C., McSherry, F., Nissim, K. and Smith, A. (2006), “Calibrating Noise to Sensitivity in Private Data Analysis,” in Theory of Cryptography, eds. S. Halevi and T. Rabin, pp. 265–284, Berlin: Springer.
   Google Scholar
• Edmondson, A. (1999), “Psychological Safety and Learning Behavior in Work Teams,” Administrative Science Quarterly, 44, 350–383. DOI: https://doi.org/10.2307/2666999.
   Web of Science ®Google Scholar
• Elisa Raffaghelli, J. (2020), “Is Data Literacy a Catalyst of Social Justice? A Response from Nine Data Literacy Initiatives in Higher Education,” Education Sciences, 10, 233. DOI: https://doi.org/10.3390/educsci10090233.
   Web of Science ®Google Scholar
• Elliott, A. C., Stokes, S. L., and Cao, J. (2018), “Teaching Ethics in a Statistics Curriculum with a Cross-Cultural Emphasis,” The American Statistician, 72, 359–367. DOI: https://doi.org/10.1080/00031305.2017.1307140.
   Web of Science ®Google Scholar
• Eubanks, V. (2018), Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor, New York: St. Martin’s Press.
   Google Scholar
• European Parliament. (2018), “Regulation on the Protection of Natural Persons with Regard to the Processing of Personal Data and on the Free Movement of such Data, and Repealing Directive 95/46/ec (data protection directive),” Technical Report, European Union. https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A32016R0679.
   Google Scholar
• Fiesler, C., Garrett, N., and Beard, N. (2020), “What Do We Teach When We Teach Tech Ethics? A Syllabi Analysis, in Proceedings of the 51st ACM Technical Symposium on Computer Science Education, pp. 289–295. https://dl.acm.org/doi/10.1145/3328778.3366825.
   Google Scholar
• Fitzpatrick, J. (2010), “If You’re not Paying for it; you’re the product.” Available at https://lifehacker.com/if-youre-not-paying-for-it-youre-the-product-5697167.
   Google Scholar
• Floridi, L., and Taddeo, M. (2016), “What is Data Ethics?,” Philosophical Transactions of the Royal Society A, 374, 20160360. DOI: https://doi.org/10.1098/rsta.2016.0360.
   Google Scholar
• Fry, H. (2018), Hello World: Being Human in the Age of Algorithms, New York: WW Norton & Company.
   Google Scholar
• Gebru, T. (2020), “Race and Gender,” in The Oxford Handbook of Ethics of AI, eds. M. D. Dubber, F. Pasquale and S. Das, pp. 251–269, Oxford: Oxford University Press.
   Google Scholar
• Gershkoff, A., Therriault, A., Satyanarayan, A., Jones, B., Burg, B., Hurt, B., Granger, B., Jacob, B., Doig, C., Fryar, C., Ramanan, D., Bhargava, D., Perez, F., Greenleigh, I., Feng, J., Loyens, J., Morgan, J., Ram, K., Green, L., Barba, L., Colaco, M., Rocklin, M., Jamei, M., Horn, M., Harris, N. E., Elprin, N., Kaldero, N., Chopra, N., McGarry, P., Todkar, R., Jurney, R., Brener, S., Couture, T., Thibodeaux, T., and McKinney, W. (2019), “Data Values and Principles.” Available at https://datapractices.org/manifesto/.
   Google Scholar
• Giroux, M. E., Coburn, P. I., Connolly, D. A., and Bernstein, D. M. (2016), “Perspective-Taking Abilities Across the Lifespan: A Review of Hindsight Bias and Theory of Mind,” in Individual Differences in Judgement and Decision-Making (1st ed.), eds. M. E. Toplak and J. Weller, pp. 157–175, London: Psychology Press.
   Google Scholar
• Gotterbarn, D., Wolf, M. J., Flick, C., and Miller, K. (2018), “Thinking Professionally: The Continual Evolution of Interest in Computing Ethics,” ACM Inroads, 9, 10–12.
   Google Scholar
• Grosz, B. J., Grant, D. G., Vredenburgh, K., Behrends, J., Hu, L., Simmons, A., and Waldo, J. (2019), “Embedded EthiCS: Integrating Ethics Across CS Education,” Communications of the ACM, 62, 54–61. DOI: https://doi.org/10.1145/3330794.
   Web of Science ®Google Scholar
• Gunaratna, N. S., and Tractenberg, R. E. (2016), “Ethical Reasoning with the 2016 Revised ASA Ethical Guidelines for Statistical Practice, in American Statistical Association Proceedings of the Joint Statistical Meetings. Available at https://www.researchgate.net/publication/313309250_Ethical_Reasoning_with_the_2016_Revised_ASA_Ethical_Guidelines_for_Statistical_Practice
   Google Scholar
• Hand, D. J. (2018), “Aspects of Data Ethics in a Changing World: Where are We Now?” Big Data, 6, 176–190. DOI: https://doi.org/10.1089/big.2018.0083.
   PubMed Web of Science ®Google Scholar
• Hardin, J., Hoerl, R., Horton, N. J., Nolan, D., Baumer, B. S., Hall-Holt, O., Murrell, P., Peng, R., Roback, P., Temple Lang, D., and Ward, M. D. (2015), “Data Science in Statistics Curricula: Preparing Students to ’Think with Data’,” The American Statistician, 69, 343–353. DOI: https://doi.org/10.1080/00031305.2015.1077729.
   Web of Science ®Google Scholar
• Heggeseth, B. (2019), “Intertwining Data Ethics in Intro Stats,” in Symposium on Data Science and Statistics. Available at https://drive.google.com/file/d/1GXzVMpb6GVNfWPS6bd9jggtqq1C77Wsc/view.
   Google Scholar
• Hicks, S. C., and Irizarry, R. A. (2018), “A Guide to Teaching Data Science,” The American Statistician, 72, 382–391. DOI: https://doi.org/10.1080/00031305.2017.1356747.
   PubMed Web of Science ®Google Scholar
• Hoffmann, A. L. and Cross, K. A. (2021), “Teaching Data Ethics: Foundations and Possibilities from Engineering and Computer Science Ethics Education.” Available at http://hdl.handle.net/1773/46921.
   Google Scholar
• Huff, D. (1954), How to Lie with Statistics, New York: WW Norton & Company, Inc.
   Google Scholar
• James, G., Witten, D., Hastie, T., and Tibshirani, R. (2013), An Introduction to Statistical Learning: With Applications in R, New York: Springer.
   Google Scholar
• James, G., Witten, D., Hastie, T., and Tibshirani, R. (2021), ISLR: Data for an Introduction to Statistical Learning with Applications in R. R package version 1.4. https://www.statlearning.com.
   Google Scholar
• James, G., Witten, D., Hastie, T., and Tibshirani, R. (2022), ISLR2: Introduction to Statistical Learning (2nd ed.), R package version 1.3-1. Available at https://www.statlearning.com.
   Google Scholar
• Kantayya, S., and Buolamwini, J. (2020), “Coded Bias,” 7th Empire Media. Available at https://www.codedbias.com/.
   Google Scholar
• Kaplan, D. (2018), “Teaching Stats for Data Science,” The American Statistician, 72, 89–96. DOI: https://doi.org/10.1080/00031305.2017.1398107.
   Web of Science ®Google Scholar
• Kerr, N. L. (1998), “Harking: Hypothesizing After the Results are Known,” Personality and Social Psychology Review, 2, 196–217. DOI: https://doi.org/10.1207/s15327957pspr0203_4.
   PubMedGoogle Scholar
• Kim, A. Y., and Escobedo-Land, A. (2015), “OKCupid Data for Introductory Statistics and Data Science Courses,” Journal of Statistics Education, 23. https://amstat.tandfonline.com/doi/abs/10.1080/10691898.2015.11889737 DOI: https://doi.org/10.1080/10691898.2015.11889737.
   Web of Science ®Google Scholar
• Kim, A. Y., and Escobedo-Land, A. (2021), “Correction to OkCupid Data for Introductory Statistics and Data Science Courses,” Journal of Statistics and Data Science Education, 29, 216–216.
   Web of Science ®Google Scholar
• Kirkegaard, E. O., and Bjerrekaer, J. D. (2016), “The OKCupid Dataset: A Very Large Public Dataset of Dating Site Users,” Open Differential Psychology, 46. DOI: https://doi.org/10.26775/ODP.2016.11.03.
   Google Scholar
• Kolaczyk, E. D., and Csárdi, G. (2014), Statistical Analysis of Network Data with R (Vol. 65), New York: Springer.
   Google Scholar
• Kramer, A. D. I., Guillory, J. E., and Hancock, J. T. (2014), “Experimental Evidence of Massive-Scale Emotional Contagion Through Social Networks,” Proceedings of the National Academy of Sciences, 111, 8788–8790.
   Google Scholar
• Langkjaer-Bain, R. (2017), “Trials of a Statistician,” Significance, 14, 14–19. DOI: https://doi.org/10.1111/j.1740-9713.2017.01052.x.
   Google Scholar
• Levin, S. (2017), “Mark Zuckerberg: I Regret Ridiculing Fears Over Facebook’s Effect on Election,” The Guardian. Available at https://www.theguardian.com/technology/2017/sep/27/mark-zuckerberg-facebook-2016-election-fake-news.
   Google Scholar
• Loukides, M., Mason, H., and Patil, D. (2018a), Ethics and Data Science, Sebastopol, CA: O’Reilly Media. https://www.oreilly.com/library/view/ethics-and-data/9781492043898/.
   Google Scholar
• Loukides, M., Mason, H., and Patil, D. (2018b), Of Oaths and Checklists, Sebastopol, CA: O’Reilly Media. https://www.oreilly.com/radar/of-oaths-and-checklists/.
   Google Scholar
• Meyer, R. (2014), “Everything We Know About Facebook’s Secret Mood Manipulation Experiment,” The Atlantic. Available at https://www.theatlantic.com/technology/archive/2014/06/everything-we-know-about-facebooks-secret-mood-manipulation-experiment/373648/.
   Google Scholar
• Milner, Y. (2019), “Data for Black Lives II,” Available at http://d4bl.org/conference.html.
   Google Scholar
• Muradova, L. (2021), “Seeing the Other Side? Perspective-Taking and Reflective Political Judgements in Interpersonal Deliberation,” Political Studies, 69, 644–664. DOI: https://doi.org/10.1177/0032321720916605.
   Web of Science ®Google Scholar
• National Academies of Sciences, Engineering, and Medicine. (2018), Data Science for Undergraduates: Opportunities and Options, Washington, DC: National Academies Press.
   Google Scholar
• National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research. (1978), “The Belmont Report: Ethical Principles and Guidelines for the Protection of Human Subjects of Research,” Technical Report 0012, Department of Health, Education, and Welfare. Available at https://videocast.nih.gov/pdf/ohrp_belmont_report.pdf.
   Google Scholar
• Neff, G., Tanweer, A., Fiore-Gartland, B., and Osburn, L. (2017), “Critique and Contribute: A Practice-Based Framework for Improving Critical Data Studies and Data Science,” Big Data, 5, 85–97. DOI: https://doi.org/10.1089/big.2016.0050.
   PubMed Web of Science ®Google Scholar
• Noble, S. U. (2018), Algorithms of Oppression: How Search Engines Reinforce Racism, New York: NYU Press.
   Google Scholar
• O’Neil, C. (2016), Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy, New York: Crown.
   Google Scholar
• Pierson, S., and Wilkinson, L. (2021), “ASA, International Community Continue to Decry Georgiou Persecution,” AMSTAT News. Available at https://magazine.amstat.org/blog/2021/05/01/asa-decries-georgiou-persecution/.
   Google Scholar
• Poulsen, K. (2014), “How a Math Genius Hacked OKCupid to Find True Love.” Available at https://www.wired.com/2014/01/how-to-hack-okcupid/.
   Google Scholar
• R Core Team. (2021), R: A Language and Environment for Statistical Computing, Vienna: R Foundation for Statistical Computing. Available at https://www.R-project.org/.
   Google Scholar
• Rosenberg, M., Confessore, N., and Cadwalladr, C. (2018), “How Trump Consultants Exploited the Facebook Data of Millions,” The New York Times. Available at https://www.nytimes.com/2018/03/17/us/politics/cambridge-analytica-trump-campaign.html.
   Google Scholar
• Saltz, J., Skirpan, M., Fiesler, C., Gorelick, M., Yeh, T., Heckman, R., Dewar, N., and Beard, N. (2019), “Integrating Ethics Within Machine Learning Courses,” ACM Transactions on Computing Education (TOCE), 19, 1– 26. DOI: https://doi.org/10.1145/3341164.
   Web of Science ®Google Scholar
• Schlenker, L. (2019), “The Ethics of Data Science,” Towards Data Science. Available at https://towardsdatascience.com/the-ethics-of-data-science-e3b1828affa2.
   Google Scholar
• Shapiro, B. R., Meng, A., O’Donnell, C., Lou, C., Zhao, E., Dankwa, B., and Hostetler, A. (2020), “Re-shape: A Method to Teach Data Ethics for Data Science Education, in Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems,” pp. 1–13. DOI: https://doi.org/10.1145/3313831.3376251.
   Google Scholar
• Shook, N. J., and Fazio, R. H. (2008), “Interracial Roommate Relationships: An Experimental Field Test of the Contact Hypothesis,” Psychological Science, 19, 717–723. DOI: https://doi.org/10.1111/j.1467-9280.2008.02147.x.
   PubMed Web of Science ®Google Scholar
• Skirpan, M., Beard, N., Bhaduri, S., Fiesler, C., and Yeh, T. (2018), “Ethics Education in Context: A Case Study of Novel Ethics Activities for the CS Classroom,” in Proceedings of the 49th ACM Technical Symposium on Computer Science Education, pp. 940–945.
   Google Scholar
• Solow, B. (2021), “Quinn White ’23: Studying Trends Through an Ethical Lens,” Grécourt Gate. Available at https://www.smith.edu/news/quinn-white-23-studying-trends-through-an-ethical-lens.
   Google Scholar
• Sweeney, L. (2002), “k-Anonymity: A Model for Protecting Privacy,” International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 10, 557–570. DOI: https://doi.org/10.1142/S0218488502001648.
   Web of Science ®Google Scholar
• Tarran, B. (2019), “German Commission Calls for Risk-Based Regulation of Algorithmic Systems,” Significance, 16, 4–5. DOI: https://doi.org/10.1111/j.1740-9713.2019.01329.x.
   Google Scholar
• Tractenberg, R. E. (2019a), “Strengthening the Practice and Profession of Statistics and Data Science Using Ethical Guidelines.” Available at https://osf.io/preprints/socarxiv/93wuk.
   Google Scholar
• Tractenberg, R. E. (2019b), “Teaching and Learning about Ethical Practice: The Case Analysis.” Available at https://osf.io/preprints/socarxiv/58umw/download.
   Google Scholar
• Utts, J. (2021), “Enhancing Data Science Ethics Through Statistical Education and Practice,” International Statistical Review, 89, 1–17. DOI: https://doi.org/10.1111/insr.12446.
   Web of Science ®Google Scholar
• Vakil, S. (2018), “Ethics, Identity, and Political Vision: Toward a Justice-Centered Approach to Equity in Computer Science Education,” Harvard Educational Review, 88, 26–52. DOI: https://doi.org/10.17763/1943-5045-88.1.26.
   Web of Science ®Google Scholar
• Wang, M. Q., Yan, A. F., and Katz, R. V. (2018), “Researcher Requests for Inappropriate Analysis and Reporting: A US Survey of Consulting Biostatisticians,” Annals of Internal Medicine, 169, 554–558. DOI: https://doi.org/10.7326/M18-1230.
   PubMed Web of Science ®Google Scholar
• Washington, A. L., and Kuo, R. (2020), “Whose Side are Ethics Codes on? Power, Responsibility and the Social Good,” in Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, pp. 230–240. Available at https://dl.acm.org/doi/abs/10.1145/3351095.3372844.
   Google Scholar
• Wasserstein, R. L., and Lazar, N. A. et al. (2016), “The ASA’s Statement on p-Values: Context, Process, and Purpose,” The American Statistician 70, 129–133. DOI: https://doi.org/10.1080/00031305.2016.1154108.
   Web of Science ®Google Scholar
• Wasserstein, R. L., Schirm, A. L., and Lazar, N. A. (2019), “Moving to a World Beyond ‘p < 0.05’,” The American Statistician, 73, 1– 19.
   Web of Science ®Google Scholar
• Wender, B., and Kloefkorn, T. (2017), “Roundtable on Data Science Postsecondary Education, Meeting #5 Highlights,” The National Academies of Sciences, Engineering, and Medicine. Available at https://www.nationalacademies.org/event/12-08-2017/docs/D8EE65EFC7F4B0C368D267EDAD10E5AB1BAFBE3369D2
   Google Scholar
• Wickham, H., Chang, W., Henry, L., Pedersen, T. L., Takahashi, K., Wilke, C., Woo, K., Yutani, H., and Dunnington, D. (2021), “ggplot2: Create Elegant Data Visualisations Using the Grammar of Graphics,” R package version 3.3.5. Available at https://CRAN.R-project.org/package=ggplot2.
   Google Scholar
• Xiao, T., and Ma, Y. (2021), “A Letter to the Journal of Statistics and Data Science Education—A Call for Review of “OkCupid Data for Introductory Statistics and Data Science Courses” by Albert Y. Kim and Adriana Escobedo-Land,” Journal of Statistics and Data Science Education, 29, 214–215.
   Google Scholar
• Zimmer, M. (2010), “‘But the Data is Already Public’: On the Ethics of Research in Facebook,” Ethics and Information Technology, 12, 313– 325. DOI: https://doi.org/10.1007/s10676-010-9227-5.
   Web of Science ®Google Scholar
• Zuboff, S. (2018), The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power (1st ed.), New York: PublicAffairs.
   Google Scholar