Publication Cover
Accountability in Research
Ethics, Integrity and Policy
Volume 31, 2024 - Issue 2
1,351
Views
11
CrossRef citations to date
0
Altmetric
Article Commentary

Citation bias, diversity, and ethics

, , , &

References

  • Ahmed, S. 2013. “Making Feminist Points.” Feministkilljoys.com. https://feministkilljoys.com/2013/09/11/making-feminist-points/
  • Ahmed, S. 2017. Living a Feminist Life. Durham: Duke University Press.
  • Ahmed, S. 2019. What’s the Use? Durham: Duke University Press.
  • Andersen, J. P., J. W. Schneider, R. Jagsi, and M. W. Nielsen. 2019. “Meta-Research: Gender Variations in Citation Distributions in Medicine are Very Small and Due to self-citation and Journal Prestige.” eLife 8: e45374. doi:10.7554/eLife.45374.
  • Bechdel, A. 1986. Dykes to Watch Out for. Ithaca, NY: Firebrand Books.
  • Bertolero, M. A., J. D. Dworkin, S. U. David, C. López Lloreda, P. Srivastava, J. Stiso, D. Zhou, K. Dzirasa, D. A. Fair, A. N. Kaczkurkin, et al. 2020. “Racial and Ethnic Imbalance in Neuroscience Reference Lists and Intersections with Gender.” BioRxiv no. October 12. Accessed January 31 2022. https://www.biorxiv.org/content/10.1101/2020.10.12.336230v1.abstract
  • Bible, King James Version. 2022 [1611]. Accessed January 28 2022. https://www.kingjamesbibleonline.org/Matthew-13-12/
  • Bouter, L. M., J. Tijdink, N. Axelsen, B. C. Martinson, and G. ter Riet. 2016. “Ranking Major and Minor Research Misbehaviors: Results from a Survey among Participants of Four World Conferences on Research Integrity.” Research Integrity and Peer Review 1 (1): 17. doi:10.1186/s41073-016-0024-5.
  • Callaham, M., R. L. Wears, and E. Weber. 2002. “Journal Prestige, Publication Bias, and Other Characteristics Associated with Citation of Published Studies in peer-reviewed Journals.” Journal of the American Medical Association 287 (21): 2847–2850. doi:10.1001/jama.287.21.2847.
  • Caplar, N., S. Tacchella, and S. Birrer. 2017. “Quantitative Evaluation of Gender Bias in Astronomical Publications from Citation Counts.” Nature Astronomy 1 (6): 0141. doi:10.1038/s41550-017-0141.
  • Carpenter, C. R., D. C. Cone, C. C. Sarli, and G. M. Gaddis. 2014. “Using Publication Metrics to Highlight Academic Productivity and Research Impact.” Academic Emergency Medicine 21 (10): 1160–1172. doi:10.1111/acem.12482.
  • Cell Press. 2022. “Cell Press Inclusion and Diversity Form.” Accessed January 29 2022. https://www.cell.com/pb/assets/raw/shared/forms/IandDstatement_form.pdf
  • Chakravartty, P., R. Kuo, V. Grubbs, and C. McIlwain. 2018. “#Communicationsowhite.” Journal of Communication 68 (2): 254–266. doi:10.1093/joc/jqy003.
  • Chatterjee, P., and R. M. Werner. 2021. “Gender Disparity in Citations in high-impact Journal Articles.” JAMA Network Open 4 (7): e2114509. doi:10.1001/jamanetworkopen.2021.14509.
  • Cite Black Women. 2022. “Home.” Accessed January 29 2022. https://www.citeblackwomencollective.org/
  • Curry, S. 2018. “Let’s Move beyond the Rhetoric: It’s Time to Change How We Judge Research.” Nature 554 (7691): 147. doi:10.1038/d41586-018-01642-w.
  • Delgado, R. 1984. “The Imperial Scholar: Reflections on a Review of Civil Rights Literature.” University of Pennsylvania Law Review 132 (3): 561–578. doi:10.2307/3311882.
  • Dion, M., J. Sumner, and S. Mitchell. 2018. “Gendered Citation Patterns across Political Science and Social Science Methodology Fields.” Political Analysis 26 (3): 312–327. doi:10.1017/pan.2018.12.
  • Duyx, B., M. J. E. Urlings, G. M. H. Swaen, L. M. Bouter, and M. P. Zeegers. 2017. “Scientific Citations Favor Positive Results: A Systematic Review and meta-analysis.” Journal of Clinical Epidemiology 88: 92–101. doi:10.1016/j.jclinepi.2017.06.002.
  • Dworkin, J. D., K. A. Linn, E. G. Teich, P. Zurn, R. T. Shinohara, and D. S. Bassett. 2020a. “The Extent and Drivers of Gender Imbalance in Neuroscience Reference Lists.” Nature Neuroscience 23 (8): 918–926. doi:10.1038/s41593-020-0658-y.
  • Dworkin, J., P. Zurn, and D. S. Bassett. 2020b. “(In)citing Action to Realize an Equitable Future.” Neuron 106 (6): 890–894. doi:10.1016/j.neuron.2020.05.011.
  • Egghe, L. 2006. “Theory and Practise of the g-index.” Scientometrics 69 (1): 131–152. doi:10.1007/s11192-006-0144-7.
  • Else, H. 2019. “Impact Factors are Still Widely Used in Academic Evaluations.” Nature no. Apr 11 https://www.nature.com/articles/s41593-020-0658-y
  • Fang, D., E. Moy, L. Colburn, and J. Hurley. 2000. “Racial and Ethnic Disparities in Faculty Promotion in Academic Medicine.” Journal of the American Medical Association 284 (9): 1085–1092. doi:10.1001/jama.284.9.1085.
  • Ferber, M. A., and M. Brun. 2011. “The Gender Gap in Citations: Does It Persist?” Feminist Economics 17 (1): 151–158. doi:10.1080/13545701.2010.541857.
  • FitzGerald, C., A. Martin, D. Berner, and S. Hurst. 2019. “Interventions Designed to Reduce Implicit Prejudices and Implicit Stereotypes in Real World Contexts: A Systematic Review.” BMC Psychology 7 (1): 29. doi:10.1186/s40359-019-0299-7.
  • Forrester, N. 2020. “Diversity in Science: Next Steps for Research Group Leaders.” Nature, September 23. Accessed January 31 2022. https://www.nature.com/articles/d41586-020-02681-y
  • Fulvio, J. M., I. Akinnola, and B. R. Postle. 2021. “Gender (Im)balance in Citation Practices in Cognitive Neuroscience.” Journal of Cognitive Neuroscience 33 (1): 3–7. doi:10.1162/jocn_a_01643.
  • Gage, M. J. 1883. “Woman as Inventor.” North American Review 136 (318): 478–489.
  • Garfield, E. 1972. “Citation Analysis as a Tool in Journal Evaluation.” Science 178 (4060): 471–479. doi:10.1126/science.178.4060.471.
  • Garfield, E. 1991. “Bibliographic Negligence: A Serious Transgression.” The Scientist 5 (23): 14–25.
  • Gingras, Y. 2016. Bibliometrics and Research Evaluation: Uses and Abuses. Cambridge, MA: MIT Press.
  • Ginther, D. K., W. T. Schaffer, J. Schnell, B. Masimore, F. Liu, L. L. Haak, and R. Kington. 2011. “Race, Ethnicity, and NIH Research Awards.” Science 333 (6045): 1015–1019. doi:10.1126/science.1196783.
  • Gomez, C. J., A. C. Herman, and P. Parigi 2022. “Leading Countries in Global Science Increasingly Receive More Citations than Other Countries Doing Similar Research.” Nature Human Behavior, May 30. Accessed July 21 2022. https://www.nature.com/articles/s41562-022-01351-5.pdf
  • Grange, R. I. 1999. “National Bias in Citations in Urology Journals: Parochialism or Availability?” BJU International 84 (6): 601–603. doi:10.1046/j.1464-410x.1999.00267.x.
  • Greenwald, A. G., and E. S. Schuh. 1994. “An Ethnic Bias in Scientific Citations.” European Journal of Social Psychology 24 (6): 623–639. doi:10.1002/ejsp.2420240602.
  • Hall, K. L., A. L. Vogel, G. C. Huang, K. J. Serrano, E. L. Rice, S. P. Tsakraklides, and S. M. Fiore. 2018. “The Science of Team Science: A Review of the Empirical Evidence and Research Gaps on Collaboration in Science.” American Psychologist 73 (4): 532–548. doi:10.1037/amp0000319.
  • Hirsch, J. E. 2005. “An Index to Quantify an Individual’s Scientific Research Output.” Proceedings of the National Academy of Sciences USA 102 (46): 16569–16572. doi:10.1073/pnas.0507655102.
  • Hofstra, B., V. V. Kulkarni, S. Munoz-Najar Galvez, B. He, D. Jurafsky, and D. A. McFarland. 2020. “The diversity-innovation Paradox in Science.” Proceedings of the National Academy of Sciences 117 (17): 9284–9291. doi:10.1073/pnas.1915378117.
  • Ira, P. 2020. “The Real Difference between Diversity and Tokenism.” An Injustice!, August 26. Accessed February 10 2022. https://aninjusticemag.com/the-real-difference-between-diversity-and-tokenism-why-they-matter-1e5b2be97edb
  • Jackson, S. M., A. L. Hillard, and T. R. Schneider. 2014. “Using Implicit Bias Training to Improve Attitudes toward Women in STEM.” Social Psychology of Education 17 (3): 419–438. doi:10.1007/s11218-014-9259-5.
  • Jannot, A. S., T. Agoritsas, A. Gayet-Ageron, and T. V. Perneger. 2013. “Citation Bias Favoring Statistically Significant Studies Was Present in Medical Research.” Journal of Clinical Epidemiology 66 (3): 296–301. doi:10.1016/j.jclinepi.2012.09.015.
  • LaFollette, M. 1992. Stealing into Print: Fraud, Plagiarism, and Misconduct in Scientific Publishing. Berkeley, CA: University of California Press.
  • Larivière, V., C. Ni, Y. Gingras, B. Cronin, and C. R. Sugimoto. 2013. “Bibliometrics: Global Gender Disparities in Science.” Nature 504 (7479): 211–213. doi:10.1038/504211a.
  • Mahian, O., and S. Wongwises. 2015. “Is It Ethical for Journals to Request self-citation?” Science and Engineering Ethics 21 (2): 531–533. doi:10.1007/s11948-014-9540-1.
  • Maliniak, D., R. Powers, and B. F. Walter. 2013. “The Gender Citation Gap in International Relations.” International Organization 67 (4): 889–922. doi:10.1017/S0020818313000209.
  • Massachusetts Institute of Technology. 2022. “Avoiding plagiarism—cite Your Source.” Accessed February 1 2022. https://integrity.mit.edu/handbook/citing-your-sources/avoiding-plagiarism-cite-your-source
  • McNutt, M., and L. Castillo-Page. 2021. “Promoting Diversity and Inclusion in STEMM Starts at the Top.” Nature Medicine 27 (11): 1864–1865. doi:10.1038/s41591-021-01496-2.
  • Merton, R. K. 1968. “The Matthew Effect in Science: The Reward and Communication Systems of Science are Considered.” Science 159 (3810): 56–63. doi:10.1126/science.159.3810.56.
  • Merton, R. K. 1979. The Sociology of Science. Chicago, IL: University of Chicago Press.
  • Mirnezami, S. R., C. Beaudry, and V. Larivière. 2016. “What Determines Researchers’ Scientific Impact? A Case Study of Quebec Researchers.” Science & Public Policy 43 (2): 262–274. doi:10.1093/scipol/scv038.
  • Mott, C., and D. Cockayne. 2017. “Citation Matters: Mobilizing the Politics of Citation toward a Practice of ‘Conscientious Engagement.’ Gender, Place, & Culture.” A Journal of Feminist Geography 24 (7): 954–973.
  • Nash, J. 2020. “Citational Desires: On Black Feminism’s Institutional Longings.” Diacritics 48 (3): 76–91. doi:10.1353/dia.2020.0020.
  • National Academies of Science, Engineering, and Medicine. 2020. Promising Practices for Addressing the Underrepresentation of Women in Science, Engineering, and Medicine. Washington, DC: National Academies Press.
  • National Academies of Sciences, Engineering, and Medicine. 2021. Addressing Diversity, Equity, Inclusion, and Anti-Racism in 21st Century STEMM Organizations: Proceedings of a Workshop in Brief. Washington, DC: National Academies Press.
  • National Research Council. 2015. Enhancing the Effectiveness of Team Science. Washington, DC: National Academies Press.
  • National Science Foundation. 2019. “Women, Minorities, and Persons with Disabilities in Science and Engineering.” Accessed July 18 2022. https://www.nsf.gov/statistics/women/
  • Office of Research Integrity. 2022. “Ethically Questionable Citation Practices.” Accessed January 9 2022. https://ori.hhs.gov/ethically-questionable-citation-practices
  • Olson, S. 2020. “Tokenism: What It Is & How It Affects Our Workplaces.” Inhersight, December 10. Accessed 10 February 2022. https://www.inhersight.com/blog/diversity/tokenism
  • Oxford Reference. 2022. “Tokenism.” Accessed February 10 2022. https://www.oxfordreference.com/view/10.1093/oi/authority.20110803104818992
  • Pagel, P. S., and J. A. Hudetz. 2011. “An Analysis of Scholarly Productivity in United States Academic Anaesthesiologists by Citation Bibliometrics.” Anaesthesia 66 (10): 873–878. doi:10.1111/j.1365-2044.2011.06860.x.
  • Paris, G., G. De Leo, P. Menozzi, and M. Gatto. 1998. “Region-based Citation Bias in Science.” Nature 396 (6708): 210. doi:10.1038/24249.
  • Pasterkamp, G., J. Rotmans, D. de Kleijn, and C. Borst. 2007. “Citation Frequency: A Biased Measure of Research Impact Significantly Influenced by the Geographical Origin of Research Articles.” Scientometrics 70 (1): 153–165. doi:10.1007/s11192-007-0109-5.
  • Penny, M., R. Jeffries, J. Grant, and S. C. Davies. 2017. “Women and Academic Medicine: A Review of the Evidence on Female Representation.” Journal of the Royal Society of Medicine 107 (7): 259–263. doi:10.1177/0141076814528893.
  • Peters, D. P., and S. J. Ceci. 1982. “Peer-review Practices of Psychological Journals: The Fate of Accepted, Published Articles, Submitted Again.” Behavioral and Brain Sciences 5 (2): 187–195. doi:10.1017/S0140525X00011183.
  • Petersen, A. M., S. Fortunato, R. K. Pan, K. Kaski, O. Penner, A. Rungi, M. Riccaboni, H. E. Stanley, and F. Pammolli. 2014. “Reputation and Impact in Academic Careers.” Proceedings of the National Academy of Sciences USA 111 (43): 15316–15321. doi:10.1073/pnas.1323111111.
  • Ray, V. 2018. “The Racial Politics of Citation. Inside Higher Education.” April 27. Accessed January 31 2022. https://www.insidehighered.com/advice/2018/04/27/racial-exclusions-scholarly-citations-opinion
  • Resnik, D. B. 2005. “Affirmative Action in Science and Engineering.” Science & Education 14 (1): 75–93. doi:10.1007/s11191-004-4221-0.
  • Rossen, K., and K. A. Miller. 2021. “Citation Bias in Organic Chemistry Research: Are industry-affiliated Papers Cited Less Often?” Organic Process Research & Development 25 (2): 167–168. doi:10.1021/acs.oprd.1c00023.
  • Rossiter, M. W. 1993. “The Matthew Matilda Effect in Science.” Social Studies of Science 23 (2): 325–341. doi:10.1177/030631293023002004.
  • Roth, W. 2016. “The Multiple Dimensions of Race.” Ethnic and Racial Studies 39 (8): 1310–1338. doi:10.1080/01419870.2016.1140793.
  • Rowson, B., S. M. Duma, M. R. King, I. Efimov, A. Saterbak, and N. C. Chesler. 2021. “Citation Diversity Statements in BMES Journals.” Annals of Biomedical Engineering 49 (3): 947–949. doi:10.1007/s10439-021-02739-6.
  • Schwartz, T. H., A. G. Palermo, S. K. Masur, and J. A. Aberg. 2019. “The Science and Value of Diversity: Closing the Gaps in Our Understanding of Inclusion and Diversity.” The Journal of Infectious Diseases 220 (Supplement_2): S33–S41. doi:10.1093/infdis/jiz174.
  • Shamoo, A. E., and D. B. Resnik. 2022. Responsible Conduct of Research. 4th ed. New York, NY: Oxford University Press.
  • Stiso, J., K. Oudyk, M. Bertolero, D. Zhou, E. Teich, D. Lydon-Staley, P. Zurn, and D. S. Bassett 2022. “Modeling Observed Gender Imbalances in Academic Citation Practices.” Accessed July 26 2022. https://arxiv.org/abs/2204.12555
  • Stryker, S. 2017. Transgender History. New York, NY: Seal Press.
  • Sweet, D. 2021. “New at Cell Press: The Inclusion and Diversity Statement.” Cell 184 (1): 1–2. doi:10.1016/j.cell.2020.12.019.
  • Taffe, M. A., and N. W. Gilpin. 2021. “Equity, Diversity and Inclusion: Racial Inequity in Grant Funding from the US National Institutes of Health.” eLife 10: e65697. doi:10.7554/eLife.65697.
  • Teplitskiy, M., E. Duede, M. Menietti, and K. R. Lakhani. 2022. “How Status of Research Papers Affects the Way They are Read and Cited.” Research Policy 51 (4): 104484. doi:10.1016/j.respol.2022.104484.
  • Thelwall, M., and K. Kousha. 2021. “Researchers’ Attitudes Towards the h-index on Twitter 2007–2020: Criticism and Acceptance.” Scientometrics 126 (6): 5361–5368. doi:10.1007/s11192-021-03961-8.
  • Thorp, H. H. 2022. “Science Needs Affirmative Action.” Science 375 (6580): 473. doi:10.1126/science.abo3934.
  • UCLA College of Social Sciences. 2017. “Women are Making Progress toward Balance in the Social Sciences.” Blog, August 9. Accessed February 8 2022. https://socialsciences.ucla.edu/2017/08/09/women-making-progress-on-the-road-to-gender-balance-in-the-social-sciences/
  • Urlings, M. J. E., B. Duyx, G. M. H. Swaen, L. M. Bouter, and M. P. Zeegers. 2021. “Citation Bias and Other Determinants of Citation in Biomedical Research: Findings from Six Citation Networks.” Journal of Clinical Epidemiology 132: 71–78. doi:10.1016/j.jclinepi.2020.11.019.
  • Vasconcelos, S., D. Vasgird, I. Ichikawa, and D. Plemmons. 2014. “Authorship Guidelines and Actual Practice: Are They Harmonized in Different Research Systems?” Journal of Microbiology & Biology Education 15 (2): 155–158. Accessed July 18 2022. https://journals.asm.org/doi/epub/10.1128/jmbe.v15i2.867
  • Wang, X., J. D. Dworkin, D. Zhou, J. Stiso, E. B. Falk, D. S. Bassett, P. Zurn, and D. M. Lydon-Staley. 2021. “Gendered Citation Practices in the Field of Communication.” Annals of the International Communication Association 45 (2): 134–153. doi:10.1080/23808985.2021.1960180.
  • Way, S. F., A. C. Morgan, D. B. Larremore, and A. Clauset. 2019. “Productivity, Prominence, and the Effects of Academic Environment.” Proceedings of the National Academy of Sciences USA 116 (22): 10729–10733. doi:10.1073/pnas.1817431116.
  • Zurn, P., D. S. Bassett, and N. C. Rust. 2020. “The Citation Diversity Statement: A Practice of Transparency, A Way of Life.” Trends in Cognitive Sciences 24 (9): 669–672. doi:10.1016/j.tics.2020.06.009.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.