249
Views
0
CrossRef citations to date
0
Altmetric
Literature, Linguistics & Criticism

Big claims, low outcomes: fact checking ChatGPT’s efficacy in handling linguistic creativity and ambiguity

ORCID Icon, ORCID Icon, , ORCID Icon, ORCID Icon &
Article: 2353984 | Received 17 Feb 2024, Accepted 07 May 2024, Published online: 18 Jun 2024

References

  • Anas, M., Saiyeda, A., Sohail, S. S., Cambria, E., & Hussain, A. (2024). Can generative AI models extract deeper sentiments as compared to traditional deep learning algorithms? IEEE Intelligent Systems, 39(2), 1–17. https://doi.org/10.1109/MIS.2024.3374582
  • Blodgett, S. L., Barocas, S., Daumé, H., III, & Wallach, H. (2020). Language (technology) is power: A critical survey of “bias” in NLP. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics 2020 July. pp. 5454–5476.
  • Borji, A. (2023). A categorical archive of ChatGPT failures. arXiv preprint arXiv:2302.03494.
  • Cai, Z. G., Haslett, D. A., Duan, X., Wang, S., & Pickering, M. J. (2023). Does ChatGPT resemble humans in language use?. arXiv preprint arXiv:2303.08014.
  • Farhat, F.,Sohail, S. S., &Madsen, D. (2023). How trustworthy is ChatGPT? The case of bibliometric analyses. Cogent Engineering. 2023 Dec. Cogent Engineering, 10(1), 1–8. https://doi.org/10.1080/23311916.2023.2222988.
  • Farhat, F., Chaudhry, B. M., Nadeem, M., Sohail, S. S., & Madsen, D. Ø. (2024). Evaluating large language models for the national premedical exam in India: Comparative analysis of GPT-3.5, GPT-4, and Bard. JMIR Medical Education, 10(e51523), 01–12. https://doi.org/10.2196/51523.
  • Farhat, F. (2023). ChatGPT as a complementary mental health resource: A boon or a bane. Annals of Biomedical Engineering, 52(2024), 1111–1114. https://doi.org/10.1007/s10439-023-03326-7.
  • Fromkin, V., Rodman, R., & Hyams, N. (2014). An introduction to language. An introduction to language. Wadsworth.
  • Kathpalia, S. S. (2018). Neologisms: Word creation processes in Hindi-English code-mixed words. English World-Wide. A Journal of Varieties of English, 39(1), 34–59. https://doi.org/10.1075/eww.00002.kat
  • Lu, Q., Qiu, B., Ding, L., Xie, L., & Tao, D. (2023). Error analysis prompting enables human-like translation evaluation in large language models: A case study on chatgpt. https://doi.org/10.20944/preprints202303.0255.v1
  • McCabe, A. (1992). Language games to play with your child. Da Capo Lifelong Books. Insight Books Plenum Press.
  • Ortega-Martín, M., García-Sierra, Ó., Ardoiz, A., Álvarez, J., Armenteros, J. C., & Alonso, A. (2023). Linguistic ambiguity analysis in ChatGPT. arXiv preprint arXiv:2302.06426.
  • Oxford Learner’s Dictionaries. (2023). Oxfordlearnersdictionaries.com dictionary. Retrieved Jun 14, 2023, from https://www.oxfordlearnersdictionaries.com/definition/english/ambiguity?q=ambiguity
  • Peng, K., Ding, L., Zhong, Q., Shen, L., Liu, X., Zhang, M., Ouyang, Y., & Tao, D. (2023). Towards making the most of chatgpt for machine translation. arXiv preprint arXiv:2303.13780.
  • Qamar, M. T., Yasmeen, J., Zeeshan, M. A., & Pathak, S. (2022). Coroneologisms and word formation processes in Hindi-English codemixed words. Acta Linguistica Asiatica, 12(1), 59–89. https://doi.org/10.4312/ala.12.1.59-89
  • Sag, I. A., Baldwin, T., Bond, F., Copestake, A., & Flickinger, D. (2002). Multiword expressions: A pain in the neck for NLP. In Computational Linguistics and Intelligent Text Processing: Third International Conference, CICLing 2002 Mexico, 2002 Proceedings 3 (pp. 1-15). Berlin, Heidelberg: Springer. https://doi.org/10.1007/3‐540‐45715‐1_1
  • Sohail, S. S., Farhat, F., Himeur, Y., Nadeem, M., Madsen, D. Ø., Singh, Y., Atalla, S., & Mansoor, W. (2023). Decoding ChatGPT: A taxonomy of existing research, current challenges, and possible future directions. Journal of King Saud University - Computer and Information Sciences, 35(8), 101675. https://doi.org/10.1016/j.jksuci.2023.101675
  • Sohail, S. S. (2024). A promising start and not a panacea: ChatGPT’s early impact and potential in medical science and biomedical engineering research. Annals of Biomedical Engineering, 52(5), 1131–1135. https://doi.org/10.1007/s10439-023-03335-6
  • Yule, G. (2010). The study of language. Cambridge university press.
  • Zhong, Q., Ding, L., Liu, J., Du, B., & Tao, D. (2023). Can chatgpt understand too? A comparative study on chatgpt and fine-tuned bert. arXiv preprint arXiv:2302.10198.