49
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Transformer models as predication machines

References

  • Alsentzer, E., Murphy, J. R., Boag, W., Weng, W.-H., Jin, D., Naumann, T., & McDermott, M. (2019). Publicly available clinical BERT embeddings. arXiv. https://arxiv.org/abs/1904.03323
  • Collins, A. M., & Loftus, E. F. (1975). A spreading-activation theory of semantic processing. Psychological Review, 82(6), 407–428. https://doi.org/10.1037/0033-295X.82.6.407
  • Collins, A. M., & Quillian, M. R. (1969). Retrieval time from semantic memory. Journal of Verbal Learning & Verbal Behavior, 8(2), 240–247. https://doi.org/10.1016/S0022-5371(69)80069-1
  • Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990). Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41(6), 391–407. https://doi.org/10.1002/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO;2-9
  • Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.
  • Hummel, J. E., & Holyoak, K. J. (2003). A symbolic-connectionist theory of relational inference and generalization. Psychological Review, 110(2), 220–264. https://doi.org/10.1037/0033-295X.110.2.220
  • Jawahar, G., Sagot, B., & Seddah, D. (2019). What does BERT learn about the structure of language? ACL. https://www.aclweb.org/anthology/P19-1356
  • Jones, M. N., Willits, J., Dennis, S., & Jones, M. (2015). Models of semantic memory. Oxford Handbook of Mathematical and Computational Psychology, 1, 232–254.
  • Kintsch, W. (2001). Predication. Cognitive Science, 25(2), 173–202. https://doi.org/10.1207/s15516709cog2502_1
  • Kintsch, W., & Mangalath, P. (2011). The construction of meaning. Topics in Cognitive Science, 3(2), 346–370. https://doi.org/10.1111/j.1756-8765.2010.01107.x
  • Landauer, T. K., McNamara, D. S., Dennis, S., & Kintsch, W. (Eds.). (2007). Handbook of latent semantic analysis. Erlbaum.
  • Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A robustly optimized BERT pretraining approach. arXiv. https://arxiv.org/abs/1907.11692
  • Osgood, C. E. (1952). The nature and measurement of meaning. Psychological Review, 49, 197–237.
  • Osgood, C. E. (1971). Exploration in semantic space: A personal diary. Journal of Social Issues, 27(4), 5–62. https://doi.org/10.1111/j.1540-4560.1971.tb00678.x
  • Rips, L. J., Shoben, E. J., & Smith, E. E. (1973). Semantic distance and the verification of semantic relations. Journal of Verbal Learning & Verbal Behavior, 12(1), 1–20. https://doi.org/10.1016/S0022-5371(73)80056-8
  • Smith, E. E., Shoben, E. J., & Rips, L. J. (1974). Structure and process in semantic memory: A featural model for semantic decisions. Psychological Review, 81(3), 214–241. https://doi.org/10.1037/h0036351
  • Sun, C., Qiu, X., Xu, Y., & Huang, X. (2019). How to fine-tune BERT for text classification? arXiv preprint arXiv:1905.05583. https://arxiv.org/abs/1905.05583