Optimization Models of Natural Communication

References

• Baayen, H. , & del Prado Martín, Moscoso . (2005). Semantic density and past-tense formation in three Germanic languages. Language , 81 , 666–698.10.1353/lan.2005.0112
   Web of Science ®Google Scholar
• Baixeries, J. , Elvevåg, B. , & Ferrer-i-Cancho, R. (2013). The evolution of the exponent of Zipf's law in language ontogeny. PLoS ONE , 8 (3), e53227.10.1371/journal.pone.0053227
   PubMed Web of Science ®Google Scholar
• Bates, E. , D’Amico, S. , Jacobsen, T. , Székely, A. , Andonova, E. , Devescovi, A. , … Tzeng, O. (2003). Timed picture naming in seven languages. Psychonomic Bulletin & Review , 10 , 344–380.
   PubMed Web of Science ®Google Scholar
• Bel-Enguix, G. , & Jiménez-López, M. D. (2011). Genetic code and verbal language. In G. Bel-Enguix , V. Dahl , & M. D. Jiménez-López (Eds.), Biology, Computation and Linguistics (pp. 85–103). Amsterdam: IOS Press.
   Google Scholar
• Bentz, C. , Alikaniotis, D. , Cysouw, M. , & Ferrer-i-Cancho, R. (2017). The entropy of words – learnability and expressivity across more than 1000 languages. Retrieved from https://www.preprints.org/manuscript/201704.0180/v1
   Google Scholar
• Bentz, C. , Kiela, D. , Hill, F. , & Buttery, P. (2014). Zipf’s law and the grammar of languages: A quantitative study of Old and Modern English parallel texts. Corpus Linguistics and Linguistic Theory , 10 , 175–211.
   Web of Science ®Google Scholar
• Benz, A. , Mattausch, J. (2011). Bidirectional optimality theory. An introduction. Benz, A. , & Mattausch, J. Bidirectional optimality theory (pp. 1–31). Amsterdam: John Benjamins.10.1075/la
   Google Scholar
• Bentz, C. , Verkerk, A. , Kiela, D. , Hill, F. , Buttery, P. (2015). Adaptive communication: Languages with more non-native speakers tend to have fewer word forms. PLoS ONE, 10 , e0128254.
   Google Scholar
• Bradbury, J. , & Vehrencamp, S. (2011). Decisions, signals and information. Chapter 8: In Principles of animal communication (2nd ed., pp. 279–324). Sunderland (MA): Sinauer Associates Inc.
   Google Scholar
• Bunge, M. (2013). La ciencia. Su método y su filosofía [Science. Its method and its philosophy]. Pamplona: Laetoli.
   Google Scholar
• Burnham, K. P. , & Anderson, D. R. (2002). Model selection and multimodel inference: A practical information-theoretic approach (2nd ed.). New York, NY : Springer-Verlag.
   Google Scholar
• Casas, B. , Català, N. , Ferrer-i-Cancho, R. , Hernández-Fernández, A. , & Baixeries, J. (2016). The polysemy of the words that children learn over time. Retrieved from https://arxiv.org/abs/1611.08807
   Google Scholar
• Cattuto, C. , Loreto, V. , & Pietronero, L. (2007). Semiotic dynamics and collaborative tagging. Proceedings of the National Academy of Sciences USA , 104 , 1461–1464.10.1073/pnas.0610487104
   PubMed Web of Science ®Google Scholar
• Chao, A. , & Shen, T.-J. (2003). Nonparametric estimation of Shannon’s index of diversity when there are unseen species in sample. Environmental and Ecological Statistics , 10 , 429–443.10.1023/A:1026096204727
   Web of Science ®Google Scholar
• Chater, N. , & Vitányi, P. M. B. (2003). Simplicity: A unifying principle in cognitive science? Trends in Cognitive Sciences , 7 , 19–22.10.1016/S1364-6613(02)00005-0
   PubMed Web of Science ®Google Scholar
• Chung, F. , Handjani, S. , & Jungreis, D. (2003). Generalization of Polya’s urn problem. Annals of Combinatorics , 7 , 141–153.10.1007/s00026-003-0178-y
   Google Scholar
• Clark, E. (1987). The principle of contrast: A constraint on language acquisition. In B. MacWhinney (Ed.), Mechanisms of language acquisition (pp. 1–33). Hillsdale, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Clark, E. (1993). The lexicon in acquisition . Cambridge: Cambridge University Press.10.1017/CBO9780511554377
   Google Scholar
• Clauset, A. , Shalizi, C. R. , & Newman, M. E. J. (2009). Power-law distributions in empirical data. SIAM Review , 51 , 661–703.10.1137/070710111
   Web of Science ®Google Scholar
• Corominas-Murtra, B. , Fortuny, J. , & Solé, R. V. (2011). Emergence of Zipf’s law in the evolution of communication. Physical Review E , 83 , 74.10.1103/PhysRevE.83.036115
   Web of Science ®Google Scholar
• Corral, A. , Boleda, G. , & Ferrer-i-Cancho, R. (2015). Zipf’s law for word frequencies: Word forms versus lemmas in long texts. PLoS ONE , 10 (7), e0129031.10.1371/journal.pone.0129031
   PubMed Web of Science ®Google Scholar
• Cover, T. M. , & Thomas, J. A. (2006). Elements of information theory (2nd ed.). Hoboken, NJ: Wiley.
   Google Scholar
• Crossley, S. , Salisbury, T. , & McNamara, D. (2010). The development of polysemy and frequency use in English second language speakers. Language Learning , 60 , 573–605.10.1111/(ISSN)1467-9922
   Web of Science ®Google Scholar
• Dahan, D. , Magnuson, J. S. , & Tanenhaus, M. K. (2001). Time course of frequency effects in spoken-word recognition: Evidence from eye movements. Cognitive Psychology , 42 , 317–367.10.1006/cogp.2001.0750
   PubMed Web of Science ®Google Scholar
• Fenk-Oczlon, G. (2001). Familiarity, information flow, and linguistic form. In J. Bybee & P. Hopper (Eds.), Frequency and the emergence of linguistic structure (pp. 431–448). Amsterdam: John Benjamins.
   Google Scholar
• Ferrer-i-Cancho, R. (2005a). Zipf’s law from a communicative phase transition. European Physical Journal B , 47 , 449–457.10.1140/epjb/e2005-00340-y
   Web of Science ®Google Scholar
• Ferrer-i-Cancho, R. (2005b). The variation of Zipf’s law in human language. European Physical Journal B , 44 , 249–257.10.1140/epjb/e2005-00121-8
   Web of Science ®Google Scholar
• Ferrer-i-Cancho, R. (2005c). Decoding least effort and scaling in signal frequency distributions. Physica A , 345 , 275–284.10.1016/j.physa.2004.06.158
   Web of Science ®Google Scholar
• Ferrer-i-Cancho, R. (2006). When language breaks into pieces. A conflict between communication through isolated signals and language. Biosystems , 84 , 242–253.10.1016/j.biosystems.2005.12.001
   PubMed Web of Science ®Google Scholar
• Ferrer-i-Cancho, R. (2016a). The meaning-frequency law in Zipfian optimization models of communication. Glottometrics , 35 , 28–37.
   Web of Science ®Google Scholar
• Ferrer-i-Cancho, R. (2016b). Compression and the origins of Zipf’s law for word frequencies. Complexity , 21 , 409–411.10.1002/cplx.v21.S2
   Web of Science ®Google Scholar
• Ferrer-i-Cancho, R. (2017). The optimality of attaching unlinked labels to unlinked meanings. Glottometrics , 36 , 1–16.
   Web of Science ®Google Scholar
• Ferrer-i-Cancho, R. , & Díaz-Guilera, A. (2007). The global minima of the communicative energy of natural communication systems. Journal of Statistical Mechanics , P06009.
   Web of Science ®Google Scholar
• Ferrer-i-Cancho, R. , & Elvevåg, B. (2010). Random texts do not exhibit the real Zipf's law-like rank distribution. PLoS ONE , 5 , e9411.10.1371/journal.pone.0009411
   PubMed Web of Science ®Google Scholar
• Ferrer-i-Cancho, R. , & Gavaldà, R. (2009). The frequency spectrum of finite samples from the intermittent silence process. Journal of the American Society for Information Science and Technology , 60 , 837–843.10.1002/asi.v60:4
   Web of Science ®Google Scholar
• Ferrer-i-Cancho, R. , & McCowan, B. (2009). A law of word meaning in dolphin whistle types. Entropy , 11 , 688–701.10.3390/e11040688
   Web of Science ®Google Scholar
• Ferrer-i-Cancho, R. , & McCowan, B. (2012). The span of correlations in dolphin whistle sequences. Journal of Statistical Mechanics , P06002.
   Web of Science ®Google Scholar
• Ferrer-i-Cancho, R. , & Servedio, V. D. P. (2005). Can simple models explain Zipf’s law in all cases? Glottometrics , 11 , 1–8.
   Google Scholar
• Ferrer-i-Cancho, R. , & Solé, R. V. (2003). Least effort and the origins of scaling in human language. Proceedings of the National Academy of Sciences USA , 100 , 788–791.10.1073/pnas.0335980100
   PubMed Web of Science ®Google Scholar
• Ferrer-i-Cancho, R. , & Vitevitch, M. S. (in press). The origins of Zipf’s meaning-frequency law.
   Google Scholar
• Ferrer-i-Cancho, R. , Hernández-Fernández, A. , Lusseau, D. , Agoramoorthy, G. , Hsu, M. J. , & Semple, S. (2013). Compression as a universal principle of animal behavior. Cognitive Science , 37 , 1565–1578.10.1111/cogs.2013.37.issue-8
   PubMed Web of Science ®Google Scholar
• Ferrer-i-Cancho, R. , Hernández-Fernández, A. , Baixeries, J. , Dębowski, Ł. , & Macutek, J. (2014). When is Menzerath-Altmann law mathematically trivial? A new approach. Statistical Applications in Genetics and Molecular Biology , 13 , 633–644.
   PubMed Web of Science ®Google Scholar
• Font-Clos, F. , Boleda, G. , & Corral, A. (2013). A scaling law beyond Zipf’s law and its relation to Heaps’ law. New Journal of Physics , 15 , 093033.10.1088/1367-2630/15/9/093033
   Web of Science ®Google Scholar
• Gerlach, M. , & Altmann, E. G. (2013). Stochastic model for the vocabulary growth in natural languages. Physical Review X , 3 , 021006.10.1103/PhysRevX.3.021006
   Web of Science ®Google Scholar
• Ha, L. Q. , Stewart, D. , Hanna, P. , & Smith, F. (2006). Zipf and type-token rules for the English, Spanish, Irish and Latin languages. Web Journal of Formal, Computational and Cognitive Linguistics 8 , 1 , 1–12.
   Google Scholar
• Haimovici, A. , Tagliazucchi, E. , Balenzuela, P. , & Chialvo, D. (2013). Brain organization into resting state networks emerges at criticality on a model of the human connectome. Physical Review Letters , 110 , 178101.10.1103/PhysRevLett.110.178101
   PubMed Web of Science ®Google Scholar
• Hernández-Fernández, A. , & Ferrer-i-Cancho, R. (2015). The infochemical core. Journal of Quantitative Linguistics , 23 , 133–153.
   Web of Science ®Google Scholar
• Hidalgo, J. , Grilli, J. , Muñoz, M. A. , Banavar, J. R. , & Maritan, A. (2014). Information-based fitness and the emergence of criticality in living systems. Proceedings of the National Academy of Science USA , 111 , 10095–10100.10.1073/pnas.1319166111
   PubMed Web of Science ®Google Scholar
• Hino, Y. , & Lupker, S. J. (1996). Effects of polysemy in lexical decision and naming: An alternative to lexical access accounts. Journal of Experimental Psychology: Human Perception & Performance , 22 , 1331–1356.
   Web of Science ®Google Scholar
• Ilgen, B. , & Karaoglan, B. (2007). Investigation of Zipf’s law-of-meaning on Turkish corpora . In 22nd International Symposium on Computer and Information Sciences (ISCIS 2007), Ankara (pp. 1–6).
   Google Scholar
• Janes, E. T. (1957). Information theory and statistical mechanics. Physics Review , 106 , 620–630.10.1103/PhysRev.106.620
   Google Scholar
• Jescheniak, J. D. , & Levelt, W. J. M. (1994). Word frequency effects in speech production: Retrieval of syntactic information and of phonological form. Journal of Experimental Psychology: Learning, Memory, and Cognition , 20 , 824–843.
   Web of Science ®Google Scholar
• Kellas, G. , Ferraro, F. R. , & Simpson, G. B. (1988). Lexical ambiguity and the timecourse of attentional allocation in word recognition. Journal of Experimental Psychology: Human Perception & Performance , 14 , 601–609.
   PubMed Web of Science ®Google Scholar
• Kello, C. (2013). Critical branching neural networks. Psychological Reviews , 120 , 230–254.
   PubMed Web of Science ®Google Scholar
• Kello, C. T. , & Beltz, B. C. (2009). Scale-free networks in phonological and orthographic wordform lexicons. In I. Chitoran , C. Coupé , E. Marsico , & F. Pellegrino (Eds.), Approaches to Phonological Complexity (pp. 171–190). Berlin: Mouton de Gruyter.
   Google Scholar
• Kello, C. T. , Brown, G. D. A. , Ferrer-i-Cancho, R. , Holden, John G. , Linkenkaer-Hansen, K. , Rhodes, T. , & Van Orden, G. C. (2010). Scaling laws in cognitive sciences. Trends in Cognitive Sciences , 14 , 223–232.10.1016/j.tics.2010.02.005
   PubMed Web of Science ®Google Scholar
• Klepousniotou, E. , & Baum, S. (2007). Disambiguating the ambiguity advantage effect in word recognition: An advantage for polysemous but not homonymous words. Journal of Neurolinguistics , 20 (1), 1–24.10.1016/j.jneuroling.2006.02.001
   Web of Science ®Google Scholar
• Köhler, R. (1987). System theoretical linguistics. Theoretical Linguistics , 14 , 241–247.
   Web of Science ®Google Scholar
• Köhler, R. (2005). Synergetic linguistics. In R. Kohler, G. Altmann, & R. G. Piotrowski (Eds.), Quantitative Linguistik. Ein internationales Handbuch, Quantitative Linguistics: An International Handbook (pp. 760–775). Berlin: Walter de Gruyter.
   Google Scholar
• Konishi, H. , Kanero, J. , Freeman, M. R. , Michnick Golinkoff, R. , & Hirsh-Pasek, K. (2014). Six principles of language development: Implications for second language learners. Developmental Neuropsychology , 39 , 404–420.10.1080/87565641.2014.931961
   PubMed Web of Science ®Google Scholar
• Li, W. , Miramontes, P. , & Cocho, G. (2010). Fitting ranked linguistic data with two-parameter functions. Entropy , 12 , 1743–1764.10.3390/e12071743
   Web of Science ®Google Scholar
• Markman, E. , & Wachtel, G. F. (1988). Children’s use of mutual exclusivity to constrain the meanings of words. Cognitive Psychology , 20 , 121–157.10.1016/0010-0285(88)90017-5
   PubMed Web of Science ®Google Scholar
• Markov, V. I. , Ostrovskaya, V. M. (1990). Organization of communication system in Tursiops truncatus Montagu. In J. Thomas & R. Kastelein (Eds.), Sensory abilities of cetaceans (Vol. 196, pp. 599–622). New York, NY : Plenum Press. NATO ASI Series.10.1007/978-1-4899-0858-2
   Google Scholar
• McCowan, B. , Hanser, S. F. , & Doyle, L. R. (1999). Quantitative tools for comparing animal communication systems: Information theory applied to bottlenose dolphin whistle repertoires. Animal Behaviour , 57 , 409–419.10.1006/anbe.1998.1000
   PubMed Web of Science ®Google Scholar
• McCowan, B. , Doyle, L. R. , & Hanser, S. F. (2002). Using information theory to assess the diversity, complexity and development of communicative repertoires. Journal of Comparative Psychology , 116 , 166–172.10.1037/0735-7036.116.2.166
   PubMed Web of Science ®Google Scholar
• Merriman, W. E. , & Bowman, L. L. (1989). The mutual exclusivity bias in children’s word learning. Monographs of the Society for Research in Child Development , 54 (3/4), 1–129.
   PubMedGoogle Scholar
• Miller, G. A. , & Chomsky, N. (1963). Finitary models of language users. In R. D. Luce , R. R. Bush , & E. Galanter (Eds.), Handbook of Mathematical Psychology , Vol. 2 (pp. 419–491). New York, NY : Wiley.
   Google Scholar
• Millis, M. L. , & Button, S. B. (1989). The effect of polysemy on lexical decision time: Now you see it, now you don’t. Memory & Cognition , 17 , 141–147.10.3758/BF03197064
   PubMed Web of Science ®Google Scholar
• Morin, E. (1990). Introduction à la pensée complexe . Paris: ESF.
   Google Scholar
• Ninio, A. (2005). Kernel vocabulary and Zipf’s law in maternal input to syntactic development . In Proceedings of the 30th Annual Boston University Conference on Language Development (pp. 423–431). Sommerville, MA: Cascadilla Press.
   Google Scholar
• Obst, O. , Polani, D. , & Prokopenko, P. (2009). Origins of scaling in genetic code . In proceeding of: Advances in Artificial Life. Darwin meets von Neumann - 10th European Conference, ECAL 2009, Budapest, Hungary, September 13–16, 2009, Revised Selected Papers, Part II.
   Google Scholar
• Oudeyer, P.-Y. (2006). Self-organization in the evolution of speech . Oxford: Oxford University Press.10.1093/acprof:oso/9780199289158.001.0001
   Google Scholar
• Petersen, A. M. , Tenenbaum, J. , Havlin, S. , Stanley, H. E. , & Perc, M. (2012). Languages cool as they expand: Allometric scaling and the decreasing need for new words. Scientific Reports , 2 , 721.10.1038/srep00943
   PubMed Web of Science ®Google Scholar
• Piantadosi, S. (2014). Zipf’s law in natural language: A critical review and future directions. Psychonomic Bulletin & Review , 21 , 1112–1130.10.3758/s13423-014-0585-6
   PubMed Web of Science ®Google Scholar
• Piantadosi, S. T. , Tily, H. , & Gibson, E. (2011). Word lengths are optimized for efficient communication. Proceedings of the National Academy of Sciences USA , 108 , 3526–3529.10.1073/pnas.1012551108
   PubMed Web of Science ®Google Scholar
• Popescu, I.-I. , & Altmann, G. (2008). Hapax legomena and language typology. Journal of Quantitative Linguistics , 15 , 370–378.10.1080/09296170802326699
   Web of Science ®Google Scholar
• Prokopenko, M. , Ay, N. , Obst, O. , & Polani, D. (2010). Phase transitions in least-effort communications. Journal of Statistical Mechanics: Theory and Experiment , P11025.10.1088/1742-5468/2010/11/P11025
   Web of Science ®Google Scholar
• Rapoport, A. (1982). Zipf’s law re-visited. Quantitative Linguistics , 16 , 1–28.
   Google Scholar
• Ritz, C. , & Streibig, J. C. (2008). Nonlinear regression with R . New York, NY : Springer.
   Google Scholar
• Rodd, J. , Gaskell, G. , & Marslen-Wilson, W. (2002). Making sense of semantic ambiguity: Semantic competition in lexical access. Journal of Memory and Language , 46 , 245–266.10.1006/jmla.2001.2810
   Web of Science ®Google Scholar
• Rubenstein, H. , Garfield, L. , & Millikan, J. (1970). Homographic entries in the internal lexicon. Journal of Verbal Learning & Verbal Behavior , 9 , 487–494.10.1016/S0022-5371(70)80091-3
   Google Scholar
• Rubenstein, H. , Lewis, S. S. , & Rubenstein, M. A. (1971). Homographic entries in the internal lexicon: Effects of systematicity and relative frequency of meaning. Journal of Verbal Learning & Verbal Behavior , 10 , 57–62.10.1016/S0022-5371(71)80094-4
   Google Scholar
• Shlens, J. (2007). Notes on Kullback-Leibler divergence and likelihood. Retrieved from https://arxiv.org/abs/1404.2000
   Google Scholar
• Steels, L. (2000). Language as a complex adaptive system. Lecture Notes in Computer Science , 1917 , 17–26.10.1007/3-540-45356-3
   Google Scholar
• Wagenmakers, E.-J. , & Farrell, S. (2004). AIC model selection using Akaike weights. Psychonomic Bulletin & Review , 11 , 192–196.10.3758/BF03206482
   PubMed Web of Science ®Google Scholar
• Willinger, W. , Alderson, D. , Doyle, J. C. , & Li, L. (2004). More ‘normal’ than normal: Scaling distributions and complex systems. In R. G. Ingalls , M. D. Rossetti , J. S. Smith , & B. A. Peters (Eds.), Proceedings of the 2004 Winter Simulation Conference (pp. 130–141). Hanover, MD: Institute for Operations Research and the Management Sciences.
   Google Scholar
• Zipf, G. K. (1945). The meaning-frequency relationship of words. Journal of General Psychology , 33 , 251–256.10.1080/00221309.1945.10544509
   PubMedGoogle Scholar
• Zipf, G. K. (1949). Human behaviour and the principle of least effort . Cambridge (MA), USA: Addison-Wesley.
   Google Scholar