Strong systematicity through sensorimotor conceptual grounding: an unsupervised, developmental approach to connectionist sentence processing

References

• Barsalou , L. 1999 . Perceptual Symbol Systems . Behavioural and Brain Sciences , 22 : 577 – 660 .
   PubMed Web of Science ®Google Scholar
• Bates , E. and Carnevale , G. 1993 . New Directions in Research on Language Development . Developmental Review , 13 : 436 – 470 .
   Web of Science ®Google Scholar
• Bates , E. and Goodman , J. C. 1997 . On the Inseparability of Grammar and the Lexicon: Evidence from Acquisition, Aphasia and Real-Time Processing . Language and Cognitive Processes , 12 : 507 – 584 .
   Web of Science ®Google Scholar
• Bloom , P. 2000 . How Children Learn the Meanings of Words , Cambridge , MA : MIT Press .
   Google Scholar
• Brachman , R. J. 1977 . What's in a Concept: Structural Foundations for Semantic Networks . International Journal of Man-Machine Studies , 9 : 127 – 152 .
   Google Scholar
• Brachman , R. J. 1979 . “ On the Epistemological Status of Semantic Networks ” . In Associative Networks: Representation and Use of Knowledge by Computers , Edited by: Findler , N. 3 – 50 . New York : Academic Press .
   Google Scholar
• Brakel , P. and Frank , S. Strong Systematicity in Sentence Processing by Simple Recurrent Networks . Proceedings of the 31st Annual Conference of the Cognitive Science Society , Edited by: Taatgen , N. and van Rijn , H. pp. 1599 – 1604 . Austin , TX : Cognitive Science Society .
   Google Scholar
• Brooks , R. 1991 . Intelligence without Representation . Artificial Intelligence , 47 : 139 – 159 .
   Web of Science ®Google Scholar
• Brown , R. 1973 . A First Language: The Early Stages , Cambridge , MA : Harvard University Press .
   Google Scholar
• Cansino , S. , Williamson , S. J. and Karron , D. 1994 . Tonotopic Organization of Human Auditory Cortex . Brain Research , 663 : 38 – 50 .
   Web of Science ®Google Scholar
• Chang , F. , Dell , S. and Bock , K. 2006 . Becoming Syntactic . Psychological Review , 113 : 234 – 272 .
   PubMed Web of Science ®Google Scholar
• Chappell , G. and Taylor , J. 1993 . The Temporal Kohonen Map . Neural Networks , 6 : 441 – 445 .
   Web of Science ®Google Scholar
• Choe , Y. and Miikkulainen , R. 2004 . Contour Integration and Segmentation with Self-Organized Lateral Connections . Biological Cybernetics , 90 : 75 – 88 .
   Web of Science ®Google Scholar
• Christiansen , M. H. and Chater , N. 1999 . Toward a Connectionist Model of Recursion in Human Linguistic Performance . Cognitive Science , 23 : 157 – 205 .
   Web of Science ®Google Scholar
• Clark , A. 2008 . Supersizing the Mind: Embodiment, Action, and Cognitive Extension , Oxford , , UK : Oxford University Press .
   Google Scholar
• Collins , A. M. and Loftus , E. F. 1975 . A Spreading Activation Theory of Semantic Memory . Psychological Review , 82 : 407 – 428 .
   Web of Science ®Google Scholar
• Collins , A. M. and Quillian , M. R. 1969 . Retrieval Time from Semantic Memory . Journal of Verbal Learning and Verbal Memory , 8 : 240 – 247 .
   Google Scholar
• Cristianini , N. 2010 . Are we there yet? . Neural Networks , 23 : 466 – 470 .
   Web of Science ®Google Scholar
• Eimas , P. and Quinn , P. 1994 . Studies on the Formation of Perceptually Based Basic-Level Categories in Young Infants . Child Development , 65 : 903 – 917 .
   PubMed Web of Science ®Google Scholar
• Elman , J. 1990 . Finding Structure in Time . Cognitive Science , 14 : 179 – 211 .
   Web of Science ®Google Scholar
• Elman , J. 1991 . Distributed Representations, Simple Recurrent Networks, and Grammatical Structure . Machine Learning , 7 : 195 – 224 .
   Web of Science ®Google Scholar
• Elman , J. 1995 . “ Language as a Dynamical System ” . In Mind as Motion: Dynamical Perspectives on Behaviour and Cognition , Edited by: Port , R. and van Gelder , T. 195 – 225 . Cambridge , MA : MIT Press .
   Google Scholar
• Fenson , L. , Pethick , S. , Renda , C. , Cox , J. , Dale , P. and Reznick , J. 2000 . Short Form Versions of the MacArthur Communicative Development Inventories . Applied Psycholinguistics , 21 : 95 – 115 .
   Web of Science ®Google Scholar
• Farkaš , I. and Crocker , M. 2008 . Syntactic Systematicity in Sentence Processing with a Recurrent Self-Organizing Network . Neurocomputing , 71 : 1172 – 1179 .
   Web of Science ®Google Scholar
• Fodor , J. and Pylyshyn , Z. 1988 . Connectionism and Cognitive Architecture: A Critical Analysis . Cognition , 28 : 3 – 71 .
   PubMed Web of Science ®Google Scholar
• Fodor , J. and McLaughlin , B. 1990 . Connectionism and the Problem of Systematicity: Why Smolensky's Solution Doesn't Work . Cognition , 35 : 183 – 204 .
   PubMed Web of Science ®Google Scholar
• Frank , S. 2006 . Learn More by Training Less: Systematicity in Sentence Processing by Recurrent Networks . Connection Science , 18 : 287 – 302 .
   Web of Science ®Google Scholar
• Frank , S. L. and Cernansky , M. Generalization and Systematicity in Echo State Networks . Proceedings of the 30th Annual Conference of the Cognitive Science Society , Edited by: Love , B. C. , McRae , K. and Sloutsky , V. M. Austin , TX : Cognitive Science Society .
   Google Scholar
• Frank , S. L. and Jacobsson , H. 2010 . Sentence-Processing in Echo State Networks: A Qualitative Analysis by Finite State Machine Extraction . Connection Science , 22 : 135 – 155 .
   Web of Science ®Google Scholar
• Goldberg , A. 1999 . “ The Emergence of Argument Structure Semantics ” . In The Emergence of Language , Edited by: MacWhinney , B. 197 – 213 . New Jersey , , USA : Lawrence Erlbaum Associates .
   Google Scholar
• Hadley , R. 1994 . Systematicity in Connectionist Language Learning . Mind and Language , 9 : 247 – 272 .
   Google Scholar
• Hagenbuchner , M. , Sperduti , A. and Tsoi , A. C. 2003 . A Self-organizing Map for Adaptive Processing of Structured Data . IEEE Transactions on Neural Networks , 14 (3) : 491 – 505 .
   Web of Science ®Google Scholar
• Harnad , S. 1990 . The Symbol Grounding Problem . Physica D , 42 : 335 – 346 .
   Web of Science ®Google Scholar
• Hebb , D. O. 1949 . The Organization of Behaviour: A Neuropsychological Theory , New York : Wiley .
   Google Scholar
• Herrmann , M. , Hertz , J. and Prugel-Bennett , A. l . 1995 . Analysis of Synfire Chains . Network: Computation in Neural Systems , 6 : 403 – 414 .
   Web of Science ®Google Scholar
• Heskes , T. 1999 . “ Energy Functions for Self-Organizing Maps ” . In Kohonen Maps , Edited by: Oja , E. and Kaski , S. 303 – 315 . Amsterdam , , The Netherlands : Elsevier .
   Google Scholar
• Howell , S. , Jankowicz , D. and Becker , S. 2005 . A Model of Grounded Language Acquisition: Sensorimotor Features Improve Lexical and Grammatical Learning . Journal of Memory and Language , 53 : 258 – 276 .
   Web of Science ®Google Scholar
• Jaeger , H. 2003 . “ Adaptive Nonlinear System Identification with Echo State Networks ” . In Advances in Neural Information Processing Systems , Edited by: Becker , S. , Thrun , S. and Obermayer , K. Vol. 15 , 593 – 600 . Cambridge , MA : MIT Press .
   Google Scholar
• James , D. and Miikkulainen , R. 1995 . “ SARDNET: A Self-Organizing Feature Map for Sequences ” . In Advances in Neural Information Processing Systems , Edited by: Tesauro , G. , Touretzky , D. S. and Leen , T. K. Vol. 7 , 577 – 584 . Cambridge , MA : MIT Press .
   Google Scholar
• Jansen , P. 2010 . “ A Self-Organizing Computational Neural Network Architecture with Applications to Sensorimotor Grounded Linguistic Grammar Acquisition ” . Hamilton , , Canada : McMaster University . unpublished Ph.D. dissertation
   Google Scholar
• Kohonen , T. 1982 . Self-Organized Formation of Topologically Correct Feature Maps . Biological Cybernetics , 43 : 59 – 69 .
   Web of Science ®Google Scholar
• Kohonen , T. 1995 . Self-Organizing Maps , Berlin : Springer .
   Google Scholar
• Mandler , J. 2004 . The Foundations of Mind: The Origins of Conceptual Thought , New York : Oxford University Press .
   Google Scholar
• Marcus , G. 1998 . Can Connectionism Save Constructivism? . Cognition , 66 : 153 – 182 .
   PubMed Web of Science ®Google Scholar
• McRae , K. , de Sa , V. and Seidenberg , M. 1997 . On the Nature and Scope of Featural Representations of Word Meaning . Journal of Experimental Psychology: General , 126 : 99 – 130 .
   PubMed Web of Science ®Google Scholar
• Meyer , D. and Schvaneveldt , R. 1971 . Facilitation in Recognizing Pairs of Words: Evidence of a Dependence between Retrieval Operations . Journal of Experimental Psychology , 90 : 227 – 234 .
   PubMedGoogle Scholar
• Meyer , D. , Schvaneveldt , R. and Ruddy , M. 1975 . “ Loci of Contextual Effects on Visual Word-Recognition ” . In Attention and Performance V , Edited by: Rabbitt , P. 98 – 118 . London : Academic Press .
   Google Scholar
• Mozer , M. 1994 . “ Neural Net Architectures for Temporal Sequence Processing ” . In Predicting the Future and Understanding the Past , Edited by: Weigend , A. and Gershenfeld , N. 243 – 264 . Redwood City , CA : Addison-Wesley Publishing .
   Google Scholar
• Nelson , K. 1973 . Structure and Strategy in Learning to Talk . Monographs of the Society for Research in Child Development , 38 : 1 – 135 .
   Google Scholar
• Pecher , D. , Zeelenberg , R. and Barsalou , L. 2004 . Sensorimotor Simulations Underlie Conceptual Representations: Modality-Specific Effects of Prior Activation . Psychonomic Bulletin and Review , 11 : 164 – 167 .
   PubMed Web of Science ®Google Scholar
• Pinker , S. 1984 . Language Learnability and Language Development , Cambridge , MA : Harvard University Press .
   Google Scholar
• Prasada , S. and Pinker , S. 1993 . Generalization of Regular and Irregular Morphological Patterns . Language and Cognitive Processes , 8 : 1 – 56 .
   Web of Science ®Google Scholar
• Richardson , D. , Spivey , M. , Barsalou , L. and McRae , K. 2003 . Spatial Representations Activated during Real-Time Comprehension of Verbs . Cognitive Science , 27 : 767 – 780 .
   Web of Science ®Google Scholar
• Ritter , H. and Kohonen , T. 1989 . Self-Organizing Semantical Maps . Biological Cybernetics , 62 : 241 – 254 .
   Web of Science ®Google Scholar
• Rumelhart , D. and McClelland , J. 1986a . Parallel Distributed Processing: Explorations in the Microstructure of Cognition , Vol. I , Cambridge , MA : MIT Press .
   Google Scholar
• Rumelhart , D. and McClelland , J. 1986b . “ On Learning the Past Tenses of English Verbs ” . In Parallel Distributed Processing: Explorations in the Microstructure of Cognition , Edited by: Rumelhart , D. and McClelland , J. Vol. II , 216 – 268 . Cambridge , MA : MIT Press .
   Google Scholar
• Schank , R. 1982 . Dynamic Memory: A Theory of Reminding and Learning in Computers and People , New York : Cambridge University Press .
   Google Scholar
• Searle , J. 1980 . Minds, Brains, and Programs . Behavioural and Brain Sciences , 3 : 417 – 457 .
   Web of Science ®Google Scholar
• Solomon , K. and Barsalou , L. 2004 . Perceptual Simulation in Property Verification . Memory and Cognition , 32 : 244 – 259 .
   PubMed Web of Science ®Google Scholar
• Strickert , M. and Hammer , B. Neural Gas for Sequences . Proceedings of the Workshop on Self-Organizing Neural Networks (WSOM) , Edited by: Yamakawa , T. pp. 53 – 58 . Kyushu, Japan, Orlando , FL : Elsevier .
   Google Scholar
• Van der Velde , F. and de Kamps , M. A Neural Architecture for Grounded Cognition: Representation, Structure, Dynamics and Learning . June 1–8 , Piscataway , NJ . Proceedings of the International Joint Conference on Neural Networks (IJCNN 2008), (IEEE World Congress on Computational Intelligence) , pp. 961 – 968 .
   Google Scholar
• Van der Velde , F. and de Kamps , M. 2011 . Compositional Connectionist Structures Based on In Situ Grounded Representations . Connection Science , 23 : 97 – 107 .
   Web of Science ®Google Scholar
• Van der Velde , F. , van der Voort van der Kleij , G. and de Kamps , M. 2004 . Lack of Combinatorial Productivity in Language Processing with Simple Recurrent Networks . Connection Science , 16 : 21 – 46 .
   Web of Science ®Google Scholar
• Voegtlin , T. 2002 . Recursive Self-Organizing Maps . Neural Networks , 15 : 979 – 991 .
   PubMed Web of Science ®Google Scholar
• Woods , B. 1975 . “ What's in a Link: Foundations for Semantic Networks ” . In Representation and Understanding: Studies in Cognitive Science , Edited by: Bobrow , D. and Collins , A. 35 – 82 . New York : Academic Press .
   Google Scholar