Publications

• Mario Giulianelli, Jack Harding, Florian Mohnert, Dieuwke Hupkes and Willem Zuidema (2018), Under the hood.
• Michael Repplinger, Lisa Beinborn and Willem Zuidema (2018), Vector-space models of words and sentences, Nieuw Archief voor de Wiskunde, Sept. 2018. pdf
• Bart de Boer and Willem Zuidema (2018), The evolution of combinatorial structure in language. Current Opinion in Behavioral Sciences, Volume 21, June 2018, Pages 138-144. Open access.
• Raquel Alhama & Willem Zuidema (2018), Pre-Wiring and Pre-Training: What does a neural network need to learn truly general identity rules?, In: Journal of Artificial Intelligence Research (special track on Deep Learning, Knowledge Representation, and Reasoning). Vol. 61. Open access.
• Dieuwke Hupkes, Sara Veldhoen & Willem Zuidema (2018), Visualisation and ‘diagnostic classifiers’ reveal how recurrent and recursive neural networks process hierarchical structure, In: Journal of Artificial Intelligence Research (special track on Deep Learning, Knowledge Representation, and Reasoning). Preprint
• Samira Abnar, Rasyan Ahmed, Max Mijnheer, Willem Zuidema (2018), Experiential, Distributional and Dependency-based Word Embeddings have Complementary Roles in Decoding Brain Activity, Proceedings Workshop on Cognitive Modeling and Computational Linguistics (CMCL 2018). Preprint
• Willem Zuidema, Dieuwke Hupkes, Geraint Wiggins, Constance Scharff and Martin Rochmeier (2018), Formal models of Structure Building in Music, Language and Animal Song, In: Henkjan Honing (ed.), The Origins of Musicality, MIT Press. https://arxiv.org/abs/1901.05180
• Björn Merker, Willem Zuidema and Iain Cross, Five fundamental constraints on theories of the origins of music, In: Henkjan Honing (ed.), The Origins of Musicality, MIT Press.
• Sara Veldhoen & Willem Zuidema, Can Neural Networks learn Logical Reasoning? (2018) In: Simon Dobnik and Shalom Lappin (eds.), Proceedings of the Conference on Logic and Machine Learning in Natural Language (LaML 2017), pp. 35-41, University of Gothenburgh, Sweden.

2017

• Hupkes, D. and Zuidema, W. (2017). Diagnostic classification and symbolic guidance to understand and improve recurrent neural networks. Proceedings Workshop on Interpreting, Explaining and Visualizing Deep Learning (at NIPS2017).
• Raquel G. Alhama & Willem Zuidema, Segmentation as Retention and Recognition: the R&R model. Proceedings CogSci 2017.
• Willemijn van Woerkom & Willem Zuidema, Selecting the model that best fits the data. Commentary on Tali Leibovich, Naama Katzin, Maayan Harel and Avishai Henik, From ‘sense of number’ to ‘sense of magnitude’ – The role of continuous magnitudes in numerical cognition, Behavior & Brain Sciences (in press, 2017)

2016

• Alhama, R. G. & Zuidema, W. (2016). Pre-Wiring and Pre-Training: What does a neural network need to learn truly general identity rules? In Proceedings of the Workshop on Cognitive Computation: Integrating Neural and Symbolic Approaches (at NIPS2016).
• Sara Veldhoen, Dieuwke Hupkes & Willem Zuidema, Diagnostic Classifiers: Revealing how Neural Networks Process Hierarchical Structure. Workshop on Cognitive Computation: Integrating Neural and Symbolic Approaches (at NIPS2016) (pdf)
• Phong Le and Willem Zuidema, Quantifying the vanishing gradient and long distance dependency problem in recursive neural networks and recursive LSTMs, Workshop on Representation Learning (at ACL2016)
• Raquel Alhama and Willem Zuidema, Generalization in Artificial Language Learning: Modelling the Propensity to Generalize In Proceedings of the 7th Workshop on Cognitive Aspects of Computational Language Learning (at ACL2016).
• Jelle Zuidema (2016), Van A naar B. In: Alex Reuneker, Ronny Boogaart en Saskia Lensink (eds.), Aries netwerk –een constructicon. Columns aangeboden aan Arie Verhagen, september 2016). (pdf)

2015

• Jelle Zuidema, Zwarte inktvlekjes op een witte achtergrond, In: Mark Geels, Tim van Opijnen (Eds.), Nederland in ideeën – Dit is het mooiste ooit. Amsterdam: Maven.
• Phong Le and Willem Zuidema, The Forest Convolutional Network: Compositional Distributional Semantics with a Neural Chart and without Binarization, Proceedings EMNLP 2015
• Raquel Alhama, Remko Scha, and Willem Zuidema, How should we evaluate models of word segmentation? (ICCM’15, best student poster award)
• Phong Le and Willem Zuidema, Unsupervised Dependency Parsing: Let’s Use Supervised Parsers (NAACL 2015)
• Phong Le and Willem Zuidema, Compositional Distributional Semantics with Long Short Term Memory, Proceedings (*SEM 2015).
• Martin Rohrmeier, Willem Zuidema, Geraint Wiggins and Constance Scharff, Principles of structure building in music, language and animal song (Proceedings Royal Society – B)
• Björn Merker, Willem Zuidema and Iain Cross, Five fundamental constraints on theories of the origin of music (Proceedings Royal Society – B)

2014

• Phong Le and Willem Zuidema, Inside-Outside Semantics: A Framework for Neural Models of Semantic Composition. Deep Learning and Representation Learning Workshop: NIPS 2014
• Phong Le and Willem Zuidema, The Inside-Outside Recursive Neural Network model for Dependency Parsing, Proceedings EMNLP’14.
• Willem Zuidema, Requirements on Scenarios for the Evolution of Language and Cognition (Proceedings Evolang’14)
• Raquel Alhama, Remko Scha, and Willem Zuidema, Rule Learning in Humans and Animals (Proceedings Evolang’14)
• Marieke Woensdregt and Willem Zuidema, Neural Networks, Algebraic Rules & Human Uniqueness (Proceedings Evolang’14)

Papers from before 2014 can be found on my old publications page.

2013

Jelle Zuidema, Honderdduizend jaar nuttig geklets. In: In: Mark Geels, Tim van Opijnen (Eds.), Nederland in ideeën (2013). pdf: nederlandinideeen2013

2013

• Willem Zuidema and Bart de Boer, Modelling in the Language
  Sciences. In: Sharma and Podesva, Research Methods in Linguistics,
  Cambridge University Press (2013)
• Borensztajn, G., Zuidema, W. and Bechtel, W. (2013). Systematicity and the need for encapsulated
  representations. In Calvo, P. and Symons, J., (eds.) The
  Architecture of Cognition, MIT Press.
• Barend Beekhuizen, Rens Bod, and Willem Zuidema (2013), Three
  Design Principles of Language: The Search for Parsimony in
  Redundancy. Language and Speech, Volume 56(3), pp265–290. (doi: 10.1177/0023830913484897)
• Phong Le, Willem Zuidema and Remko Scha (2013) Learning from errors: Using vector-based compositional semantics for
  parse reranking. Workshop on Continuous Vector Space Models and their Compositionality (ACL 2013). (pdf)
• Willem Zuidema, Contextfreeness Revisited (2013). Proceedings CogSci’13. (pdf)
• Carel ten Cate, Robert Lachlan, and Willem Zuidema, Analyzing the structure of bird vocalizations and language: finding common
  ground. In: Bolhuis and Everaert(eds), Birdsong,
  Speech, And Language – Exploring the Evolution of Mind and Brain, MIT Press (2013)
• Willem Zuidema, Language in Nature: on the Evolutionary Roots of a Cultural Phenomenon. In: Philippe Binder and Kenny Smith
  (eds.), The Language Phenomenon, Berlin: Springer (2013)

2012

• Willem Zuidema, Language in Nature: on the evolutionary roots of a cultural, ILLC Preprint Series (PP-2012-13), University of
  Amsterdam.
• P. Lê & W. Zuidema (2012). Learning Compositional Semantics for Open Domain Semantic Parsing. In: Proceedings of COLING 2012 (Mumbai, India).

2011

• Jelle Zuidema, Taalonderzoek binnen en buiten de gebaande paden, Cavia 26: pp14-17. (pdf)
• Richard Kunert, Raquel Fernández, and Willem Zuidema (2011) Adaptation in Child Directed Speech: Evidence from Corpora. In
  Proceedings of the 15th SEMDIAL Workshop on the Semantics and Pragmatics of Dialogue (Los Angelogue), pp. 112-119, Los Angeles,
  California.
  (pdf)
• Federico Sangati and Willem Zuidema. 2011. Accurate Parsing with
  Compact Tree-Substitution Grammars: Double-DOP. In Proceedings of the
  Conference on Empirical Methods in Natural Language Processing
  (EMNLP’11), pp 84-95.
  (pdf)
• Gideon Borensztajn and Willem Zuidema. 2011. Episodic grammar: a
  computational model of the interaction between episodic and semantic
  memory in language processing. Proceedings of the 33d Annual Conference of the
  Cognitive Science Society (CogSci’11), pp 507-512
  (pdf)

2010

• Federico Sangati, Willem Zuidema, and Rens Bod. 2010. Efficiently
  extracting recurring tree fragments from large treebanks. In Proceedings
  of LREC.
• Maarten Versteegh, Federico Sangati, and Willem Zuidema (2010),
  Simulations Of Socio-Linguistic Change: Implications For
  Unidirectionality, Proceedings Evolang8 (Utrecht, April 2010)
• Willem Zuidema and Arie Verhagen, What are the unique design
  features of language? Formal tools for comparative claims. Adaptive
  Behavior. Vol. 18, No. 1, 48-65
• Bart de Boer and Willem Zuidema, Multi-agent simulations of the
  evolution of combinatorial phonology. Adaptive
  Behavior. Vol. 18, No 2., 141-154

2009

• Willem Zuidema, A syllable frequency list for Dutch, ILLC Preprint Series
  (PP-2009-50), University of
  Amsterdam. () pdf manuscript
  (email me to obtain the full appendix).
• Bart de Boer and Willem Zuidema, Models of Language Evolution: Does the Math Add Up?
  ILLC Preprint Series (PP-2009-49), University of Amsterdam. pdf manuscript
• Van Heijningen, De Visser, Zuidema and Ten Cate, Simple rules can
  explain discrimination of putative recursive syntactic structures by a
  songbird species, Proceeding National Academy of Sciencies – USA
  (PNAS), December 1, 2009, vol. 106, no. 48,
  pp.20538-20543 PNAS
  website
• Federico Sangati, Willem Zuidema and Rens Bod, 2009, An accurate
  re-ranking generative model for dependency parsing. Proceedings of
  the 11th International Conference on Parsing Technologies (IWPT’09),
  pp 238-241 pdf
• Federico Sangati and Willem Zuidema, Unsupervised Methods for Head
  Assignments (2009), Proceedings of the 12th Conference of the
  European Chapter of the ACL (EACL’09), pp. 701-709.
  pdf
• Vanessa Ferdinand and Willem Zuidema (2009), Thomas’ Theorem meets
  Bayes’ Rule: a model of the iterated learning of language,
  Proceedings of the 31st Annual Conference of the Cognitive Science
  Society (Cogsci’09), pp.1786-1791.
• Gideon Borensztajn, Willem Zuidema, and Rens Bod (2009), The
  hierarchical prediction network: towards a neural theory of
  language, Proceedings of the 31st Annual Conference of the Cognitive Science
  Society (Cogsci’09), pp.2974-2979.
• Willem Zuidema and Bart de Boer (2009), The evolution of
  combinatorial phonology. Journal of Phonetics
  Volume 37, Issue 2, April 2009, Pages 125-144 pdf
• Gideon Borensztajn, Willem Zuidema and Rens Bod (2009), Children’s
  grammars grow more abstract with age – Evidence from an automatic
  procedure for identifying the productive units of
  language. TopiCS in Cognitive Science 1(1):175-188
  pdf

2008

• Gideon Borensztajn, Jelle Zuidema and Rens
  Bod, Taalverwerving: De wetenschap van
  de kleine wetenschapper, Kunst en Wetenschap, 17/4:9-10,
  December 2008 (in Dutch).
• Willem Zuidema, Bart de Boer, Evolutionary Explanations for Natural
  Language – Criteria from Evolutionary Biology. ILLC Preprint Series
  (PP-2008-56), University of
  Amsterdam pdf
• V. Ferdinand and W. Zuidema, An experiment in iterated function
  learning, ILLC Preprint Series (PP-2008-53), University of
  Amsterdam pdf
• V. Ferdinand and W. Zuidema, Language adapting to the brain: a study
  of a Bayesian iterated learning model, ILLC Preprint Series
  (PP-2008-54), University of
  Amsterdam pdf
• Gideon Borensztajn, Willem Zuidema and Rens Bod (2008), Children’s
  grammars grow more abstract with age – Evidence from an automatic
  procedure for identifying the productive units of
  language. Proceedings CogSci,
  2008. pdf manuscript
• Willem Zuidema (2008), Empirical evidence for recursive
  hierarchical structure in child language. In: Sakas, W (ed.),
  Proceedings Workshop on Psycho-Computational Models of Language
  Acquisition
• Willem Zuidema, A gradual path to hierarchical phrase-structure:
  insights from modeling and corpus data. In: Andrew D M Smith, Kenny
  Smith and Ramon Ferrer i Cancho (eds). The Evolution of Language –
  Proceedings of the 7th International Conference (Evolang7), World Scientific.
• Federico Sangati and Willem Zuidema, Communication, Cooperation,
  and Coherence. In: Andrew D M Smith, Kenny Smith and Ramon Ferrer i
  Cancho (eds). The Evolution of Language – Proceedings of the 7th
  International Conference (Evolang7), World Scientific, pp. 491-492.

2007

• Gideon Borensztajn and Willem Zuidema (2007), Bayesian Model
  Merging for Unsupervised Constituent Labeling and Grammar
  Induction. ILLC Prepublication PP-2007-40, University of
  Amsterdam. pdf
• Willem Zuidema (2007), Parsimonious Data-Oriented Parsing, in:
  Proceedings of the 2007 Joint Conference on Empirical Methods in
  Natural Language Processing and Computational Natural Language
  Learning (EMNLP-CoNLL 2007). pdf manuscript

2006

• Willem Zuidema, What are the Productive Units of Natural Language
  Grammar? A DOP Approach to the Automatic Identification of
  Constructions. Proceedings CONLL’06. (pdf
  manuscript). (Note: the mentioned supplementary material giving
  the derivation of equation~8 is superceded by the EMNLP-CoNLL 2007
  paper above).
• Willem Zuidema, Theoretical Evaluation of Estimation Methods
  for Data-Oriented Parsing, in: Conference Companion / Proceedings
  11th Conference of the European Chapter of the Association for
  Computational Linguistics (EACL’06), published by the Association for
  Computational Linguistics, pp. 183-186. (pdf corrected manuscript; note: the published
  version of this paper contains an error – see corrigendum.)
• Willem Zuidema and Timothy O’Donnell, Beyond the argument from
  design (extended abstract), Proceedings Evolang 5 (pdf)

2005

• Willem Zuidema, The Major Transitions in the Evolution of
  Language, Theoretical and Applied Linguistics, University of
  Edinburgh, UK, 2005. (download pdf: 1.9Mb)

2004

• Bart de Boer and Willem Zuidema, From Holistic to Combinatorial Signals
  (extended abstract), Proceedings Evolang 4 (txt).
• Timothy O’Donnell and Willem Zuidema, Mathematical Linguistics and
  Language Evolution (extended abstract), Proceedings Evolang 4 (txt).

2003

• Willem Zuidema, Optimal Communication in a Noisy and Heterogeneous
  Environment, in: W. Banzhaf, T. Christaller, P. Dittrich, J. T. Kim,
  and J. Ziegler, editors, Advances in Artificial Life – Proceedings of
  the 7th European Conference on Artificial Life (ECAL), Lecture Notes
  in Artificial Intelligence, Vol. 2801, pp. 553-563, Springer Verlag,
  Berlin, Heidelberg, 2003 (pdf
  manuscript and supplementary
  material)
• Willem Zuidema and Gert Westermann, Evolution of an Optimal
  Lexicon under Constraints from Embodiment, Artificial Life, vol. 9,
  issue 4, pp 387-402, 2003.
  (pdf manuscript)
• Willem Zuidema and Bart de Boer, How did we get from there to here
  in the evolution of language? Behavioral and Brain Sciences (in press
  for BBS issue 26(6), 2003) (Commentary on R. Jackendoff, Foundations
  of Language, Oxford University Press, Oxford, UK, 2002). (pdf manuscript)
• Nick Barton and Willem Zuidema, Evolution: The erratic path
  towards complexity, Current Biology, vol. 13, issue 16, pp. 649-651,
  2003. (Commentary on R. Lenski, C. Ofria, R. Pennock, and C. Adami,
  The evolutionary origin of complex features, Nature, vol. 8,
  pp. 139-144, 2003).
  (pdf manuscript)
• Willem Zuidema, How the poverty of the stimulus solves the poverty
  of the stimulus, in: Suzanna Becker, Sebastian Thrun, and Klaus
  Obermayer (eds.), Advances in Neural Information Processing Systems 15
  (Proceedings of NIPS’02), MIT Press,
  Cambridge, MA, pp. 51-58, 2003.
  (postscript)
  (pdf)

2002

• Andy Gardner and Willem Zuidema, Is evolvability involved in the
  origin of modular variation?, Evolution 57, Nr. 6, pp 1448-1450,
  2003. (Commentary on Lipson, Pollack and Suh (2002), On the origin of
  modular variation, Evolution 56, pp. 1549-1556).
  (pdf manuscript)
• Willem Zuidema, The importance of
  social learning in the evolution of cooperation and
  communication, Behavioral and Brain Sciences, Vol. 25,
  issue 2, pp 283-284, 2002; Commentary on Howard Rachlin,
  Altruism and Selfishness, Behavioral and Brain Sciences,
  Vol. 25, issue 2, pp. 239-250, 2002.
• Joachim De Beule, Joris Van Looveren and Willem Zuidema, *From
  perception to language: grounding formal syntax in an almost real
  world, presented at the Belgium-Netherlands Artificial
  Intelligence Conference, October 21-22. 2002, Leuven, Belgium
• Willem Zuidema, *Language adaptation helps language acquisition (2002),
  in: Bridget Hallam, Dario Floreano, John Hallam, Gillian Hayes and
  Jean-Arcady Meyer (Eds.), From Animals to Animats 7 (Proceedings of
  the 7th International Conference on the Simulation of Adaptive
  Behavior, Edinburgh, August 4-9, 2002), MIT Press, Cambridge, MA,
  pp. 417-418
  (postscript)
  (pdf)
• Willem Zuidema, *Language Adaptation helps Language Acquisition
  (2002), presented at International
  Workshop on Self-Organization and Evolution of Social Behaviour,
  September 8-13, Monte Verita, Switzerland; article in Proceedings
• Willem Zuidema, *How the poverty of stimulus solves the poverty of
  stimulus (abstract [pdf]),
  presented at Evolution
  of Language 2002

2001

• Willem Zuidema, Emergent syntax: the unremitting value of computational
  modeling for understanding the origins of complex language (2001),
  AI-MEMO 01-04, AI-Lab, VUB Brussels (postscript) (pdf) (long version of conference
  publication with the same title)
• Willem Zuidema and Gert Westermann, On the Relevance of Language
  Evolution Models for Cognitive Science (2001), AI-MEMO 01-03, AI-Lab,
  VUB Brussels (postscript) (pdf) (long version of Zuidema and
  Westermann (2001), DECO)
• Willem Zuidema, Language is different: the relevance of group, culture
  and computers in the evolution of syntax, presented at the OHLL
  Coevolution of Syntax and Semantics meeting, September 2001, Paris,
  France.
• Willem Zuidema, *Emergent syntax: the unremitting value of
  computational modeling for understanding the origins of complex
  language (2001), in: Kelemen and Sosik (eds.), Advances in Artificial
  Life (Proceedings 6th European Conference on Artificial Life, Prague,
  September 10-14, 2001), Series: Lecture Notes in Computer Science
  Vol. 2159, Springer, Berlin, pp. 641-644,
  (postscript)
  (pdf)(all papers online at the ECAL2001-website ; buy the
  book at the
  publisher’s page – Springer )
• Willem Zuidema and Gert Westermann, *Towards formal models of embodiment
  and selforganization of language (presented at DECO-2001, Edinburgh, July
  31st 2001); article in Proceedings

2000

• Willem Hero Zuidema, Evolution of syntax in groups
  of agents (2000): Master’s thesis, Theoretical Biology, Utrecht
  University
• Willem Zuidema and Paulien Hogeweg, Selective advantages of syntactic
  language – a model study, in: Gleitman and Joshi (eds.),
  Proceedings of the 22nd Annual Meeting of the Cognitive Science
  Society, Lawrence Erlbaum Associates, Hillsdale, USA, pp. 577 – 582, 2000.
  (postscript)
  (pdf)(all papers online at the Cogsci2000-website;
  buy the book at
  the publisher’s page – Erlbaum)
• Willem Zuidema, Language evolution: establishing conventions and
  exploiting constraints (2000), presented at Bene-Evolang 2000
• Willem Zuidema and Paulien Hogeweg, *Social patterns guide evolving grammars
  (2000) (postscript) (pdf) Presented at the Evolution of language
  2000 conference; article in Proceedings

1999

• Willem Zuidema and Paulien Hogeweg, *Selective advantages of grammatical
  language, abstract (html) of presentation
  at Theory and Mathematics in Biology and Medicin 1999.
• Willem Zuidema, Social patterns restrict
  evolving grammars (1999) — appendix a
  — appendix b (postscript): Internal report
  (stageverslag); appendix a contains the basic program code for the
  language evolution model used in other papers and the thesis above.
• Willem Zuidema, Rule-learning in recurrent neural
  networks (1999) and appendix (program
  code) (postscript): class paper for “connectionism”