Publications

2021

  • Bas Cornelissen, Willem Zuidema, John Ashley Burgoyne (2021), submitted
  • Janie Sinclair, Jaap Jumelet, Willem Zuidema & Raquel Fernandez (2021), submitted
  • Samira Abnar, Mostafa Dehghani, Willem Zuidema (in prep.)
  • Rasyan Ahmed, Willem Zuidema, Tom Lentz (in prep.)
  • Oskar van der Wal, Jaap Jumelet, Willem Zuidema & Katrin Schulz (in prep.)

2020

  • Peter Dekker and Willem Zuidema (2020), Word Prediction in Computational
    Historical Linguistics, Journal of Language Modelling (forthcoming).
  • Phong Le and Willem Zuidema (2020), DoLFIn: Distributions over Latent Features for Interpretability, Proceedings Coling 2020.
  • Bas Cornelissen, Willem Zuidema, John Ashley Burgoyne (2020), Mode Classification and Natural Units in Plainchant, In: Proceedings 21st International Society for Music Information Retrieval Conference (ISMIR), best paper “Multi/Interdisciplinary Research”
  • Bas Cornelissen, Willem Zuidema, John Ashley Burgoyne (2020), Studying Large Plainchant Corpora Using chant21, In: Proceedings 7th International Conference on Digital Libraries for Musicology (DLfM 2020), October 2020, Pages 40–44, https://doi.org/10.1145/3424911.3425514
  • Samira Abnar and Willem Zuidema (2020), Quantifying Attention Flow in Transformers. Proceedings ACL’2020. https://arxiv.org/abs/2005.00928
  • Samira Abnar, Mostafa Dehghani, Willem Zuidema (submitted), Transferring Inductive Biases through Knowledge Distillation. https://arxiv.org/abs/2006.00555

2019

  • Raquel G. Alhama and Willem Zuidema (2019). A Review of Computational Models of Basic Rule Learning: the Neural-Symbolic Debate and Beyond. Psychonomic Bulletin & Review, 26(4), 1174-1194. Best Article Award. Cite: bibtex
  • Willem Zuidema, Robert M. French, Raquel G. Alhama, Kevin Ellis, Timothy J. O’Donnell, Tim Sainburg, Timothy Q. Gentner (2019), Five Ways in Which Computational Modeling Can Help Advance Cognitive Science: Lessons From Artificial Grammar Learning. TopICS. https://onlinelibrary.wiley.com/doi/full/10.1111/tops.12474?af=R.  Cite: bibtex
  • Julia Uddén, Mauricio de Jesus Dias Martins, Willem Zuidema & W. Tecumseh Fitch (2019), Hierarchical Structure in Sequence Processing: How to Measure It and Determine Its Neural Implementation, TopiCS. https://onlinelibrary.wiley.com/doi/full/10.1111/tops.12442
  • Abnar, Beinborn, Choenni and Zuidema (2019), Blackbox meets blackbox: Representational Similarity and Stability Analysis of Neural Language Models and Brains.  BlackboxNLP2019, arxiv
  •  Jaap Jumelet, Willem Zuidema, Dieuwke Hupkes (2019), Analysing Neural Language Models: Contextual Decomposition Reveals Default Reasoning in Number and Gender Assignment. CoNLL2019. https://arxiv.org/abs/1909.08975 (Honourable mention)
  • Mul & Zuidema (2019), Siamese recurrent networks learn first-order logic reasoning and exhibit zero-shot compositional generalization, https://arxiv.org/abs/1906.00180
  • Willem Zuidema and Phong Le (2019), Vector-based and Neural Models of Semantics, In: Peter Hagoort (ed.), Human Language, MIT Press. Proofs
  • Willem Zuidema and Hartmut Fitz (2019), Models of human language and speech processing, In: Peter Hagoort (ed.), Human Language, MIT Press.

 

2018

      • Mario Giulianelli, Jack Harding, Florian Mohnert, Dieuwke Hupkes and Willem Zuidema (2018), Under the hood.
      • Michael Repplinger, Lisa Beinborn and Willem Zuidema (2018), Vector-space models of words and sentences, Nieuw Archief voor de Wiskunde, Sept. 2018. pdf
      • Bart de Boer and Willem Zuidema (2018), The evolution of combinatorial structure in language. Current Opinion in Behavioral Sciences, Volume 21, June 2018, Pages 138-144. Open access.
      • Raquel Alhama & Willem Zuidema (2018), Pre-Wiring and Pre-Training: What does a neural network need to learn truly general identity rules?, In: Journal of Artificial Intelligence Research (special track on Deep Learning, Knowledge Representation, and Reasoning). Vol. 61. Open access.
      • Dieuwke Hupkes, Sara Veldhoen & Willem Zuidema (2018), Visualisation and ‘diagnostic classifiers’ reveal how recurrent and recursive neural networks process hierarchical structure, In: Journal of Artificial Intelligence Research (special track on Deep Learning, Knowledge Representation, and Reasoning). Preprint
      • Samira Abnar, Rasyan Ahmed, Max Mijnheer, Willem Zuidema (2018), Experiential, Distributional and Dependency-based Word Embeddings have Complementary Roles in Decoding Brain Activity, Proceedings Workshop on Cognitive Modeling and Computational Linguistics (CMCL 2018). Preprint
      • Willem Zuidema, Dieuwke Hupkes, Geraint Wiggins, Constance Scharff and Martin Rochmeier (2018), Formal models of Structure Building in Music, Language and Animal Song, In: Henkjan Honing (ed.), The Origins of Musicality, MIT Press. https://arxiv.org/abs/1901.05180
      • Björn Merker, Willem Zuidema and Iain Cross, Five fundamental constraints on theories of the origins of music, In: Henkjan Honing (ed.), The Origins of Musicality, MIT Press.
      • Sara Veldhoen & Willem Zuidema, Can Neural Networks learn Logical Reasoning? (2018) In: Simon Dobnik and Shalom Lappin (eds.), Proceedings of the Conference on Logic and Machine Learning in Natural Language (LaML 2017), pp. 35-41, University of Gothenburgh, Sweden.

2017

      • Hupkes, D. and Zuidema, W. (2017). Diagnostic classification and symbolic guidance to understand and improve recurrent neural networks. Proceedings Workshop on Interpreting, Explaining and Visualizing Deep Learning (at NIPS2017).
      • Raquel G. Alhama & Willem Zuidema, Segmentation as Retention and Recognition: the R&R model. Proceedings CogSci 2017.
      • Willemijn van Woerkom & Willem Zuidema, Selecting the model that best fits the data. Commentary on Tali Leibovich, Naama Katzin, Maayan Harel and Avishai Henik, From ‘sense of number’ to ‘sense of magnitude’ – The role of continuous magnitudes in numerical cognition, Behavior & Brain Sciences (in press, 2017)

2016

      • Alhama, R. G. & Zuidema, W. (2016). Pre-Wiring and Pre-Training: What does a neural network need to learn truly general identity rules? In Proceedings of the Workshop on Cognitive Computation: Integrating Neural and Symbolic Approaches (at NIPS2016).
      • Sara Veldhoen, Dieuwke Hupkes & Willem Zuidema, Diagnostic Classifiers: Revealing how Neural Networks Process Hierarchical Structure. Workshop on Cognitive Computation: Integrating Neural and Symbolic Approaches (at NIPS2016) (pdf)
      • Phong Le and Willem Zuidema, Quantifying the vanishing gradient and long distance dependency problem in recursive neural networks and recursive LSTMs, Workshop on Representation Learning (at ACL2016)
      • Raquel Alhama and Willem Zuidema, Generalization in Artificial Language Learning: Modelling the Propensity to Generalize In Proceedings of the 7th Workshop on Cognitive Aspects of Computational Language Learning (at ACL2016).
      • Jelle Zuidema (2016), Van A naar B. In: Alex Reuneker, Ronny Boogaart en Saskia Lensink (eds.), Aries netwerk –een constructicon. Columns aangeboden aan Arie Verhagen, september 2016). (pdf)

2015

      • Jelle Zuidema, Zwarte inktvlekjes op een witte achtergrond, In: Mark Geels, Tim van Opijnen (Eds.), Nederland in ideeën – Dit is het mooiste ooit. Amsterdam: Maven.
      • Phong Le and Willem Zuidema, The Forest Convolutional Network: Compositional Distributional Semantics with a Neural Chart and without Binarization, Proceedings EMNLP 2015
      • Raquel Alhama, Remko Scha, and Willem Zuidema, How should we evaluate models of word segmentation? (ICCM’15, best student poster award)
      • Phong Le and Willem Zuidema, Unsupervised Dependency Parsing: Let’s Use Supervised Parsers (NAACL 2015)
      • Phong Le and Willem Zuidema, Compositional Distributional Semantics with Long Short Term Memory, Proceedings (*SEM 2015).
      • Martin Rohrmeier, Willem Zuidema, Geraint Wiggins and Constance Scharff, Principles of structure building in music, language and animal song (Proceedings Royal Society – B)
      • Björn Merker, Willem Zuidema and Iain Cross, Five fundamental constraints on theories of the origin of music (Proceedings Royal Society – B)

2014

Papers from before 2014 can be found on my old publications page.

2013

Jelle Zuidema, Honderdduizend jaar nuttig geklets. In: In: Mark Geels, Tim van Opijnen (Eds.), Nederland in ideeën (2013). pdf: nederlandinideeen2013

2013

      • Willem Zuidema and Bart de Boer, Modelling in the Language
        Sciences. In: Sharma and Podesva, Research Methods in Linguistics,
        Cambridge University Press (2013)
      • Borensztajn, G., Zuidema, W. and Bechtel, W. (2013). Systematicity and the need for encapsulated
        representations. In Calvo, P. and Symons, J., (eds.) The
        Architecture of Cognition, MIT Press.
      • Barend Beekhuizen, Rens Bod, and Willem Zuidema (2013), Three
        Design Principles of Language: The Search for Parsimony in
        Redundancy. Language and Speech, Volume 56(3), pp265–290. (doi: 10.1177/0023830913484897)
      • Phong Le, Willem Zuidema and Remko Scha (2013) Learning from errors: Using vector-based compositional semantics for
        parse reranking. Workshop on Continuous Vector Space Models and their Compositionality (ACL 2013). (pdf)
      • Willem Zuidema, Contextfreeness Revisited (2013). Proceedings CogSci’13. (pdf)
      • Carel ten Cate, Robert Lachlan, and Willem Zuidema, Analyzing the structure of bird vocalizations and language: finding common
        ground. In: Bolhuis and Everaert(eds), Birdsong,
        Speech, And Language – Exploring the Evolution of Mind and Brain
        , MIT Press (2013)
      • Willem Zuidema, Language in Nature: on the Evolutionary Roots of a Cultural Phenomenon. In: Philippe Binder and Kenny Smith
        (eds.), The Language Phenomenon, Berlin: Springer (2013)

2012

      • Willem Zuidema, Language in Nature: on the evolutionary roots of a cultural, ILLC Preprint Series (PP-2012-13), University of
        Amsterdam.
      • P. Lê & W. Zuidema (2012). Learning Compositional Semantics for Open Domain Semantic Parsing. In: Proceedings of COLING 2012 (Mumbai, India).

2011

      • Jelle Zuidema, Taalonderzoek binnen en buiten de gebaande paden, Cavia 26: pp14-17. (pdf)
      • Richard Kunert, Raquel Fernández, and Willem Zuidema (2011) Adaptation in Child Directed Speech: Evidence from Corpora. In
        Proceedings of the 15th SEMDIAL Workshop on the Semantics and Pragmatics of Dialogue (Los Angelogue), pp. 112-119, Los Angeles,
        California.
        (pdf)
      • Federico Sangati and Willem Zuidema. 2011. Accurate Parsing with
        Compact Tree-Substitution Grammars: Double-DOP. In Proceedings of the
        Conference on Empirical Methods in Natural Language Processing
        (EMNLP’11), pp 84-95.
        (pdf)
      • Gideon Borensztajn and Willem Zuidema. 2011. Episodic grammar: a
        computational model of the interaction between episodic and semantic
        memory in language processing. Proceedings of the 33d Annual Conference of the
        Cognitive Science Society (CogSci’11), pp 507-512
        (pdf)

2010

      • Federico Sangati, Willem Zuidema, and Rens Bod. 2010. Efficiently
        extracting recurring tree fragments from large treebanks. In Proceedings
        of LREC.
      • Maarten Versteegh, Federico Sangati, and Willem Zuidema (2010),
        Simulations Of Socio-Linguistic Change: Implications For
        Unidirectionality, Proceedings Evolang8 (Utrecht, April 2010)
      • Willem Zuidema and Arie Verhagen, What are the unique design
        features of language? Formal tools for comparative claims. Adaptive
        Behavior. Vol. 18, No. 1, 48-65
      • Bart de Boer and Willem Zuidema, Multi-agent simulations of the
        evolution of combinatorial phonology. Adaptive
        Behavior. Vol. 18, No 2., 141-154

2009

      • Willem Zuidema, A syllable frequency list for Dutch, ILLC Preprint Series
        (PP-2009-50), University of
        Amsterdam. () pdf manuscript
        (email me to obtain the full appendix).
      • Bart de Boer and Willem Zuidema, Models of Language Evolution: Does the Math Add Up?
        ILLC Preprint Series (PP-2009-49), University of Amsterdam. pdf manuscript
      • Van Heijningen, De Visser, Zuidema and Ten Cate, Simple rules can
        explain discrimination of putative recursive syntactic structures by a
        songbird species, Proceeding National Academy of Sciencies – USA
        (PNAS), December 1, 2009, vol. 106, no. 48,
        pp.20538-20543 PNAS
        website
      • Federico Sangati, Willem Zuidema and Rens Bod, 2009, An accurate
        re-ranking generative model for dependency parsing. Proceedings of
        the 11th International Conference on Parsing Technologies (IWPT’09),
        pp 238-241 pdf
      • Federico Sangati and Willem Zuidema, Unsupervised Methods for Head
        Assignments (2009), Proceedings of the 12th Conference of the
        European Chapter of the ACL (EACL’09), pp. 701-709.
        pdf
      • Vanessa Ferdinand and Willem Zuidema (2009), Thomas’ Theorem meets
        Bayes’ Rule: a model of the iterated learning of language,
        Proceedings of the 31st Annual Conference of the Cognitive Science
        Society (Cogsci’09), pp.1786-1791.
      • Gideon Borensztajn, Willem Zuidema, and Rens Bod (2009), The
        hierarchical prediction network: towards a neural theory of
        language, Proceedings of the 31st Annual Conference of the Cognitive Science
        Society (Cogsci’09), pp.2974-2979.
      • Willem Zuidema and Bart de Boer (2009), The evolution of
        combinatorial phonology. Journal of Phonetics
        Volume 37, Issue 2, April 2009, Pages 125-144 pdf
      • Gideon Borensztajn, Willem Zuidema and Rens Bod (2009), Children’s
        grammars grow more abstract with age – Evidence from an automatic
        procedure for identifying the productive units of
        language. TopiCS in Cognitive Science 1(1):175-188
        pdf

2008

      • Gideon Borensztajn, Jelle Zuidema and Rens
        Bod, Taalverwerving: De wetenschap van
        de kleine wetenschapper
        , Kunst en Wetenschap, 17/4:9-10,

        December 2008 (in Dutch).
      • Willem Zuidema, Bart de Boer, Evolutionary Explanations for Natural
        Language – Criteria from Evolutionary Biology. ILLC Preprint Series
        (PP-2008-56), University of
        Amsterdam pdf
      • V. Ferdinand and W. Zuidema, An experiment in iterated function
        learning, ILLC Preprint Series (PP-2008-53), University of
        Amsterdam pdf
      • V. Ferdinand and W. Zuidema, Language adapting to the brain: a study
        of a Bayesian iterated learning model, ILLC Preprint Series
        (PP-2008-54), University of
        Amsterdam pdf
      • Gideon Borensztajn, Willem Zuidema and Rens Bod (2008), Children’s
        grammars grow more abstract with age – Evidence from an automatic
        procedure for identifying the productive units of
        language. Proceedings CogSci,
        2008. pdf manuscript
      • Willem Zuidema (2008), Empirical evidence for recursive
        hierarchical structure in child language. In: Sakas, W (ed.),
        Proceedings Workshop on Psycho-Computational Models of Language
        Acquisition
      • Willem Zuidema, A gradual path to hierarchical phrase-structure:
        insights from modeling and corpus data. In: Andrew D M Smith, Kenny
        Smith and Ramon Ferrer i Cancho (eds). The Evolution of Language –
        Proceedings of the 7th International Conference (Evolang7), World Scientific.
      • Federico Sangati and Willem Zuidema, Communication, Cooperation,
        and Coherence. In: Andrew D M Smith, Kenny Smith and Ramon Ferrer i
        Cancho (eds). The Evolution of Language – Proceedings of the 7th
        International Conference (Evolang7), World Scientific, pp. 491-492.

2007

      • Gideon Borensztajn and Willem Zuidema (2007), Bayesian Model
        Merging for Unsupervised Constituent Labeling and Grammar
        Induction. ILLC Prepublication PP-2007-40, University of
        Amsterdam. pdf
      • Willem Zuidema (2007), Parsimonious Data-Oriented Parsing, in:
        Proceedings of the 2007 Joint Conference on Empirical Methods in
        Natural Language Processing and Computational Natural Language
        Learning (EMNLP-CoNLL 2007). pdf manuscript

2006

      • Willem Zuidema, What are the Productive Units of Natural Language
        Grammar? A DOP Approach to the Automatic Identification of
        Constructions. Proceedings CONLL’06. (pdf
        manuscript
        ). (Note: the mentioned supplementary material giving

        the derivation of equation~8 is superceded by the EMNLP-CoNLL 2007
        paper above).
      • Willem Zuidema, Theoretical Evaluation of Estimation Methods
        for Data-Oriented Parsing
        , in: Conference Companion / Proceedings

        11th Conference of the European Chapter of the Association for
        Computational Linguistics (EACL’06), published by the Association for
        Computational Linguistics, pp. 183-186. (pdf corrected manuscript; note: the published
        version of this paper contains an error – see corrigendum.
        )
      • Willem Zuidema and Timothy O’Donnell, Beyond the argument from
        design (extended abstract), Proceedings Evolang 5 (pdf)

2005

      • Willem Zuidema, The Major Transitions in the Evolution of
        Language, Theoretical and Applied Linguistics, University of
        Edinburgh, UK, 2005. (download pdf: 1.9Mb)

2004

      • Bart de Boer and Willem Zuidema, From Holistic to Combinatorial Signals
        (extended abstract), Proceedings Evolang 4 (txt).
      • Timothy O’Donnell and Willem Zuidema, Mathematical Linguistics and
        Language Evolution (extended abstract), Proceedings Evolang 4 (txt).

2003

      • Willem Zuidema, Optimal Communication in a Noisy and Heterogeneous
        Environment, in: W. Banzhaf, T. Christaller, P. Dittrich, J. T. Kim,
        and J. Ziegler, editors, Advances in Artificial Life – Proceedings of
        the 7th European Conference on Artificial Life (ECAL)
        , Lecture Notes

        in Artificial Intelligence, Vol. 2801, pp. 553-563, Springer Verlag,
        Berlin, Heidelberg, 2003 (pdf
        manuscript
        and supplementary
        material
        )
      • Willem Zuidema and Gert Westermann, Evolution of an Optimal
        Lexicon under Constraints from Embodiment, Artificial Life, vol. 9,
        issue 4, pp 387-402, 2003.
        (pdf manuscript)
      • Willem Zuidema and Bart de Boer, How did we get from there to here
        in the evolution of language? Behavioral and Brain Sciences (in press
        for BBS issue 26(6), 2003) (Commentary on R. Jackendoff, Foundations
        of Language
        , Oxford University Press, Oxford, UK, 2002). (pdf manuscript)
      • Nick Barton and Willem Zuidema, Evolution: The erratic path
        towards complexity, Current Biology, vol. 13, issue 16, pp. 649-651,
        2003. (Commentary on R. Lenski, C. Ofria, R. Pennock, and C. Adami,
        The evolutionary origin of complex features, Nature, vol. 8,
        pp. 139-144, 2003).
        (pdf manuscript)
      • Willem Zuidema, How the poverty of the stimulus solves the poverty
        of the stimulus, in: Suzanna Becker, Sebastian Thrun, and Klaus
        Obermayer (eds.), Advances in Neural Information Processing Systems 15
        (Proceedings of NIPS’02)
        , MIT Press,

        Cambridge, MA, pp. 51-58, 2003.
        (postscript)
        (pdf)

2002

      • Andy Gardner and Willem Zuidema, Is evolvability involved in the
        origin of modular variation?, Evolution 57, Nr. 6, pp 1448-1450,
        2003. (Commentary on Lipson, Pollack and Suh (2002), On the origin of
        modular variation, Evolution 56, pp. 1549-1556).
        (pdf manuscript)
      • Willem Zuidema, The importance of
        social learning in the evolution of cooperation and
        communication
        , Behavioral and Brain Sciences, Vol. 25,

        issue 2, pp 283-284, 2002; Commentary on Howard Rachlin,
        Altruism and Selfishness
        , Behavioral and Brain Sciences,

        Vol. 25, issue 2, pp. 239-250, 2002.
      • Joachim De Beule, Joris Van Looveren and Willem Zuidema, *From
        perception to language: grounding formal syntax in an almost real
        world, presented at the Belgium-Netherlands Artificial
        Intelligence Conference, October 21-22. 2002, Leuven, Belgium
      • Willem Zuidema, *Language adaptation helps language acquisition (2002),
        in: Bridget Hallam, Dario Floreano, John Hallam, Gillian Hayes and
        Jean-Arcady Meyer (Eds.), From Animals to Animats 7 (Proceedings of
        the 7th International Conference on the Simulation of Adaptive
        Behavior, Edinburgh, August 4-9, 2002), MIT Press, Cambridge, MA,
        pp. 417-418
        (postscript)
        (pdf)
      • Willem Zuidema, *Language Adaptation helps Language Acquisition
        (2002), presented at International
        Workshop on Self-Organization and Evolution of Social Behaviour
        ,

        September 8-13, Monte Verita, Switzerland; article in Proceedings
      • Willem Zuidema, *How the poverty of stimulus solves the poverty of
        stimulus (abstract [pdf]),
        presented at Evolution
        of Language 2002

2001

      • Willem Zuidema, Emergent syntax: the unremitting value of computational
        modeling for understanding the origins of complex language (2001),
        AI-MEMO 01-04, AI-Lab, VUB Brussels (postscript) (pdf) (long version of conference
        publication with the same title)
      • Willem Zuidema and Gert Westermann, On the Relevance of Language
        Evolution Models for Cognitive Science (2001), AI-MEMO 01-03, AI-Lab,
        VUB Brussels (postscript) (pdf) (long version of Zuidema and
        Westermann (2001), DECO)
      • Willem Zuidema, Language is different: the relevance of group, culture
        and computers in the evolution of syntax, presented at the OHLL
        Coevolution of Syntax and Semantics meeting, September 2001, Paris,
        France.
      • Willem Zuidema, *Emergent syntax: the unremitting value of
        computational modeling for understanding the origins of complex
        language (2001), in: Kelemen and Sosik (eds.), Advances in Artificial
        Life (Proceedings 6th European Conference on Artificial Life, Prague,
        September 10-14, 2001), Series: Lecture Notes in Computer Science
        Vol. 2159, Springer, Berlin, pp. 641-644,
        (postscript)
        (pdf)(all papers online at the ECAL2001-website ; buy the
        book at the
        publisher’s page – Springer
        )
      • Willem Zuidema and Gert Westermann, *Towards formal models of embodiment
        and selforganization of language (presented at DECO-2001, Edinburgh, July
        31st 2001); article in Proceedings

2000

      • Willem Hero Zuidema, Evolution of syntax in groups
        of agents
        (2000): Master’s thesis, Theoretical Biology, Utrecht

        University
      • Willem Zuidema and Paulien Hogeweg, Selective advantages of syntactic
        language – a model study, in: Gleitman and Joshi (eds.),
        Proceedings of the 22nd Annual Meeting of the Cognitive Science
        Society
        , Lawrence Erlbaum Associates, Hillsdale, USA, pp. 577 – 582, 2000.

        (postscript)
        (pdf)(all papers online at the Cogsci2000-website;
        buy the book at
        the publisher’s page – Erlbaum
        )
      • Willem Zuidema, Language evolution: establishing conventions and
        exploiting constraints (2000), presented at Bene-Evolang 2000
      • Willem Zuidema and Paulien Hogeweg, *Social patterns guide evolving grammars
        (2000) (postscript) (pdf) Presented at the Evolution of language
        2000
        conference; article in Proceedings

1999