Maarten de Rijke

Information retrieval

Author: mdr (page 1 of 16)

A new step

Many short-term actions are needed to help us through the current disruptions. As academics, if we can help to support processes that are important to keep society running, we should all step in. Immediately. But we should also look beyond today and continue to set and pursue long-term goals. 

Like many of us, I am in research because of the fascination that complex problems bring, because of the excitement of discovery and the satisfaction of creating new knowledge and of pushing innovation. For me, all of this is closely tied to working with PhD students and postdocs. 

For the last fifteen years I’ve been trying to do research, and encourage others to do research, at the interface of academia and society. The mantra is simple: try to do great science with great impact. For me personally, this has meant helping to set up startups, setting up joint projects with partners in industry and in local and national governments. It has also meant helping to build up Amsterdam Data Science and helping to get the national Innovation Center for Artificial Intelligence up and running.

The time has come for me to take a new step at the intersection of academia and society. As of today, I have joined Ahold Delhaize as Vice President Personalization and Relevance and as Senior Research Fellow, for two days a week. In this role I will focus on developing and deploying an applied research agenda in the domain of personalization and relevance, on boosting the research on personalization and relevance at Ahold Delhaize, on setting a research talent agenda, and, more generally, on helping to grow R&D throughout Ahold Delhaize.

My appointment at the University of Amsterdam has been reduced from five days per week to three days per week. During those three days I will continue in my role as University Professor. I will focus on supervising my PhD students and postdocs, and on my role as scientific director of the national Innovation Center for Artificial Intelligence.

Stay safe.

Schiet nou toch eens op. De tijd dringt

Vandaag presenteerde de EU haar “white paper” over AI in Europa. Samenvatting van mijn commentaar:

  • Zet veel duidelijker en veel ambitieuzer in op AI-talent — daar staat of valt alles mee.
  • Waarom geeft de EU de hoop over consumentendata op? Is consumentendata nou niet precies waar je het vertrouwen wint of verliest?
  • Beleidsmakers zijn voor de kaders en regelgeving: zij moeten zich niet bemoeien met de inhoud van de AI-wetenschap en AI-innovatie — dat moet je overlaten aan wetenschappers en ondernemers.
  • Het idee van één enkel “lighthouse” als Europees AI-centrum is slecht doordacht, geld verslindend, en staat sociaal-economische impact van AI-technologie in de weg.
  • Waarom wordt er wel gesproken van een netwerk van excellentie (4 pagina’s) en een netwerk van vertrouwen (16 pagina’s!), maar niet van een netwerk van kansen en uitdagingen? Is dat niet waar het begint?
  • Bovenal: doe nu eens wat!

Zie De Volkskrant

Aan de slag!

Morgen, 8 oktober, presenteert VNO-NCW een `Nationale AI Coalitie’. Het Nederlandse bedrijfsleven steekt de komende zeven jaar ruim €1 mrd in kunstmatige intelligentie (AI). Van de overheid wordt ook een flinke bijdrage gevraagd. Het Financieele Dagblad besteedt aandacht aan de verwachte aankondigingen van deze week.


Genoeg gepraat. Genoeg gepolderd. Aan de slag.

CIKM 2019 papers online

The papers that my team and I will be presenting at CIKM 2019 are online now:

  • Wanyu Chen, Fei Cai, Chen Honghui, and Maarten de Rijke. A Dynamic Co-attention Network for Session-based Recommendation. In CIKM 2019: 28th ACM Conference on Information and Knowledge Management, pages 1461-1470. ACM, November 2019. Bibtex, PDF
    @inproceedings{chen-2019-dynamic,
    Author = {Chen, Wanyu and Cai, Fei and Chen Honghui and de Rijke, Maarten},
    Booktitle = {CIKM 2019: 28th ACM Conference on Information and Knowledge Management},
    Date-Added = {2019-08-09 09:21:52 +0200},
    Date-Modified = {2019-11-05 18:09:20 +0800},
    Month = {November},
    Pages = {1461-1470},
    Publisher = {ACM},
    Title = {A Dynamic Co-attention Network for Session-based Recommendation},
    Year = {2019}}
  • Svitlana Vakulenko, Javier Fernández, Axel Polleres, Maarten de Rijke, and Michael Cochez. Message Passing for Complex Question Answering over Knowledge Graphs. In CIKM 2019: 28th ACM Conference on Information and Knowledge Management, page 1431–1440. ACM, November 2019. Bibtex, PDF
    @inproceedings{vakulenko-2019-message,
    Author = {Vakulenko, Svitlana and Fern{\'{a}}ndez, Javier and Polleres, Axel and de Rijke, Maarten and Cochez, Michael},
    Booktitle = {CIKM 2019: 28th ACM Conference on Information and Knowledge Management},
    Date-Added = {2019-08-09 09:27:58 +0200},
    Date-Modified = {2019-11-03 21:15:35 +0800},
    Month = {November},
    Pages = {1431--1440},
    Publisher = {ACM},
    Title = {Message Passing for Complex Question Answering over Knowledge Graphs},
    Year = {2019}}
  • Shanshan Wang, Pengjie Ren, Zhumin Chen, Zhaochun Ren, Jun Ma, and Maarten de Rijke. Order-free Medicine Combination Prediction With Graph Convolutional Reinforcement Learning. In CIKM 2019: 28th ACM Conference on Information and Knowledge Management, page 1623–1632. ACM, November 2019. Bibtex, PDF
    @inproceedings{wang-2019-order-free,
    Author = {Wang, Shanshan and Ren, Pengjie and Chen, Zhumin and Ren, Zhaochun and Ma, Jun and de Rijke, Maarten},
    Booktitle = {CIKM 2019: 28th ACM Conference on Information and Knowledge Management},
    Date-Added = {2019-08-09 09:23:55 +0200},
    Date-Modified = {2019-11-03 21:16:13 +0800},
    Month = {November},
    Pages = {1623--1632},
    Publisher = {ACM},
    Title = {Order-free Medicine Combination Prediction With Graph Convolutional Reinforcement Learning},
    Year = {2019}}
  • Xiaohui Xie, Jiaxin Mao, Yiqun Liu, Maarten de Rijke, Qingyao Ai, Yufei Huang, Min Zhang, and Shaoping Ma. Improving Web Image Search with Contextual Information. In CIKM 2019: 28th ACM Conference on Information and Knowledge Management, page 1683–1692. ACM, November 2019. Bibtex, PDF
    @inproceedings{xie-2019-improving,
    Author = {Xie, Xiaohui and Mao, Jiaxin and Liu, Yiqun and de Rijke, Maarten and Ai, Qingyao and Huang, Yufei and Zhang, Min and Ma, Shaoping},
    Booktitle = {CIKM 2019: 28th ACM Conference on Information and Knowledge Management},
    Date-Added = {2019-08-09 09:26:32 +0200},
    Date-Modified = {2019-11-03 21:16:30 +0800},
    Month = {November},
    Pages = {1683--1692},
    Publisher = {ACM},
    Title = {Improving Web Image Search with Contextual Information},
    Year = {2019}}

IJCAI 2019 papers online

Cascading non-stationary bandits: Online learning to rank in the non-stationary cascade model by Chang Li and Maarten de Rijke is online now at this location.

In the paper, we argue that non-stationarity appears in many online applications such as web search and advertising. We study the online learning to rank problem in a non-stationary environment where user preferences change abruptly at an unknown moment in time. We consider the problem of identifying the K most attractive items and propose cascading non-stationary bandits, an online learning variant of the cascading model, where a user browses a ranked list from top to bottom and clicks on the first attractive item. We propose two algorithms for solving this non-stationary problem: CascadeDUCB andCascadeSWUCB. We analyze their performance and derive gap-dependent upper bounds on the $n$-step regret of these algorithms. We also establish a lower bound on the regret for cascading non-stationary bandits and show that both algorithms match the lower bound up to a logarithmic factor. Finally, we evaluate their performance on a real-world web search click dataset.

  • Chang Li and Maarten de Rijke. Cascading non-stationary bandits: Online learning to rank in the non-stationary cascade model. In IJCAI 2019: Twenty-Eighth International Joint Conference on Artificial Intelligence, page 2859–2865, August 2019. Bibtex, PDF
    @inproceedings{li-2019-cascading,
    Author = {Li, Chang and de Rijke, Maarten},
    Booktitle = {IJCAI 2019: Twenty-Eighth International Joint Conference on Artificial Intelligence},
    Date-Added = {2019-05-30 22:36:52 +0200},
    Date-Modified = {2019-08-04 15:53:45 +0200},
    Month = {August},
    Pages = {2859--2865},
    Title = {Cascading non-stationary bandits: Online learning to rank in the non-stationary cascade model},
    Year = {2019}}

Other papers and presentations at IJCAI are part of the SCAI workshop:

  • Jiahuan Pei, Arent Stienstra, Julia Kiseleva, and Maarten de Rijke. SEntNet: Source-aware Recurrent Entity Networks for Dialogue Response Selection. In 4th International Workshop on Search-Oriented Conversational AI (SCAI), August 2019. Bibtex, PDF
    @inproceedings{pei-2019-sentnet,
    Author = {Pei, Jiahuan and Stienstra, Arent and Kiseleva, Julia and de Rijke, Maarten},
    Booktitle = {4th International Workshop on Search-Oriented Conversational AI (SCAI)},
    Date-Added = {2019-06-06 11:55:06 +0200},
    Date-Modified = {2019-06-06 11:56:16 +0200},
    Month = {August},
    Title = {SEntNet: Source-aware Recurrent Entity Networks for Dialogue Response Selection},
    Year = {2019}}
  • Yangjun Zhang, Pengjie Ren, and Maarten de Rijke. Improving Background Based Conversation with Context-aware Knowledge Pre-selection. In 4th International Workshop on Search-Oriented Conversational AI (SCAI), August 2019. Bibtex, PDF
    @inproceedings{zhang-2019-improving,
    Author = {Zhang, Yangjun and Ren, Pengjie and de Rijke, Maarten},
    Booktitle = {4th International Workshop on Search-Oriented Conversational AI (SCAI)},
    Date-Added = {2019-06-06 11:53:36 +0200},
    Date-Modified = {2019-06-06 11:55:01 +0200},
    Month = {August},
    Title = {Improving Background Based Conversation with Context-aware Knowledge Pre-selection},
    Year = {2019}}

  • Maarten de Rijke and Pengjie Ren. SERP-based Conversations. In 4th International Workshop on Search-Oriented Conversational AI (SCAI), August 2019. 

SIGIR 2019 papers online

Here’s our harvest for SIGIR 2019, which is about to get started in less than 24 hours:

  • Joris Baan, Maartje ter Hoeve, Marlies van der Wees, Anne Schuth, and Maarten de Rijke. Do Transformer Attention Heads Provide Transparency in Abstractive Summarization?. In FACTS-IR: SIGIR 2019 Workshop on Fairness, Accountability, Confidentiality, Transparency and Safety in Information Retrieval, July 2019. Bibtex, PDF
    @inproceedings{baan-2019-do,
    Author = {Baan, Joris and ter Hoeve, Maartje and van der Wees, Marlies and Schuth, Anne and de Rijke, Maarten},
    Booktitle = {FACTS-IR: SIGIR 2019 Workshop on Fairness, Accountability, Confidentiality, Transparency and Safety in Information Retrieval},
    Date-Added = {2019-05-31 22:24:14 +0200},
    Date-Modified = {2019-05-31 22:38:02 +0200},
    Month = {July},
    Title = {Do Transformer Attention Heads Provide Transparency in Abstractive Summarization?},
    Year = {2019}}
  • Yifan Chen, Pengjie Ren, Yang Wang, and Maarten de Rijke. Bayesian Personalized Feature Interaction Selection for Factorization Machines. In SIGIR 2019: 42nd international ACM SIGIR conference on Research and Development in Information Retrieval, page 665–674. ACM, July 2019. Bibtex, PDF
    @inproceedings{chen-2019-bayesian,
    Author = {Chen, Yifan and Ren, Pengjie and Wang, Yang and de Rijke, Maarten},
    Booktitle = {SIGIR 2019: 42nd international ACM SIGIR conference on Research and Development in Information Retrieval},
    Date-Added = {2019-04-14 16:48:31 +0200},
    Date-Modified = {2019-08-02 15:58:43 +0200},
    Month = {July},
    Pages = {665--674},
    Publisher = {ACM},
    Title = {Bayesian Personalized Feature Interaction Selection for Factorization Machines},
    Year = {2019}}
  • Yang Fang, Xiang Zhao, Peixin Huang, Weidong Xiao, and Maarten de Rijke. M-HIN: Complex Embeddings for Heterogeneous Information Networks via Metagraphs. In SIGIR 2019: 42nd international ACM SIGIR conference on Research and Development in Information Retrieval, page 913–916. ACM, July 2019. Bibtex, PDF
    @inproceedings{fang-2019-m-hin,
    Author = {Fang, Yang and Zhao, Xiang and Huang, Peixin and Xiao, Weidong and de Rijke, Maarten},
    Booktitle = {SIGIR 2019: 42nd international ACM SIGIR conference on Research and Development in Information Retrieval},
    Date-Added = {2019-04-14 21:00:49 +0200},
    Date-Modified = {2019-08-02 15:59:43 +0200},
    Month = {July},
    Pages = {913--916},
    Publisher = {ACM},
    Title = {M-HIN: Complex Embeddings for Heterogeneous Information Networks via Metagraphs},
    Year = {2019}}
  • Rolf Jagerman, Harrie Oosterhuis, and Maarten de Rijke. To Model or to Intervene: A Comparison of Counterfactual and Online Learning to Rank from User Interactions. In SIGIR 2019: 42nd international ACM SIGIR conference on Research and Development in Information Retrieval, page 15–24. ACM, July 2019. Bibtex, PDF
    @inproceedings{jagerman-2019-model,
    Author = {Jagerman, Rolf and Oosterhuis, Harrie and de Rijke, Maarten},
    Booktitle = {SIGIR 2019: 42nd international ACM SIGIR conference on Research and Development in Information Retrieval},
    Date-Added = {2019-04-14 16:45:43 +0200},
    Date-Modified = {2019-08-02 15:58:05 +0200},
    Month = {July},
    Pages = {15--24},
    Publisher = {ACM},
    Title = {To Model or to Intervene: A Comparison of Counterfactual and Online Learning to Rank from User Interactions},
    Year = {2019}}
  • Claudio Lucchese, Franco Maria Nardini, Rama Kumar Pasumarthi, Sebastian Bruch, Michael Bendersky, Xuanhui Wang, Harrie Oosterhuis, Rolf Jagerman, and Maarten de Rijke. Learning to Rank in Theory and Practice: From Gradient Boosting to Neural Networks and Unbiased Learning. In SIGIR 2019: 42nd international ACM SIGIR conference on Research and Development in Information Retrieval, page 1419–1420, ACM, July 2019. Bibtex, PDF
    @inproceedings{lucchese-2019-learning,
    Address = {ACM},
    Author = {Lucchese, Claudio and Nardini, Franco Maria and Pasumarthi, Rama Kumar and Bruch, Sebastian and Bendersky, Michael and Wang, Xuanhui and Oosterhuis, Harrie and Jagerman, Rolf and de Rijke, Maarten},
    Booktitle = {SIGIR 2019: 42nd international ACM SIGIR conference on Research and Development in Information Retrieval},
    Date-Added = {2019-05-31 22:47:26 +0200},
    Date-Modified = {2019-08-02 16:00:12 +0200},
    Month = {July},
    Pages = {1419--1420},
    Title = {Learning to Rank in Theory and Practice: From Gradient Boosting to Neural Networks and Unbiased Learning},
    Year = {2019}}
  • Ana Lucic, Hinda Haned, and Maarten de Rijke. Explaining Predictions from Tree-based Boosting Ensembles. In FACTS-IR: SIGIR 2019 Workshop on Fairness, Accountability, Confidentiality, Transparency and Safety in Information Retrieval, July 2019. Bibtex, PDF
    @inproceedings{lucic-2019-explaining,
    Author = {Lucic, Ana and Haned, Hinda and de Rijke, Maarten},
    Booktitle = {FACTS-IR: SIGIR 2019 Workshop on Fairness, Accountability, Confidentiality, Transparency and Safety in Information Retrieval},
    Date-Added = {2019-05-31 22:21:39 +0200},
    Date-Modified = {2019-05-31 22:38:12 +0200},
    Month = {July},
    Title = {Explaining Predictions from Tree-based Boosting Ensembles},
    Year = {2019}}
  • Muyang Ma, Pengjie Ren, Yujie Lin, Zhumin Chen, Jun Ma, and Maarten de Rijke. $\pi$-Net: A Parallel Information-sharing Network for Cross-domain Shared-account Sequential Recommendations. In SIGIR 2019: 42nd international ACM SIGIR conference on Research and Development in Information Retrieval, page 685–694. ACM, July 2019. Bibtex, PDF
    @inproceedings{ma-2019-pi-net,
    Author = {Ma, Muyang and Ren, Pengjie and Lin, Yujie and Chen, Zhumin and Ma, Jun and de Rijke, Maarten},
    Booktitle = {SIGIR 2019: 42nd international ACM SIGIR conference on Research and Development in Information Retrieval},
    Date-Added = {2019-04-14 16:49:57 +0200},
    Date-Modified = {2019-08-02 15:59:03 +0200},
    Month = {July},
    Pages = {685--694},
    Publisher = {ACM},
    Title = {$\pi$-Net: A Parallel Information-sharing Network for Cross-domain Shared-account Sequential Recommendations},
    Year = {2019}}
  • Alexandra Olteanu, Jean Garcia-Gathright, Maarten de Rijke, and Michael D. Ekstrand. Workshop on Fairness, Accountability, Confidentiality, Transparency, and Safety in Information Retrieval (FACTS-IR). In SIGIR 2019: 42nd international ACM SIGIR conference on Research and Development in Information Retrieval, page 1423–1425. ACM, July 2019. Bibtex, PDF
    @inproceedings{olteanu-2019-workshop,
    Author = {Olteanu, Alexandra and Garcia-Gathright, Jean and de Rijke, Maarten and Ekstrand, Michael D.},
    Booktitle = {SIGIR 2019: 42nd international ACM SIGIR conference on Research and Development in Information Retrieval},
    Date-Added = {2019-05-31 22:51:14 +0200},
    Date-Modified = {2019-08-02 16:00:36 +0200},
    Month = {July},
    Pages = {1423--1425},
    Publisher = {ACM},
    Title = {Workshop on Fairness, Accountability, Confidentiality, Transparency, and Safety in Information Retrieval (FACTS-IR)},
    Year = {2019}}
  • Jiahuan Pei, Pengjie Ren, and Maarten de Rijke. A Modular Task-oriented Dialogue System Using a Neural Mixture-of-Experts. In WCIS: SIGIR 2019 Workshop on Conversational Interaction Systems. ACM, July 2019. Bibtex, PDF
    @inproceedings{pei-2019-modular,
    Author = {Pei, Jiahuan and Ren, Pengjie and de Rijke, Maarten},
    Booktitle = {WCIS: SIGIR 2019 Workshop on Conversational Interaction Systems},
    Date-Added = {2019-06-01 07:18:46 +0200},
    Date-Modified = {2019-07-14 12:24:23 +0200},
    Month = {July},
    Publisher = {ACM},
    Title = {A Modular Task-oriented Dialogue System Using a Neural Mixture-of-Experts},
    Year = {2019}}
  • Taihua Shao, Fei Cai, Honghui Chen, and Maarten de Rijke. Length-adaptive Neural Network for Answer Selection. In SIGIR 2019: 42nd international ACM SIGIR conference on Research and Development in Information Retrieval, page 869–872. ACM, July 2019. Bibtex, PDF
    @inproceedings{shao-2019-length-adaptive,
    Author = {Shao, Taihua and Cai, Fei and Chen, Honghui and de Rijke, Maarten},
    Booktitle = {SIGIR 2019: 42nd international ACM SIGIR conference on Research and Development in Information Retrieval},
    Date-Added = {2019-04-14 20:59:02 +0200},
    Date-Modified = {2019-08-02 15:59:20 +0200},
    Month = {July},
    Pages = {869--872},
    Publisher = {ACM},
    Title = {Length-adaptive Neural Network for Answer Selection},
    Year = {2019}}
  • Meirui Wang, Pengjie Ren, Lei Mei, Zhumin Chen, Jun Ma, and Maarten de Rijke. A Collaborative Session-based Recommendation Approach with Parallel Memory Modules. In SIGIR 2019: 42nd international ACM SIGIR conference on Research and Development in Information Retrieval, page 345–354. ACM, July 2019. Bibtex, PDF
    @inproceedings{wang-2019-collaborative,
    Author = {Wang, Meirui and Ren, Pengjie and Mei, Lei and Chen, Zhumin and Ma, Jun and de Rijke, Maarten},
    Booktitle = {SIGIR 2019: 42nd international ACM SIGIR conference on Research and Development in Information Retrieval},
    Date-Added = {2019-04-14 16:52:16 +0200},
    Date-Modified = {2019-08-02 15:58:23 +0200},
    Month = {July},
    Pages = {345--354},
    Publisher = {ACM},
    Title = {A Collaborative Session-based Recommendation Approach with Parallel Memory Modules},
    Year = {2019}}

UAI 2019 paper on safe online learning to re-rank via implicit click feedback online

BubbleRank: Safe Online Learning to Re-Rank via Implicit Click Feedback by Chang Li, Branislav Kveton, Tor Lattimore, Ilya Markov, Maarten de Rijke, Csaba Szepesvari, and Masrour Zoghi is online now at this location.

In the paper we study the problem of safe on-line learning to re-rank, where user feedback is used to improve the quality of displayed lists. Learning to rank has traditionally been studied in two settings. In the offline setting, rankers are typically learned from relevance labels created by judges. This approach has generally be- come standard in industrial applications of ranking, such as search. However, this approach lacks exploration and thus is limited by the information content of the offline training data. In the online setting, an algorithm can experiment with lists and learn from feedback on them in a sequential fashion. Bandit algorithms are well-suited for this setting but they tend to learn user preferences from scratch, which results in a high initial cost of exploration. This poses an additional challenge of safe exploration in ranked lists. We propose BubbleRank, a bandit algorithm for safe re-ranking that combines the strengths of both the offline and online settings. The algorithm starts with an initial base list and improves it online by gradually exchanging higher-ranked less attractive items for lower-ranked more attractive items. We prove an up- per bound on the n-step regret of BubbleRankthat degrades gracefully with the quality of the initial base list. Our theoretical findings are supported by extensive experiments on a large-scale real-world click dataset.

The paper will be presented at UAI 2019: Conference on Uncertainty in Artificial Intelligence, July 2019.

Using process mining for understanding the structure of interaction processes

Svitlana Vakulenko explains how we have recently used process mining techniques to understand the structure of interaction processes, which will in turn help us to improve information-seeking dialogue systems. We extract a new model of information-seeking dialogues, QRFA, for Query, Request, Feedback, Answer. The QRFA model better reflects conversation flows observed in real information-seeking conversations than models proposed previously. QRFA allows us to identify malfunctioning in dialogue system transcripts as deviations from the expected conversation flow described by the model via conformance analysis.

Read the full post.

Investeer in kennisbasis AI of word een toeschouwer

In een opiniestuk voor NRC Handelsblad en NRC Next beargumenteer ik dat artificiële intelligentie ons leven hoe dan ook zal veranderen en dat Nederland voor de keuze staat om vol mee te doen in de ontwikkeling van AI en het spel mee te bepalen, of om de bank te blijven zitten. Wie niet actief meedoet, heeft geen invloed – niet op het spel en al helemaal niet op de spelregels. Investeer in de AI-kennisbasis, investeer in talent. Kom van de bank!

Het hele stuk is hier te vinden.

Learning to answer questions by taking broader contexts into account

Mostafa Dehghani has posted an explanation of our recent work on TraCRNet (“tracker net”) to learn how to answer questions from multiple, possible long documents. TraCRNet uses the universal transformer and is able to go beyond understanding a set of input documents separately and combine their information in multiple steps. TraCRNet is highly parallellizable and far more robust against noisy input than previous proposals for addressing the question answering task.

See this page for the full post.

« Older posts

© 2020 Maarten de Rijke

Theme by Anders NorenUp ↑