ur CIKM 2014 short paper “Vertical-aware click model-based effectiveness metrics” by Ilya Markov, Eugene Kharitonov, Vadim Nikulin, Pavel Serdyukov, Maarten de Rijke and Fabio Crestani is available now. You can find it online here. Today’s web search systems present users with heterogeneous information coming from sources of different types, also known as verticals. Evaluating such systems…
Category: Publications
CIKM 2014 paper on multileaved comparisons for fast online evaluation online
Our CIKM 2014 paper “Multileaved comparisons for fast online evaluation” by Anne Schuth, Floor Sietsma, Shimon Whiteson, Damien Lefortier and Maarten de Rijke is available online now. Evaluation methods for information retrieval systems come in three types: offline evaluation, using static data sets annotated for relevance by human judges; user studies, usually conducted in a lab-based setting;…
IIiX 2014 short paper on social bookmarking online
Our IIiX 2014 short paper on “A social bookmarking system to support cluster-driven archival arrangement” by Marc Bron, Shenghui Wang, Titia van der Werf and Maarten de Rijke is available online now. Cultural heritage materials are increasingly being made available through standard search facilities. However, it is challenging to automatically organize these materials in a way…
ACM SIGIR Workshop on Gathering Efficient Assessments of Relevance (GEAR) paper online
With some delays, because of the holidays and traveling, but the short paper that Aleksandr Chuklin and I published at the ACM SIGIR Workshop on Gathering Efficient Assessments of Relevance (GEAR) is online. It’s called “The anatomy of relevance: topical, snippet and perceived relevance in search result evaluation. And you can find it here. Currently, the…
KDD 2014 paper on personalized search result diversification online
Our KDD 2014 paper “Personalized search result diversification via structure learning” by Shangsong Liang, Zhaochun Ren and Maarten de Rijke is available online now. This paper is concerned with the problem of personalized diversification of search results, with the goal of enhancing the performance of both plain diversification and plain personalization algorithms. In previous work, the problem…
Coling 2014 paper on temporal evidence classification online
Our Coling 2014 paper “Prior-informed distant supervision for temporal evidence classification” by Ridho Reinanda and Maarten de Rijke is available online now. Temporal evidence classification, i.e., finding associations between temporal expressions and relations expressed in text, is an important part of temporal relation extraction. To capture the variations found in this setting, we employ a distant supervision…
ECAI 2014 paper on detecting the reputation polarity of microblog posts online
Our ECAI paper “Detecting the reputation polarity of microblog posts” by Cristina Garbacea, Manos Tsagkias and Maarten de Rijke is available online now. We address the task of detecting the reputation polarity of social media updates, that is, deciding whether the content of an update has positive or negative implications for the reputation of a given entity….
ICML 2014 paper on K-armed dueling bandit problem online
Our ICML 2014 paper “Relative upper confidence bound for the K-armed dueling bandit problem” by Masrour Zoghi, Shimon Whiteson, Remi Munos and Maarten de Rijke is available online now. This paper proposes a new method for the K-armed dueling bandit problem, a variation on the regular K-armed bandit problem that offers only relative feedback about pairs of…
SIGIR 2014 paper on hierarchical multi-label classification of social text streams online
Our SIGIR 2014 paper on “Hierarchical multipliable classification of social text streams“ by Zhaochun Ren, Maria-Hendrike Peetz, Shangsong Liang, Willemijn van Dolen and Maarten de Rijke is available online now. Hierarchical multi-label classification assigns a document to multiple hierarchical classes. In this paper we focus on hierarchical multi-label classification of social text streams. Concept drift, complicated relations…
SIGIR 2014 paper on the use of fusion for diversification online
Our SIGIR 2014 paper “Fusion helps diversification” by Shangsong Liang, Zhaochun Ren and Maarten de Rijke is available online now. A popular strategy for search result diversification is to first retrieve a set of documents utilizing a standard retrieval method and then rerank the results. We adopt a different perspective on the problem, based on data…