Community Activities & Benchmarking
NIST TREC Track Coordinator
Organizing evaluation campaign on the known-item identification task where the searcher has previously experienced or consumed the item but cannot recall a reliable identifier. (https://trec-tot.github.io/)
NIST TREC Track Coordinator
Organized evaluation campaign with the goal of evaluating how well search engines understand and address the underlying task users aim to achieve when submitting a query.
NIST TREC Track Coordinator
Organized evaluation campaign with the goal of evaluating whether search engines can improve their performance for a given user query by using previous user interactions with the search engine.
CLEF Coordinator
Organized evaluation campaign with the goal of evaluating the effectiveness and efficiency of search algorithms to identify all relevant information in a document collection.
FIRE Coordinator
Organizing evaluation campaign for developing retrieval systems for spoken queries in one of India's 22 officially recognized languages to locate relevant documents. (https://sites.google.com/view/sqclir2024)