Pascal Mettes

My research goal is to find a bridge between prior knowledge and deep networks. Deep learning in computer vision thrives under examples but commonly ignores additional explicit knowledge about the research problem. Think about hierarchical relations between categories, relational knowledge between tasks, or spatio-temporal knowledge. The research of my team focuses on discovering the shared geometry between pixels and knowledge. Specifically, we research hyperbolic and hyperspherical geometry for deep learning and learning with prototypes. Our advances and new research proposals are investigated for computer vision problems such as hierarchical recognition, segmentation, localization, and zero-shot recognition in images and videos.

Organization and network

• 2022 - ECCV workshop on Hyperbolic Representation Learning for Computer Vision
• 2022 - Area chair BMVC (previously AC in 2020 and 2021)
• 2022 - Panelist at the International Conference on Multimedia Retrieval
• 2022 - Netherlands Conference on Computer Vision
• 2021 - Member of ELLIS - European Laboratory for Learning and Intelligent Systems
• 2021 - ICCV workshop on Structured Representations for Video Understanding
• 2016 - ACM Multimedia web chair

Talks

• 2022 - Talk at Columbia University, USA. Host: dr. Carl Vondrick
• 2022 - Talk at FAIR, USA. Host: dr. Karen Ullrich
• 2022 - Talk at Utrecht University, the Netherlands. Host: dr. Ronald Poppe
• 2022 - Talk at Delft University of Technology, the Netherlands. Host: dr. Jan van Gemert
• 2021 - Lecture at Efficient Deep Learning winter school on Hyperbolic Deep Learning
• 2021 - Talk at TU Dresden, Germany. Host: prof. Martin Keller-Ressel
• 2021 - Talk at University of Tübingen, Germany. Host: prof. Zeynep Akata
• 2021 - Talk at Diagnostic Image Analysis Group, Radboud UMC, the Netherlands
• 2021 - Speaker at Bertelsmann Video AI Event, virtual
• 2020 - Lecturer at VISUM summer school on Action Recognition in Videos, virtual
• 2020 - Talk at Aalto University, Finland. Host: dr. Xiao Yu
• 2019 - Speaker at NVPBHV fall meeting, Amsterdam, the Netherlands
• 2019 - Lecturer at VISUM summer school on Deep Learning, Porto, Portugal

Grants

• PI - ELLIS PhD award with prof. Rita Cucchiara
• PI - NWO ClickNL
• PI - Google Perception Academic Funding with dr. Thomas Mensink
• PI - Data Science Center grant with dr. Erwin Berkhout
• PI - Informatics Institute collaboration grant with prof. Paul Groth
• co-PI - NWO ClickNL with dr. Nanne van Noord
• co-PI - ACTA AiO competition

Awards

• Doctoral Consortium Award - ACM Multimedia 2016
• Benchmark winner - TRECVID Multimedia Event Detection 2015
• Reviewer award - CVPR21, ICLR21, ECCV20, ICML20, NeurIPS19, ICMR18, ICCV17, ICMR15

Shuffled ImageNet-Banks for Video Event Detection and Search

Pre-trained models can be downloaded by following the instructions [here].

Water Detection through Spatio-Temporal Invariant Descriptors

The complete Video Water Dataset is available [here] (warning 14GB).