new
 

Elia
Bruni


Postdoc at Dialogue Modelling Group led by Raquel Fernández, ILLC, University of Amsterdam

 
 

I obtained my PhD at the Language, Interaction and Computation Lab at the University of Trento. My research is in the areas of natural language processing, computer vision and machine learning. At ILLC I am building neural conversational agents using generative adversarial networks. I am also interested in grounding the meaning of words in the visual world. In the past, I extracted distributional semantic models from pictures and merged them with traditional text-based semantic representations. At ILLC, I am planning to do visual grounding using neural language models, within a semi-supervised setting.

I am also in the managment committee of the ICT COST Action IC1307 - The European Network on Integrating Vision and Language.

 
 
 

Code

VSEM: An open library for visual semantics representation


Resources

The MEN Test Collection.

Tutorial

Visual Features for Linguists
ACL 2013 Tutorial

Publications

2015

Affective Analysis of Professional and Amateurs Abstract Paintings Using Statistical Analysis and Art Theory.
A. Sartori, V. Yanulevskaya, A. A. Salah, J. Uijlings, E. Bruni and N. Sebe.
Submitted.

Reading visually embodied meaning from the brain: visually grounded computational models decode visual-object mental imagery induced by written text.
A. J. Anderson, E. Bruni, A. Lopopolo, M. Poesio and M. Baroni
Neuroimage 2015

2014

Automatic Personality and Interaction Style Recognition from Facebook Profile Pictures.
F. Celli, E. Bruni and B. Lepri
Proceedings of the ACM Multimedia 2014

Is this a wampimuk? Cross-modal mapping between distributional semantics and the visual world
A. Lazaridou, E. Bruni and M. Baroni
Proceedings of the ACL 2014

Distributional semantics through the peephole
U. Bordignon and E. Bruni
Idées de Langue 1

Multimodal distributional semantics
E. Bruni, N. K. Tran and M. Baroni
Journal of Artificial Intelligence Research 49: 1-47

2013

Of words, eyes and brains: Correlating image-based distributional semantic models with neural representations of concepts
A. J. Anderson, E. Bruni, U. Bordignon, M. Poesio and M. Baroni
Proceedings of the EMNLP 2013

VSEM: An open library for visual semantics representation
E. Bruni, U. Bordignon, A. Liska, J. Uijlings and I. Sergienya
Proceedings of the ACL 2013 (System demonstration)

2012

Distributional Semantics with Eyes: Using Image Analysis to Improve Computational Representations of Word Meaning
E. Bruni, J. Uijlings, M. Baroni and N. Sebe
Proceedings of the ACM Multimedia 2012

In the eye of the beholder: Employing statistical analysis and eye tracking for analyzing abstract paintings
(Dataset)
V. Yanulevskaya, J. Uijlings, E. Bruni, A. Sartori, F. Bacci, N. Sebe, E. Zamboni and D. Melcher
Proceedings of the ACM Multimedia 2012

Automatic Analysis of Emotions Conveyed by Abstract Painting
V. Yanulevskaya, E. Bruni, J. Uijlings, A. Sartori, E. Zamboni, F. Bacci, D. Melcher and N. Sebe
Visual Science of Art Conference (VSAC). 2012

Distributional Semantics in Technicolor
E. Bruni, G. Boleda, M. Baroni and N. K. Tran
Proceedings of the ACL 2012 (50th Annual Meeting of the Association for Computational Linguistics), East Stroudsburg PA: ACL.

Automatic Analysis of Multimodal Requirements: A Research Preview
E. Bruni, A. Ferrari, N. Seyff and G. Tolomei
REFSQ'12

2011

Distributional semantics from text and images
E. Bruni, G.B. Tran and M. Baroni
Proceedings of the EMNLP 2011 Geometrical Models for Natural Language Semantics (GEMS)



PhD Thesis

Multimodal distributional semantics
Elia Bruni
2013. PhD Thesis, University of Trento.



Presentations

2013

Grounding distributional semantics into the visual world
E. Bruni
Invited talk at UWMSR, WA

Invited talk at Laboratoire Heudiasyc, UTC, France

Multimodal Semantics at CLIC
E. Bruni
Invited talk at WVL, Atlanta

2012

Distributional semantics in Technicolor
E. Bruni
Presentation at LaVi seminar series, University of Trento

Multimodal Distributional Semantics
E. Bruni
CODISCO, University of Rome 3

2011

E. Bruni and M. Baroni
Multimodal distributional semantics. Poster and short presentation at the
Workshop on Integrating Language and Vision held at NIPS 2011

Hadoop Streaming: An Introduction (code)
E. Bruni, C. Martella
Presentation at CLIC-CIMEC, University of Trento

M. Baroni, E. Bruni and G.B. Tran
Multimodal distributional semantics. Poster and short presentation at the
V&L Net Workshop on Vision and Language (VL11)

A. Anderson, E. Bruni, B. Murphy, M. Baroni and M. Poesio
fMRI analyses of semantic structure using joint text and image models. Poster and short presentation at the
V&L Net Workshop on Vision and Language (VL11)

Distributional semantics from text and images
E. Bruni, G.B. Tran and M. Baroni
Presentation at Geometrical Models for Natural Language Semantics (GEMS), University of Edinburgh

Multimodal semantic spaces
E. Bruni
Presentation at KnowDive seminar series, University of Trento


Teaching

2014

Brisk course on Calculus and Linear Algebra (CIMEC PhD School)

Introduction to computer vision at Artificial Intelligence

2013

Distributional semantics from images at Text processing for the School of Humanities and Philosophy of Trento

2012

Distributional semantics from images at Text processing for the School of Humanities and Philosophy of Trento (slides)

Multimodal distributional semantics at Trento RISE Winter Camp (slides)

2011

Multimodal distributional semantics at Text processing for the School of Humanities and Philosophy of Trento (slides)