Desmond Elliott

Desmond Elliott is an Associate Professor and Villum Young Investigator at the Department of Computer Science, University of Copenhagen. His research focuses on vision-language models, multilingual and multimodal processing, with particular emphasis on tokenization-free language modeling approaches. He leads a research group actively working on pixel language models and cross-lingual multimodal understanding.

• University of Copenhagen, Department of Computer Science
• Villum Young Investigator
• Associate Editor for JAIR (2025-2028)
• Senior Area Chair for ACL 2025

Elliott's research spans vision-language integration, multilingual NLP, and multimodal machine learning. His work explores how language models can operate directly on visual pixels without traditional tokenization, enabling more seamless integration of vision and language processing. He investigates compositional generalization in multimodal systems, retrieval-augmented image captioning, and cross-lingual transfer in vision-language tasks. His group develops methods for low-resource language processing and creates benchmarks for evaluating multimodal systems across diverse cultural contexts.

His recent publications demonstrate strong trends in pixel-based language modeling, synthetic dataset generation through retrieval augmentation, and multilingual vision-language processing. The work spans theoretical advances in model architectures and practical applications in areas like medical text analysis, food culture understanding, and social media content moderation. His research often bridges computer vision and natural language processing with a focus on making these technologies accessible across diverse languages and cultures.

• Best Paper Honorable Mention at CVPR Visual Concepts Workshop 2025
• Best Long Paper Award at EMNLP 2021
• Area Chair Favourite paper at COLING 2018

Elliott actively supervises student projects in BSc and MSc programs related to his research interests. His research has received substantial funding from Google (2024-2025), Facebook (2022-2024), Villum Foundation (2021-2026), Novo Nordisk Foundation (2019-2024), and European Union (2023-2026). He regularly recruits postdocs for projects including the Danish Foundation Models project and the Responsible AI for the People Project.

His group holds regular meetings on Tuesdays from 13:00-14:00 in IF G.03, with an active mailing list for announcements. The research environment appears collaborative, with frequent co-authorship across institutions and regular participation in major NLP and computer vision conferences.