Publications

Conference Papers (Peer-Reviewed)

2026

Are the LLMs Capable of Maintaining at Least the Language Genus?
Sandra Mitrović*, David Kletz*, Ljiljana Dolamic, and Fabio Rinaldi

Proceedings of the Thirty-Second Language Resources and Evaluation Conference (LREC), Plama de Majorque, Spain
European Language Resources Association
Program

2025

Polarity inversion operators in PLM
David Kletz, Pascal Amsili, and Marie Candito
Proceedings of the 29th Conference on Computational Natural Language Learning (CoNLL), pages 312-322, Vienna, Austria
Association for Computational Linguistics
DOI: 10.18653/v1/2025.conll-1.20

Swushroomsia at SemEval-2025 Task 3: Probing LLMs’ Collective Intelligence for Multilingual Hallucination Detection
Sandra Mitrović*, Joseph Cornelius*, David Kletz*, Ljiljana Dolamic, and Fabio Rinaldi
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Association for Computational Linguistics
[* equal contribution] Paper

Assessing RAG System Capabilities on Financial Documents
Oscar Lithgow-Serrano, David Kletz, Vani Kanjirangat, David Adametz, Marzio Lunghi, Claudio Bonesana, Matilde Tristany-Farinha, Yuntao Li, Detlef Repplinger, Marco Pierbattista, Stefania Stan, and Oleg Szeh
Proceedings of The 10th Workshop on Financial Technology and Natural Language Processing (FinNLP), pages 124-147
DOI: 10.18653/v1/2025.finnlp-2.9

Better Together: Towards Localizing Fact-Related Hallucinations using Open Small Language Models
David Kletz, Sandra Mitrović, Ljiljana Dolamic, and Fabio Rinaldi
Proceedings of the CHOMPS Workshop, December 2025
DOI: 10.18653/v1/2025.chomps-main.3

2024

The Self-Contained Italian Negation Test (SCIN)
Viola Gullace, David Kletz, Thierry Poibeau, Alessandro Lenci, and Pascal Amsili
Proceedings of the Tenth Italian Conference on Computational Linguistics (CLiC-it 2024), pages 425-430, Pisa, Italy
CEUR Workshop Proceedings
ISBN: 979-12-210-7060-6
Paper

2023

The Self-Contained Negation Test Set
David Kletz, Pascal Amsili, and Marie Candito
Proceedings of the 6th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP, pages 212-221, Singapore
Association for Computational Linguistics
DOI: 10.18653/v1/2023.blackboxnlp-1.16

Probing structural constraints of negation in Pretrained Language Models
David Kletz, Marie Candito, and Pascal Amsili
Proceedings of the 24th Nordic Conference on Computational Linguistics (NoDaLiDa), pages 541-554, Tórshavn, Faroe Islands
University of Tartu Library
Paper

EvoSem: A database of polysemous cognate sets
Mathieu Dehouck, Alex François, Siva Kalyan, Martial Pastor, and David Kletz
Proceedings of the 4th Workshop on Computational Approaches to Historical Language Change (LChange), pages 66-75, Singapore
Association for Computational Linguistics
DOI: 10.18653/v1/2023.lchange-1.7

2022

A Methodology for Building a Diachronic Dataset of Semantic Shifts and its Application to QC-FR-Diac-V1.0, a Free Reference for French
David Kletz, Philippe Langlais, François Lareau, and Patrick Drouin
Proceedings of the Thirteenth Language Resources and Evaluation Conference (LREC), pages 2117-2125, Marseille, France
European Language Resources Association
Paper

Other Publications

Preprint

Automatic Prompt Optimization for Dataset-Level Feature Discovery Cosma, A., Szehr, O., Kletz, D., Antonucci, A., & Pelletier, O. (2026). arXiv preprint arXiv:2601.13922.

National conference

Presenting LLMs’ collective intelligence approach for Multilingual Hallucination Detection Sandra Mitrović*, Joseph Cornelius*, David Kletz*, Ljiljana Dolamic, and Fabio Rinaldi Proceedings of the 10th edition of the Swiss Text Analytics Conference Abstrace on ACL Anthology

Journal

Detection of recurring defects in airline incident report
D. Kletz, P. Langlais, V. Letard, L. Pages, F. Piedboeuf, H. S. Dos Santos, T. Y. Zhou, D.A. Hermelo, I. Elbaz, T. Gao, and F. Gotti
Les Cahiers du GERAD G–2021–51 iii, pages 6-21, 2021

Thesis and Dissertation

PhD Thesis: Négation et Modèles de Langue Pré-entraînés (Negation and Pretrained Language Models)
David Kletz
Université Sorbonne Nouvelle, Paris, France
Defended: February 4, 2025
Supervisors: Marie Candito (MCF-HDR, Université Paris Cité) and Pascal Amsili (Professor, Université Sorbonne Nouvelle) Link

Master’s Thesis: Méthodologies pour la détection de diachronies sémantiques et leurs impacts
David Kletz
Université de Montréal, 2021
Supervisor: Philippe Langlais, Patrick Drouin, François Lareau Link

Research Datasets and Resources

Lucifer Dataset
David Kletz, Sandra Mitrović, Ljiljana Dolamic, and Fabio Rinaldi, 2025
Public dataset for hallucination annotation in language models
GitHub [Accompanying the CHOMPS workshop paper]

EvoSem Database
Mathieu Dehouck, Alex François, Siva Kalyan, Martial Pastor, and David Kletz, 2023
Public database of polysemous cognate sets
Website

QC-FR-Diac-V1.0
David Kletz, Philippe Langlais, François Lareau, and Patrick Drouin, 2022
A free diachronic reference dataset for French
Public database, Language Resources and Evaluation Conference (LREC)
GitHub