LLMs' Default Demographics

On this page, we share additional information and supplementary material on our paper:

Johannes Schäfer, Aidan Combs, Christopher Bagdon, Jiahui Li, Nadine Probol, Lynn Greschner, Sean Papay, Yarik Menchaca Resendiz, Aswathy Velutharambath, Amelie Wuehrl, Sabine Weber, and Roman Klinger. 2025. Which Demographics do LLMs Default to During Annotation?. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 17331–17348, Vienna, Austria. Association for Computational Linguistics.

In this work, we identify which human demographic groups are mimicked by LLMs during subjective annotation tasks on text data.

Paper
Code and model predictions