Publications
Loci Similes: A Benchmark for Extracting Intertextualities in Latin Literature
Findings of the Association for Computational Linguistics: EMNLP
Julian Schelb, Michael Wittweiler, Marie Revellio, Barbara Feichtinger, Andreas Spitz
A benchmark of 1,490 scholarly attested intertextual links between Latin authors, released with a reference implementation. Distinguishes verbatim quotation from allusion by a deterministic lemma-based rule and compares lexical retrieval, dense retrieval and cross-encoder reranking on the same candidate pool.
R.U.Psycho? A Framework for Robust Unified Psychometric Testing of Language Models
Language Resources and Evaluation Conference (LREC)
Julian Schelb, Orr Borin, David Garcia, Andreas Spitz
Questionnaires written for human respondents are increasingly run against generative models to claim traits or benchmark alignment. This framework makes those runs reproducible and comparable, so a reported trait can be re-measured rather than taken on trust.
Assessing In-context Learning and Fine-tuning for Topic Classification of German Web Data
ACL Student Research Workshop
Julian Schelb, Roberto Ulloa, Andreas Spitz
Political and social scientists study information consumption by classifying millions of visited webpages, which rules out manual labelling. The paper compares fine-tuned encoders against in-context learning in a low-resource German setting, and reports where the cheaper option is good enough.
ECCE: Entity-centric Corpus Exploration Using Contextual Implicit Networks
Companion Proceedings of the Web Conference
Julian Schelb, Maud Ehrmann, Matteo Romanello, Andreas Spitz
A web application for reading a document collection through the people and places in it. Named entities are detected across the corpus and their contextual co-occurrence becomes an implicit network that can be browsed instead of the raw documents.
Tag-Pag: A Dedicated Tool for Systematic Web Page Annotations
Preprint
Anton Pogrebnjak, Julian Schelb, Andreas Spitz, Celina Kacperski, Roberto Ulloa
Existing annotation tools assume you are labelling spans of text. Researchers who scrape the web usually need the opposite: a verdict on whether an entire page belongs to a category. Tag-Pag systematises that page-level decision.
An Evaluation of Classifiers for Mapping Generative LLM Responses to Answer Options of Multiple-choice Questionnaires
EACL Student Research Workshop
Alisea Stroligo, Anna Shamray, Julian Schelb, Andreas Spitz
A generative model answering a multiple-choice item rarely returns a clean option label. The paper compares classifiers that map free-form responses back onto the intended answer options, a step that quietly decides the outcome of many questionnaire-based evaluations.