Andreas Kruff, M.Sc.

Profile

Andreas Kruff is a research associate at the Institute of Information Science at TH Köln (University of Applied Sciences). He is part of the team led by Prof. Philipp Schaer. He works in the area of information retrieval and recommender systems.

He is joining the DFG-funded RESIRE project, which is being carried out in cooperation with the University of Duisburg-Essen and the TH Köln. As part of the project, user simulations will be used to make retrieval experiments both more comparable and reproducible in the future. Andreas holds a B.Sc. and M.Sc. in Data and Information Science from TH Köln, where his academic emphasis on information retrieval and extraction laid the foundation for his current pursuits.

List of Publications

2026

Extended Overview of the CLEF 2026 LongEval Lab on Longitudinal Evaluation of Model Performance.
In: E. Sánchez-Salido, A. Barrón-Cedeño, A. G. S. de Herrera, S. MacAvaney and J. M. Struß, editors, Working Notes of the Conference and Labs of the Evaluation Forum, CLEF 2026, Jena, Germany, 21-24 September 2026, volume 4283, series CEUR Workshop Proceedings, pages 5144-5173. CEUR-WS.org, 2026.
Sarah Bouaraba, Timo Breuer, Matteo Cancellieri, Alaa El-Ebshihy, Maik Fröbe, Petra Galuscáková, Lorraine Goeuriot, Gabriel Iturra-Bocaz, Jüri Keller, Petr Knoth, Andreas Kruff, Philippe Mulhem, Florina Piroi, David Pride, Philipp Schaer and Didier Schwab.
[doi]  [BibTeX] 
Overview of the CLEF 2026 LongEval Lab on Longitudinal Evaluation of Model Performance.
In: M. Hagen, M. Potthast, B. Stein, P. Schaer, E. Zangerle, S. MacAvaney, J. M. Struß, E. Sánchez-Salido, A. Barrón-Cedeño and A. G. S. de Herrera, editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction - 17th International Conference of the CLEF Association, CLEF 2026, Jena, Germany, September 21-24, 2026, Proceedings, volume 17087, series Lecture Notes in Computer Science, pages 548-573. Springer, 2026.
Sarah Bouaraba, Timo Breuer, Matteo Cancellieri, Alaa El-Ebshihy, Maik Fröbe, Petra Galuscáková, Lorraine Goeuriot, Gabriel Iturra-Bocaz, Jüri Keller, Petr Knoth, Andreas Konstantin Kruff, Philippe Mulhem, Florina Piroi, David Pride, Philipp Schaer and Didier Schwab.
[doi]  [BibTeX] 
Evaluating Information Retrieval Models Along Time: The LongEval Lab at CLEF 2026.
In: R. Campos, A. Jatowt, Y. Lan, M. Aliannejadi, C. Bauer, S. MacAvaney, A. Anand, Z. Ren, S. Verberne, N. Bai and M. Mansoury, editors, Advances in Information Retrieval - 48th European Conference on Information Retrieval, ECIR 2026, Delft, The Netherlands, March 29 - April 2, 2026, Proceedings, Part IV, volume 16486, series Lecture Notes in Computer Science, pages 345-353. Springer, 2026.
Timo Breuer, Matteo Cancellieri, Alaa El-Ebshihy, Maik Fröbe, Petra Galuscáková, Lorraine Goeuriot, Gabriel Iturra-Bocaz, Jüri Keller, Petr Knoth, Andreas Konstantin Kruff, Philippe Mulhem, Florina Piroi, David Pride, Philipp Schaer and Didier Schwab.
[doi]  [BibTeX] 
LISP - A Rich Interaction Dataset and Loggable Interactive Search Platform.
In: R. Campos, A. Jatowt, Y. Lan, M. Aliannejadi, C. Bauer, S. MacAvaney, A. Anand, Z. Ren, S. Verberne, N. Bai and M. Mansoury, editors, Advances in Information Retrieval - 48th European Conference on Information Retrieval, ECIR 2026, Delft, The Netherlands, March 29 - April 2, 2026, Proceedings, Part IV, volume 16486, series Lecture Notes in Computer Science, pages 479-495. Springer, 2026.
Jana Isabelle Friese, Andreas Konstantin Kruff, Philipp Schaer, Norbert Fuhr and Nicola Ferro.
[doi]  [BibTeX] 
Sim4IA-Bench: A User Simulation Benchmark Suite for Next Query and Utterance Prediction.
In: R. Campos, A. Jatowt, Y. Lan, M. Aliannejadi, C. Bauer, S. MacAvaney, A. Anand, Z. Ren, S. Verberne, N. Bai and M. Mansoury, editors, Advances in Information Retrieval - 48th European Conference on Information Retrieval, ECIR 2026, Delft, The Netherlands, March 29 - April 2, 2026, Proceedings, Part IV, volume 16486, series Lecture Notes in Computer Science, pages 594-609. Springer, 2026.
Andreas Konstantin Kruff, Christin Katharina Kreutz, Timo Breuer, Philipp Schaer and Krisztian Balog.
[doi]  [BibTeX] 
Validating Search Query Simulations: A Taxonomy of Measures.
In: R. Campos, A. Jatowt, Y. Lan, M. Aliannejadi, C. Bauer, S. MacAvaney, A. Anand, Z. Ren, S. Verberne, N. Bai and M. Mansoury, editors, Advances in Information Retrieval - 48th European Conference on Information Retrieval, ECIR 2026, Delft, The Netherlands, March 29 - April 2, 2026, Proceedings, Part I, volume 16483, series Lecture Notes in Computer Science, pages 243-256. Springer, 2026.
Andreas Konstantin Kruff, Nolwenn Bernard and Philipp Schaer.
[doi]  [BibTeX] 

2025

User Simulation in Practice: Lessons Learned from Three Shared Tasks.
SIGIR Forum, 59(2), 2025.
Marcel Gohsen, Zahra Abbasiantaeb, Mohammad Aliannejadi, Krisztian Balog, Timo Breuer, Jeffrey Dalton, Maik Fröbe, Christin Katharina Kreutz, Andreas Kruff, Simon Lupart, Nailia Mirzakhmedova, Harriscen Scells, Philipp Schaer, Benno Stein and Johannes Kiesel.
[BibTeX] 
Evaluating Contrastive Feedback for Effective User Simulations.
2025.
Andreas Konstantin Kruff, Timo Breuer and Philipp Schaer.
[doi] [pdf]  [BibTeX] 
Scientometric Analysis of the German IR Community within TREC & CLEF.
In: M. Eibl, editor, Datenströme und Kulturoasen — Die Informationswissenschaft als Bindeglied zwischen den Informationswelten: Proceedings des 18. Internationalen Symposiums für Informationswissenschaft (ISI 2025). Hülsbusch, 2025.
Andreas Konstantin Kruff and Philipp Schaer.
[doi] [pdf]  [BibTeX] 
Report on the Second Workshop on Simulations for Information Access (Sim4IA 2025) at SIGIR 2025.
SIGIR Forum, 59(2):1-15, 2025.
Philipp Schaer, Christin Katharina Kreutz, Krisztian Balog, Timo Breuer, Andreas Kruff, Mohammad Aliannejadi, Christine Bauer, Nolwenn Bernard, Nicola Ferro, Marcel Gohsen, Nurul Lubis and Saber Zerhoudi.
[doi]  [BibTeX] 
Second SIGIR Workshop on Simulations for Information Access (Sim4IA 2025).
In: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, series SIGIR ’25, pages 4172–4175. ACM, 2025.
Philipp Schaer, Christin Katharina Kreutz, Krisztian Balog, Timo Breuer and Andreas Konstantin Kruff.
[doi] [pdf]  [BibTeX] 

2023

Billie-Newman at SemEval-2023 Task 5: Clickbait Classification and Question Answering with Pre-Trained Language Models, Named Entity Recognition and Rule-Based Approaches.
In: A. K. Ojha, A. S. Dogruöz, G. D. S. Martino, H. T. Madabushi, R. Kumar and E. Sartori, editors, Proceedings of the The 17th International Workshop on Semantic Evaluation, SemEval@ACL 2023, Toronto, Canada, 13-14 July 2023, pages 1542-1550. Association for Computational Linguistics, 2023.
Andreas Kruff and Anh Huy Matthias Tran.
[doi] [pdf]  [BibTeX] 

2021

Ad-hoc Retrieval of scientific Documents on the LIVIVO Search Portal.
In: G. Faggioli, N. Ferro, A. Joly, M. Maistro and F. Piroi, editors, Proceedings of the Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum, Bucharest, Romania, September 21st - to - 24th, 2021, volume 2936, series CEUR Workshop Proceedings, pages 1723-1742. CEUR-WS.org, 2021.
Anh Huy Matthias Tran, Andreas Kruff, Joshua Thos, Constantin Krah, Michelle Reiners, Fabian Ax, Saskia Brech, Sascha Gharib and Verena Pawlas.
[pdf]  [BibTeX] 

M.Sc.Andreas Kruff

Role
Researcher / PhD Student
Mail
andreas.kruff@th-koeln.de
Room
B4.280