Scholarly Impact of CLEF and TREC compared
TREC and CLEF are long-running Information Retrieval evaluation campaigns with a history going back many years. Both conferences are well-known, but TREC is the older one, and CLEF is an official spin-off of TREC. Since TREC is the “older brother,” it is better known outside the core IR community. Looking at the current impact measured in citations, this is not really understandable since CLEF has a citation rate three times higher compared to TREC:
In this thesis, you should dig into this matter and research the impact of TREC and CLEF over the years. With the help of tools like Publish or Perish, you should gather your own dataset and thoroughly analyze the available publication and citation data on both conferences.
Relevant Literature and Links
- Publish or Perish: https://harzing.com/resources/publish-or-perish
- Tsikrika T, Larsen B, Müller H, Endrullis S, Rahm E (2013) The scholarly impact of CLEF (2000–2009).In: P. Forner et al. (Eds.): CLEF 2013, LNCS 8138, pp. 1–12, 2013. https://dbs.uni-leipzig.de/file/CLEF2013-lncs.pdf
- Larsen B. (2019) The Scholarly Impact of CLEF 2010–2017. In: Ferro N., Peters C. (eds) Information Retrieval Evaluation in a Changing World. The Information Retrieval Series, vol 41. Springer, Cham. https://doi.org/10.1007/978-3-030-22948-1_22
Requirements
- Basic knowledge in statistical and bibliographic analysis
- Interest in the collection and analysis of own gathered publication data