We cordially invite proposals for the GermEval Shared Task 2025 co-located with Konvens 2025 in Hildesheim, Germany (September 9-12) .
GermEval is a series of shared task evaluation campaigns that focus on Natural Language Processing for the German language and has been running since 2014, traditionally co-located with Konvens.
Previous shared tasks
Previous shared tasks have been devoted to:
- Named entity recognition (2014)
- Lexical Substitution (2015)
- Aspect-based Sentiment in Social Media Customer Feedback (2016)
- Offensive Language (2018, 2019)
- Hierarchical classification of blurbs (2019)
- Lemmatization of German web and social media texts (2019)
- Identification of Toxic, Engaging, and Fact-Claiming Comments (2021)
- Text Complexity (2022)
- Speaker Attribution (2023)
- Sexism Detection in German Online News Fora (2024)
See also https://germeval.github.io/tasks/ for details.
Time schedule
| Proposal submission deadline: | December 15, 2024 |
| Notification: | December 20, 2024 |
| Extended submission period | January 4 - February 14, 2025 |
| Extended notification: | One week after submission |
| Workshop: | September 10, 2025 |
The early deadline facilitates a quick start of the organization of a shared task. Later submission is possible until February 14. We will try to review the proposal in that case within one week.
While fixing the exact timeline for the shared task is up to the task organizers, we propose the following tentative schedule:
| Trial data ready: | March 8, 2025 |
| Training data ready: | April 12, 2025 |
| Test data ready: | May 17, 2025 |
| Evaluation start: | June 16, 2025 |
| Evaluation end: | June 27, 2025 |
| Paper submission due: | July 11, 2025 |
| Camera ready due: | August 15, 2025 |
Submission guidelines
For GermEval proposals are invited for any shared task involving natural language processing in the context of the German language. For a detailed questionnaire to be submitted please see: https://gscl.org/germeval
Proposals should be submitted by e-mail to info.konvens2025@gscl.org, from the email of the contact person, with the subject “GermEval-2025 Shared Task Proposal”. Proposals should make clear that a schedule similar to that suggested above can be implemented, especially for the preparation of resources (trial/training/development/test data sets). Proposals should be 2 to 3 pages long, in ACL–PDF format. We encourage proposers to include appendices with examples that help understanding the data and type of evaluation.
Proposals will be reviewed by the KONVENS Program Committee. Proposers might be contacted during the reviewing period to provide further information. Potential proposers should feel free to indicate the intention to submit by emailing info.konvens2025@gscl.org. We are also happy to answer your questions about the process, or to solicit early feedback for a proposal.
Proceedings
Peer-reviewed workshop papers can be published in the KONVENS 2025 Proceedings. A camera-ready version of all accepted papers should be available at latest on August 22, 2025.