CLEF CheckThat! 2023 Task 1 — English Check-Worthiness
The English data of Subtask 1B (check-worthiness, text only) of Task 1 of the CLEF 2023 CheckThat! Lab: 23,533 sentences from political debates, each labelled by whether it contains a claim worth fact-checking. The labels are Yes (5,651) and No (17,882). The data come in three files: train 16,876 (4,058 Yes, 12,818 No), dev 5,625 (1,355 Yes, 4,270 No), dev-test 1,032 (238 Yes, 794 No). Each row has a sentence ID, the sentence and the label.
Cite this dataset at
checkthat-2023-task1-english.echo.directory
Analytics
Topic 0
Topic 1
Topic 2
Topic 3
Topic 4
Topic 5
Topic 6
Topic 7
Topic 8
Topic 9
Topic 10
Topic 11
Show all 20 topics
Topic 12
Topic 13
Topic 14
Topic 15
Topic 16
Topic 17
Topic 18
Topic 19
Computed over the full corpus.
Record
- Catalog key
checkthat-2023-task1-english- Authors
- Nakov, Preslav; Barrón-Cedeño, Alberto; Da San Martino, Giovanni; CheckThat! Lab Organizers
- Year
- 2023
- Source paper
- CLEF 2023 CheckThat! Lab: Check-Worthiness Detection
- DOI / arXiv
- 10.1007/978-3-031-28241-6_59
- License
- Creative Commons Attribution-NonCommercial-ShareAlike 4.0 (CC BY-NC-SA 4.0) (CC-BY-NC-SA-4.0)
- Records
- 23,533
- Languages
- en
- Collected
- 2023 (2020s)
- Tasks
- Check-worthiness detection inferred
- Region
- Global (inferred: the platform is used worldwide)
Provenance
- Originally published at
- https://gitlab.com/checkthat_lab/clef2023-checkthat-lab link checked
- Original files as received
- The source files, unconverted, kept for reference: mirrored on echo.directory on 2026-10-02, 928.3 KB across 1 files. Checksums in MANIFEST.json. For use, start with the data package below.
- Data package
- Version 1.0.0 of this dataset as an ECHO Data Package: posts (23,533 rows), annotations (23,533 rows).
- Structure
- Labelled data, Text
Citations
The CLEF-2023 CheckThat! Lab: Checkworthiness, Subjectivity, Political Bias, Factuality, and Authority
Alberto Barrón-Cedeño, Firoj Alam, Tommaso Caselli, Giovanni Da San Martino, Tamer Elsayed
Journal Article · European Conference on Information Retrieval · 2023
Cited by
- Multimodal Automated Fact-Checking: A Survey
Mubashara Akhtar, M. Schlichtkrull et al. · Conference on Empirical Methods in Natural Language Processing · 2023 · cited 84× - LAraBench: Benchmarking Arabic AI with Large Language Models
Ahmed Abdelali, Hamdy Mubarak et al. · Conference of the European Chapter of the Association for Computational Linguistics · 2023 · cited 44× - Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AI
Houjiang Liu, Anubrata Das et al. · Proc. ACM Hum. Comput. Interact. · 2023 · cited 38× - Overview of the CLEF-2023 CheckThat! Lab Task 1 on Check-Worthiness in Multimodal and Multigenre Content
Firoj Alam, Alberto Barrón-Cedeño et al. · Conference and Labs of the Evaluation Forum · 2023 · cited 38× - A Corpus for Sentence-Level Subjectivity Detection on English News Articles
Francesco Antici, F. Ruggeri et al. · International Conference on Language Resources and Evaluation · 2023 · cited 28×
Show all 10
- Modality Deep-learning Frameworks for Fake News Detection on Social Networks: A Systematic Literature Review
Mohamed A. Mostafa, Ahmad S. Almogren et al. · ACM Computing Surveys · 2024 · cited 23× - Can LLMs Automate Fact-Checking Article Writing?
Dhruv Sahnan, David P. A. Corney et al. · Transactions of the Association for Computational Linguistics · 2025 · cited 17× - Overview of the CLEF-2024 CheckThat! Lab Task 1 on Check-Worthiness Estimation of Multigenre Content
Maram Hasanain, Reem Suwaileh et al. · Conference and Labs of the Evaluation Forum · 2024 · cited 17× - Lost in Translation, Found in Spans: Identifying Claims in Multilingual Social Media
Shubham Mittal, Megha Sundriyal et al. · Conference on Empirical Methods in Natural Language Processing · 2023 · cited 14× - Overview of the CLEF-2023 CheckThat! Lab Task 3 on Political Bias of News Articles and News Media
Giovanni Da San Martino, Firoj Alam et al. · Conference and Labs of the Evaluation Forum · 2023 · cited 12×
Citation data from Semantic Scholar, retrieved 2026-10-19.
How to cite
BibTeX
@misc{echo2026,
title = {ECHO: Exploratory Compendium of Humanity Online},
author = {Switzer, Braden and Zafarani, Reza},
year = {2026},
url = {https://echo.directory},
note = {Syracuse University}
}
@inproceedings{checkthat2023,
title = {CLEF 2023 {CheckThat!} Lab: Check-Worthiness Detection},
author = {Nakov, Preslav and Barr\'on-Cede\~no, Alberto and Da San Martino, Giovanni and others},
booktitle = {CLEF 2023 Working Notes},
year = {2023}
} APA
Switzer, B., & Zafarani, R. (2026). ECHO: Exploratory Compendium of Humanity Online [Data repository]. Syracuse University. https://echo.directory
Nakov, P., Barrón-Cedeño, A., Da San Martino, G., & CheckThat! Lab Organizers (2023). CLEF CheckThat! 2023 Task 1 — English Check-Worthiness [Data set]. https://doi.org/10.1007/978-3-031-28241-6_59
MLA
Switzer, Braden, and Reza Zafarani. ECHO: Exploratory Compendium of Humanity Online. Syracuse University, 2026, echo.directory.
Nakov, Preslav, et al. CLEF CheckThat! 2023 Task 1 — English Check-Worthiness. 2023, doi.org/10.1007/978-3-031-28241-6_59.