TextDetox Multilingual Toxicity — Japanese
A TextDetox 2024 shared task (Japanese) dataset of 5,000 Japanese posts (2,500 toxic, 2,500 non-toxic), collected by Dementieva et al. for PAN/CLEF TextDetox 2024. Each record contains post text, binary toxicity label (0=non-toxic, 1=toxic). TextDetox Japanese provides 5,000 balanced binary toxicity annotations — part of a 15-language multilingual benchmark for cross-lingual toxicity detection research. Suitable for toxicity detection, multilingual content moderation, cross-lingual NLP, hate speech classification, text detoxification.
Cite this dataset at
textdetox-ja.echo.directory
Analytics
Topic 0
Topic 1
Topic 2
Topic 3
Topic 4
Topic 5
Topic 6
Topic 7
Computed over the full corpus.
Record
- Catalog key
textdetox-ja- Authors
- Dementieva, Daryna; Moskovskiy, Daniil; Logacheva, Varvara; Dale, David; Ustalov, Dmitry; Panchenko, Alexander
- Year
- 2024
- Source paper
- Overview of the Multilingual Text Detoxification Task at PAN 2024
- DOI / arXiv
- 10.1007/978-3-031-71908-0_11
- License
- OpenRAIL++ (Hugging Face card) (LicenseRef-OpenRAIL-plus-plus)
- Records
- 5,000
- Languages
- ja
- Collected
- 2024 (2020s)
- Tasks
- Toxicity detection (binary;
is_toxic) inferred - Region
- East Asia (inferred: from the language of the data)
Provenance
- Originally published at
- https://huggingface.co/datasets/textdetox/multilingual_toxicity_dataset link checked
- Hosted copy
- Mirrored on echo.directory on 2026-10-02, 440.6 KB across 1 files. Checksums in MANIFEST.json.
Citations
Overview of PAN 2024: Multi-author Writing Style Analysis, Multilingual Text Detoxification, Oppositional Thinking Analysis, and Generative AI Authorship Verification Condensed Lab Overview
A. Ayele, N. Babakov, Janek Bevendorff, Xavier Bonet Casals, Berta Chulvi
Journal Article · Conference and Labs of the Evaluation Forum · 2024
Cited by
- Overview of PAN 2025: Voight-Kampff Generative AI Detection, Multilingual Text Detoxification, Multi-author Writing Style Analysis, and Generative Plagiarism Detection
Janek Bevendorff, Daryna Dementieva et al. · Conference and Labs of the Evaluation Forum · 2025 · cited 54× - Overview of the "Voight-Kampff" Generative AI Authorship Verification Task at PAN and ELOQUENT 2025
Janek Bevendorff, Yu-Xia Wang et al. · Conference and Labs of the Evaluation Forum · 2025 · cited 43× - Diversity Boosts AI-Generated Text Detection
Advik Raj Basani, Pin-Yu Chen · Trans. Mach. Learn. Res. · 2025 · cited 9× - Generative AI Authorship Verification Based on Contrastive-Enhanced Dual-Model Decision System
Jun-Lang Liu, Lei-Lei Kong et al. · Conference and Labs of the Evaluation Forum · 2025 · cited 8× - elfen: A Python Package for Efficient Linguistic Feature Extraction for Natural Language Datasets
Maximilian Maurer · Conference of the European Chapter of the Association for Computational Linguistics · 2026 · cited 7×
Show all 10
- AIDBench: A benchmark for evaluating the authorship identification capability of large language models
Zichen Wen, Dadi Guo et al. · arXiv.org · 2024 · cited 6× - LOG-AID: Logit-Based Statistical Features for AI Text Detection
Sophie Titze, Oren Halvani · Conference and Labs of the Evaluation Forum · 2025 · cited 5× - Style Change Detection Using Graph and Structural Linguistic Features for Multi-Author Writing Analysis
Ioana-Roxana Boriceanu, Andra Băltoiu · Conference and Labs of the Evaluation Forum · 2025 · cited 5× - Unibuc - NLP at "Voight-Kampff" Generative AI Detection PAN 2025
Teodor-George Marchitan, Claudiu Creanga et al. · Conference and Labs of the Evaluation Forum · 2025 · cited 5× - Literal Re-translation as a Method for AI Text Disguise and Detection Evasion
Poojan Vachharajani · Conference and Labs of the Evaluation Forum · 2025 · cited 4×
Citation data from Semantic Scholar, retrieved 2026-10-19.
How to cite
BibTeX
@misc{echo2026,
title = {ECHO: Exploratory Compendium of Humanity Online},
author = {Switzer, Braden and Zafarani, Reza},
year = {2026},
url = {https://echo.directory},
note = {Syracuse University}
}
@inproceedings{dementieva2024overview,
title = {Overview of the Multilingual Text Detoxification Task at PAN 2024},
author = {Dementieva, Daryna and others},
booktitle = {CLEF 2024 Working Notes},
year = {2024}
} APA
Switzer, B., & Zafarani, R. (2026). ECHO: Exploratory Compendium of Humanity Online [Data repository]. Syracuse University. https://echo.directory
Dementieva, D., Moskovskiy, D., Logacheva, V., Dale, D., Ustalov, D., & Panchenko, A. (2024). TextDetox Multilingual Toxicity — Japanese [Data set]. https://doi.org/10.1007/978-3-031-71908-0_11
MLA
Switzer, Braden, and Reza Zafarani. ECHO: Exploratory Compendium of Humanity Online. Syracuse University, 2026, echo.directory.
Dementieva, Daryna, et al. TextDetox Multilingual Toxicity — Japanese. 2024, doi.org/10.1007/978-3-031-71908-0_11.