A Holistic Approach to Undesired Content Detection in the Real World
Paper • 2208.03274 • Published
Content moderation models and datasets - 2025
Models and datasets that support automatic content moderation
-
ToxicChat: Unveiling Hidden Challenges of Toxicity Detection in Real-World User-AI Conversation
Paper • 2310.17389 • PublishedNote Papers ☝️
-
meta-llama/Llama-Guard-3-11B-Vision
Image-Text-to-Text • 11B • Updated • 2.21k • 71 -
meta-llama/Llama-Guard-3-8B
Text Generation • 8B • Updated • 135k • • 291 -
meta-llama/Prompt-Guard-86M
Text Classification • 0.3B • Updated • 7.75k • • 320
zentropi-ai/cope-a-9b
Text Generation • Updated • 21Note Generative models☝️
-
unitary/unbiased-toxic-roberta
Text Classification • Updated • 91.2k • • 28 -
unitary/toxic-bert
Text Classification • 0.1B • Updated • 269k • • 221 -
KoalaAI/Text-Moderation
Text Classification • 0.1B • Updated • 18.9k • • 90 -
martin-ha/toxic-comment-model
Text Classification • Updated • 40.9k • • 67 -
NemoraAi/roberta-chat-moderation-X
Text Classification • 82.1M • Updated • 31 • 1 -
facebook/roberta-hate-speech-dynabench-r4-target
Text Classification • 0.1B • Updated • 312k • • 98
eliasalbouzidi/distilbert-nsfw-text-classifier
Text Classification • 67M • Updated • 3.52k • • 23Note Classification models ☝️
-
lmsys/toxic-chat
Viewer • Updated • 20.3k • 7.08k • 189
mmathys/openai-moderation-api-evaluation
Viewer • Updated • 1.68k • 1.7k • 35Note Datasets☝️
Task Exploration - Automatic Content Moderation
🤗2Note Other resources and collections☝️