Hate Speech Dataset Catalogue

This page catalogues datasets annotated for hate speech, online abuse, and offensive language. They may be useful for e.g. training a natural language processing system to detect this language.

The list is maintained by Leon Derczynski, Bertie Vidgen, Hannah Rose Kirk, Pica Johansson, Yi-Ling Chung, Mads Guldborg Kjeldgaard Kongsbak, Laila Sprejer, and Philine Zeinert.

We provide a list of datasets and keywords. If you would like to contribute to our catalogue or add your dataset, please see the instructions for contributing.

If you use these resources, please cite (and read!) our paper: Directions in Abusive Language Training Data: Garbage In, Garbage Out. And if you would like to find other resources for researching online hate, visit The Alan Turing Institute's Online Hate Research Hub or read The Alan Turing Institute's Reading List on Online Hate and Abuse Research.

If you're looking for a good paper on online hate training datasets (beyond our paper, of course!) then have a look at 'Resources and benchmark corpora for hate speech detection: a systematic review' by Poletto et al. in Language Resources and Evaluation.

Accompanying data statements preferred for all corpora.

How to contribute

We accept entries to our catalogue based on pull requests to the content folder. The dataset must be avaliable for download to be included in the list. If you want to add an entry, follow these steps!

Please send just one dataset addition/edit at a time - edit it in, then save. This will make everyone’s life easier (including yours!)

Create file

Go to the repo url file and click the "Add file" dropdown and then click on "Create new file".

Choose location

In the following page type content/datasets/<name-of-the-file>.md. if you want to add an entry to the datasets catalog or content/keywords/<name-of-the-file>.md if you want to add an entry to the lists of abusive keywords, if you want to just add an static page you can leave in the root of content it will automatically get assigned an url eg: /content/about.md becomes the /about page

Fill in content

Copy the contents of templates/dataset.md or templates/keywords.md respectively to the camp below, filling out the fields with the correct data format. Everything below the second --- will automatically get rendered into the page, so you may add any standard markdown fields e.g tables, headings, lists...

Commit changes

Click on "Commit changes", on the popup make sure you give some brief detail on the proposed change. and then click on Propose changes

Submit PR

Submit the pull request on the next page when prompted.