Skip to content

CaliberAI/neutralizing-bias

Repository files navigation

Neutralizing Biased Text

This repo contains code for the paper, "Automatically Neutralizing Biased Text".

Concretely this means algorithms for

  • Identifying biased words in sentences.
  • Neutralizing bias in sentences.

Repo List TODO REPLACE WITH NEW IMG

Installation

pip install -r requirements.txt

Data

Click this link to download (100MB, expands to 500MB).

Overview

harvest/: Code for making the dataset. It works by crawling and filtering Wikipedia for bias-driven edits.

src/: Code for training models and using trained models to run inference. The models implemented here are referred to as MODULAR and CONCURRENT in the paper.

Usage

Please see src/README.md and harvest/README.md.

TODO MAKE THESE HYPERLINKS

About

Code and data for the paper, "Automatically Neutralizing Subjective Bias in Text"

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 84.0%
  • Jupyter Notebook 14.8%
  • Shell 1.2%