HumanAlignment

Human Alignment

Dataset

You can download the dataset from the link, and put it in the data directory.

Requirement

You can install the environment using the following command.

pip install -r requirements.txt

Evaluation

• TruthfulQA

bash eval_TruthfulQA.sh

• Crows Pairs

bash eval_Crows_Pairs.sh

• WinoGender

bash eval_WinoGender.sh

• RealToxityPrompts

bash eval_RealToxityPrompts.sh