1PP Misalign RL

Reward-hacking environments for the 1PP 1.7B models (raw, asst, ua) · the two environments still worth continuing

Loading data.json (about 7 MB)…