Valentin Hofmann Profile picture
Postdoc @allen_ai @uwnlp | Formerly @UniofOxford @CisLMU @stanfordnlp @GoogleDeepMind
Mar 4, 2024 16 tweets 5 min read
💥 New paper 💥

We discover a form of covert racism in LLMs that is triggered by dialect features alone, with massive harms for affected groups.

For example, GPT-4 is more likely to suggest that defendants be sentenced to death when they speak African American English.

🧵 Image Prior work has focused on racial bias displayed by LLMs when they are prompted with overt mentions of race.

By contrast, racism in the form of dialect prejudice is completely covert since the race of speakers is never explicitly revealed to the models.