Paul Röttger Profile picture
PhD Student @oiioxford @turinginst || CTO & Co-Founder https://t.co/GzzghuyKuh || NLP & Hate Speech Research
May 2, 2022 9 tweets 4 min read
🥳 New paper accepted at #NAACL2022 (Main) 🥳

NLP tasks like hate speech detection are subjective: annotators disagree about what the correct data labels are. We propose two contrasting paradigms to enable better data annotation.

arxiv.org/pdf/2112.07475…

⬇️ Highlights below ⬇️ ⚠️ We argue that dataset creators should consider annotator subjectivity in the annotation process and either explicitly encourage it or discourage it, depending on the intended use of their dataset ⚠️
As a framework, we propose two contrasting data annotation paradigms: