,
5 tweets,
2 min read
Read on Twitter
Our new pre-print “When Does Label Smoothing Help?”, joint work with @skornblith and @geoffreyhinton tiny.cc/w7tg9y (1/5)
Wanna know why label smoothing improves translation quality but hurts perplexity in English-to-German using Transformer? (2/5)
Wanna know why networks trained with label smoothing distill poorly? (3/5)
Wanna know how label smoothing changes representations by attenuating intra-class variation and inter-class similarity structure? (4/5) 
Wanna know the calibration of networks trained with label smoothing? All answers in tiny.cc/w7tg9y (5/5)
