Matthias Samwald (NeurIPS) Profile picture
🔬 Associate professor of artificial intelligence and biomedical informatics. ✨ Aligning human and machine intelligence
Nov 11, 2022 9 tweets 5 min read
We suffered through curating and analysing thousands of benchmarks -- to better understand the (mis)measurement of AI! 📏🤖🔬

We cover all of #NLProc and #ComputerVision.

Now live at @NatureComms! nature.com/articles/s4146…

1/ Image Benchmarks are crucial to measuring and steering AI progress.

Their number has become astounding.

Each has unique patterns of activity, improvement and eventual stagnation/saturation. Together they form the intricate story of global progress in AI. 🌐
2/ Image