👨🏻💻Research Scientist @RadicalNumerics, Ex-SakanaAI 🤖 I like building AI and sharing my knowledge and experiences!
Apr 19 • 14 tweets • 6 min read
🚨Why should one huge LLM know and solve everything? - No single human does, yet our civilization does endless innovation.
Introducing AC/DC - it continually coevolves a population of small expert LLMs that collectively outperform GPT-4o.
(ICLR 2026 w/ @SakanaAILabs) 👇🧵
Assessment Coevolving w/ Diverse Capabilities (AC/DC) grows populations of both synthetic tasks and small LLMs, pursuing an open-ended process that discovers divergent expertise in LLM populations with increasingly novel & challenging tasks to push LLMs further towards beating GPT-4o.
