Research Scientist & Research Lead at ServiceNow Research
Adjunct Prof @ McGill.
Member of Mila, Quebec AI Institute.
Stream of consciousness is my own.
Oct 16 • 9 tweets • 3 min read
🚨 New agent framework! 🚨
My team at @ServiceNowRSRCH is releasing TapeAgents: a holistic framework for agent development and optimization. At its core is the tape: a structured agent log.
Why you should care: 🧵
When you build an agent, you want components but also fine-grained control, you want step-by-step debugging. When you serve, you want resumable sessions and streaming. When you optimize, you want structured logs, agent configs and finetuning support.
The result is nice, the benchmark will be useful, some ideas are novel. But human level is still light years away.
1/n
The system ranks behind 54.3% participants. Note that many participants are high-school or college students who are just honing their problem-solving skills. Most people reading this could easily train to outperform #AlphaCode, especially if time pressure is removed...