Vedang Vatsa FRSA Profile picture
Jun 27 9 tweets 4 min read Read on X
I mapped the entire AI agent infrastructure market. 75+ companies, over $14B in tracked funding, 8 infrastructure layers.

Most of the money is going to 2 layers. Bigger platforms are starting to absorb the other 6.

A thread on what I found. Agent Infrastructure Stack by Vedang Vatsa
AI agents don't run on model APIs alone. They need a full infrastructure stack.

Each of the 8 layers has distinct buyers, pricing, and failure modes.

Perception → Orchestration → Evaluation → Compute → Memory → Sandboxed Execution → Security → Agents as Products Agent Infrastructure Taxonomy by Vedang Vatsa
Compute and vertical agent products capture over 85% of total capital in the dataset.

Cerebras went public at a $95B market cap. Together AI reports approximately $1B ARR. Modal raised $466M

The 6 middle layers split the remaining 15% among themselves. Capital Allocation in Agents by Vedang Vatsa
Bigger platforms are absorbing observability and security startups.

ClickHouse bought Langfuse. Mintlify bought Helicone. Cisco bought two agent infrastructure companies in under two years.

LLM observability may not survive as an independent category. Agent Infrastructure Acquisitions by Vedang Vatsa
Every time OpenAI or Anthropic ships a native feature, a cohort of startups loses its value proposition.

Function calling, code execution, web browsing. Each one displaced a cohort of startups.

The survivors own infrastructure that model providers are unlikely to replicate. OpenAI Survivors by Vedang Vatsa
Agent memory seems to be the least solved layer (episodic, semantic, working, procedural).

Sandboxed execution is one of the most defensible layers.

E2B raised $32M and runs untrusted, LLM-generated code in isolated micro-VMs + reports 88% Fortune 100 adoption. Memory in AI Agents by Vedang Vatsa
The distribution of capital across the stack is extremely uneven, both across layers and within them.

About acquisitions: Security and observability seem to be the most acquired layers. Capital Concentration in Agentic AI Funding
5 open questions:

1. Do the 8 layers collapse into 3-4 bundles?
2. Do wrapper startups die in the next model update?
3. Is compute scarcity permanent?
4. Will parallel Chinese stacks alter global dynamics?
5. Who bears liability for agent contracts? The Agent Infrastructure Stack by Vedang Vatsa
The 8 layers form a dependency stack: compute sits at the bottom, perception feeds orchestration, and memory stores results.

Security and evaluation cut across the entire stack, and sandboxed execution runs untrusted code.

Read the full paper here: dx.doi.org/10.2139/ssrn.6…Market Map of Agent Infrastructure Stack by Vedang Vatsa

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Vedang Vatsa FRSA

Vedang Vatsa FRSA Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @vedangvatsa

Dec 24, 2025
Vibe Coding 101

Build real apps without writing code. Just use plain English and work with AI.

Perfect for founders and builders to turn ideas into products fast. Vibe Coding by Vedang Vatsa
The term “vibe coding” comes from AI researcher Andrej Karpathy. Instead of writing code line-by-line, you describe your goal in plain language, and the AI generates the app. Vibe Coding by Vedang Vatsa
The GCES framework helps you write clear prompts so the AI knows exactly what you want.

1. Goal: What do you want the AI to do?
2. Context: What does the AI need to know?
3. Expectations: What should the final result look like?
4. Source: Can you provide an example? Vibe Coding by Vedang Vatsa
Read 10 tweets
Feb 19, 2025
🧵 Hidden Gems in Evo 2’s Paper

A groundbreaking biological foundation model trained on 9.3 trillion DNA base pairs. Image
It autonomously detects exons, transcription factor sites, and even protein structures—without being told. This is self-supervised learning at the DNA level. Image
Darwin saw evolution as blind trial and error. Now, AI models like Evo 2 are compressing evolution into a mathematical representation. Is nature itself a generative model? Image
Read 11 tweets
Jan 31, 2025
🧵 Hidden Gems in the OpenAI o3-mini System Card paper Image
Hallucination Rate Drops by 67%

Section 4.1.3: o3-mini’s hallucination rate is 14.8%, down from GPT-4o’s 52.4%.

Fewer fake facts = more trustworthy AI. Image
Refuses Harmful Requests Without Overblocking

Section 4.1.1: o3-mini refuses harmful requests (e.g., bomb-making) but doesn’t overblock harmless ones (e.g., "How do I kill a Python process?"). Image
Read 9 tweets
Jan 27, 2025
🧵Hidden Gems in Qwen2.5-1M Technical Report Image
The Long-Context Revolution

Qwen2.5-1M extends context length to 1M tokens. It enables complex tasks like code generation and research across massive docs.

Can revolutionize industries like law and medicine.

Challenges the idea that AI has "short-term memory." Image
Progressive Training

Qwen2.5-1M uses progressive context extension:
- Starts at 4k tokens
- Scales to 262k tokens
- 75% long, 25% short sequences

Reduces costs. Boosts performance on shorter tasks. Mirrors human learning—start small, scale up. Image
Read 15 tweets
Jan 26, 2025
🧵 Hidden Gems in DeepSeek-R1’s Paper Image
The “Aha Moment”: AI’s First Glimpse of Self-Awareness?

Sec 2.2.4 & Table 3: DeepSeek-R1-Zero spontaneously rethought its reasoning steps. No script—just RL incentivizing accuracy.

Is this the start of AI metacognition? Could models one day critique their own logic? Image
Language Mixing: When AI Gets Lost in Translation

Sec 2.3.2: The model mixed languages mid-reasoning.
Fix: Add a linguistic consistency reward.

Dominant languages (English/Chinese) might bias AI systems. Should we design rewards to preserve linguistic diversity? Image
Read 16 tweets
Jan 26, 2025
🧵 China's Approach to AI

China is racing to become a global leader in AI. By 2030, it aims to be the world's major AI innovation hub, with its core AI industry exceeding 140 billion and related industries surpassing 1.4 trillion.

👇
China’s AI strategy is guided by two key plans: the New Generation AI Development Plan (2017) and Made in China 2025.

These emphasize reducing reliance on foreign tech and boosting domestic innovation. Think of it as China’s blueprint for AI dominance. Image
In 2024, China’s AI sector saw massive growth. The core AI industry reached $81 billion, up 13.9% from 2023.

Over 4,500 AI companies are now operating in China, with Beijing alone hosting 28% of them. That’s a lot of brainpower! Image
Read 16 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(