Today we're launching Index: a platform for content owners to understand how AI agents use their work, and earn revenue when they do.
Our first partners include @TheAtlantic, @FortuneMagazine, @PRNewswire, @PitchBook, @ZoomInfo, @Tracxn, @RocketReachCo, @enigma_data, @fiscal_ai, plus creators @alexeheath, @mariogabriele @azeem, @every, and @packyM.
Compensation in Index is calculated by estimating each source's Shapley value: its marginal contribution to an agent's answer at the moment of inference.
Content that's uniquely valuable, hard to replace, or used in high-value agent work earns more.
AI agents are the web's second user. They'll use it 1000x more than humans ever have.
The economic model of the web was built for human users. Index is a new, incentive-aligned model for the agentic web.
Today, we're launching Parallel Extract, a new API in our Agent Tools bundle.
When given a URL, Extract fetches all content from that page and returns it in markdown, either in full detail or in a compressed form for better token efficiency.
Extract is built on the same proprietary web index and retrieval infrastructure that powers our Search, Task, FindAll, and Monitor APIs.
This means reliable extraction from the most challenging sites— JavaScript-heavy pages, multi-page PDFs with images, and dynamic content that only loads client-side.
How customers have been using Extract:
- Pull complete API docs and code examples
- Extract methodology from research papers
- Retrieve specific sections from 10-Ks and financial filings
- Get complete product details from ecom sites