Thread by @aigleeson

RIP SEO.

a16z just called it: traditional search is dead.

Welcome to Generative Engine Optimization (GEO).

Now people ask AI, not Google and if you’re not in the answer, you don’t exist.

Here's how to add this 1 small file to your website to get your brand in any LLM:

SEO was for Google.

AIO (AI Optimization) is for Large Language Models.

Right now, LLMs are crawling the web and pulling content into their “knowledge”.

If you don’t guide them, they might ignore you or use outdated info.

Why it matters:

• AI search is exploding (ChatGPT Search, Perplexity, Arc Search, etc.)
• Models build answers from web data
• If you’re not optimized, you’ll be invisible in AI responses even if you rank on Google

How to create your llm.txt:

1. Open a plain text editor → Name it llm.txt
2. Add your rules:

"
User-agent: GPTBot
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: PerplexityBot
Allow: /

Sitemap: yoursite.com/sitemap.xml
Data-source: yoursite.com/ai-dataset.json
"

3. Include AI-friendly resources:

• JSON/CSV/Markdown with facts, summaries, product info
• Keep it updated

4. Upload it to your site’s root domain:


5. Test it in your browser to make sure it’s publicyoursite.com/llm.txt

Example AI data source (JSON):

[
{
"name": "Your Company",
"description": "AI-powered platform for...",
"founded": "2023",
"website": ""
}
]

This gives LLMs clean, structured data to use in answers.yoursite.com

Prompt to use for making LLM.TXT file in a second:

"
I want to create an LLM.TXT file for my website so it ranks across all Large Language Models (ChatGPT, Claude, Perplexity, Gemini, etc.).

Ask me for:

- My website URL
- Sitemap URL
- Any structured data URLs (JSON, CSV, or Markdown)
- Any content I want to restrict from AI crawlers
- Any preferred crawlers to block or allow

Then, generate a complete LLM.TXT file with:
- Allow/Disallow rules for major AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.)
- Links to my sitemap(s) and structured data
- Clear comments explaining each section

Make sure it’s optimized for maximum AI visibility and compliant with current AI crawler standards.
"

Google SEO took 20 years to mature.

AI SEO is just starting.

The brands that act now will own the AI answer box for years.

- Add llm.txt today.
- Tomorrow, you’ll be the default answer in AI.

Learn more here:
llmstxt.org

I hope you've found this thread helpful.

Follow me @aigleeson for more.

Like/Repost the quote below if you can:

https://twitter.com/1904718477296062464/status/1956647158679310517