EMRAH Profile picture
May 26 10 tweets 2 min read
Hey @JohnMu @dannysullivan! Here is a proposed web standard for AI crawling: A Cryptographically Signed & AI-Generated llms.txt protocol. Traditional llms.txt can be manipulated by SEO spam. We can fix this at the architecture level. (1/8) Image How it works: Gemini/Googlebot crawls a site, generates the optimal context format for LLMs, signs it with a cryptographic key, and outputs a custom file to the root directory. No storage cost for Google as it's hosted on the user's server. (2/8)