GEO Was Mostly Noise. Here’s What Actually Works for AI Search Visibility.

Ahrefs analyzed 137,210 domains for llms.txt adoption and AI crawler traffic. Key finding: 97% of published llms.txt files received zero requests from any AI system. Of the 3% that got traffic, 77% came from non-AI bots — SEO auditing tools and general crawlers.

Google confirmed explicitly that llms.txt is not required for generative AI features.

And on r/SEO, a thread titled “GEO Got Torched: THANK YOU” collected 131 upvotes from practitioners who had wasted time and money on an optimization framework that turned out to solve a problem AI search doesn’t actually have.

What llms.txt Actually Does

llms.txt is a text file you place at your domain root that tells AI agents which parts of your site are most relevant. The idea, when it circulated, was that AI crawlers would find it, read it, and prioritize your specified content.

The Ahrefs data shows what actually happened: AI assistants — the ones serving search answers — don’t fetch llms.txt. The file’s primary actual audience is coding tools like Claude Code, which use it to understand a project’s file structure. That’s a narrow, specific use case. It has nothing to do with appearing in ChatGPT or Perplexity or Google AI Mode answers.

Of the AI-related bots that did fetch llms.txt files, training crawlers (bots indexing data for model training) dominated. PerplexityBot barely registered. AI assistants used for search barely registered. The intended audience — AI search engines — largely ignored the file.

This doesn’t mean llms.txt is worthless. If you’re running a developer tool or documentation site and you want coding agents to navigate your content correctly, there’s a narrow case for it. But as an AI search optimization strategy, the data says it didn’t work.

Why GEO Became a Consulting Product

The GEO (Generative Engine Optimization) framework arrived at a moment when everyone with an SEO practice was looking for a new service line. AI search was new and confusing, publishers were scared, and “optimize your content for AI search” was billable work.

The problem: AI search doesn’t expose its ranking factors the way traditional search does. There’s no Google Search Console equivalent that shows you why a particular source got cited. Without that feedback loop, GEO tactics were mostly theoretical — do this and hope the AI notices.

Some of the underlying advice was sound: write clearly, structure content well, be authoritative. But that’s just good content practice, not a specialized AI optimization framework. The llms.txt layer was added on top of sensible advice and oversold as the mechanism.

What Actually Moves the Needle

The same Ahrefs research, along with Google’s official AI search guidance and practitioner reports, points at consistent factors that correlate with AI citation:

Entity authority. AI systems cite sources they recognize as authoritative within a domain. This is built through consistent publishing, genuine expertise signals, backlinks from recognized sources, and being referenced across the web independently of your own promotion. It can’t be fast-tracked.

Brave Search rankings. Claude’s real-time search uses Brave Search results. If you’re specifically trying to appear in Claude answers, Brave rankings are the mechanism. Brave prioritizes independent web sources with clean technical setups and genuine content quality.

Reddit presence. As covered in the Reddit citation strategy piece: Reddit ranks in Google, ChatGPT cites Reddit, therefore Reddit presence feeds into ChatGPT citation. This is a concrete, measurable lever.

Original content AI can’t replicate. Data you generated, tests you ran, research you conducted — content that exists nowhere else. AI systems cite original sources because they have to; they can’t synthesize what doesn’t exist.

Structured, clean content. Clear headings, direct answers near the top of the page, specific data points named explicitly. This is not AI-specific formatting — it’s good editorial practice. But it does make your content easier for AI systems to extract and cite accurately.

The Actual Takeaway

The GEO framework wasn’t useless in all dimensions — the underlying content quality advice is real. But the specific tactics around llms.txt and AI-specific formatting were not backed by evidence, and the data now confirms they didn’t work.

The practitioners celebrating on r/SEO weren’t celebrating because AI search stopped mattering. They were celebrating because the anxiety-driven checklist that consultants sold them turned out to be unnecessary, and they could go back to doing the things that actually work.

For affiliate marketers: the AI SEO framework that holds up is entity authority + original content + structured writing + Reddit presence + Brave Search optimization. That’s a 12-month build, not a quick tactic. But it’s the one with actual correlation to AI citation outcomes.

Stop adding llms.txt files and start publishing something AI assistants would actually want to cite.