Answer Engine Optimisation (AEO) is the practice of making your website's content discoverable, extractable, and citable by AI systems - including ChatGPT, Perplexity, Claude, Google AI Overviews, and Gemini.
Unlike traditional SEO, which optimises for position in a list of search results, AEO optimises for inclusion in the AI's synthesised answer. The distinction matters because AI search is binary: you're either part of the answer or you're invisible. There is no page two.
Gartner projected that search engine query volume would drop 25% by 2026 due to AI chatbots. HubSpot's research found that ChatGPT converts at 15.9% and Perplexity at 10.5% — both significantly higher than average organic search. The shift is real, it's measurable, and most businesses aren't prepared for it.
This guide is the hub for our complete AEO content series — eight in-depth articles covering every layer of the stack, from the format AI systems prefer to the analytics that tell you whether it's working. It's based on the infrastructure we've built and deployed through Getmd.ai, our platform for making websites AI-readable at scale.
Why most websites are invisible to AI
Your website was built for human browsers. It has navigation menus, tracking scripts, cookie banners, and deeply nested HTML that buries your actual content under thousands of tokens of noise. A typical CMS page consumes over 16,000 tokens in HTML. The same content in clean markdown takes roughly 3,000. That's an 80% waste problem — and AI systems respond by moving on to cleaner sources.
Fewer than 15% of websites have implemented even basic AI-readability standards. The opportunity is wide open.
The AEO stack: five technical foundations
AEO sits on five technical foundations. Each one has a dedicated deep-dive in our content series:
1. Unblocked AI crawlers. Many websites are invisible to AI search because their robots.txt inadvertently blocks ClaudeBot, GPTBot, and PerplexityBot. A five-minute audit is the single highest-impact quick win in AEO. → The robots.txt audit: are you accidentally blocking AI?
2. Markdown — the format AI systems prefer. Markdown delivers pure content at a fraction of the token cost of HTML, with unambiguous structural signals. It's the foundation everything else builds on. → What is markdown and why LLMs prefer it
3. llms.txt — the site-level index. A curated table of contents at your website's root that tells AI agents who you are, what your site contains, and where to find the important pages. → What is llms.txt and why every website needs one
4. Per-page markdown files — the gold standard. Every page on your site gets a clean markdown endpoint with YAML frontmatter. This is what GetMD.ai automates at scale. → Per-page .md files: the gold standard for AI readability
5. Content Signals — AI usage governance. A response header standard that lets you declare whether AI systems can train on your content, cite it in search, or use it for agentic tasks — more granular than robots.txt. → Content Signals: telling AI how it can use your content
For the full walkthrough connecting all five, see our overview: Making your website AI-readable: the complete guide.
Content structure: earning citations
Technical infrastructure gets your content in front of AI agents. The structure of your content determines whether they cite it. Research into ChatGPT citation patterns found that 44% of all citations come from the first 30% of a page, and cited passages are nearly twice as likely to use definitive language compared to hedged framing.
The principles that earn citations: lead with the answer rather than building to it, write self-contained passages of 75–150 words that make sense in isolation, mirror real questions in your headings, use definitive language, and present comparisons and specifications in structured formats like tables and ordered lists.
We've published the full methodology: How to structure content so AI systems cite you.
Measuring AEO: closing the blind spot
Standard analytics tools filter out bot traffic. Google Analytics and HubSpot show human visitors, not AI crawlers. You have a massive blind spot — AI systems are deciding whether to cite you or ignore you, and you can't see any of it in your dashboards.
Effective AI crawl analytics tracks which bots are visiting, which pages they're hitting, what response codes they're getting, how frequently they return, and whether activity is trending up or down. Beyond crawl data, platforms like Profound Analytics track your brand's share of voice across AI-generated answers — showing you not just whether bots are reading your content, but whether AI systems are actually citing you.
Full deep-dive: How to know which pages LLMs have indexed.
AEO and SEO: complementary, not competing
AEO doesn't replace SEO. Organic search still drives the majority of web traffic. But AEO is where the growth is — and the businesses investing in both will outperform those betting on either alone.
Where they overlap: both reward well-structured content, topical authority, and quality backlinks. Where they diverge: SEO measures rankings and organic traffic; AEO measures AI crawl activity, citation frequency, and share of voice in AI responses. SEO success is positional. AEO success is binary.
Getting started
If you want to make your website visible to the AI systems reshaping how people discover businesses, explore our AEO services or get in touch.
Frequently Asked Questions
What is Answer Engine Optimization (AEO)?
Answer Engine Optimization is the practice of making website content discoverable and citable by AI systems like ChatGPT, Perplexity, Claude, and Google AI Overviews. It involves making content machine-readable through formats like markdown and standards like llms.txt, and structuring content so AI systems can extract and cite specific passages in their answers.
How is AEO different from SEO?
SEO optimises for position in a list of search results. AEO optimises for inclusion in an AI-generated answer. SEO success is positional — you rank higher or lower. AEO success is binary — you're either cited or invisible.
Why do AI systems prefer markdown over HTML?
A typical web page consumes over 16,000 tokens in HTML, with roughly 80% spent on navigation, scripts, and styling. The same content in markdown takes approximately 3,000 tokens — all actual content. For AI systems processing millions of pages, markdown is dramatically more efficient.
Does AEO replace SEO?
No. AEO complements SEO. Organic search still drives the majority of web traffic. AEO targets the growing share of discovery happening through AI systems. Businesses should invest in both.
Go deeper — our complete AEO content series:
- Making your website AI-readable: the complete guide
- What is markdown and why LLMs prefer it
- What is llms.txt and why every website needs one
- Per-page .md files: the gold standard for AI readability
- The robots.txt audit: are you accidentally blocking AI?
- How to structure content so AI systems cite you
- Content Signals: telling AI how it can use your content
- How to know which pages LLMs have indexed
