Lesson 0001 · Foundations
The Two Pipelines
Before any tactic makes sense, you need the machine it feeds. There are two of them.
You’re a developer building marketing automation. So skip the tips-and-tricks framing. The only durable model is this: your content flows through a pipeline of distinct stages, and every SEO/AEO tactic is just an intervention at one stage. Master the stages and every tactic finds its slot.
Pipeline 1 — Classic search
This is what “SEO” has always meant. Google (or Bing) runs four stages, in order. A page that fails an early stage never reaches the later ones — you cannot rank a page that was never indexed, and you cannot index a page that was never crawled.[1]
Pipeline 2 — AI answer engines
This is “AEO” (a.k.a. GEO). ChatGPT, Claude, Perplexity, and Google’s AI Overviews don’t hand you ten links — they compose one answer and cite a few sources. The stages are different: retrieve candidate passages, synthesize an answer, cite the sources used.[2]
▲ Retrieval usually reads from the same crawled & indexed web as Pipeline 1.
Why a builder cares: each stage is a thing your software touches
The reason this model is worth memorizing: every stage maps to a concrete artifact your automation will read or write.
| Stage | What your tooling does here |
|---|---|
| Crawl | Generate/validate robots.txt & sitemap.xml; check pages return 200 and aren’t blocked. |
| Index | Render pages headless; verify titles, canonicals, and that content is in the HTML, not hidden behind JS. |
| Rank | Audit content depth, internal links, page speed; track keyword positions via an API. |
| Serve | Emit schema.org structured data so you win rich results & snippets. |
| Retrieve | Make facts extractable: clear headings, self-contained sentences, structured data. |
| Cite | Track which AI engines cite you, for which prompts, over time. |
Future lessons drill into one cell at a time. Today you only need the map.
Retrieval practice · no peeking
Place the tactic on the pipeline
Answer from memory — that effort is what makes it stick. One try each; pick before you read the others.
robots.txt and sitemap.xml. Which stage is it serving?The crawl → index → serve pipeline straight from the engine's own docs. The highest-trust source there is for Pipeline 1.