Technical GEO

Before any engine can mention you, its crawlers have to fetch and parse your pages. These are the working guides to that plumbing: robots.txt rules for AI crawlers, llms.txt, Cloudflare's crawler controls, and the rendering and structured-data checks that decide whether your content is readable to the engines at all. Most of it is under an hour of work — and it's the hour that everything else in GEO depends on.

• August 18, 2026 · 18 min read

  AI Crawler Log Analysis: Crawl Volume Isn't Citations

  GPTBot can crawl 4,000 pages and cite none. An AI crawler log analysis guide: what each bot proves, why volume misleads, and where citations show up.

  • technical-geo
  • ai-crawlers
  • log-analysis
  • gptbot
  • measurement
  Read post

• August 14, 2026 · 13 min read

  Opt Out of AI Overviews Without Losing Rankings

  Google's Search Console controls let you opt out of AI Overviews without losing rankings — but only one lever is ranking-neutral. A plain reading of each.

  • technical GEO
  • AI Overviews
  • AI Mode
  • Search Console
  • publishers
  • AI visibility
  Read post

• August 3, 2026 · 18 min read

  llms.txt and AI Crawler Access: The 20-Minute Setup

  Google says skip llms.txt. Chrome now audits it. Here's the 20-minute technical GEO setup, in evidence order: crawler access first, llms.txt last.

  • llms.txt
  • AI crawler access
  • technical GEO
  • robots.txt
  • generative engine optimization
  Read post

• July 26, 2026 · 18 min read

  Cloudflare's Sept 15 AI Crawler Rules: Who to Let In

  Cloudflare's September 15 AI crawler defaults are changing. A bot-by-bot framework for protecting your content without deleting yourself from AI answers.

  • AI crawlers
  • Cloudflare
  • technical GEO
  • robots.txt
  • AI visibility
  Read post