# Origin serve-ability for agents

> Keeping your origin open and cheap to serve, by edge-caching the near-static machine surfaces and allowlisting verified bots while rate-limiting only unverified spoofers, so a verified agent always gets a fast 200 instead of a block.

<!-- Canonical: https://agentmint.net/signals/origin-serveability/ · Signal in the AgentMint.net Signals Database · Evidence: hypothesis (Low confidence) · Last verified 2026-07-08 · Evidence types are load-bearing: spec-fact | reported | hypothesis (no measured). -->

- **Affects (funnel stage):** Discovery
- **Evidence:** hypothesis
- **Confidence:** Low
- **Impact:** 2/3
- **Status:** active
- **Last verified:** 2026-07-08

## Per-platform status

Undocumented platforms show "unknown" - honest unknowns, never invented.

| Platform | Status | Notes | Source |
| --- | --- | --- | --- |
| ChatGPT | unknown | Not documented by this platform. | - |
| Gemini / Google AI Mode | unknown | Not documented by this platform. | - |
| Perplexity | unknown | Not documented by this platform. | - |
| Copilot | unknown | Not documented by this platform. | - |
| Claude | unknown | Not documented by this platform. | - |

## Evidence and sources

- [Cloudflare Radar 2025 Year in Review](https://blog.cloudflare.com/radar-2025-year-in-review/) (2025-12-15)
- [Cloudflare, Cache revalidation](https://developers.cloudflare.com/cache/concepts/revalidation/)
- [nginx, ngx_http_proxy_module](https://nginx.org/en/docs/http/ngx_http_proxy_module.html)
- [Wikimedia Diff, Mueller, Danis and Lavagetto](https://diff.wikimedia.org/2025/04/01/how-crawlers-impact-the-operations-of-the-wikimedia-projects/) (2025-04-01)
- [404 Media, Jason Koebler](https://404media.co/anthropic-ai-scraper-hits-ifixits-website-a-million-times-in-a-day/) (2024-07-24)
- [Read the Docs, Eric Holscher](https://about.readthedocs.com/blog/2024/07/ai-crawlers-abuse/) (2024-07-25)

## How to act on this

Edge-cache the near-static machine surfaces (llms.txt, Markdown mirrors, feeds, mostly-static product pages) with stale-while-revalidate, and allowlist verified bots while rate-limiting only unverified spoofers.

### Related checklist items
- [Verify your WAF or bot protection isn't silently blocking legitimate agent IP ranges.](https://agentmint.net/tools/agentic-readiness-checklist/#a-bot-access-04) (Readiness)
- [Don't rely on robots.txt to control the user-initiated fetchers (ChatGPT-User, Perplexity-User).](https://agentmint.net/tools/agentic-readiness-checklist/#a-bot-access-03) (Readiness)
- [Confirm AI-agent user-agents actually appear in your server logs.](https://agentmint.net/tools/agentic-readiness-checklist/#a-monitoring-01) (Readiness)

### Handbook chapters
- [Serving Agent Traffic Without Breaking Your Origin](https://agentmint.net/handbook/serving-agent-traffic/)

### Related signals
- [Agent infrastructure reachability](https://agentmint.net/signals/agent-infra-reachability/)
- [Crawl directives (robots.txt + sitemap)](https://agentmint.net/signals/crawl-directives/)
- [Offer consistency and freshness across surfaces](https://agentmint.net/signals/offer-consistency-freshness/)