## Oddiwire — crawl policy.
##
## Everything public is crawlable. The only page held back is the dashboard,
## which carries a customer's key and has nothing to rank for; it says so in
## its own meta robots tag rather than here, so the rule travels with the page.
##
## The AI crawlers are named explicitly and allowed. This is a developer API:
## the buyer is frequently an agent reading docs on behalf of a person, and
## /llms.txt exists for exactly that reader.

User-agent: *
Allow: /
## The odds API answers only to a key, and the MCP connector is POST JSON-RPC:
## a crawler that follows a /v1/* or /mcp link is refused at the edge, which
## Search Console reports back as this site's indexing errors (401/403). These
## are service routes, not pages, so they are excluded by path. Everything
## public -- every page, /llms.txt included -- stays crawlable above.
Disallow: /v1/
Disallow: /mcp

User-agent: GPTBot
Allow: /

User-agent: OAI-SearchBot
Allow: /

User-agent: ChatGPT-User
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: Claude-User
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Google-Extended
Allow: /

User-agent: Bingbot
Allow: /

Sitemap: https://oddiwire.com/sitemap.xml