Backend audit · Requires API key
Free AI Bot Policy Auditor
Fetch and audit robots.txt, llms.txt, and agents.json coverage for explicit AI crawler and agent-discovery policy.
Authenticated backend audit. Requires API key; VeracityAPI fetches public policy files from the target site, applies quota/billing, and does not store fetched raw files.
Input
Use via MCP: audit_ai_bot_policy · authenticated quota required
Result
—
Load a sample or paste your own input.
Evidence
Machine-readable JSON
What it catches
- Missing robots.txt
- Missing llms.txt
- Missing agents.json
- Unclear named AI bot policy
- Crawler/discovery contradictions
What it misses
- Crawler compliance
- Private CDN rules
- Guaranteed indexing