Backend audit · Requires API key

Free AI Bot Policy Auditor

Fetch and audit robots.txt, llms.txt, and agents.json coverage for explicit AI crawler and agent-discovery policy.

Authenticated backend audit. Requires API key; VeracityAPI fetches public policy files from the target site, applies quota/billing, and does not store fetched raw files.

Run the tool Read methodology

Input

Use via MCP: audit_ai_bot_policy · authenticated quota required

Result

Load a sample or paste your own input.

Evidence

    Machine-readable JSON

    What it catches

    • Missing robots.txt
    • Missing llms.txt
    • Missing agents.json
    • Unclear named AI bot policy
    • Crawler/discovery contradictions

    What it misses

    • Crawler compliance
    • Private CDN rules
    • Guaranteed indexing