Content-Signal correct variant
Cloudflare/AIPREF Content-Signal directives in robots.txt with valid yes/no values inside a group.
Site-wide file — one per host.
This signal isn't a page; the container fetches it at a fixed path, and the
correct/broken/authbroken variant is chosen by the request host. On this host the canonical path(s)
below serve the correct variant. Add
?mode=… to override locally.
Canonical path(s)
Broken variant
An unknown value (ai-train=maybe) and an empty key/value (=no).
Catalogued flags
| Flag | Kind | Severity |
|---|---|---|
contentSignalUnknownValue | defect | medium |
contentSignalEmptyKeyValue | defect | medium |
contentSignalOutsideGroup | defect | high |
contentSignalConflicting | defect | high |
Fetch the live file: https://agentic-mcp-modern.crawler-test.com/robots.txt