Agent Ready

Content-Usage (IETF AIPREF)

The same preference in the vocabulary the IETF working group is standardising. Cloudflare's Content-Signal draft expired in April 2026 without revision; AIPREF is on the Proposed Standard track and was revised in August. They are not interchangeable: one says ai-train=no, the other says train-ai=n.

  • /robots.txt
  • A proposed standard, still in progress.
  • Specification
What the test asks for
We request /robots.txt on your domain over the network, exactly the way an outside client would, and read what comes back. A setting that is switched on but unreachable is not a pass.
Can QWeb Agent Ready add it for me?
Yes. The free plugin publishes this. We write both, in every crawler group, and send Content-Usage as a response header as well so it covers the files robots.txt cannot speak for. Emitting one and not the other means being unreadable to today's tooling or absent from tomorrow's standard.
How settled is this?
A proposed standard, still in progress. We publish it because compatible software can use it today, not because anyone has promised it is permanent. If it changes, the plugin follows.

Does your site pass this one?

The free test checks it against your live URL, along with 18 others, and tells you how many the free plugin can fix.