// Policy
One robots.txt line to block AI training: Google, OpenAI, Microsoft and Anthropic sign on
A proposed extension to the Robots Exclusion Protocol would let sites refuse every generative-AI training crawler at once. It is headed to the IETF.
// TAG
A proposed extension to the Robots Exclusion Protocol would let sites refuse every generative-AI training crawler at once. It is headed to the IETF.