OpenAI, Google, Microsoft and Anthropic will obey one robots.txt line that opts your site out of AI training
OpenAI, Google, Microsoft and Anthropic have agreed to honour a single new line in a website’s robots.txt file that says “don’t train your AI on this”, so site owners will no longer have to block each company’s crawler one by one. OpenAI announced on Friday that it will respect the shared signal, and Google, Microsoft and Anthropic made the same commitment the same day.

















