Have it both ways: stay discoverable in search while disallowing AI training

What changed

Cloudflare launched a new Disallow AI Training setting that allows website owners to block AI training by mixed-use crawlers while maintaining search engine indexing.

Why you should care

Website owners can now independently control AI training usage without sacrificing search visibility, resolving a long-standing tradeoff.

Your move

Watch. Setting is verified and supported by major crawler operators

Evidence

Needs verificationCloudflare — AI ↗

What to watch next

Whether other crawler operators beyond Apple, Google, and Microsoft begin honoring the Disallow AI Training setting by early next year.

Event

policy

Event date

Sep 15, 2026

Relevant to

General AI readers