CLEAR BRIEFS. OBSERVABLE RESULTS.THE WORKING COLLECTION / 2026

Checks

A name on the page is not a finished check

One row per name. Leave the result cell empty until you have an action you could fail.

Awesome Patel

Well Made Ideas · Published by Awesome Patel (publication profile) · Published Updated

blog.cloudflare.com published this account (2026-09-15): Cloudflare launched Disallow AI Training so sites can stay in search while refusing training. As of 15 September 2026, Block and Block on pages with ads apply to mixed-use crawlers including Applebot, Bingbot, and Googlebot. Block AI Bots and Managed Robots.txt are being deprecated in favor of Search/Training/Agent controls and Bot Preference Sync.

This guide uses that public page as the example. This site did not run the test, close the deal, or measure the product.

Write only what the page says

The page's claim is: Cloudflare launched Disallow AI Training so sites can stay in search while refusing training. As of 15 September 2026, Block and Block on pages with ads apply to mixed-use crawlers including Applebot, Bingbot, and Googlebot. Block AI Bots and Managed Robots.txt are being deprecated in favor of Search/Training/Agent controls and Bot Preference Sync.

Put the URL under that sentence. If a later recap adds a number or a date, keep the original page as the record.

One row per name. Leave the result cell empty until you have an action you could fail.

Do the site's check on this one page. Fill a line only when the page supports it. Where the page is silent, write Not stated.

A finished note names the page, the date, and the limit of the claim. It does not borrow a result from a different story.

Stop at the untested line

Anything you did not open, install, or count stays untested. Leave that line visible.

Source page: Cloudflare changes AI crawl defaults: Disallow AI Training versus Block for mixed-use crawlers.

Sources: Cloudflare changes AI crawl defaults: Disallow AI Training versus Block for mixed-use crawlers

Related guides

Primary references