The company will also introduce a "pay-per-crawl" system to give users more fine-grained control over how AI companies can access their sites.

Cloudflare is testing a new way for websites to charge AI companies that use their content to train models, run inference, or power search. The new feature, called Pay per Crawl, lets website owners set their own terms for how and when AI bots can access their sites.