Cloudflare Launched Beta for AI Bot Monetization
The platform now allows publishers to monetize content scraped by AI models through a pay-per-use model.
Updated on Oct. 13, 2026 in Artificial Intelligence
Live Poll
Should AI companies be required to pay publishers when scraping content from their websites?
In September 2026, Cloudflare launched a beta feature enabling publishers to monitor and monetize AI bot traffic. This system replaces the company's previous pay-per-crawl plan, giving site owners new control over how large language models interact with their content.
Why it matters
The tool aims to ensure human-generated content remains viable as AI companies increasingly rely on it for training. Cloudflare positions this as a method to balance AI development with publisher compensation, though it is not intended to replace advertising revenue.
Cloudflare handles 20% of global internet traffic, providing the infrastructure to track AI scraping frequency. The system requires AI companies to formally declare their crawlers to participate in the payment program.
The players
Cloudflare
A global cloud services provider managing a network that routes 20% of all internet traffic.
The details
Cloudflare provides publishers with dashboards that identify and quantify how often large language models (AI systems trained on massive datasets to generate human-like text) scrape specific content. Through these dashboards, site owners can choose to either block identified bots or accept payment offers. The process centralizes bot management directly within the Cloudflare network layer, effectively forcing an explicit transaction between content creators and AI developers.
Timeline
Cloudflare launched the pay-per-use beta feature in September 2026.
The Tech Race
The pay-per-use model marks a shift from the previous pay-per-crawl plan by evolving from access-based charging to a direct usage-based compensation framework. This reflects a broader industry transition toward formalizing the economic relationship between AI model training and source data.
Publishers utilizing the Cloudflare network can now actively manage AI bot access through their administrative dashboards. Site owners should evaluate their traffic logs to determine if participating in the payment beta provides a viable offset to existing advertising revenue.
The takeaway
This rollout indicates that infrastructure providers are becoming the primary gatekeepers for AI data attribution. Publishers should monitor their dashboard metrics to see if AI developers comply with the declaration requirements for crawler participation.
Further reading
Explore the broader implications of data licensing in the Artificial Intelligence section.
Source note: This article includes information reported by AdExchanger.
Live Poll
Should AI companies be required to pay publishers when scraping content from their websites?
