CCloud Releases
Home
Following

Cloud Releases

Service catalogues and updates come from each provider's public product listing and announcements.

Explore

  • Home
  • Latest updates
  • Following

About

  • About
  • Contact
  • Privacy Policy
  • Terms of Use

Providers

  • Amazon Web Services
  • Microsoft Azure
  • Google Cloud
  • Cloudflare

Not affiliated with any cloud provider. Product names and logos belong to their owners.

  1. Providers
  2. ›Cloudflare
  3. ›AI Crawl Control
  4. ›Update

Feature•Jun 16, 2026

Pay Per Crawl advanced configuration

AI Crawl ControlCloudflare · Core platform

You can now configure advanced Pay Per Crawl settings for your zone, including:

  • Disable Pay Per Crawl by URI pattern using Configuration Rules to offer free access to specific pages while charging for others.
  • Dynamic pricing by having your origin return a crawler-price response header, or by using a Cloudflare Worker to set prices based on request properties.

When dynamic pricing is enabled, Pay Per Crawl adds a cf-pay-per-crawl request header to origin requests so your origin or Worker can determine the appropriate price.

Refer to the Advanced configuration documentation for details.

Read the original announcement↗

More from AI Crawl Control

All AI Crawl Control updates →

  1. Introducing Redirects for AI Training

    Cloudflare's network now supports redirecting verified AI training crawlers to canonical URLs when they request deprecated or duplicate pages.

    AI Crawl Control•Feature•Apr 17, 2026

  2. Tools to prepare your site for the agentic Internet

    AI Crawl Control now includes new tools to help you prepare your site for the agentic Internet—a web where AI agents are first-class citizens that discover and interact with content differently than human visitors.

    AI Crawl Control•Feature•Apr 17, 2026

  3. Advanced WAF customization for AI Crawl Control blocks

    AI Crawl Control now supports extending the underlying WAF rule with custom modifications. Any changes you make directly in the WAF custom rules editor — such as adding path-based exceptions, extra user agents, or additional expression clauses — are preserved when you update…

    AI Crawl Control•Feature•Mar 24, 2026

  4. Analytics enhancements

    AI Crawl Control metrics have been enhanced with new views, improved filtering, and better data visualization.

    AI Crawl Control•Feature•Feb 9, 2026

  5. New reference documentation

    New reference documentation is now available for AI Crawl Control:

    AI Crawl Control•Feature•Feb 4, 2026