• Shaarli
  • Tag cloud
  • Picture wall
  • Daily
  • RSS
  • Login
4402 shaares
Filters

Rate limiting by IP using Cloudflare's rate limiting rules | Simon Willison’s TILs

QRCode

My blog was showing poor performance, with some pages taking several seconds to load or even failing entirely.

My entire site runs behind Cloudflare with a 200 second cache TTL. This means my backend normally doesn't even notice spikes in traffic as they are mostly served from the Cloudflare cache.

Unfortunately this trick doesn't help for crawlers that are hitting every possible combination of facets on my search page!

Using Cloudflare to rate limit requests to a path

https://til.simonwillison.net/cloudflare/rate-limiting
June 4, 2026 at 2:16:30 PM EDT *
cloudflare hosting apache
FILLER
Shaarli · The personal, minimalist, super fast, database-free, bookmarking service by the Shaarli community · Documentation
Fold Fold all Expand Expand all Are you sure you want to delete this link? Are you sure you want to delete this tag? The personal, minimalist, super fast, database-free, bookmarking service by the Shaarli community