Select Page
Field note: the day a CDN rewrote the crawler contract

Field note: the day a CDN rewrote the crawler contract

15 September 2026 — observations on Cloudflare’s Accountable designation, and what it can and cannot enforce. The constraint nobody could design around For thirty years, crawler preferences lived in a text file. robots.txt is a declaration: it states...