Cloudflare updates "robots.txt" — what does that mean for the future of the web?

Cloudflare expands robots.txt with new AI content signals, giving publishers control over search, AI input, and AI training.