Cloudflare is enhancing robots.txt, giving website owners more control over how AI systems access their data.

Artificial-intelligence startups, like the makers of the “smart” web browser Dia, are being acquired for vast sums. But it’s ...