ThefuzzyFurryComrade@pawb.socialM to

Fuck AI@lemmy.world · 2 months ago

Cloudflare Is Blocking AI Crawlers by Default

5

118

Cloudflare Is Blocking AI Crawlers by Default

ThefuzzyFurryComrade@pawb.socialM to

Fuck AI@lemmy.world · 2 months ago

5

The age of the AI scraping free-for-all may be coming to an end. At least if Cloudflare gets its way.

Chat

emrikol@lemmy.sdf.org
link
fedilink
arrow-up
9·
2 months ago
Let me introduce you to https://commoncrawl.org/
- titty_wizard@lemmy.world
  link
  fedilink
  arrow-up
  4·
  2 months ago
  Very cool, thank you for sharing