this post was submitted on 13 May 2025
281 points (94.6% liked)
Fediverse
33468 readers
774 users here now
A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).
If you wanted to get help with moderating your own community then head over to !moderators@lemmy.world!
Rules
- Posts must be on topic.
- Be respectful of others.
- Cite the sources used for graphs and other statistics.
- Follow the general Lemmy.world rules.
Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration)
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
You're right, and it's infuriating that the AI scrapers are just so lazy/incompetent that they do things like try to scrape every dynamic page of a git repo instead of just cloning it. Similarly, they could just connect over ActivityPub and it wouldn't have much more overhead than another private instance.
There's Anubis which uses JavaScript to force browsers to do some work before they can access, but given how unpopular Cloudflare is around here, I imagine there'd be a lot of complaints if it was deployed on every instance.