this post was submitted on 16 Mar 2025
99 points (99.0% liked)

Technology

66593 readers
4103 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Telorand@reddthat.com 52 points 19 hours ago (2 children)

Graber replied that generative AI companies are “already scraping public data from across the web,” including from Bluesky, since “everything on Bluesky is public like a website is public.” So she said Bluesky is trying to create a “new standard” to govern that scraping, similar to the robots.txt file that websites use to communicate their permissions to web crawlers.

[–] unexposedhazard@discuss.tchncs.de 39 points 18 hours ago (2 children)

Yeah these people are just stupid.

“Oh, hell no!” the user Sketchette wrote. “The beauty of this platform was the NOT sharing of information. Especially gen AI. Don’t you cave now.”

No you fucking idiot, it has a open API, anyone has been able to extract as much data as they want for any purpose and thats good. Same as all the actual fediverse platforms. The thing that should get people worried is that Bluesky has the power to universally make and enforce this and any decision they want because its a shitty centralized platform like any other social media site.

[–] General_Effort@lemmy.world 3 points 12 hours ago

I wonder why Bluesky bothers. The reaction was predictable.

[–] Telorand@reddthat.com 4 points 17 hours ago (2 children)

It's that interoperability of unique instances that makes the Fediverse resistant to scraping. The posts are all public, but crawling it all and categorizing everything is probably like untangling a cotton ball.

[–] General_Effort@lemmy.world 3 points 12 hours ago

Don't really see the problem. If you pick up the content while web crawling, you will end up with a lot of duplicates, but that's normal. If you wanted to scrape the Fediverse in particular, you'd know the structure of the data.

[–] joyjoy@lemm.ee 9 points 16 hours ago

Or you can host your own instance and let the servers send you all their data (instances can still defederate)

[–] neblem@lemmy.world 6 points 16 hours ago

Outside of rate limiting and sending detected bad bots to poisoned static data, yeah not much you can really do without harming valid use cases.

In the federated world people can just set up relays or listener instances, which are far better than hammering hobbyist instances with the additional bandwidth.