this post was submitted on 29 Oct 2023
75 points (96.3% liked)

Privacy

29872 readers
1650 users here now

A place to discuss privacy and freedom in the digital world.

Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.

In this community everyone is welcome to post links and discuss topics related to privacy.

Some Rules

Related communities

Chat rooms

much thanks to @gary_host_laptop for the logo design :)

founded 4 years ago
MODERATORS
 

Hi, I'm building a personal website and I don't want it to be used to train AI. In my robots.txt file I blocked:

  • ChatGPT-User
  • GPTBot
  • Google-Extended
  • FacebookBot

What bots should I also add? Are there any other ways to block AI bots?

IMPORTANT: I don't want to block search engine crawlers, only bots that are used to train AI.

you are viewing a single comment's thread
view the rest of the comments
[–] otl@lemmy.sdf.org 4 points 8 months ago

Maybe there's some IP address ranges to try block?

It's difficult because, for example, blocking the addresses OpenAI's crawlers use may inadvertently block addresses from Azure used by Bing or whatever.