this post was submitted on 11 Aug 2024
264 points (95.5% liked)

Technology

58111 readers
4076 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
L3s@lemmy.world
enu@lemm.ee
fry@fry.gs
L3s@fry.gs
enu@lemmy.world
L4s@fry.gs
L4s@lemmy.world
264
OpenAI has built a text watermarking method to detect chatgpt written content (www.tomshardware.com)
submitted 1 month ago by PenisDuckCuck9001@lemmynsfw.com to c/technology@lemmy.world
69 comments fedilink hide all child comments
 

Am I missing something? The article seems to suggest it works via hidden text characters. Has OpenAI never heard of pasting text into a utf8 notepad before?

you are viewing a single comment's thread
view the rest of the comments
[–] deadcade@lemmy.deadca.de 32 points 1 month ago (1 children)

Research on this topic exists, and it is possible to alter the output of an LLM in minor ways, that statistically "watermark" the results without drastically changing the quality of the output. OpenAI has probably implemented this into ChatGPT.

https://www.youtube.com/watch?v=2Kx9jbSMZqA

I think the tool exists, and is (at least close to) as good as they claim it is. They can't release it, because once the public can tell with high accuracy whether ChatGPT wrote some text, another AI can be developed to circumvent detection from this method, making the tool useless.

[–] CameronDev@programming.dev 11 points 1 month ago (1 children)

That is a long video, is the paper published somewhere?

Im willing to accept that you can statistically "watermark" the text, but I'm not convinced that it would be tamper resistant, which is a large part of what makes a watermark useful. If it can't survive an idiot with a thesaurus, its probably not gonna be terribly useful.

[–] Womble@lemmy.world 7 points 1 month ago (1 children)

It can likely also be defeated by adding "In the style of X" to a prompt, changing the distribution and pattern of the responses.

[–] JackbyDev@programming.dev 2 points 1 month ago (1 children)

...but that output is also from the AI so it would still be watermarked lol

[–] archomrade@midwest.social 2 points 1 month ago (1 children)

You could feed it through a different, smaller model that could even be self-hosted. It isn't difficult to make a model that rephrases an input in another style.

[–] JackbyDev@programming.dev 2 points 1 month ago

Ah, okay. That's fair. It wasn't clear they meant a different system lol.