this post was submitted on 27 Sep 2023
253 points (90.2% liked)

Technology

55715 readers
5628 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] ReallyActuallyFrankenstein@lemmynsfw.com 28 points 9 months ago (2 children)

ControlNet uses the AI image-generating tool Stable Diffusion, and one of its initial uses was generating fancy QR codes using the code as an input image. That idea was then taken further, with some users developing a workflow that lets them specify any image or text as a black-and-white mask that implants itself into the generated image—kind of like an automated, generative version of the masking tool in Photoshop.

“What happened there was that this user discovered that if they used the QR Code ControlNet but instead of feeding it a QR code, they fed it some other black-and-white patterns, they could create nice optical illusions,” said Passos. “You can now send a conditioning image and the model blends in a pattern that satisfies that while still making a coherent image at the same time.”

Which is...just ControlNet?

[–] Borimino@feddit.dk 19 points 9 months ago (1 children)

Yes, the article explains what Control Net is for those of us who haven't heard of it before. And the article says that Control Net was (apparently) initially meant to be used for qr codes.

Sorry to be indirect - ControlNet is a Stable Diffusion tool that generally allows for generating images with input control frames. The QR code use-case was a single potential use that went viral.

I was just eye-rolling a bit over the expert in the article also not understanding what ControlNet is, since it's propagating an incorrect history.