this post was submitted on 02 Sep 2023
123 points (96.9% liked)

Selfhosted

39937 readers
363 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS
ruud@lemmy.world
Loki@lemmy.world
CannaVet@lemmy.world
devve@lemmy.world
HybridSarcasm@lemmy.world
HybridSarcasm@lemmy.hybridsarcasm.xyz
123
Lemmy-safety can now run in docker (github.com)
submitted 1 year ago by db0@lemmy.dbzer0.com to c/selfhosted@lemmy.world
12 comments fedilink hide all child comments
 

Through the efforts of @dandroid@dandroid.app, the lemmy-safety tool can now run via docker, which should help you run it without having to mess with python on your end.

For those who don't remember, lemmy-safety is a script you can read to clean up your pict-rs images from potential CSAM.

top 12 comments
sorted by: hot top controversial new old
[–] dandroid@dandroid.app 16 points 1 year ago (2 children)

Thanks for the shout out!

Full disclosure, I use podman, not docker. If anyone has any issues with this using docker, let me know and I'll get it fixed ASAP. I'm not 100% sure the --device option works the same way with docker.

I added instructions on how to add the nvidia-container-toolkit repo on the two distros I have (one rpm based, one deb based). If adding the repo is different on your distro, please consider adding it to the instructions. The instructions on the nvidia-container-toolkit web page are... subpar in my opinion.

[–] Rescuer6394@feddit.nl 7 points 1 year ago* (last edited 1 year ago) (1 children)

for docker the syntax is --gpus all

https://docs.docker.com/config/containers/resource_constraints/#expose-gpus-for-use

bonus: syntax to expose the gpu in a docker compose

    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: 1
              capabilities: [gpu]

more at https://docs.docker.com/compose/gpu-support/#example-of-a-compose-file-for-running-a-service-with-access-to-1-gpu-device

[–] dandroid@dandroid.app 2 points 1 year ago

Would it be too much for you to ask to test that out and update the documentation? I don't have docker, and installing it would mess up my podman-docker setup, which would impact some things I have running. podman-docker simulates docker with podman so I can use docker-compose with podman.

[–] yoz@aussie.zone 1 points 1 year ago

Thank you.

[–] chrisbit@leminal.space 4 points 1 year ago (1 children)

nvidia-container-cli: initialization error: load library failed: libnvidia-ml.so.1: cannot open shared object file: no such file or directory: unknown.

I was getting this error with docker-desktop installed, but it worked after purging and installing docker-ce instead, and running with the --gpus all command.

[–] dandroid@dandroid.app 2 points 1 year ago

Interesting. This might be a different between podman and docker. I was using podman in my setup. Unfortunately we might need two different sets of instructions for podman and docker.

[–] SubArcticTundra@lemmy.ml 1 points 1 year ago (2 children)

Does this run some ML wizardry on the images?

[–] db0@lemmy.dbzer0.com 2 points 1 year ago

Yes, it's uisng the clip image2text model

[–] Fidelity9373@artemis.camp 1 points 1 year ago

By the looks of it, pretty much. Not in the sense of building an AI model, but more like traditional image recognition. Seems to process everything locally too, which is a plus; no sending data off to unknown servers.

[–] Mautobu@victoriagaming.ca 1 points 1 year ago

Thank you for this great service to the community.

[–] koper@feddit.nl -2 points 1 year ago (1 children)

Applying AI-voodoo to a non-existing problem with unknown side effects? Sign me up!

[–] konalt@lemmy.world 2 points 1 year ago

This was created in response to mass posting of CSAM on lemmy recently. It might be one of the reasons its a "non-existing problem".