Selfhosted

37811 readers

517 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago

MODERATORS

HybridSarcasm@lemmy.world

HybridSarcasm@lemmy.hybridsarcasm.xyz

How can I reduce the amount of storage used by my Lemmy instance? (lemmy.world)

submitted 7 months ago by TrinityTek@lemmy.world to c/selfhosted@lemmy.world

35 comments fedilink hide all child comments

I've had a Lemmy instance running on a VPS with 100 GB of storage for a few months and it has filled up. I've been searching for ways to reduce the amount of storage used but so far I am coming up empty. Can anyone point me in the right direction?

you are viewing a single comment's thread
view the rest of the comments

[–] bdonvr@thelemmy.club 48 points 7 months ago* (last edited 7 months ago) (2 children)

Firstly move pict-rs to object storage. My instance's pict-rs uses 150GB alone. I pay less than $2/mo to put it on Cloudflare R2. Backblaze B2 might be even cheaper. Instructions: https://crates.io/crates/pict-rs#filesystem-to-object-storage-migration

If that doesn't help enough and you're comfortable with SQL, you can purge the unnecessary entries in received-activities.

Command: delete from received_activity where published & NOW() - INTERVAL '3 days'; (Lemmy has problems with ampersands so you'll have to edit it)

Then do a vacuum full received_activity; to reclaim the space.

This deleted 98 million entries for me and reduced my database size from 49GB to 20GB a week ago when I started running out of space. No other effect as far as I can tell. Thanks @illecors@lemmy.cafe

[–] TrinityTek@lemmy.world 7 points 7 months ago

Thank you, that SQL command looks like exactly what I'm after! I'm going to give that a shot. I appreciate the help!

[–] MrRazamataz@lemmy.razbot.xyz 2 points 7 months ago (2 children)

what is stored in received_activity ? anything important? I mean obviously it's something the instance has received from other instances but is this then stored somewhere else (like comments then stored elsewhere for eg)

[–] bdonvr@thelemmy.club 3 points 7 months ago* (last edited 7 months ago) (1 children)

As far as I've been told it's basically just a log of all received activities. Nothing references it.

Nothing seems to have gone wrong in the past week on thelemmy.club since I removed it. I do have backups though.

[–] MrRazamataz@lemmy.razbot.xyz 1 points 7 months ago

Nice, thank you.

[–] Die4Ever@programming.dev 3 points 7 months ago* (last edited 7 months ago) (1 children)

in v0.19.0 Lemmy will automatically delete entries over 7 days old

https://github.com/LemmyNet/lemmy/issues/4113

https://github.com/LemmyNet/lemmy/commit/cb01427dcff14b3d88e30220695fc97978786a9a

currently it waits 3 months before deleting

[–] MrRazamataz@lemmy.razbot.xyz 1 points 7 months ago (1 children)

Time to update then!

[–] Die4Ever@programming.dev 3 points 7 months ago* (last edited 7 months ago) (1 children)

it's in alpha currently, but you could still run it

I think you might have to use the :dev tag to get this update, a bit risky to stay on that tag though, maybe wait for the next docker image of an alpha release

[–] MrRazamataz@lemmy.razbot.xyz 2 points 7 months ago (1 children)

Ta, good to know

[–] Die4Ever@programming.dev 2 points 7 months ago (1 children)

Well now you can use :0.19.0-rc.5 :)

[–] MrRazamataz@lemmy.razbot.xyz 2 points 7 months ago (1 children)

epic :)

[–] Die4Ever@programming.dev 2 points 7 months ago (1 children)

oh btw 3rd party apps aren't working with 0.19.0 yet, because of changes to the authentication API

[–] MrRazamataz@lemmy.razbot.xyz 1 points 7 months ago

Good to know. I'll check it out.