90

How do you monitor your server containers, disks, load...?

Do you use an easy-to-use web interface? Do you do everything via SSH? Or maybe you've got a more complicated setup?

I want to change my setup and I'm looking for new ideas, I've been using Cockpit for some years and some of the plugins are really outdated (ZFS for example) and others are completely broken (docker-compose).

top 50 comments
sorted by: hot top controversial new old
[-] aksdb@lemmy.world 51 points 4 months ago

My own server? YOLO

At work? Grafana, KOBS, Victoria Metrics, Jaeger, OpsGenie, ...

[-] summerof69@lemm.ee 20 points 4 months ago

My own server? YOLO

I can't figure out whether there's a monitoring tool called YOLO or you don't monitor anything.

[-] aksdb@lemmy.world 19 points 4 months ago

Now I am intrigued to develop one that is called YOLO.

But just in case: no, I don't monitor my server. If I notice something not working, I ssh into the machine and check what's up. I don't want to deal with another zoo of services for the monitoring part.

[-] Shimitar@feddit.it 3 points 4 months ago
[-] Gimpydude@lemmynsfw.com 8 points 4 months ago
[-] AlphaAutist@lemmy.world 4 points 4 months ago

This is the first time I’ve heard of Victoria Metrics. It looks like it has a similar use case as Prometheus, is that correct? If so, what made you or your team choose one over the other?

[-] aksdb@lemmy.world 2 points 4 months ago

IIRC it had better performance than Prometheus. We also ditched Elasticsearch in favor of ClickHouse to keep up with log ingestion.

[-] scrion@lemmy.world 2 points 4 months ago* (last edited 4 months ago)

I can second that. We had some really good experiences with ClickHouse and its performance. If it fits the bill, it's a very nice piece of software.

[-] AlphaAutist@lemmy.world 2 points 4 months ago

Thanks for the info! Looks pretty cool I’ll have to check it out

[-] Toes@ani.social 47 points 4 months ago

My clients when they text me the server is down.

[-] fatboy93@lemm.ee 22 points 4 months ago

This has the same energy as my spouse yelling at me because jellyfin went down

[-] Passerby6497@lemmy.world 4 points 4 months ago

Or my partners greeting me in the morning "Home assistant went down again, so the lights are all manual"

Thankfully that one is mostly solved.

[-] TCB13@lemmy.world 3 points 4 months ago

So damn accurate ahhaha

[-] zaphod@lemmy.ca 21 points 4 months ago

"Huh weird, I tried to use and it's not working. Welp, guess I better fix it..."

[-] ArmoredCavalry@lemmy.world 20 points 4 months ago

I'm a huge fan of Netdata, very configurable and monitors just about anything you could want. Great interface and alerts too - https://www.netdata.cloud/

[-] cmeu@lemmy.world 8 points 4 months ago

Same been running netdata for years. They're monetizing now where it used to just be free. Good for them, it's a great product. And it's foss

[-] Trincapinones@lemmy.world 6 points 4 months ago

I was looking for something free that I could host on my machine but thanks, I didn't know about it

[-] kueckieben@discuss.tchncs.de 8 points 4 months ago

Netdata is free and can be run standalone. Just install it and do not configure the cloud integration. You can see your dashboard on localhost:19999

[-] Trincapinones@lemmy.world 2 points 4 months ago

Oh that's neat, will take a look! Can you run it on docker?

[-] ArmoredCavalry@lemmy.world 3 points 4 months ago* (last edited 4 months ago)

As others stated, you can run and access the interface locally (or setup your own reverse proxy) for free. Their Cloud dashboard is also free for up to 5 nodes. They recently added a flat-rate "Homelab" plan as well, if you want to remove the limit. It's all quite usable for $0 otherwise though!

[-] pixelscience@sh.itjust.works 4 points 4 months ago

Netdata 100%

It feeds my itch for more data than I know what to do with and it's presented in one of the cleanest ways I've ever seen for so much info.

[-] EncryptKeeper@lemmy.world 2 points 4 months ago

I love how easy to use NetData is, but when running it on my home servers it destroys their performance lol. Every once in awhile I check in to see if it runs better.

load more comments (3 replies)
[-] rambos@lemm.ee 12 points 4 months ago

I just use homepage as my homepage :D

I can see simple CPU/RAM/storage stats and got widgets for almost all services, one of them is portainer so I can see if any service is stopped (most of them are running in docker). Also few services send notification on error or update

I know its not really a monitoring tool, but it works well enough for me

[-] its_me_gb@feddit.uk 12 points 4 months ago* (last edited 4 months ago)

Node exporter on hosts, OpenTelemetry collector to scrape metrics and collect logs, shipping them to Prometheus and Loki, visualising with Grafana.

Day job is for an observability platform where we heavily encourage the use of (and also contribute) to the OpenTelemetry collector project, hence my use of it.

[-] farcaller@fstab.sh 3 points 4 months ago

Try VictoriaMetrics. Basically the same feature set as Prometheus, but so much more resource friendly for homelab scale. I store some metrics for 12 months now, because it's easy.

[-] oh_gosh_its_osh@lemmy.ml 1 points 4 months ago

Similar setup here with additional exporters like cadvisor for container metrics and other components.

OpenTelemetry is awesome, but still a very fast moving project. Expect therefore more frequent updates and changes compared to more older and established projects.

load more comments (2 replies)
[-] Concave1142@lemmy.world 8 points 4 months ago

Zabbix for agent / snmp based statistics.

Uptime Kuma for up/down states with a webhook notification into Discord so I get instant alerts on my phone when one goes down.

[-] Dran_Arcana@lemmy.world 7 points 4 months ago

How has nobody in this thread said check_mk yet?

It's free, you host it yourself. It's built off of nagios, compatible with nagios plugins, supports snmp or agent based checks. It can email, SMS, slack or discord you when something breaks, you can write your own custom checks in any language that can output to a local console... I could never imagine even looking for something else.

[-] corsicanguppy@lemmy.ca 2 points 4 months ago* (last edited 4 months ago)

+1 for check_mk.

It's got a scriptable config file that begs for automation like mgmtConfig and it does SNMP. For me, that's it. SNMP->MQTT->SNMP next year.

load more comments (1 replies)
[-] m_randall@sh.itjust.works 5 points 4 months ago

I like monit. It’s simple to setup and pretty flexible.

https://mmonit.com/monit/

load more comments (1 replies)
[-] sysadmin420@lemmy.world 5 points 4 months ago* (last edited 4 months ago)

I've been using uptime Kuma recently and it's great but works better outside of docker.

Inside docker I'd get a lot of false down positives from I assume docker throttling the checks.

Plus it works with email, telegram, and matrix chat alerts. I monitor all my clients sites with it, and it's bullet proof behind caddy.

load more comments (2 replies)
[-] MystikIncarnate@lemmy.ca 4 points 4 months ago

At home, libreNMS. Just SNMP everything.

For work, whatever the tool of the day is from management.

[-] packetloss@lemmy.world 4 points 4 months ago
[-] aordogvan@lemmy.world 2 points 4 months ago

Second Zabbix. Been using it for years and it just works.

load more comments (1 replies)
[-] TheInsane42@lemmy.world 4 points 4 months ago

At home, nagios, at work colleagues. (I finally escaped the admin rat race)

[-] refreeze@lemmy.world 4 points 4 months ago

Prometheus and Altertmanager

[-] SorteKanin@feddit.dk 4 points 4 months ago* (last edited 4 months ago)

Grafana set up to run on the server locally, then I connect to it via SSH forwarding. Then I can view all kinds of metrics in my browser in a neat interface.

[-] Trincapinones@lemmy.world 2 points 4 months ago

I liked Grafana a lot, but I can't monitor things like zfs pools with it right?

[-] SorteKanin@feddit.dk 6 points 4 months ago

I don't know as I don't use zfs pools, but a simple search led me to this https://grafana.com/grafana/dashboards/15362-zfs-pool-metrics/

[-] Trincapinones@lemmy.world 3 points 4 months ago

Nevermind then! Will take a look at it ^^

[-] pythia@lemmy.dbzer0.com 3 points 4 months ago

Monitorix or Netdata.

[-] JoeKrogan@lemmy.world 2 points 4 months ago* (last edited 4 months ago)

Btop and logwatch with logrotate. I use healthchecks to check if the server is unreachable and it notifies me.

[-] crony@lemmy.cronyakatsuki.xyz 1 points 4 months ago* (last edited 4 months ago)

Used to not monitor at all, but after setting up crowdsec I got completeky into prometheus + grafana system resource and security monitiring on my dedicated hetzner server.

I also keep uptime kuma on another cheap vps to monitor the states of websites directly for issues and I have seted up watchtower to send ntfy notifications on updates so I can know an update is the one fucking everything up.

Recently also setup restuc backups so I made it so I also get backup health check logs as ntfy notifications on my phone, which really helps me keep everything runnig.

What I really need to also do is create prometheus/grafana alerts for additional things to get notifications on my phone for them also ( like when crowdsec starts to randomly not get any more acqusitions, so I have to restart it. Once passed over a week before I looked at grafana and caught that ).

Note: this is all a hoby, I also don't host anything at home out of a couple reasons, most important being internet and hardware is expensive af here so it's simply cheaper for me to play around with vps's and hetzner dedicated servers.

[-] hexagonwin@lemmy.sdf.org 1 points 4 months ago

i just have top running through ssh on an xterm window.

load more comments
view more: next ›
this post was submitted on 17 Feb 2024
90 points (97.9% liked)

Selfhosted

37715 readers
704 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS