Selfhosted

39980 readers

770 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago

MODERATORS

HybridSarcasm@lemmy.world

HybridSarcasm@lemmy.hybridsarcasm.xyz

How to monitor standard nginx accesses? (lemmy.g97.top)

submitted 1 year ago by gabriele97@lemmy.g97.top to c/selfhosted@lemmy.world

4 comments fedilink hide all child comments

Hi! I would like to monitor accesses to my services done through my nginx setup that acts as reverse proxy.

I've tried fluentd to export Prometheus metrics with fluend to scrape the access.log file produced by nginx. The problem is that it uses a lot of resources as I can see (130+ MB of RAM only for fluentd, and each http request towards the fluentd metrics endpoint transfers a lot of data and I assume It Will increase consequently with the increase of the access.log file).

Is there any "embedded" scraper with integrated dashboard that I can recall on demand? For example, one of the problem with the previous solution is that peometheus scrapes the metrics every 5s so I have a constant transfer of different MBs every second due to the size of the metrics, even if I am not looking at grafana (my frontend for Prometheus). With an on demand service I would scrape the access.log file only when I am using the on demand service.

Thank you

top 4 comments

sorted by: hot top controversial new old

[–] vegetaaaaaaa@lemmy.world 2 points 1 year ago

goaccess?
lnav?

Without knowing more about what metrics/stats you want to generate it's hard to tell

[–] saint@group.lt 1 points 1 year ago

Ages ago there was such a tool - Webalizer and everybody was using it :) not anymore..

[–] redcalcium@c.calciumlabs.com 1 points 1 year ago

The commercial nginx+ has a status endpoint that can be hooked into graphana/prometheus, but as you can imagine, status endpoints is one of the money maker for nginx inc so they won't put it on the opensource version anytime soon. There is also a basic status endpoint available in the opensource version of nginx, but it doesn't return much.

[–] blackjacksepp@feddit.de 1 points 1 year ago

Have a look at nginx vts. I run it on my Raspberry Pi, it works great and provides everything I need! The auto-installer is easy to use and it can output as html, json or prometheus.