this post was submitted on 05 May 2024
819 points (99.0% liked)

Programmer Humor

19149 readers
1152 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

founded 1 year ago
MODERATORS
Feyter@programming.dev
anzo@programming.dev
BurningTurtle@programming.dev
819
That Nim Flashbacks (sh.itjust.works)
submitted 4 months ago by pastermil@sh.itjust.works to c/programmer_humor@programming.dev
56 comments fedilink hide all child comments
 
you are viewing a single comment's thread
view the rest of the comments
[–] xmunk@sh.itjust.works 4 points 4 months ago (3 children)

For bonus points, this failure is in a cron job that sends out recently queued messages. It runs once every ten minutes - last weekend we had 12 failures: four were in a cluster on their own, one was in a run of two, and six were in a single continuous run.

Please note that this server is unused by our business so no messages ever get naturally queued. Every day we sync the live production server to this server at about 9 PM - assuming an employee was queuing up a message before the snapshot is taken there might be a number of unsent messages in the snapshot - those messages will all be sent by the first cron job after the sync.

It is a wonderfully awful problem that has me wanting to pull out my luscious locks.

[–] sukhmel@programming.dev 4 points 4 months ago (2 children)

I wish you luck. Also, maybe you could get someone else to get a fresh view of an issue

[–] xmunk@sh.itjust.works 4 points 4 months ago (1 children)

Yup, luck is appreciated and I'm trying to get more eyes but unfortunately I'm a senior dev that has the second highest seniority at the company so I feel guilty dragging others into it.

[–] Sacreblew@lemmy.ca 3 points 4 months ago

Lots of logging to triangulate when it fails and what variables it has at the time.