I blame the skip duration. Yt default is 5s, when playing at 2.5x speed (set via an extension) that becomes effectively 2s. It's perfect. If I need more I just press it again.

I have jellyfin set up and (at least on the webbrowser) the default is 30s. Seriously? Why would anyone need 30s skipping? I had the same issue as you before - but only on jellyfin, with YouTube I almost always hit the exact moment I need.

Passive media consumption is dead. It doesn't matter to me if it's the most interesting movie or series - I'd rather be doomscrolling or upvoting shitposts.