Unless I'm misreading it which is possible it's awfully late, he said he processed 60,000 rows didn't find what he was looking for but his hard drive overheated on the full pass.

Discs don't overheat because there was load. Even if he f***** up and didn't index the data correctly (I assume it's a relational database since he's talking about rows) The disc isn't just going to overheat because the job is big. It's going to be lack of air flow or lack of heatsink.

I guarantee you he was running on an external NVMe, and one of those little shitty-ass Chinese enclosures. Or maybe one of those self immolating SanDisk enclosures. Hell, maybe he's on a desktop and he slept a raw NVMe on his motherboard without a heatsink

There are times when you want a brilliant college student on your team, But you need seasoned professionals to help them through the things they've never seen before and never done before.

[–] exu@feditown.com 6 points 46 minutes ago

Can't be a relational database, Musk said the government doesn't use SQL.

[–] LillyPip@lemmy.ca 23 points 3 hours ago (1 children)

This cannot be real, wtf. This is cartoon levels of ineptitude.

Or sabotage by someone heading out? Please let this be resistance sabotage they haven’t noticed yet.

[–] turnip@lemm.ee 9 points 3 hours ago* (last edited 3 hours ago) (1 children)

You guys arent running your software off raspberry pi's with sdcards from the gas station?

My allowance is 5$ a month!

[–] LillyPip@lemmy.ca 5 points 3 hours ago

Look, all I’m saying is give Pis a chance.

[–] nonentity@sh.itjust.works 14 points 3 hours ago (1 children)

Either she knows something novel, where processing data using voice coils is somehow beneficial, or is someone who calls their computer a ‘hard drive’, which summarily negates any legitimacy of technical competence.

[–] ZILtoid1991@lemmy.world 3 points 41 minutes ago

Or wrote the code using AI without checking what it exactly does.

[–] BenLeMan@lemmy.world 5 points 3 hours ago

You're not supposed to place your laptop directly in the lap of your fur suit. Always leave an air gap for ventilation, smh.

[–] DarkSpectrum@lemmy.world 24 points 5 hours ago

I will now attempt a full comment ... brace your hard drives

[–] NigelFrobisher@aussie.zone 4 points 3 hours ago

“I store my records on vinyl. You’ve probably never heard of them.”

[–] jkercher@programming.dev 22 points 5 hours ago (1 children)

60k rows of anything will be pulled into the file cache and do very little work on the drive. Possibly none after the first read.

[–] Sprocketfree@sh.itjust.works 1 points 3 hours ago

Not if each row is pi!

[–] GreenKnight23@lemmy.world 31 points 6 hours ago (1 children)

I smell something, but it's not overheating electronics.

I've processed over 5 million records on a laptop that's almost 10 years old. it took two days to get my results.

there's no way 60,000 records overheated ANYTHING.

[–] wewbull@feddit.uk 7 points 5 hours ago (1 children)

Doesn't actually say that 60k overheated his drive. He says that he ran a run on 60k, and that he couldn't do the whole database due to overheating. Two unrelated statements except that 60k is the lower bound for what he could process.

Doesn't mean he knows what he's doing though, as pretty huge datasets are processable on quite modest hardware if you do it right.

[–] GreenKnight23@lemmy.world 1 points 2 hours ago

that's somehow worse.

a "data analyst" couldn't cut up the work into a parallel processes and run them synchronously? what the actual fuck?

"sorry, I can only do 60k at a time."

just fucking split them up into 6 parallel batch processes running 10k at a time. it's fucking math, not rocket science. I'm not even an analyst and I could fucking do that much.

[–] Professorozone@lemmy.world 11 points 5 hours ago (3 children)

I didn't know hard drive overheating was a thing. Should I be worried that my 5 year old hard drive is about to overheat. I mean is this actually a floppy disk or something?

[–] melpomenesclevage@lemmy.dbzer0.com 6 points 3 hours ago

it is a thing, but any competently designed computer should have things in place to prevent this.

unless you're an arrogant dipshit and disable all the hardware safeties on your computer to make it go faster and wear harder.

[–] ChaoticNeutralCzech@feddit.org 3 points 3 hours ago* (last edited 3 hours ago)

When an HDD works continuously it can heat up to above 60 °C if proper air circulation is not allowed, which can cause a very premature failure. In fact, it should be kept under 40 °C to achieve the intended lifespan. Unfortunately, PC cases are usually not great at removing heat from the HDD by default.

As for your drive, it most likely has a temperature sensor so it can be displayed by various utilities.

[–] KillingTimeItself@lemmy.dbzer0.com 8 points 4 hours ago (8 children)

it is, in the select event that your platter bearing fails, in which case it would be very, very obvious.

load more comments (8 replies)

[–] RussianBot8453@lemmy.world 79 points 8 hours ago (2 children)

I'm a data engineer that processes 2 billion row 3000 column datasets every day, and I open shit in Excel with more than 60k rows. What the hell is this chick talking about?

[–] zenpocalypse@lemm.ee 19 points 6 hours ago (1 children)

Seems like a good excuse to someone who doesn't know what they're doing and needs an excuse because why they haven't completed it yet?

The whole post is complete bs in multiple ways. So weird.

[–] Akasazh@feddit.nl 3 points 5 hours ago

If you work for a boss that fundamentally misunderstands what you are doing, then misleading them into thinking you're 'hard at work, making decisions with consequences' is the theatre you put up to keep the cash flowing.

It's one of the fundamental flows of autocracy, people try and represent what you want them to

[–] person420@lemmynsfw.com 22 points 7 hours ago (2 children)

Some interesting facts about excel I learned the hard way.

It only supports about a million or so rows
It completely screws up numbers if the column is a number and the number is over 15 digits long.

Not really related to what you said, but I'm still sore about the bad data import that caused me days of work to clean up.

[–] driving_crooner@lemmy.eco.br 3 points 3 hours ago* (last edited 3 hours ago)

It completely screws up numbers if the column is a number and the number is over 15 digits long.

I work in insurance in Brazil, by standards of our regulatory body, claims numbers must be a string of 20 numbers (zfill(20) if needed). You can't imagine the amount of times excel had fucked me up rounding down the claim numbers, this is one of the first things I teach to my interns and juniors when they're working with the claims databases.

load more comments (1 replies)

[–] sirdorius@programming.dev 54 points 8 hours ago (1 children)

When the only thing that is stopping kids from dismantling your government is an O(N^N) algorithm

[–] wise_pancake@lemmy.ca 3 points 3 hours ago

Are you telling me there’s a difference between an inner and a cross join?

Cross join is obviously faster, I don’t even have to write “on”

[–] AeonFelis@lemmy.world 31 points 8 hours ago

Hard drive was made by Tesla

[–] inclementimmigrant@lemmy.world 10 points 6 hours ago* (last edited 6 hours ago) (1 children)

What in the fuck is this idiot doing? I've process datasets far larger than that and never once have I run into a hard drive "overheat". I mean what level of incompetence do you have to have to get a hard drive to overheat processing a measley 60K rows of data?

load more comments (1 replies)

[–] cupcakezealot@lemmy.blahaj.zone 4 points 5 hours ago (1 children)

does elon only hire chip from sales guy vs web dude or something

[–] Fillicia@sh.itjust.works 5 points 5 hours ago

No he also hire people who created a script to make fake ballots with a bias.

https://bsky.app/profile/denisedwheeler.bsky.social/post/3lhowh3ijgs2f

[–] zalgotext@sh.itjust.works 97 points 10 hours ago (14 children)

my hard drive overheated

So, this means they either have a local copy on disk of whatever database they're querying, or they're dumping a remote db to disk at some point before/during/after their query, right?

Either way, I have just one question - why?

[–] zenpocalypse@lemm.ee 14 points 6 hours ago* (last edited 6 hours ago)

Even if it was local, a raspberry pi can handle a query that size.

Edit - honestly, it reeks of a knowledge level that calls the entire PC a "hard drive".

[–] Bosht@lemmy.world 43 points 8 hours ago (1 children)

I'd much sooner assume that they're just fucking stupid and talking out of their ass tbh.

[–] kautau@lemmy.world 15 points 7 hours ago* (last edited 4 hours ago)

Same as Elon when he confidently told off engineers during his takeover of Twitter or gestures broadly at the Mr. Dunning Kruger himself

Wonder if it’s an SQL DB

Elon probably hired confident right wingers whose parents bought and paid their way through prestigious schools. If he hired anyone truly skilled and knowledgeable, they’d call him out on his bullshit. So the people gutting government programs and passing around private data like candy are just confidently incorrect

[–] GoodEye8@lemm.ee 23 points 8 hours ago (7 children)

My one question would be "How?"

What the hell are you doing that your hard drives are overheating? How do you even know it's overheating as I'm like 90% certain hard drives (except NVMe if we're being liberal with the meaning of hard drive) don't even have temperature sensors?

The only conclusion I can come to is that everything he's saying is just bullshit.

[–] Auli@lemmy.ca 17 points 8 hours ago

They have temp sensors. But have never heard of a overheating drive.

load more comments (6 replies)

load more comments (11 replies)

load more comments