this post was submitted on 16 Mar 2025
800 points (98.8% liked)

Programmer Humor

21564 readers
2274 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] GreenKnight23@lemmy.world 53 points 12 hours ago (1 children)

I smell something, but it's not overheating electronics.

I've processed over 5 million records on a laptop that's almost 10 years old. it took two days to get my results.

there's no way 60,000 records overheated ANYTHING.

[–] wewbull@feddit.uk 20 points 11 hours ago (1 children)

Doesn't actually say that 60k overheated his drive. He says that he ran a run on 60k, and that he couldn't do the whole database due to overheating. Two unrelated statements except that 60k is the lower bound for what he could process.

Doesn't mean he knows what he's doing though, as pretty huge datasets are processable on quite modest hardware if you do it right.

[–] GreenKnight23@lemmy.world 7 points 8 hours ago

that's somehow worse.

a "data analyst" couldn't cut up the work into a parallel processes and run them synchronously? what the actual fuck?

"sorry, I can only do 60k at a time."

just fucking split them up into 6 parallel batch processes running 10k at a time. it's fucking math, not rocket science. I'm not even an analyst and I could fucking do that much.