Doesn't actually say that 60k overheated his drive. He says that he ran a run on 60k, and that he couldn't do the whole database due to overheating. Two unrelated statements except that 60k is the lower bound for what he could process.

Doesn't mean he knows what he's doing though, as pretty huge datasets are processable on quite modest hardware if you do it right.

[–] GreenKnight23@lemmy.world 11 points 15 hours ago (1 children)

that's somehow worse.

a "data analyst" couldn't cut up the work into a parallel processes and run them synchronously? what the actual fuck?

"sorry, I can only do 60k at a time."

just fucking split them up into 6 parallel batch processes running 10k at a time. it's fucking math, not rocket science. I'm not even an analyst and I could fucking do that much.

[–] sniggleboots@lemm.ee 1 points 2 hours ago (1 children)

I don't want to take away from the valid point of your comment, but rocket science is almost exclusively math

[–] GreenKnight23@lemmy.world 1 points 2 hours ago

1000001281