this post was submitted on 09 Oct 2024
9 points (76.5% liked)

Stable Diffusion

4878 readers
1 users here now

Discuss matters related to our favourite AI Art generation technology

Also see

Other communities

founded 2 years ago
MODERATORS
db0@lemmy.dbzer0.com
Even_Adder@lemmy.dbzer0.com
9
Question about upcoming trends and hardware requirements (lemmy.ml)
submitted 9 months ago* (last edited 9 months ago) by comfy@lemmy.ml to c/stable_diffusion@lemmy.dbzer0.com
16 comments fedilink hide all child comments
 

I want to buy a new GPU mainly for SD. The machine-learning space is moving quickly so I want to avoid buying a brand new card and then a fresh model or tool comes out and puts my card back behind the times. On the other hand, I also want to avoid needlessly spending extra thousands of dollars pretending I can get a 'future-proof' card.

I'm currently interested in SD and training LoRas (etc.). From what I've heard, the general advice is just to go for maximum VRAM.

  • Is there any extra advice I should know about?
  • Is NVIDIA vs. AMD a critical decision for SD performance?

I'm a hobbyist, so a couple of seconds difference in generation or a few extra hours for training isn't going to ruin my day.

Some example prices in my region, to give a sense of scale:

  • 16GB AMD: $350
  • 16GB NV: $450
  • 24GB AMD: $900
  • 24GB NV: $2000

edit: prices are for new, haven't explored pros and cons of used GPUs

you are viewing a single comment's thread
view the rest of the comments
[–] WalnutLum@lemmy.ml 4 points 9 months ago

DirectML sucks but ROCm is great, but you need to check if the software you want to use works with ROCM. Also note there's only like 4 cards that work with ROCm as well.