this post was submitted on 27 Jun 2023
14 points (100.0% liked)

Gaming

32008 readers
147 users here now

From video gaming to card games and stuff in between, if it's gaming you can probably discuss it here!

Please Note: Gaming memes are permitted to be posted on Meme Mondays, but will otherwise be removed in an effort to allow other discussions to take place.

See also Gaming's sister community Tabletop Gaming.

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 3 years ago
MODERATORS
alyaza@beehaw.org
TheRtRevKaiser@beehaw.org
gyrfalcon@beehaw.org
Whom@beehaw.org
The_Hunted_One@beehaw.org
chloyster@beehaw.org
remington@beehaw.org
14
Will there be AI accelerator cards in the future of gaming PCs? (feddit.de)
submitted 2 years ago by Port8080@feddit.de to c/gaming@beehaw.org
15 comments fedilink hide all child comments
 

Hi there, I want to share some thoughts and want to hear your opinions on it.

Recently, AI developments are booming also in the sense of game development. E.g. NVIDIA ACE which would bring the possibility of NPCs which run an AI model to communicate with players. Also, there are developments on an alternative to ray tracing where lighting, shadows and reflections are generated using AI which would need less performance and has similar visual aesthetics as ray tracing.

So it seems like raster performance is already at a pretty decent level. And graphic card manufacturers are already putting increasingly AI processors on the graphics card.

In my eyes, the next logical step would be to separate the work of the graphics card, which would be rasterisation and ray tracing, from AI. Resulting in maybe a new kind of PCIe card, an AI accelerator, which would feature a processor optimized for parallel processing and high data throughput.

This would allow developers to run more advanced AI models on the consumer's pc. For compatibility, they could e.g. offer a cloud based subscription system.

So what are your thoughts on this?

you are viewing a single comment's thread
view the rest of the comments
[โ€“] Port8080@feddit.de 1 points 2 years ago (1 children)

I'd guess that an AI card should have a great value proposition to be worth buying.

Sure the card should have great value or must have an accessible price. It probably also depends on how "heavy" the tasks get. But seeing e.g. OpenAI struggling with requests, it may be useful to decentralize the processing (with running the model locally on the user's pc).

I'm not sure where you're going with this, but it feels wrong. I'm not buying a hardware part that cannot function without a constant internet connection or regular payment.

Maybe this statement was a bit confusing. What I meant was, that in a transition phase developers could choose to allow the usage of a dedicated accelerator card to run everything locally and offline. And for people who don't have or want such a card they could provide a cloud based subscription model, where the processing is done on remote servers.

[โ€“] maynarkh 1 points 2 years ago

Yeah, that makes more sense.

By the way, Microsoft just announced that they are trying to do the opposite, and move users to thin clients with Windows itself being a cloud service.

That said much less processing power is required to run a model than to train it. Games also would not require big models, since they only need to know the game lore, not all the world's knowledge.

There are limited LLMs out there that can run on a phone.