98
‘Sputnik moment’: $1tn wiped off US stocks after Chinese firm unveils AI chatbot
(www.theguardian.com)
ahh... the sound of a bursting bubble.
- plop -
this post was submitted on 28 Jan 2025
98 points (100.0% liked)
Technology
38089 readers
312 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 3 years ago
MODERATORS
Cheaper AI isn't the pop we want. We want companies to stop trying to use AI for every god damn thing it is terrible at. We don't want cheaper AI that's just going to be baked into more stuff.
I mean, I do want cheaper GenAI in the sense that I want people to see that it's dollar store crap that's not worth the electricity to run the servers to make it and give it up like they did the fucking Juicero and every other smart appliance a couple years ago. God forbid I hold my breath and people wise up and understand that these people are all grifters looking to tape a horn to a horse and sell their "unicorn" to FAANG or whatever the equivalent is these days, I can't be assed to rewrite the new poob acronym.
AI isn't the enemy, though, and we aren't the ones being grifted—that would be companies who think they can make tons of money replacing people with AI. It's a reasonable useful tool/fun toy/interesting curiosity in certain circumstances. And for an end user it doesn't use any more power than a video game. But it's a tool for craftsmen and folks who understand the limitations, not a replacement for workers. And it sure as hell isn't a production feature. Anyone looking to make money baking AI into consumer products is an idiot and going to lose their hat.
Nah, o1 has been out how long? They are already on o3 in the office.
It’s completely normal a year later for someone to copy their work and publish it.
It probably cost them less because they probably just distilled o1 XD. Or might have gotten insider knowledge (but honestly how hard could CoT fine tuning possibly be?)
Deepseek showed that actually putting thought into the architecture achieves much more than just throwing more hardware at the problem.
This means a) there will be much less demand for hardware, since much more could be run locally on regular consumer devices. And b) the export restrictions don't really work and instead force China to create actually better models.
That means, a lot of the investments into the thousands of AI companies are in jeopardy.
Realistically, the CCP is probably throwing a lot of money at developers to get something good going and available, and US companies are whining about how it's not fair. The fact of the matter is that a solid product is available for much cheaper, and US companies are now screaming foul. Guess what, a superior product made of good code (people) beats out just throwing money at hardware, who'd've gone an thunk it.
What I find really fascinating here is that obviously openAI, Meta, etc. seem to be structurally incapable of actually innovating at this point.
I mean, reducing training costs by literally an order of magnitude just by writing better software is astonishing and shows how complacent the large corporations have gotten.
You can write off hardware purchases, paying for skilled devs is like pulling teeth
Meta? The one that released Llama 3.3? The one that actually publishes its work? What are you talking about?
Why is it so hard to believe that deepseek is just yet another amazing paper in a long line of research done by everyone. Just because it’s Chinese? Everyone will adapt to this amazing innovation and then stagnate and throw compute at it until the next one. That’s how research works.
Not to mention China has billions of more people to establish a research community…
I think “just writing better code” is a lot harder than you think. You actually have to do research first you know? Our universities and companies do research too. But I guarantee using R1 techniques on more compute would follow the scaling law too. It’s not either or.
One thing to be kept in mind, though:
verified this myself with the 1.1b model
Yes but also it’s open source soooo
https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Llama-70B-Uncensored-i1-GGUF
- open weights, as the training dataset is not open/available afaik. But yum :D
Much better.
Thank you!
continuous development and progress
Lol
Last year Dario Amodei, the co-founder of leading AI firm Anthropic, put the current cost of training advanced models at between $100m and $1bn.
So his estimate is so vague as to be fucking useless.
How people haven't seen through this emperors new clothes nonsense & grasped that these are the bullshitting self appointed druids of the neo religion.
That bubble they keep mentioning is where they're all getting high off their own farts
Business people will do almost anything to eliminate wages
Tbf, that could also just be describing the variability of models.
I'd imagine there's a difference in cost for training Dall-E 3 and GPT-3.5 for example.
Sweet, cheaper stocks this week.
ELI5 request on lemmy: "You see, dear grandchildren, your grandfather used to have an apple orchard. The fruits were so sweet and nutritious that every town citizen wanted a taste because they thought it was the only possible orchard in the world. Therefore the citizens gave a lot of money to your grandfather because the citizens thought the orchard would give them more apples in return, more than the worth of the money they gave. Little did they know the world was vastly larger than our ever more arid US wasteland. Suddenly an oriental orchard was discovered which was surprisingly cheaper to plant, maintain, and produced more apples. This meant a significant potential loss of money for the inhabitants of the town called Idiocracy. Therefore, many people asked their money back by selling their imaginary not-yet-grown apples to people who think the orchard will still be worth more in the future.
This is called investing, or to those who are honest with themselves: participating in a multi-level marketing pyramid scheme. You see, children, it can make a lot of money, but it destroys the soul and our habitat at the same time, which goes unnoticed by all these people with advanced degrees. So think again when you hear someone speak with fancy words and untamed confidence. Many a times their reasoning falls below the threshold of dog poop. But that’s a story for another time. Sweet dreams."