this post was submitted on 27 Jan 2025
881 points (98.1% liked)

Technology

61227 readers
4342 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

cross-posted from: https://lemm.ee/post/53805638

(page 2) 50 comments
sorted by: hot top controversial new old
[–] Mac@mander.xyz 33 points 2 days ago (2 children)

What the fuck are markets when you can automate making money on them???

Ive been WTF about the stock market for a long time but now it's obviously a scam.

load more comments (2 replies)
[–] barsoap@lemm.ee 137 points 3 days ago* (last edited 3 days ago) (23 children)

Shovel vendors scrambling for solid ground as prospectors start to understand geology.

...that is, this isn't yet the end of the AI bubble. It's just the end of overvaluing hardware because efficiency increased on the software side, there's still a whole software-side bubble to contend with.

load more comments (23 replies)
[–] FightToAdapt@slrpnk.net 69 points 3 days ago (8 children)

I think this prompted investors to ask "where's the ROI?".

Current AI investment hype isn't based on anything tangible. At least the amount of investment isn't, it is absurd to think that trillion dollars that was put in the space already, even before that Softbanks deal is going to be returned. The models still hallucinate as it is inherent to the architecture, we are nowhere near replacing the workers but we got chatbots that "when they work sometimes, then they are kind of good?" and mediocre off-putting pictures. Is there any value? Sure, it's not NFTs. But the correction might be brutal.

Interestingly enough, DeepSeek's model is released just before Q4 earning's call season, so we will see if it has a compounding effect with another statement from big players that they burned massive amount of compute and USD only to get milquetoast improvements and get owned by a small Chinese startup that allegedly can do all that for 5 mil.

[–] prof_wafflez@lemmy.world 22 points 2 days ago* (last edited 2 days ago) (34 children)

hype isn’t based on anything tangible

So just like crypto

EDIT: The crypto bros out in full force... and right on cue proudly proclaiming they don't understand the difference between the value of blockchain technology (which so far has not had a ton of real world value outside of mostly impractical database applications, other than furthering climate change and buying drugs) vs the SPECULATIVE value of coins since coins have no real value factors to back up their SPECULATIVE value. Stocks often have real value that back up their value, like company profits or products. Stop drinking kool aid to the point of literal zero critical thinking, jfc.

load more comments (34 replies)
load more comments (7 replies)
[–] Teknikal@eviltoast.org 27 points 2 days ago (1 children)

Was watching bbc news interview some American guy about this and wow they were really pushing that it's no big deal and deepseek is way behind and a bit of a joke. Made claims they weren't under cyber attack they just couldn't handle having traffic etc.

Kinda making me root for China honestly.

load more comments (1 replies)
[–] ChiefGyk3D@infosec.pub 57 points 3 days ago (11 children)

My understanding is that DeepSeek still used Nvidia just older models and way more efficiently, which was remarkable. I hope to tinker with the opensource stuff at least with a little Twitch chat bot for my streams I was already planning to do with OpenAI. Will be even more remarkable if I can run this locally.

However this is embarassing to the western companies working on AI and especially with the $500B announcement of Stargate as it proves we don't need as high end of an infrastructure to achieve the same results.

load more comments (11 replies)
[–] index@sh.itjust.works 37 points 3 days ago (6 children)

It still rely on nvidia hardware why would it trigger a sell-off? Also why all media are picking up this news? I smell something fishy here...

[–] ArchRecord@lemm.ee 17 points 2 days ago (17 children)

Here's someone doing 200 tokens/s (for context, OpenAI doesn't usually get above 100) on... A Raspberry Pi.

Yes, the "$75-$120 micro computer the size of a credit card" Raspberry Pi.

If all these AI models can be run directly on users devices, or on extremely low end hardware, who needs large quantities of top of the line GPUs?

[–] aesthelete@lemmy.world 21 points 2 days ago* (last edited 2 days ago)

Thank the fucking sky fairies actually, because even if AI continues to mostly suck it'd be nice if it didn't swallow up every potable lake in the process. When this shit is efficient that makes it only mildly annoying instead of a complete shitstorm of failure.

load more comments (16 replies)
[–] Railcar8095@lemm.ee 33 points 3 days ago (1 children)

The way I understood it, it's much more efficient so it should require less hardware.

Nvidia will sell that hardware, an obscene amount of it, and line will go up. But it will go up slower than nvidia expected because anything other than infinite and always accelerating growth means you're not good at business.

load more comments (1 replies)
[–] PhAzE@lemmy.ca 22 points 3 days ago (4 children)

It requires only 5% of the same hardware that OpenAI needs to do the same thing. So that can mean less quantity of top end cards and it can also run on less powerful cards (not top of the line).

Should their models become standard or used more commonly, then nvidis sales will drop.

load more comments (4 replies)
load more comments (3 replies)
[–] daddy32@lemmy.world 29 points 3 days ago

Great, a stock sale.

[–] Kazumara@discuss.tchncs.de 39 points 3 days ago (3 children)

Hm even with DeepSeek being more efficient, wouldn't that just mean the rich corps throw the same amount of hardware at it to achieve a better result?

In the end I'm not convinced this would even reduce hardware demand. It's funny that this of all things deflates part of the bubble.

[–] UnderpantsWeevil@lemmy.world 51 points 3 days ago* (last edited 3 days ago) (2 children)

Hm even with DeepSeek being more efficient, wouldn’t that just mean the rich corps throw the same amount of hardware at it to achieve a better result?

Only up to the point where the AI models yield value (which is already heavily speculative). If nothing else, DeepSeek makes Altman's plan for $1T in new data-centers look like overkill.

The revelation that you can get 100x gains by optimizing your code rather than throwing endless compute at your model means the value of graphics cards goes down relative to the value of PhD-tier developers. Why burn through a hundred warehouses full of cards to do what a university mathematics department can deliver in half the time?

load more comments (2 replies)
load more comments (2 replies)
[–] RubicTopaz@lemmy.world 38 points 3 days ago (1 children)

Finally a proper good open source model as all tech should be

load more comments (1 replies)
[–] thespcicifcocean@lemmy.world 11 points 2 days ago (4 children)

nvidia falling doesn't make much sense to me, GPUs are still needed to run the model. Unless Nvidia is involved in its own AI model or something?

[–] racemaniac@lemmy.dbzer0.com 24 points 2 days ago (7 children)

If you need far less computing power to train the models, far less gpus are needed, and that hurts nvidia

load more comments (7 replies)
load more comments (3 replies)
[–] sith@lemmy.zip 25 points 3 days ago

Nice. Fuck you Nvidia.

load more comments
view more: ‹ prev next ›