this post was submitted on 09 Jan 2025
483 points (99.2% liked)

Opensource

1715 readers
60 users here now

A community for discussion about open source software! Ask questions, share knowledge, share news, or post interesting stuff related to it!

CreditsIcon base by Lorc under CC BY 3.0 with modifications to add a gradient



founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Lifter@discuss.tchncs.de 2 points 1 week ago (1 children)

Training the model yourself would take years on a single machine. If you factor that into your cost per query, it blows up.

The data centers are (currently) mainly used for training new models.

[–] jsomae@lemmy.ml 1 points 1 week ago

But if you divide the cost of training by the number of people using the model, it should be pretty low.