this post was submitted on 09 Nov 2023
283 points (100.0% liked)
Technology
37360 readers
231 users here now
Rumors, happenings, and innovations in the technology sphere. If it's technological news or discussion of technology, it probably belongs here.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I kind of want to go for the framework laptop, but I still do like ARM and given I want to do more stuff around machine learning in the future, which is already kind of difficult to run large language models with only 8 gigabytes of RAM, it at least kind of runs with ARM. On my basement PC, It will barely do anything
There are some external GPUs that can be USB-attached. Dunno about for the Mac. Latency hit, but probably not as significant for current LLM use than games, as you don't have a lot of data being pushed over the bus once the model is up.
Those don't work on Apple silicon Macs. sadly