this post was submitted on 12 Jan 2024
64 points (77.6% liked)

Technology

59148 readers
2011 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

For those of you who don't want to use a ChatGPT but want a LLM.

you are viewing a single comment's thread
view the rest of the comments
[–] General_Effort@lemmy.world 6 points 10 months ago

It's a bad list.

YSK: There are several things mixed in it.

  1. There are "models" (usually meaning "weights" specifically). The models (weights) are the raw data that contain the wisdom of the AIs.
  2. There is software to "run" these models on your own machine, or to connect to an API.
  3. There are services which run models for you and let you interact via web interface, app, or API. Some services may add text to your prompt, to create a better(?) prompt.

There is a bewildering array of models out there. Mostly, they are specialized and/or merged versions of some popular foundation models (by mistral, meta, and a few others). Without endorsing any service, I find that openrouter.ai and together.ai let you try a fairly large selection. There are other services.

You can find more/better information here: !localllama@sh.itjust.works