485
submitted 2 months ago by mozz@mbin.grits.dev to c/technology@beehaw.org

Credit to @bontchev

you are viewing a single comment's thread
view the rest of the comments
[-] mozz@mbin.grits.dev 2 points 2 months ago

Are you talking about MoE? Can you link me to more about this? I know about networks that do this approach for picking the next token, but I'm not aware of any real chatbot that actually runs multiple LLMs and then votes on the outcome or anything. I'm interested to know more if that's really what it is.

[-] MagicShel@programming.dev 3 points 2 months ago

I didn't have any links at hand so I googled and found this academic paper. https://arxiv.org/pdf/2310.20151.pdf

Here's a video summarizing that paper by the authors if that's more digestible for you: https://m.youtube.com/watch?v=OU2L7MEqNK0

I don't know who is doing it or if it's even on any publicly available systems, so I can't speak to that or easily find that information.

this post was submitted on 15 Apr 2024
485 points (100.0% liked)

Technology

37208 readers
258 users here now

Rumors, happenings, and innovations in the technology sphere. If it's technological news or discussion of technology, it probably belongs here.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS