Questions about LLMs in Group Chats(vineeth.io) |
Questions about LLMs in Group Chats(vineeth.io) |
this is something that's talked a lot about in education -- how to foster a productive group discussion: https://www.teacher.org/blog/what-is-the-harkness-discussion...
Also, I have no idea what the use case for this would be but making it work sounds cool and kinda fruitful.
Yes, and once you collect enough samples from the LLM you could train a SLM to do it faster and cheaper.
I've implemented this for a toy project before and it worked surprisingly well, yes! It can take some creative prompting to have the model understand which messages are actually directed at it, though, which I guess makes sense since every User message is _supposed_ to be?
Also would it only respond if a message was directed at it or could they proactively decide to join a conversation?
Moderation/mediation is probably the most obvious thing "usecase." I'm more interested in just pushing the limits of what the language models can do and see what kind of things they'll do.
There's a corner of the internet interested in these models as a form of "alien intelligence." Don't immediately know what the application would be, but the results are super interesting
Cynically? Your group chat is hosted by a tech company. That tech company wants to tell investors they've got an LLM, and show user counts going up. And the fastest way to boost user counts on a failing product is to make it an always-on feature of a successful product.
I mean yeah literally you could talk about your plans [i.e. by yourself or with the other real people] or what's going on in your life and have the bot chime in with thoughts too. You could talk about food, philosophy, politics, travel, complain about stuff, get advice for relationships or work, gossip. All in a group chat setting.
It's not hard to imagine a bot that's able to contribute here and there in a meaningful way in any of these subjects, and other unlimited subjects. But perhaps you weren't open to it in the first place so I'm not going to try to convince you further if you don't buy it; If you don't want to really give it consideration then nobody is going to convince you otherwise.