Please capture any feedback on Improvements from this month here.
Not to be too negative about it but I can't say I really like any of the LLM-driven NPC responses compared to the old handwritten BabbleOn scripting. They're quite slow which makes them feel even more NPC-y, many of them don't sound particularly correct to the characters (NPCs suddenly talking like Cockney croupiers or Jersey gun molls), and despite how long they take to generate they all end up being pretty much the same sentences anyway with minor changes to the (excessively added) filler words.
This is using GPT-3.5, with plans to at some point move to GPT-4 in the future which should improve answers more.
They're not replacements for GMs! Simply providing a slightly more context-aware way of saying things; it also reacts based on the way the question is asked.
Though it has been my experience through testing, that the ability of GPT to emulate speech or prose, in naturalistic and differing ways, degrades very quickly where a large percentage of the output is pre-defined and factual (ie. a list of specific drinks constituting most of a sentence). This is, from what I've read how the LLM is trained, a fundamental limitation of the technology because it cannot adequately hallucinate when it must be specific or factual. It might be that hand-written responses are superior in cases where very specific information (like where players are clustered, or what items are for sale) is the primary thing being conveyed, and the LLM better in instances where what is precisely said is not so important.
In terms of avoiding exposure to airborne pathogens and weaponry, a fully outfitted environmental suit should be required. Or as stated Chrome Magic. In the real world, significant preparation happens if something like deadly airborne diseases (or worse weaponized chemicals) is expected to be encountered, and shouldn't be any different here.
I feel the rarity, danger and risk of utilizing weapons like these should not be cancelled out by simply wearing a motorcycle helmet.
Also, if you're wearing gear because you expect a chemical gas attack, you should be dressed in gear that everyone will know you're expecting a chemical gas attack. Not just brooding at the bar in the corner.
Just my thoughts.
Thank you for the clarifications.
(Edited by Slither at 9:58 am on 1/1/2024)
You say to the bartender, "Where's the party at?"
The bartender says to you before continuing to help another customer, "Give me a second."
Having finished with the other customer the bartender turns to you.
The bartender says, "A GPT massaged message."
That way people know the NPC heard them. If you get a bunch of NPC responses in mere moments then one suddenly takes 15-25 seconds, I could easily see players wondering if there's a problem. I know I wondered!
Could be done in a variety of ways of course. I just think that a few extra bits added to the process could help improve the overall experience, however it looks.
