Could you please release the SillyTavern text completion preset file?
It's really too complicated.please
It's not complicated at all.
Step 1: Select the Universal-Light preset.
Step 2: Bump MinP up to 0.2.
You're now at the recommended settings. It's not worth shipping a whole preset file for.
That is the only official recommendation I have ever made. Any complexity past that is complexity you're taking on yourself.
I'm not familiar with the way other people use this model, so if anybody else has suggestions that work better for them then great, implement that, but it's not my responsibility to ship other people's suggestions.
I'm using sphiratrioth - Roleplay settings from their presets and it works quite well for me. I think it was the ChatML version.. But i did change like one or two settings, increase repetition penalty from 1 to 1.1 for example.
Goodluck. I'm also a noob at this shit, so I can relate, everyone says it's not hard.. But they don't realize a lot of us are relatively new to all of this.
Goodluck. I'm also a noob at this shit, so I can relate, everyone says it's not hard.. But they don't realize a lot of us are relatively new to all of this.
Let me clarify: I totally empathize with the fact that dialling in LLM settings is difficult! Everyone's expectations/preferences, system prompt, character card, etc... will all make the ideal settings different.
I was only irritated by the implication that I should ship a whole JSON file for what is only 2 settings.
Or, and I'm probably reading into OP's comment with this; the notion that there's an "ideal preset" that I'm somehow hiding. I'm not! Model makers don't know how their stuff will be used! I can only tell you how I like to use it. :)