what instruct format does it use? or does it not use any?
just wondering if I should use adventure (nothing) or mlchat or llama3 or whatever else format in the ST, the examples in description make me think it has no instruct formatting but can't be sure
Just use the mistral template.
I use a minimized version of llamaception for the prompt. I havent played around with any of the built in presets. But give them a try!
Here are my settings:
Temp:
1.1 - 1.5 (The higher the better for creativity...)
I usually play around with these, and Top and Min P usually move together for me.
Top P: 0.85-0.9 (Lower for more varied output)
Min P: 0.1 - 0.15 (Higher for more varied output)
Dry Settings: (I usually use this entirely over Rep Pen, and these can vary greatly...)
Multiplier: 1.5
Base: 1
Allowed Length: 2
If I am having repetition, or similar phrasing I will start ramping Multi and Base.