MiniMax-M2 is a nice model, but prone to getting stuck in repetition loops
#1
by
anikifoss
- opened
Really enjoying MiniMax-M2, it's very fast, and is good at generating code. However, it seems to be prone to getting stuck in repetition loops.
Increasing temperature does not seem to help.
Anyone else having these issues?
Using a small bump to repeat-penalty seems to help: --repeat-penalty 1.01 --repeat-last-n 64
Had to further tweak min-p and repeat-penalty to avoid repetition loops:
--temp 1.0 --top-k 0 --top-p 1.0 --min-p 0.02 \
--repeat-penalty 1.04 --repeat-last-n 256 \