Thanks, Ubergarm!
#4
by
Chico70
- opened
Thanks, Ubergarm! I've just tested the IQ5_K model with Roo Code and the updated ik_llama.cpp. It worked fine!!!!
Great!!! Did you have to use any --jinja stuff or does it "just work"? I'm still getting used to the various MCP/tool use clients with the newer openai api endpoints. Also curious how it is working for coding and agentic use in your vibe experience?
I'm using it with --jinja parameter and the Unsloth's chat_template. 😁
And... It's working with Cline and Roo code, but I've heard they don't use the full tool function api. I'm still not using MCP, but I'll try it soon....