7,049 4 months ago

Quantized version of Qwen3 models (4B,8B,14B,32B, 30B-moe) optimized for tool usage in Cline / Roo Code and solving Complex Problems.

tools 4b 8b 14b 30b 32b
f02b03063c35 · 327B
{
"min_p": 0.001,
"num_ctx": 131072,
"num_keep": 1024,
"num_predict": 32786,
"repeat_penalty": 1.1,
"stop": [
"<|im_start|>",
"<|im_end|>",
"</thinking>",
"</tool_call>",
"</tool_response>",
"</write_to_file>",
"</execute_command>"
],
"temperature": 0.25,
"top_k": 20,
"top_p": 0.7
}