6,950 4 months ago

Quantized version of Qwen3 models (4B,8B,14B,32B, 30B-moe) optimized for tool usage in Cline / Roo Code and solving Complex Problems.

tools 4b 8b 14b 30b 32b
c559786d6f3c · 326B
{
"min_p": 0.001,
"num_ctx": 65536,
"num_keep": 1024,
"num_predict": 16384,
"repeat_penalty": 1.1,
"stop": [
"<|im_start|>",
"<|im_end|>",
"</thinking>",
"</tool_call>",
"</tool_response>",
"</write_to_file>",
"</execute_command>"
],
"temperature": 0.25,
"top_k": 40,
"top_p": 0.9
}