145 yesterday

Suite of weighted quantizations for Magnum V4 models. Available in 9b, 12b, 22b, and 27b. Made by Anthracite-org (Huggingface).

tools
f02dd72bb242 · 59B
{
"stop": [
"<|im_start|>",
"<|im_end|>"
]
}