milkey/deepseek-v3-UD:IQ2

milkey/

deepseek-v3-UD:IQ2_XXS

2,004 Downloads Updated 7 months ago

(Unsloth Dynamic Quants) A strong Mixture-of-Experts (MoE) language model with 671B total parameters with 37B activated for each token.

Updated 7 months ago

7 months ago

745eb9f86c04 · 196GB ·

archdeepseek2

parameters671B

quantizationIQ2_XXS

196GB

{ "stop": [ "<｜begin▁of▁sentence｜>", "<｜end▁of▁sentence｜>",

241B

{{- range $i, $_ := .Messages }} {{- if eq .Role "user" }}<｜User｜> {{- else if eq .Role "assista

360B

Note: this model requires Ollama 0.5.5 or later.

Quants computing resources are sponsored by Fujian Xiaowei Technology Co., Ltd. / 12301.cc / Mondrian Project