milkey/deepseek-v3-UD:IQ1

milkey/

deepseek-v3-UD:IQ1_S

2,004 Downloads Updated 7 months ago

(Unsloth Dynamic Quants) A strong Mixture-of-Experts (MoE) language model with 671B total parameters with 37B activated for each token.

Updated 7 months ago

7 months ago

9ce3ae0fb95d · 140GB ·

archdeepseek2

parameters671B

quantizationIQ1_S

140GB

{ "stop": [ "<｜begin▁of▁sentence｜>", "<｜end▁of▁sentence｜>",

241B

{{- range $i, $_ := .Messages }} {{- if eq .Role "user" }}<｜User｜> {{- else if eq .Role "assista

360B

Note: this model requires Ollama 0.5.5 or later.

Quants computing resources are sponsored by Fujian Xiaowei Technology Co., Ltd. / 12301.cc / Mondrian Project