1,354 10 months ago

能运行在单张Rtx 4090 24G显卡上经过动态量化的完全版671b模型。 来自于Unsloth's DeepSeek-R1,https://huggingface.co/unsloth/DeepSeek-R1-GGUF。

10 months ago

bd8b066a31fb · 140GB ·

deepseek2
·
671B
·
IQ1_S
{ "stop": [ "<|begin▁of▁sentence|>", "<|end▁of▁sentence|>",
{{- if .System }}{{ .System }}{{ end }} {{- range $i, $_ := .Messages }} {{- $last := eq (len (slice

Readme

Unsloth’s DeepSeek-R1,

RunningDynamic R1 Quants on an RTX 4090 GPU with 24GB VRAM / memory