luckyqm/
deepseek-r1-671b:iq1-s

1,354 10 months ago

能运行在单张Rtx 4090 24G显卡上经过动态量化的完全版671b模型。 来自于Unsloth's DeepSeek-R1，https://huggingface.co/unsloth/DeepSeek-R1-GGUF。

10 months ago

bd8b066a31fb · 140GB ·

model
deepseek2
·
671B
·
IQ1_S
params
{ "stop": [ "<｜begin▁of▁sentence｜>", "<｜end▁of▁sentence｜>",
template
{{- if .System }}{{ .System }}{{ end }} {{- range $i, $_ := .Messages }} {{- $last := eq (len (slice

Readme

Unsloth’s DeepSeek-R1，

RunningDynamic R1 Quants on an RTX 4090 GPU with 24GB VRAM / memory