luckyqm/
deepseek-r1-671b

1,354 10 months ago

能运行在单张Rtx 4090 24G显卡上经过动态量化的完全版671b模型。 来自于Unsloth's DeepSeek-R1，https://huggingface.co/unsloth/DeepSeek-R1-GGUF。

Models

View all →

2 models

deepseek-r1-671b:iq1-m

169GB · 4K context window · Text · 10 months ago

deepseek-r1-671b:iq1-s

140GB · 4K context window · Text · 10 months ago

Readme

Unsloth’s DeepSeek-R1，

RunningDynamic R1 Quants on an RTX 4090 GPU with 24GB VRAM / memory