sammcj/
deepseek-r1:iq3_xxs

6 8 months ago

deepseek r1 quants

8 months ago

3c10fa4dff60 · 258GB ·

model
deepseek2
·
671B
·
IQ3_XXS
params
{ "min_p": 0.9, "num_ctx": 65536, "stop": [ "<｜begin▁of▁sentence｜>",
template
{{- if .System }}{{ .System }}{{ end }} {{- range $i, $_ := .Messages }} {{- $last := eq (len (slice

Readme

  • IQ3_XXS = bartowski gguf
  • UD-Q2_K_XL = unsloth gguf