milkey/
deepseek-v2.5-1210-UD:IQ1_M

176 7 months ago

(Unsloth Dynamic Quants) DeepSeek-V2.5-1210 is an upgraded version of DeepSeek-V2.5, offering enhanced mathematical, coding, writing, and reasoning capabilities.

7 months ago

0c73a4c140b8 · 57GB ·

model
deepseek2
·
236B
·
BF16
template
{{- if .Suffix }}<｜fim▁begin｜>{{ .Prompt }}<｜fim▁hole｜>{{ .Suffix }}<｜fim▁end｜> {{
params
{ "stop": [ "<｜begin▁of▁sentence｜>", "<｜end▁of▁sentence｜>",

Readme

Now try to run it on your high performing PC. ; - ）

https://unsloth.ai/blog/deepseekr1-dynamic

https://huggingface.co/deepseek-ai/DeepSeek-V2.5-1210

Quants computing resources are sponsored by Fujian Xiaowei Technology Co., Ltd. / 12301.cc / Mondrian Project