156 1 year ago

GGUF on HF from crusoeai/dolphin-2.9.3-qwen2-1.5b-GGUF

Models

View all →

16 models

dolphin-2.9.3-qwen2-1.5b:latest

986MB · 128K context window · Text · 1 year ago

dolphin-2.9.3-qwen2-1.5b:q2_k

676MB · 128K context window · Text · 1 year ago

dolphin-2.9.3-qwen2-1.5b:q3_k_s

761MB · 128K context window · Text · 1 year ago

dolphin-2.9.3-qwen2-1.5b:q3_k_m

824MB · 128K context window · Text · 1 year ago

dolphin-2.9.3-qwen2-1.5b:q3_k_l

880MB · 128K context window · Text · 1 year ago

dolphin-2.9.3-qwen2-1.5b:q4_0

935MB · 128K context window · Text · 1 year ago

dolphin-2.9.3-qwen2-1.5b:q4_1

1.0GB · 128K context window · Text · 1 year ago

dolphin-2.9.3-qwen2-1.5b:q4_k_s

940MB · 128K context window · Text · 1 year ago

dolphin-2.9.3-qwen2-1.5b:q4_k_m

986MB · 128K context window · Text · 1 year ago

dolphin-2.9.3-qwen2-1.5b:q5_0

1.1GB · 128K context window · Text · 1 year ago

dolphin-2.9.3-qwen2-1.5b:q5_1

1.2GB · 128K context window · Text · 1 year ago

dolphin-2.9.3-qwen2-1.5b:q5_k_s

1.1GB · 128K context window · Text · 1 year ago

dolphin-2.9.3-qwen2-1.5b:q5_k_m

1.1GB · 128K context window · Text · 1 year ago

dolphin-2.9.3-qwen2-1.5b:q6_k

1.3GB · 128K context window · Text · 1 year ago

dolphin-2.9.3-qwen2-1.5b:q8_0

1.6GB · 128K context window · Text · 1 year ago

dolphin-2.9.3-qwen2-1.5b:fp16

3.1GB · 128K context window · Text · 1 year ago

Readme