adrienbrault/
qwen1.5-0.5b-openhermes-2.5

206 1 year ago

https://huggingface.co/brittlewis12/Qwen1.5-0.5B-OpenHermes-2.5-GGUF

Models

View all →

10 models

qwen1.5-0.5b-openhermes-2.5:Q2_K

298MB · 32K context window · Text · 1 year ago

qwen1.5-0.5b-openhermes-2.5:Q3_K_S

333MB · 32K context window · Text · 1 year ago

qwen1.5-0.5b-openhermes-2.5:Q3_K_M

350MB · 32K context window · Text · 1 year ago

qwen1.5-0.5b-openhermes-2.5:Q3_K_L

364MB · 32K context window · Text · 1 year ago

qwen1.5-0.5b-openhermes-2.5:Q4_K_S

397MB · 32K context window · Text · 1 year ago

qwen1.5-0.5b-openhermes-2.5:Q4_K_M

407MB · 32K context window · Text · 1 year ago

qwen1.5-0.5b-openhermes-2.5:Q5_K_S

453MB · 32K context window · Text · 1 year ago

qwen1.5-0.5b-openhermes-2.5:Q5_K_M

459MB · 32K context window · Text · 1 year ago

qwen1.5-0.5b-openhermes-2.5:Q6_K

515MB · 32K context window · Text · 1 year ago

qwen1.5-0.5b-openhermes-2.5:Q8_0

665MB · 32K context window · Text · 1 year ago

Readme

See https://huggingface.co/brittlewis12/Qwen1.5-0.5B-OpenHermes-2.5-GGUF

Pushed using https://github.com/adrienbrault/hf-gguf-to-ollama