krith/qwen2.5-coder-32b-instruct

krith/

qwen2.5-coder-32b-instruct

2,011 Downloads Updated 11 months ago

I-quants for qwen2.5-coder-32b-instruct

tools

Models

View all →

Name

8 models

Size

Context

Input

qwen2.5-coder-32b-instruct:IQ3_M

15GB · 32K context window · Text · 11 months ago

qwen2.5-coder-32b-instruct:IQ3_M

15GB

32K

Text

qwen2.5-coder-32b-instruct:IQ2_XXS

9.0GB · 32K context window · Text · 11 months ago

qwen2.5-coder-32b-instruct:IQ2_XXS

9.0GB

32K

Text

qwen2.5-coder-32b-instruct:IQ2_XS

10.0GB · 32K context window · Text · 11 months ago

qwen2.5-coder-32b-instruct:IQ2_XS

10.0GB

32K

Text

qwen2.5-coder-32b-instruct:IQ2_S

10GB · 32K context window · Text · 11 months ago

qwen2.5-coder-32b-instruct:IQ2_S

10GB

32K

Text

qwen2.5-coder-32b-instruct:IQ2_M

11GB · 32K context window · Text · 11 months ago

qwen2.5-coder-32b-instruct:IQ2_M

11GB

32K

Text

qwen2.5-coder-32b-instruct:IQ3_XXS

13GB · 32K context window · Text · 11 months ago

qwen2.5-coder-32b-instruct:IQ3_XXS

13GB

32K

Text

qwen2.5-coder-32b-instruct:IQ3_XS

14GB · 32K context window · Text · 11 months ago

qwen2.5-coder-32b-instruct:IQ3_XS

14GB

32K

Text

qwen2.5-coder-32b-instruct:IQ4_XS

18GB · 32K context window · Text · 11 months ago

qwen2.5-coder-32b-instruct:IQ4_XS

18GB

32K

Text

Readme

Created using GGUF files from https://huggingface.co/bartowski/Qwen2.5-Coder-32B-Instruct-GGUF