839 9 months ago

The latest series of Code-Specific Qwen models, with significant improvements in code generation, code reasoning, and code fixing. I-Quant models.

tools

Models

View all →

47 models

qwen2.5-coder:latest

4.4GB · 32K context window · Text · 9 months ago

qwen2.5-coder:0.5b-iq2_xs

324MB · 32K context window · Text · 9 months ago

qwen2.5-coder:0.5b-iq2_s

326MB · 32K context window · Text · 9 months ago

qwen2.5-coder:0.5b-iq3_xxs

334MB · 32K context window · Text · 9 months ago

qwen2.5-coder:0.5b-iq3_xs

339MB · 32K context window · Text · 9 months ago

qwen2.5-coder:0.5b-iq3_s

339MB · 32K context window · Text · 9 months ago

qwen2.5-coder:0.5b-iq4_xs

349MB · 32K context window · Text · 9 months ago

qwen2.5-coder:0.5b-iq4_nl

353MB · 32K context window · Text · 9 months ago

qwen2.5-coder:1.5b-iq2_xxs

511MB · 32K context window · Text · 9 months ago

qwen2.5-coder:1.5b-iq2_xs

550MB · 32K context window · Text · 9 months ago

qwen2.5-coder:1.5b-iq2_s

564MB · 32K context window · Text · 9 months ago

qwen2.5-coder:1.5b-iq3_xs

732MB · 32K context window · Text · 9 months ago

qwen2.5-coder:1.5b-iq3_s

762MB · 32K context window · Text · 9 months ago

qwen2.5-coder:1.5b-iq4_xs

896MB · 32K context window · Text · 9 months ago

qwen2.5-coder:1.5b-iq4_nl

936MB · 32K context window · Text · 9 months ago

qwen2.5-coder:3b-iq2_xxs

948MB · 32K context window · Text · 9 months ago

qwen2.5-coder:3b-iq2_xs

1.0GB · 32K context window · Text · 9 months ago

qwen2.5-coder:3b-iq2_s

1.1GB · 32K context window · Text · 9 months ago

qwen2.5-coder:3b-iq3_xxs

1.3GB · 32K context window · Text · 9 months ago

qwen2.5-coder:3b-iq3_xs

1.4GB · 32K context window · Text · 9 months ago

qwen2.5-coder:3b-iq3_s

1.5GB · 32K context window · Text · 9 months ago

qwen2.5-coder:3b-iq4_xs

1.7GB · 32K context window · Text · 9 months ago

qwen2.5-coder:3b-iq4_nl

1.8GB · 32K context window · Text · 9 months ago

qwen2.5-coder:7b-iq2_xxs

2.3GB · 32K context window · Text · 9 months ago

qwen2.5-coder:7b-iq2_xs

2.5GB · 32K context window · Text · 9 months ago

qwen2.5-coder:7b-iq2_s

2.6GB · 32K context window · Text · 9 months ago

qwen2.5-coder:7b-iq3_xxs

3.1GB · 32K context window · Text · 9 months ago

qwen2.5-coder:7b-iq3_xs

3.3GB · 32K context window · Text · 9 months ago

qwen2.5-coder:7b-iq3_s

3.5GB · 32K context window · Text · 9 months ago

qwen2.5-coder:7b-iq4_xs

4.2GB · 32K context window · Text · 9 months ago

qwen2.5-coder:7b-iq4_nl

4.4GB · 32K context window · Text · 9 months ago

qwen2.5-coder:14b-iq2_xxs

4.3GB · 32K context window · Text · 9 months ago

qwen2.5-coder:14b-iq2_xs

4.7GB · 32K context window · Text · 9 months ago

qwen2.5-coder:14b-iq2_s

5.0GB · 32K context window · Text · 9 months ago

qwen2.5-coder:14b-iq3_xxs

5.9GB · 32K context window · Text · 9 months ago

qwen2.5-coder:14b-iq3_xs

6.4GB · 32K context window · Text · 9 months ago

qwen2.5-coder:14b-iq3_s

6.7GB · 32K context window · Text · 9 months ago

qwen2.5-coder:14b-iq4_xs

8.1GB · 32K context window · Text · 9 months ago

qwen2.5-coder:14b-iq4_nl

8.5GB · 32K context window · Text · 9 months ago

qwen2.5-coder:32b-iq2_xxs

9.0GB · 32K context window · Text · 9 months ago

qwen2.5-coder:32b-iq2_xs

10.0GB · 32K context window · Text · 9 months ago

qwen2.5-coder:32b-iq2_s

10GB · 32K context window · Text · 9 months ago

qwen2.5-coder:32b-iq3_xxs

13GB · 32K context window · Text · 9 months ago

qwen2.5-coder:32b-iq3_xs

14GB · 32K context window · Text · 9 months ago

qwen2.5-coder:32b-iq3_s

14GB · 32K context window · Text · 9 months ago

qwen2.5-coder:32b-iq4_xs

18GB · 32K context window · Text · 9 months ago

qwen2.5-coder:32b-iq4_nl

19GB · 32K context window · Text · 9 months ago

Readme

Qwen 2.5 Coder series of models are now updated in 6 sizes: 0.5B, 1.5B, 3B, 7B, 14B and 32B.

  • Quantization from fp32
  • Using i-matrix calibration dataset calibration_datav3.txt
  • I-Quants models, only if passing tests iq2_xs, iq2_xxs, iq3_xxs, iq4_nl, iq3_s, iq2_s, iq4_xs, iq3_xs
  • Default quantization 7b:iq4_nl

Model description

image.png