unclemusclez/
unsloth-qwen2.5

561 10 months ago

Qwen 2.5 with Unsloth

0.5b 1.5b 3b 7b 14b

160 models

unsloth-qwen2.5:latest
dd42d9b4e3f1 • 8.5GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b
677a5035a761 • 352MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b
fa9381d3d598 • 935MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b
70c27162c440 • 1.8GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b
d561007a1b38 • 4.4GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b
5d1f535f0067 • 8.6GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-base-q2_K
e8fd7513388c • 339MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-base-q3_K_S
a1e8030342b8 • 338MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-base-q3_K_M
2810594cc7d3 • 355MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-base-q3_K_L
b7379eabda9e • 369MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-base-q4_0
11e15c8918a4 • 352MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-base-q4_1
77163d8362ef • 375MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-base-q4_K_S
cfe1c9afcd0d • 385MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-base-q4_K_M
45eb153d3d3b • 398MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-base-q5_0
306fb12d0319 • 397MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-base-q5_1
bfb71d6ae5e6 • 419MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-base-q5_K_S
9670433d0905 • 413MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-base-q5_K_M
4728469bdca0 • 420MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-base-q6_K
f5f666f495b3 • 506MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-base-q8_0
c98192226dcb • 531MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-base-fp16
f77dd7dc065f • 994MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-instruct-q2_K
3bddd6c06de8 • 339MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-instruct-q3_K_S
30ddbf7f29db • 338MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-instruct-q3_K_M
f8fa83ae402f • 355MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-instruct-q3_K_L
8f1bd96acbd0 • 369MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-instruct-q4_0
677a5035a761 • 352MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-instruct-q4_1
06b3aafdb819 • 375MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-instruct-q4_K_S
3d2d8ba5e946 • 385MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-instruct-q4_K_M
6068c0c6da15 • 398MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-instruct-q5_0
c440580f824b • 397MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-instruct-q5_1
8bad65f785af • 419MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-instruct-q5_K_S
325b56b0d527 • 413MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-instruct-q5_K_M
9e7f2a590bc0 • 420MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-instruct-q6_K
2f76e7af8649 • 506MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-instruct-q8_0
a42893183752 • 531MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:0.5b-instruct-fp16
4e6a44f40bc1 • 994MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-base-q2_K
e61aa154116b • 676MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-base-q3_K_S
ac8afc2b3f57 • 761MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-base-q3_K_M
f280d356f8b8 • 824MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-base-q3_K_L
d296c5c8e19b • 880MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-base-q4_0
264e7b9b885e • 935MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-base-q4_1
2f9d81507d3e • 1.0GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-base-q4_K_S
2f5da038b465 • 940MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-base-q4_K_M
2a186e5d4b21 • 986MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-base-q5_0
28bb8f39891a • 1.1GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-base-q5_1
6fd39d84133e • 1.2GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-base-q5_K_S
b62780642634 • 1.1GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-base-q5_K_M
335448f90d63 • 1.1GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-base-q6_K
de93bcb56180 • 1.3GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-base-q8_0
4c452cbdc944 • 1.6GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-base-fp16
03a5399eda95 • 3.1GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-instruct-q2_K
208b64c1c892 • 676MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-instruct-q3_K_S
0d9ac60d9d3a • 761MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-instruct-q3_K_M
5d3b91345ad2 • 824MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-instruct-q3_K_L
ab8f844efd06 • 880MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-instruct-q4_0
fa9381d3d598 • 935MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-instruct-q4_1
c118e04c84af • 1.0GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-instruct-q4_K_S
704fb86d126b • 940MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-instruct-q4_K_M
f7b31dc24fb6 • 986MB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-instruct-q5_0
0822695afb21 • 1.1GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-instruct-q5_1
70c9ce3dacc6 • 1.2GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-instruct-q5_K_S
dbaff1d627fc • 1.1GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-instruct-q5_K_M
e02696cad6d2 • 1.1GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-instruct-q6_K
014591d9ed72 • 1.3GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-instruct-q8_0
1df523920619 • 1.6GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:1.5b-instruct-fp16
66260dceac3b • 3.1GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-base-q2_K
c1dd50a3950d • 1.3GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-base-q3_K_S
00ec4d189c78 • 1.5GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-base-q3_K_M
d7d2725b21c6 • 1.6GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-base-q3_K_L
cb4a8e61fad0 • 1.7GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-base-q4_0
84e16aedbb5b • 1.8GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-base-q4_1
e64ab45b3d83 • 2.0GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-base-q4_K_S
9cd228fe8149 • 1.8GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-base-q4_K_M
836b30b214f8 • 1.9GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-base-q5_0
08330f9affb5 • 2.2GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-base-q5_1
284c4bdbaa5a • 2.3GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-base-q5_K_S
17f6ab03717e • 2.2GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-base-q5_K_M
21594fe64806 • 2.2GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-base-q6_K
82ac4580cf23 • 2.5GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-base-q8_0
e830a2aab770 • 3.3GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-base-fp16
998586319f23 • 6.2GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-instruct-q2_K
26cf2e506aa4 • 1.3GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-instruct-q3_K_S
1d111d775868 • 1.5GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-instruct-q3_K_M
bb49e1cfd143 • 1.6GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-instruct-q3_K_L
963d17ee83b6 • 1.7GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-instruct-q4_0
70c27162c440 • 1.8GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-instruct-q4_1
06bf51153a68 • 2.0GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-instruct-q4_K_S
0a7a9a1cb184 • 1.8GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-instruct-q4_K_M
c07627109db1 • 1.9GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-instruct-q5_0
3464ae5d2e86 • 2.2GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-instruct-q5_1
94a7dc12e78b • 2.3GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-instruct-q5_K_S
bfb6bf6ca4d5 • 2.2GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-instruct-q5_K_M
8041d3346744 • 2.2GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-instruct-q6_K
d17defd35e78 • 2.5GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-instruct-q8_0
de9877798718 • 3.3GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:3b-instruct-fp16
61b634d1ac74 • 6.2GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-base-q2_K
e2320549c786 • 3.0GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-base-q3_K_S
26f2963ce139 • 3.5GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-base-q3_K_M
a64b5cea38be • 3.8GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-base-q3_K_L
667c950c57ae • 4.1GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-base-q4_1
90c01c60b524 • 4.9GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-base-q4_K_S
c23b86d76a89 • 4.5GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-base-q4_K_M
719874bd883e • 4.7GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-base-q5_0
17b2c81f6cfc • 5.3GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-base-q5_1
752058048c41 • 5.8GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-base-q5_K_S
4dc49a8ce9b5 • 5.3GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-base-q5_K_M
7f3822b10538 • 5.4GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-base-q6_K
021b141954c0 • 6.3GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-base-q8_0
979b713c03d8 • 8.1GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-base-fp16
908acfed9fae • 15GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-instruct-q2_K
4c5222d8d9b1 • 3.0GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-instruct-q3_K_S
e63a1c29fb95 • 3.5GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-instruct-q3_K_M
1b17f185fe0d • 3.8GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-instruct-q3_K_L
fc08ad2900e1 • 4.1GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-instruct-q4_1
d83ead18cb32 • 4.9GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-instruct-q4_K_S
2e8596eebad3 • 4.5GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-instruct-q4_K_M
8da26aea0619 • 4.7GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-instruct-q5_0
6199712ead46 • 5.3GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-instruct-q5_1
c1a13a396090 • 5.8GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-instruct-q5_K_S
0e2dbaeac2ee • 5.3GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-instruct-q5_K_M
d14a49646082 • 5.4GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-instruct-q6_K
802fbd63872c • 6.3GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-instruct-q8_0
1264574b5ed4 • 8.1GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:7b-instruct-fp16
2ee1bb5779e8 • 15GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-q2_K
b620adf6d276 • 5.8GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-q3_K_S
7a9e52ed13fc • 6.7GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-q3_K_M
4e1cc412a965 • 7.3GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-q3_K_L
c675b61f6d1d • 7.9GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-q4_0
7e92bd0c5fe6 • 8.5GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-q4_1
e49c0d4bd8e5 • 9.4GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-q4_K_S
feb77454f90c • 8.6GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-q4_K_M
2cebb617ff8e • 9.0GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-q5_0
d194fa0238d4 • 10GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-q5_1
55e3d12cab76 • 11GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-q5_K_S
d6daf65e78f8 • 10GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-q5_K_M
e43f3c11885b • 11GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-q6_K
e42edf8ee7e4 • 12GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-q8_0
4f43d4641bd1 • 16GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-iq2_s
495e839b3681 • 6.9GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-iq3_s
36b75539d8ea • 6.7GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-iq4_nl
88f249f86dc8 • 8.6GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-base-fp16
44d480a56514 • 30GB • 128K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-q2_K
6e4d4b557ce8 • 5.8GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-q3_K_S
f965656fd84e • 6.7GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-q3_K_M
19622b73fbb2 • 7.3GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-q3_K_L
ad1017b5b156 • 7.9GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-q4_0
dd42d9b4e3f1 • 8.5GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-q4_1
ad6ef5e59e7e • 9.4GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-q4_K_S
124941680f38 • 8.6GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-q4_K_M
c85bb463e8ab • 9.0GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-q5_0
7b10eca23789 • 10GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-q5_1
8d1b39827c98 • 11GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-q5_K_S
718a9a1752fa • 10GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-q5_K_M
63daf4bcbfd5 • 11GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-q6_K
afc3ed13e8c5 • 12GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-q8_0
447a829fd4ee • 16GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-iq2_s
6f147bed0ed1 • 6.9GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-iq3_s
23f37fa38d26 • 6.7GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-iq4_nl
5d1f535f0067 • 8.6GB • 32K context window •
Text input • 10 months ago
unsloth-qwen2.5:14b-instruct-fp16
f93356ab7ee5 • 30GB • 32K context window •
Text input • 10 months ago