unclemusclez/
unsloth-llama3.2

367 1 year ago

Llama 3.2 with Unsloth

1b 3b

65 models

unsloth-llama3.2:latest
de9877798718 • 3.3GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:1b
2775b15317b6 • 771MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b latest
de9877798718 • 3.3GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-instruct-q2_K
863b40fdcc52 • 581MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-instruct-q3_K_S
ad6edd03e7e6 • 642MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-instruct-q3_K_M
799cf7f6ad85 • 691MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-instruct-q3_K_L
76bdeddbaab8 • 733MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-instruct-q4_0
2775b15317b6 • 771MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-instruct-q4_1
7cf081620a70 • 832MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-instruct-q4_K_S
7d6372a6ee39 • 776MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-instruct-q4_K_M
bafb9ac61b41 • 808MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-instruct-q5_0
30cf7c937b0f • 893MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-instruct-q5_1
647a20083dca • 954MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-instruct-q5_K_S
91b6067cc6f5 • 893MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-instruct-q5_K_M
9ee6b4bcf4f4 • 912MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-instruct-q6_K
6c692196f3ae • 1.0GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-instruct-q8_0
f8d59ec2fcf3 • 1.3GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-instruct-fp16
f2f012bca592 • 2.5GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-text-q2_K
56840d3320d9 • 581MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-text-q3_K_S
6bc54e53003f • 642MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-text-q3_K_M
8310a1fb16a2 • 691MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-text-q3_K_L
fee06533f1e9 • 733MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-text-q4_0
21437583db0f • 771MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-text-q4_1
d1db8d75a497 • 832MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-text-q4_K_S
e748130b177b • 776MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-text-q4_K_M
b1fef8ec1082 • 808MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-text-q5_0
46f5fc1c2735 • 893MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-text-q5_1
2e1d376951c2 • 954MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-text-q5_K_S
858b50493ae7 • 893MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-text-q5_K_M
5e42de9ee9ee • 912MB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-text-q6_K
2a2070b323d9 • 1.0GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-text-q8_0
ed7e49dfe232 • 1.3GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:1b-text-fp16
130cd65e0d86 • 2.5GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-q2_K
26cf2e506aa4 • 1.3GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-q3_K_S
1d111d775868 • 1.5GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-q3_K_M
bb49e1cfd143 • 1.6GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-q3_K_L
963d17ee83b6 • 1.7GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-q4_0
70c27162c440 • 1.8GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-q4_1
06bf51153a68 • 2.0GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-q4_K_S
1fa28e00cbb4 • 1.9GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-q4_K_M
ccf84fdfc568 • 2.0GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-q5_0
3464ae5d2e86 • 2.2GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-q5_1
94a7dc12e78b • 2.3GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-q5_K_S
bfb6bf6ca4d5 • 2.2GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-q5_K_M
8041d3346744 • 2.2GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-q6_K
d17defd35e78 • 2.5GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-q8_0
de9877798718 • 3.3GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-iq2_s
f47a215c4fb1 • 1.5GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-iq3_s
bb8fdf79f86b • 1.5GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-instruct-fp16
61b634d1ac74 • 6.2GB • 32K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-text-q2_K
2e90e827c406 • 1.4GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-text-q3_K_S
987862e467af • 1.5GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-text-q3_K_M
885de852370d • 1.7GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-text-q3_K_L
d065677736d6 • 1.8GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-text-q4_0
7d667b6cb615 • 1.9GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-text-q4_1
adb11beeff37 • 2.1GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-text-q4_K_S
555029d63ed1 • 1.9GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-text-q4_K_M
079f415f3188 • 2.0GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-text-q5_0
078926863fd4 • 2.3GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-text-q5_1
da8da07ba799 • 2.4GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-text-q5_K_S
406cee88f7ea • 2.3GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-text-q5_K_M
a944b8c554a4 • 2.3GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-text-q6_K
e4c15f5ec3a0 • 2.6GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-text-q8_0
1b1bbc4855a8 • 3.4GB • 128K context window •
Text input • 1 year ago
unsloth-llama3.2:3b-text-fp16
80c5862d26d9 • 6.4GB • 128K context window •
Text input • 1 year ago