mannix/
llama3-12b

375 1 year ago

Meta-Llama-3-12B-Instruct is a depth upscaling merge of llama3-8b from M. Labonne

22 models

llama3-12b:latest
e0c119d95b71 • 6.6GB • 8K context window •
Text input • 1 year ago
llama3-12b:q2_k
0a8f93ca7b66 • 4.5GB • 8K context window •
Text input • 1 year ago
llama3-12b:q3_k_s
97cb3289814a • 5.2GB • 8K context window •
Text input • 1 year ago
llama3-12b:q3_k_m
b9372eae00ad • 5.7GB • 8K context window •
Text input • 1 year ago
llama3-12b:q3_k_l
3978e41a6ba8 • 6.2GB • 8K context window •
Text input • 1 year ago
llama3-12b:q4_0
e0c119d95b71 • 6.6GB • 8K context window •
Text input • 1 year ago
llama3-12b:q4_1
dae37e580f01 • 7.3GB • 8K context window •
Text input • 1 year ago
llama3-12b:q4_k_s
33d25c018340 • 6.7GB • 8K context window •
Text input • 1 year ago
llama3-12b:q4_k_m
79a32fda0a89 • 7.0GB • 8K context window •
Text input • 1 year ago
llama3-12b:q5_0
83ab16e5e660 • 8.0GB • 8K context window •
Text input • 1 year ago
llama3-12b:q5_1
d05052525020 • 8.7GB • 8K context window •
Text input • 1 year ago
llama3-12b:q5_k_s
885781ecc54c • 8.0GB • 8K context window •
Text input • 1 year ago
llama3-12b:q5_k_m
55889883bfcf • 8.2GB • 8K context window •
Text input • 1 year ago
llama3-12b:q6_k
eba84d69b546 • 9.5GB • 8K context window •
Text input • 1 year ago
llama3-12b:q8_0
78207d18d578 • 12GB • 8K context window •
Text input • 1 year ago
llama3-12b:iq2_xxs
327bb229e46c • 3.3GB • 8K context window •
Text input • 1 year ago
llama3-12b:iq2_xs
a8f409600753 • 3.6GB • 8K context window •
Text input • 1 year ago
llama3-12b:iq2_s
ab100bc8cdd0 • 3.8GB • 8K context window •
Text input • 1 year ago
llama3-12b:iq3_xxs
18f8949884e5 • 4.6GB • 8K context window •
Text input • 1 year ago
llama3-12b:iq3_s
2cdb3df959e5 • 5.2GB • 8K context window •
Text input • 1 year ago
llama3-12b:iq4_xs
fc13bbde7661 • 6.3GB • 8K context window •
Text input • 1 year ago
llama3-12b:iq4_nl
ffaeb70f71f0 • 6.6GB • 8K context window •
Text input • 1 year ago