mannix/
llama3.1-8b

132 1 year ago

New state-of-the-art model from Meta available in 8B, 70B and 405B sizes.

tools

41 models

llama3.1-8b:latest
885c3c5eb985 • 4.7GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:q2_k
2ad66026e41b • 3.2GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:q3_k_s
f3cdd952222f • 3.7GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:q3_k_m
e7e336cc5357 • 4.0GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:q3_k_l
33e1f370a85e • 4.3GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:q4_0
885c3c5eb985 • 4.7GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:q4_1
771d557349e0 • 5.1GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:q4_k_s
2b5830ad7ab6 • 4.7GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:q4_k_m
d05515115059 • 4.9GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:q5_0
73183a0bfce3 • 5.6GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:q5_1
2470a4bdcca5 • 6.1GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:q5_k_s
26e709023e52 • 5.6GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:q5_k_m
6728a24d6ec4 • 5.7GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:q6_k
31b353b1a9cf • 6.6GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:q8_0
0505708bd3e6 • 8.5GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:iq3_xxs
bbe7798242a4 • 3.3GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:iq3_xs
eeacbf00decc • 3.5GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:iq3_s
6023f801a6c8 • 3.7GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:iq4_xs
116f5b67fb4e • 4.4GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:iq4_nl
25fd6f8ef9bd • 4.7GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:fp16
2226598f5b1d • 16GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-q3_k_s
680626e9793b • 3.7GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-q3_k_m
a97b4aee751e • 4.0GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-q3_k_l
4c441fe59bcd • 4.3GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-q4_0
9ea9f665cf53 • 4.7GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-q4_1
771d557349e0 • 5.1GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-q4_k_s
2b5830ad7ab6 • 4.7GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-q4_k_m
d05515115059 • 4.9GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-q5_0
95fe1c1d7ef8 • 5.6GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-q5_1
2470a4bdcca5 • 6.1GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-q5_k_s
26e709023e52 • 5.6GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-q5_k_m
f55cf351453c • 5.7GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-q6_k
31b353b1a9cf • 6.6GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-q8_0
0505708bd3e6 • 8.5GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-iq2_s
a25ff0b3184e • 2.8GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-iq3_xxs
bbe7798242a4 • 3.3GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-iq3_xs
eeacbf00decc • 3.5GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-iq3_s
6023f801a6c8 • 3.7GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-iq4_xs
116f5b67fb4e • 4.4GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-iq4_nl
25fd6f8ef9bd • 4.7GB • 128K context window •
Text input • 1 year ago
llama3.1-8b:tools-fp16
2226598f5b1d • 16GB • 128K context window •
Text input • 1 year ago