mannix/
llama3.1-70b

278 1 year ago

New state-of-the-art model from Meta available in 8B, 70B and 405B sizes

tools

34 models

llama3.1-70b:latest
97472d8625ca • 40GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:q2_k
8d01ec0a1da8 • 26GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:q3_k_s
8c70082b54c2 • 31GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:q3_k_m
7e1d37d33254 • 34GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:q3_k_l
2562e5ed065d • 37GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:q4_0
97472d8625ca • 40GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:q4_k_s
5c12fdc600ec • 40GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:q4_k_m
acc549c6f0a7 • 43GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:q5_0
48a20abf7be6 • 49GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:q5_k_s
b78174f36299 • 49GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:q5_k_m
0640520f72ee • 50GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:q6_k
7b1daa273147 • 58GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:q8_0
27dabcc1497b • 75GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:iq2_xs
e48232a28e5e • 21GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:iq2_s
97e5954a1183 • 22GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:iq3_xxs
fd1a566990dc • 27GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:iq3_xs
bff9db4444e4 • 29GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:iq3_s
27d003259729 • 31GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:iq4_xs
2413f9649000 • 38GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:iq4_nl
34e8277f1159 • 40GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:tools-q2_k
d40d13b9091f • 26GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:tools-q3_k_s
529177d61d4c • 31GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:tools-q3_k_m
15c0d61326b8 • 34GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:tools-q4_0
526b16a7d5f6 • 40GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:tools-q4_k_m
ad9a1802d505 • 43GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:tools-q5_0
192c0ffe2a1f • 49GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:tools-q5_k_s
c8843f415927 • 49GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:tools-q5_k_m
e1b5eb8a6c3b • 50GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:tools-q6_k
1ce2d1155b7d • 58GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:tools-q8_0
ef4c24092e3a • 75GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:tools-iq2_xs
6605aef93345 • 21GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:tools-iq3_s
fe1cc40aaf42 • 31GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:tools-iq4_xs
09edcec0973a • 38GB • 128K context window •
Text input • 1 year ago
llama3.1-70b:tools-iq4_nl
066a42abb5b1 • 40GB • 128K context window •
Text input • 1 year ago