mannix/
smaug-qwen2-72b

173 1 year ago

The latest in the Smaug series - a finetune of Qwen2-72B-Instruct

21 models

smaug-qwen2-72b:latest
9327c58886f6 • 41GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:q2_k
fa47aaaf00fe • 30GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:q3_k_s
76ee733dc74a • 34GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:q3_k_m
9e2b066ef95b • 38GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:q3_k_l
0d8451ad64d0 • 40GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:q4_0
9327c58886f6 • 41GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:q4_1
55ae87d2953e • 46GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:q4_k_s
27bbbcbad044 • 44GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:q5_0
67b3eacee74d • 50GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:q5_1
d0a11d64fb02 • 55GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:q5_k_s
f8ac3195a552 • 51GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:q6_k
f9329bac654b • 64GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:q8_0
f1889deae6de • 77GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:iq2_xxs
8f1e7be3c073 • 25GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:iq2_xs
a0063920f6bf • 27GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:iq2_s
24c9b2d7c2f1 • 28GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:iq3_xxs
8d92419d24e4 • 32GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:iq3_xs
2f5bf5713f7d • 33GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:iq3_s
de077a3c2d03 • 34GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:iq4_xs
4c3908417cc0 • 40GB • 32K context window •
Text input • 1 year ago
smaug-qwen2-72b:iq4_nl
5f7f7e6a9c48 • 41GB • 32K context window •
Text input • 1 year ago