mannix/
smaug-llama3-8b

305 1 year ago

This model was built using the Smaug recipe for improving performance on real world multi-turn conversations applied to meta-llama/Meta-Llama-3-8B-Instruct.

22 models

smaug-llama3-8b:latest
cf834f6d7941 • 4.7GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:q2_k
954542c98b4a • 3.2GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:q3_k_s
ef8beebd5903 • 3.7GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:q3_k_m
fa8551083e02 • 4.0GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:q3_k_l
7814aeba1a08 • 4.3GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:q4_0
cf834f6d7941 • 4.7GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:q4_1
b0e9b6998fd7 • 5.1GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:q4_k_s
7cb8a82d6123 • 4.7GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:q4_k_m
175fcd282d79 • 4.9GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:q5_0
d1a149118453 • 5.6GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:q5_1
07e4b1174204 • 6.1GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:q5_k_s
47c7cf819c7b • 5.6GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:q5_k_m
4c2c1e8e09e9 • 5.7GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:q6_k
1a9e7f1510ca • 6.6GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:q8_0
f0317901c8fe • 8.5GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:iq2_xxs
ae891636e467 • 2.4GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:iq2_xs
9d700c5032a1 • 2.6GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:iq2_s
e3b5eada00d7 • 2.8GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:iq3_xxs
865352eed7df • 3.3GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:iq3_s
1b7bd120e4ee • 3.7GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:iq4_xs
3a22b93daaf9 • 4.4GB • 8K context window •
Text input • 1 year ago
smaug-llama3-8b:iq4_nl
115b5d9c8596 • 4.7GB • 8K context window •
Text input • 1 year ago