mannix/
llama3-gradient

172 1 year ago

This model extends LLama-3 70B's context length from 8k to over 1m tokens. [I-Quants]

4 models

llama3-gradient:70b-instruct-1048k-iq2_xxs
6f9809573738 • 19GB • 1M context window •
Text input • 1 year ago
llama3-gradient:70b-instruct-1048k-iq2_xs
a273e2c2c579 • 21GB • 1M context window •
Text input • 1 year ago
llama3-gradient:70b-instruct-1048k-iq2_s
0087ebdee223 • 22GB • 1M context window •
Text input • 1 year ago
llama3-gradient:70b-instruct-1048k-iq4_xs
6775a945de09 • 38GB • 1M context window •
Text input • 1 year ago