vanilj/
llama3.1-70b-iquants:IQ2_XXS

163 1 year ago

Llama 3.1 70b IQs: IQ1_M, IQ2_M, IQ2_S, IQ2_XS, IQ2_XXS, IQ3_XS, IQ4_XS

tools
... /
params
56bb8bd477a5 · 96B
{
"stop": [
"<|start_header_id|>",
"<|end_header_id|>",
"<|eot_id|>"
]
}