mannix/
llama3-12b:q3_k_s

375 1 year ago

Meta-Llama-3-12B-Instruct is a depth upscaling merge of llama3-8b from M. Labonne

1 year ago

97cb3289814a · 5.2GB ·

model
llama
·
11.5B
·
Q3_K_S
params
{ "num_keep": 24, "stop": [ "<|start_header_id|>", "<|end_header_id|>",
template
{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Pr

Readme

Meta-Llama-3-12B-Instruct is a depth upscaling merge of llama3-8b from M. Labonne

Quantized with imatrix using groups_merged.txt

https://huggingface.co/mlabonne/Meta-Llama-3-12B-Instruct