vanilj/
llama-3-8b-instruct-32k-v0.1:Q4_K_S

231 1 year ago

Llama 3 8b 32k

1 year ago

2f71d9f7b4c5 · 4.7GB ·

model
llama
·
8.03B
·
Q4_K_S
params
{ "num_keep": 24, "stop": [ "<|start_header_id|>", "<|end_header_id|>",
template
{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Pr

Readme

These are the files from the repo MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF.