23 1 year ago

Llama3-70B-EnSecAI-Ru-Chat

tools

1 year ago

7a28ac8b844c · 141GB ·

llama
·
70.6B
·
F16
{{ if .Messages }} {{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{- if .Sys
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"

Readme

Fp16 (latest): HF i1-Q4_K_M: HF Q4_K_M: Quantized using Ollama

SOTA Russian model on MERA benchmark

Generation parameters: -temperature=0.6 -top_p=0.9