rscr/
llama3_70b_ru:i1-Q4_K_M

23 1 year ago

Llama3-70B-EnSecAI-Ru-Chat

tools

1 year ago

44c379f7bcf6 · 43GB ·

model
llama
·
70.6B
·
Q4_K_M
params
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"
template
{{ if .Messages }} {{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{- if .Sys

Readme

Fp16 (latest): HF i1-Q4_K_M: HF Q4_K_M: Quantized using Ollama

SOTA Russian model on MERA benchmark

Generation parameters: -temperature=0.6 -top_p=0.9