rscr/
llama3_70b_ru

23 1 year ago

Llama3-70B-EnSecAI-Ru-Chat

tools

Models

View all →

3 models

llama3_70b_ru:latest

141GB · 8K context window · Text · 1 year ago

llama3_70b_ru:Q4_K_M

43GB · 8K context window · Text · 1 year ago

llama3_70b_ru:i1-Q4_K_M

43GB · 8K context window · Text · 1 year ago

Readme

Fp16 (latest): HF i1-Q4_K_M: HF Q4_K_M: Quantized using Ollama

SOTA Russian model on MERA benchmark

Generation parameters: -temperature=0.6 -top_p=0.9