eas/
capytessborosyi-34b-200k-dare-ties:4_K_M

167 1 year ago

q3_K_M and q4_K_M configured with 10k context

1 year ago

e94962e27fc2 · 21GB ·

model
llama
·
34.4B
·
Q4_K_M
template
SYSTEM: {{ .System }} USER: {{ .Prompt }} ASSISTANT:
params
{ "num_ctx": 5125, "stop": [ "</s>" ] }

Readme

Merge of NousResearch/Nous-Capybara-34B, migtissera/Tess-M-v1.3 and bhenrym14/airoboros-3_1-yi-34b-200k, because why not?

Original brucethemoose/CapyTessBorosYi-34B-200K-DARE-Ties