cas/
mixtral_11bx2_moe:latest

169 1 year ago

from TheBloke/Mixtral_11Bx2_MoE_19B-GGUF

1 year ago

02707069aa46 · 11GB ·

model
llama
·
19.2B
·
Q4_K_M
system
You are YiMoeMixtral, a helpful AI assistant.
params
{ "num_ctx": 8192, "stop": [ "### Input", "### Response" ] }
template
{{ if and .First .System }}### Instruction: {{ .System }} {{ end }} ### Input: {{ .Prompt }} ### Res

Readme

MoE of

kyujinpy/Sakura-SOLAR-Instruct

jeonsworld/CarbonVillain-en-10.7B-v1

from https://huggingface.co/cloudyu/Mixtral_11Bx2_MoE_19B

supposedly well performing cf. https://www.reddit.com/r/LocalLLaMA/comments/1916896/llm_comparisontest_confirm_leaderboard_big_news/

(in my first experiments not performing well though, maybe other template?)