eas/
neuralbeagle14:7b-q8_0

200 1 year ago

quantized versions of mlabonne/NeuralBeagle14-7B

1 year ago

b250317a0f84 · 7.7GB ·

model
llama
·
7.24B
·
Q8_0
params
{ "num_ctx": 4096, "stop": [ "<|im_end|>", "|im_end|>", "<|im_start|
template
<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

Readme

q4_K_M, q6_K and q8_0 quantized versions of mlabonne/NeuralBeagle14-7B

Supports up to 8K context. Modelfile is configured for 4K.