krith/
mistral-small-instruct-2409:IQ4_XS

172 1 year ago

I-quants for mistral-small-instruct-2409

tools

1 year ago

58137b3aab92 · 12GB ·

model
llama
·
22.2B
·
IQ1_M
template
{{- if .Messages }} {{- range $index, $_ := .Messages }} {{- if eq .Role "user" }} {{- if and (le (l
license
# Mistral AI Research License If You want to use a Mistral Model, a Derivative or an Output for any
params
{ "stop": [ "[INST]", "[/INST]" ] }

Readme

Created using GGUF files from https://huggingface.co/bartowski/Mistral-Small-Instruct-2409-GGUF