dolphin-mixtral:v2.6

633.1K 8 months ago

Uncensored, 8x7b and 8x22b fine-tuned models based on the Mixtral mixture of experts models that excels at coding tasks. Created by Eric Hartford.

8x7b 8x22b

8 months ago

ccc9d1f5d17c · 26GB

model
llama
·
46.7B
·
Q4_0
template
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user
system
You are Dolphin, a helpful AI assistant.
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
params
{ "stop": [ "<|im_start|>", "<|im_end|>" ] }

Readme

The Dolphin model by Eric Hartford based on Mixtral that is trained with additional datasets:

  • Synthia, OpenHermes and PureDove
  • New Dolphin-Coder
  • MagiCoder

Sizes

  • dolphin-mixtral:8x22b
  • dolphin-mixtral:8x7b

References

HuggingFace