mistral-openorca:7b-q4_K

mistral-openorca:7b-q4_K_S

170.4K Downloads Updated 1 year ago

Mistral OpenOrca is a 7 billion parameter model, fine-tuned on top of the Mistral 7B model using the OpenOrca dataset.

Updated 1 year ago

1 year ago

b8b68de9a6c0 · 4.1GB

model

archllama

parameters7.24B

quantizationQ4_K_S

4.1GB

template

{{- if .System }} <|im_start|>system {{ .System }}<|im_end|> {{- end }} <|im_start|>user {{ .Prompt

135B

params

{ "stop": [ "<|im_start|>", "<|im_end|>" ] }

58B

Readme

Mistral OpenOrca is a 7 billion parameter model, fine-tuned on top of the Mistral 7B model using the OpenOrca dataset.

HuggingFace Leaderboard evals place this model as leader for all models smaller than 30B at the release time, outperforming all other 7B and 13B models.

Usage

CLI

ollama run mistral-openorca "Why is the sky blue?"

API

curl -X POST http://localhost:11434/api/generate -d '{
  "model": "mistral-openorca",
  "prompt": "Why is the sky blue?"
}'

More information

HuggingFace repo