ifioravanti/
bagel-hermes:2x34b-q4_0

21 1 year ago

1 year ago

8ca5f88a32d1 · 34GB ·

model
llama
·
60.8B
·
Q4_0
params
{ "num_ctx": 32768, "stop": [ "<|im_start|>", "<|im_end|>" ] }
template
<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

Readme

image

CLI

ollama run ifioravanti/bagel-hermes:2x34b-q6_k

API

Example:

curl -X POST http://localhost:11434/api/generate -d '{ 
  "model": "ifioravanti/bagel-hermes:2x34b-q6_k",
  "prompt": "Here is a story about llamas eating grass"
 }'

References

Hugging Face