axolotl-ai-co/romulus-mistral-nemo-12b-simpo finetuned on jondurbin/gutenberg-dpo-v0.1

tools

Updated 1 year ago

1 year ago

e2067c2ab4c0 · 10GB ·

archllama

parameters12.2B

quantizationQ6_K

10GB

{{- range $i, $_ := .Messages }} {{- if eq .Role "user" }} {{- if and $.Tools (le (len (slice $.Mess

688B

Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

11kB

{ "stop": [ "[INST]", "[/INST]" ] }

30B

Readme

Finetuned using an A100 on Google Colab for 1 epoch.