huihui_ai/mistral-small-abliterated:24b-instruct-2501-q5_K

huihui_ai/

mistral-small-abliterated:24b-instruct-2501-q5_K_M

6,140 Downloads Updated 10 months ago

Mistral Small 3 sets a new benchmark in the “small” Large Language Models category below 70B.

tools 24b

Updated 10 months ago

10 months ago

de9d076128c4 · 17GB ·

archllama

parameters23.6B

quantizationQ5_K_M

17GB

{{- range $index, $_ := .Messages }} {{- if eq .Role "system" }}[SYSTEM_PROMPT]{{ .Content }}[/SYSTE

695B

You are Mistral Small 3, a Large Language Model (LLM) created by Mistral AI, a French startup headqu

644B

Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

11kB

{ "temperature": 0.15 }

21B

This is an uncensored version of mistralai/Mistral-Small-24B-Instruct-2501 created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.