rouge/
wizardlm-2-7b-abliterated:Q4_K_M

376 1 year ago

This is the WizardLM-2-7B model with orthogonalized bfloat16 safetensor weights, based on the implementation by @failspy

1 year ago

af1e1e698bc2 · 4.4GB ·

model
llama
·
7.24B
·
Q4_K_M
system
You are a highly capable AI assistant designed to help users to the best of your abilities. Your int
params
{ "stop": [ "USER", "ASSISTANT" ], "temperature": 0.6 }
template
{{ if .System }}{{ .System }} {{ end }}{{ if .Prompt }}USER: {{ .Prompt }} {{ end }}ASSISTANT: {{ .R

Readme

WizardLM-2-7B-abliterated

This is the WizardLM-2-7B model with orthogonalized bfloat16 safetensor weights, based on the implementation by @failspy. For more info:

GGUF Files

GGUF files here: https://huggingface.co/fearlessdots/WizardLM-2-7B-abliterated-GGUF