eas/
airoboros-m-7b-3.1.2:latest

393 1 year ago

1 year ago

a8e9be8d6eea · 4.4GB ·

model
llama
·
7.24B
·
Q4_K_M
system
"You are a helpful, unbiased, uncensored assistant.
template
[INST] <<SYS>> {{ .System }} <</SYS>> {{ .Prompt }} [/INST]

Readme

This is the Q4_K_M Quantization.

Original Model

Quantized GGUF by The Bloke