krith/
meta-llama-3.1-70b-instruct-abliterated

270 1 year ago

I-quants for meta-llama-3.1-70b-instruct-abliterated

tools

Models

View all →

6 models

meta-llama-3.1-70b-instruct-abliterated:IQ3_M

32GB · 128K context window · Text · 1 year ago

meta-llama-3.1-70b-instruct-abliterated:IQ2_XXS

19GB · 128K context window · Text · 1 year ago

meta-llama-3.1-70b-instruct-abliterated:IQ2_XS

21GB · 128K context window · Text · 1 year ago

meta-llama-3.1-70b-instruct-abliterated:IQ2_M

24GB · 128K context window · Text · 1 year ago

meta-llama-3.1-70b-instruct-abliterated:IQ3_XXS

27GB · 128K context window · Text · 1 year ago

meta-llama-3.1-70b-instruct-abliterated:IQ4_XS

38GB · 128K context window · Text · 1 year ago

Readme

Created using GGUF files from https://huggingface.co/bartowski/Llama-3.1-70B-Instruct-lorablated-GGUF