krith/
meta-llama-3.1-8b-instruct-abliterated

175 1 year ago

I-quants for meta-llama-3.1-8b-instruct-abliterated

tools

Models

View all →

4 models

meta-llama-3.1-8b-instruct-abliterated:IQ3_M

3.8GB · 128K context window · Text · 1 year ago

meta-llama-3.1-8b-instruct-abliterated:IQ2_M

2.9GB · 128K context window · Text · 1 year ago

meta-llama-3.1-8b-instruct-abliterated:IQ3_XS

3.5GB · 128K context window · Text · 1 year ago

meta-llama-3.1-8b-instruct-abliterated:IQ4_XS

4.4GB · 128K context window · Text · 1 year ago

Readme

Created using GGUF files from https://huggingface.co/bartowski/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF