krith/
gemma-2-9b-it-abliterated

164 1 year ago

I-quants for gemma-2-9b-it-abliterated

Models

View all →

4 models

gemma-2-9b-it-abliterated:IQ3_M

4.5GB · 8K context window · Text · 1 year ago

gemma-2-9b-it-abliterated:IQ2_M

3.4GB · 8K context window · Text · 1 year ago

gemma-2-9b-it-abliterated:IQ3_XS

4.1GB · 8K context window · Text · 1 year ago

gemma-2-9b-it-abliterated:IQ4_XS

5.2GB · 8K context window · Text · 1 year ago

Readme

Created using GGUF files from https://huggingface.co/bartowski/gemma-2-9b-it-abliterated-GGUF