krith/
llama-3.3-70b-instruct

459 10 months ago

I-quants for llama-3.3-70b-instruct

tools

Models

View all →

11 models

llama-3.3-70b-instruct:IQ3_M

32GB · 128K context window · Text · 11 months ago

llama-3.3-70b-instruct:IQ1_S

15GB · 128K context window · Text · 10 months ago

llama-3.3-70b-instruct:IQ1_M

17GB · 128K context window · Text · 10 months ago

llama-3.3-70b-instruct:IQ2_XXS

19GB · 128K context window · Text · 10 months ago

llama-3.3-70b-instruct:IQ2_XS

21GB · 128K context window · Text · 11 months ago

llama-3.3-70b-instruct:IQ2_S

22GB · 128K context window · Text · 11 months ago

llama-3.3-70b-instruct:IQ2_M

24GB · 128K context window · Text · 11 months ago

llama-3.3-70b-instruct:IQ3_XXS

27GB · 128K context window · Text · 11 months ago

llama-3.3-70b-instruct:IQ3_XS

29GB · 128K context window · Text · 11 months ago

llama-3.3-70b-instruct:IQ3_S

31GB · 128K context window · Text · 11 months ago

llama-3.3-70b-instruct:IQ4_XS

38GB · 128K context window · Text · 11 months ago

Readme

Created using GGUF files from https://huggingface.co/ThomasBaruzier/Llama-3.3-70B-Instruct-GGUF