vanilj/
llama-3-8b-instruct-32k-v0.1

231 1 year ago

Llama 3 8b 32k

Models

View all →

11 models

llama-3-8b-instruct-32k-v0.1:latest

4.9GB · 31K context window · Text · 1 year ago

llama-3-8b-instruct-32k-v0.1:Q2_K

3.2GB · 31K context window · Text · 1 year ago

llama-3-8b-instruct-32k-v0.1:Q3_K_S

3.7GB · 31K context window · Text · 1 year ago

llama-3-8b-instruct-32k-v0.1:Q3_K_M

4.0GB · 31K context window · Text · 1 year ago

llama-3-8b-instruct-32k-v0.1:Q3_K_L

4.3GB · 31K context window · Text · 1 year ago

llama-3-8b-instruct-32k-v0.1:Q4_K_S

4.7GB · 31K context window · Text · 1 year ago

llama-3-8b-instruct-32k-v0.1:Q4_K_M

4.9GB · 31K context window · Text · 1 year ago

llama-3-8b-instruct-32k-v0.1:Q5_K_S

5.6GB · 31K context window · Text · 1 year ago

llama-3-8b-instruct-32k-v0.1:Q5_K_M

5.7GB · 31K context window · Text · 1 year ago

llama-3-8b-instruct-32k-v0.1:Q6_K

6.6GB · 31K context window · Text · 1 year ago

llama-3-8b-instruct-32k-v0.1:Q8_0

8.5GB · 31K context window · Text · 1 year ago

Readme

These are the files from the repo MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF.