granite3.1-dense

116.2K 7 months ago

The IBM Granite 2B and 8B models are text-only dense LLMs trained on over 12 trillion tokens of data, demonstrated significant improvements over their predecessors in performance and speed in IBM’s initial testing.

tools 2b 8b

33 models

granite3.1-dense:latest
34d3be74ec54 • 5.0GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:2b
fba1ad01113e • 1.6GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:8b latest
34d3be74ec54 • 5.0GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:2b-instruct-q2_K
f412eb659c66 • 1.0GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:2b-instruct-q3_K_S
74791f52899c • 1.2GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:2b-instruct-q3_K_M
d65eb61a1e65 • 1.3GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:2b-instruct-q3_K_L
85ad99cb9a18 • 1.4GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:2b-instruct-q4_0
7ed050a70760 • 1.5GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:2b-instruct-q4_1
c265a649f4f8 • 1.6GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:2b-instruct-q4_K_S
a8d7602ade5f • 1.5GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:2b-instruct-q4_K_M
fba1ad01113e • 1.6GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:2b-instruct-q5_0
f26890da1451 • 1.8GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:2b-instruct-q5_1
35c067239cb5 • 1.9GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:2b-instruct-q5_K_S
1a2b39f6e69c • 1.8GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:2b-instruct-q5_K_M
86cdcdb94cd6 • 1.8GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:2b-instruct-q6_K
66d07595e1dc • 2.1GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:2b-instruct-q8_0
ef1441680161 • 2.7GB • 128K context window •
Text input • 8 months ago
granite3.1-dense:2b-instruct-fp16
1f64b4541957 • 5.1GB • 128K context window •
Text input • 8 months ago
granite3.1-dense:8b-instruct-q2_K
4b18119a5086 • 3.2GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:8b-instruct-q3_K_S
338340c340cb • 3.6GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:8b-instruct-q3_K_M
0dc5c3ac8a1e • 4.0GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:8b-instruct-q3_K_L
8f28ec28aafc • 4.4GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:8b-instruct-q4_0
fc2c18155205 • 4.7GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:8b-instruct-q4_1
a94882d992cf • 5.2GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:8b-instruct-q4_K_S
4707086b3bed • 4.7GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:8b-instruct-q4_K_M
34d3be74ec54 • 5.0GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:8b-instruct-q5_0
3ec7544ebcb8 • 5.7GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:8b-instruct-q5_1
5f3faea362a7 • 6.2GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:8b-instruct-q5_K_S
8c98cd3dd70e • 5.7GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:8b-instruct-q5_K_M
4ae40e965ca7 • 5.8GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:8b-instruct-q6_K
8e5691d17175 • 6.8GB • 128K context window •
Text input • 7 months ago
granite3.1-dense:8b-instruct-q8_0
fd5499afc361 • 8.7GB • 128K context window •
Text input • 8 months ago
granite3.1-dense:8b-instruct-fp16
51d4ae6e2b23 • 16GB • 128K context window •
Text input • 8 months ago