granite3-dense

116.6K 9 months ago

The IBM Granite 2B and 8B models are designed to support tool-based use cases and support for retrieval augmented generation (RAG), streamlining code generation, translation and bug fixing.

tools 2b 8b

33 models

granite3-dense:latest
5c2e6f3112f4 • 1.6GB • 4K context window •
Text input • 9 months ago
granite3-dense:2b latest
5c2e6f3112f4 • 1.6GB • 4K context window •
Text input • 9 months ago
granite3-dense:8b
199456d876ee • 4.9GB • 4K context window •
Text input • 9 months ago
granite3-dense:2b-instruct-q2_K
2261d92d6175 • 1.0GB • 4K context window •
Text input • 9 months ago
granite3-dense:2b-instruct-q3_K_S
7c6af70b9f11 • 1.2GB • 4K context window •
Text input • 9 months ago
granite3-dense:2b-instruct-q3_K_M
c08ae454856c • 1.3GB • 4K context window •
Text input • 9 months ago
granite3-dense:2b-instruct-q3_K_L
201ccf1522e8 • 1.4GB • 4K context window •
Text input • 9 months ago
granite3-dense:2b-instruct-q4_0
dd4a07b9e1b7 • 1.5GB • 4K context window •
Text input • 9 months ago
granite3-dense:2b-instruct-q4_1
e12ad0fad2ad • 1.7GB • 4K context window •
Text input • 9 months ago
granite3-dense:2b-instruct-q4_K_S
0f87f54eb387 • 1.5GB • 4K context window •
Text input • 9 months ago
granite3-dense:2b-instruct-q4_K_M
5c2e6f3112f4 • 1.6GB • 4K context window •
Text input • 9 months ago
granite3-dense:2b-instruct-q5_0
db3fbcdec89b • 1.8GB • 4K context window •
Text input • 9 months ago
granite3-dense:2b-instruct-q5_1
bc5ed577d64f • 2.0GB • 4K context window •
Text input • 9 months ago
granite3-dense:2b-instruct-q5_K_S
be9d8efefd30 • 1.8GB • 4K context window •
Text input • 9 months ago
granite3-dense:2b-instruct-q5_K_M
dcace13d6d34 • 1.9GB • 4K context window •
Text input • 9 months ago
granite3-dense:2b-instruct-q6_K
7f374efdad9b • 2.2GB • 4K context window •
Text input • 9 months ago
granite3-dense:2b-instruct-q8_0
f35cd2e1e433 • 2.8GB • 4K context window •
Text input • 9 months ago
granite3-dense:2b-instruct-fp16
24e5c0a35f78 • 5.3GB • 4K context window •
Text input • 9 months ago
granite3-dense:8b-instruct-q2_K
2ea57f8bc8fd • 3.1GB • 4K context window •
Text input • 9 months ago
granite3-dense:8b-instruct-q3_K_S
4c5f0dba11a8 • 3.6GB • 4K context window •
Text input • 9 months ago
granite3-dense:8b-instruct-q3_K_M
c1a94d47b25c • 4.0GB • 4K context window •
Text input • 9 months ago
granite3-dense:8b-instruct-q3_K_L
c74b04a2513f • 4.3GB • 4K context window •
Text input • 9 months ago
granite3-dense:8b-instruct-q4_0
16473222519f • 4.7GB • 4K context window •
Text input • 9 months ago
granite3-dense:8b-instruct-q4_1
8a47472a11f2 • 5.1GB • 4K context window •
Text input • 9 months ago
granite3-dense:8b-instruct-q4_K_S
8fc1ce76b8f2 • 4.7GB • 4K context window •
Text input • 9 months ago
granite3-dense:8b-instruct-q4_K_M
199456d876ee • 4.9GB • 4K context window •
Text input • 9 months ago
granite3-dense:8b-instruct-q5_0
449cddb1864d • 5.6GB • 4K context window •
Text input • 9 months ago
granite3-dense:8b-instruct-q5_1
ae4ab94be005 • 6.1GB • 4K context window •
Text input • 9 months ago
granite3-dense:8b-instruct-q5_K_S
49055e666925 • 5.6GB • 4K context window •
Text input • 9 months ago
granite3-dense:8b-instruct-q5_K_M
e85361d1973c • 5.8GB • 4K context window •
Text input • 9 months ago
granite3-dense:8b-instruct-q6_K
ec258d53940b • 6.7GB • 4K context window •
Text input • 9 months ago
granite3-dense:8b-instruct-q8_0
f1466e70a7be • 8.7GB • 4K context window •
Text input • 9 months ago
granite3-dense:8b-instruct-fp16
d3a4062e339e • 16GB • 4K context window •
Text input • 9 months ago