rjmalagon/
granite3.2:8b-instruct-bf16

18 7 months ago

Bfloat16 version of the Granite3 dense 8B instruct model.

tools

7 months ago

127d69371a35 · 16GB ·

model
granite
·
8.17B
·
(!unknown_file_type 32!)
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
template
{{- /* ------ MESSAGE PARSING ------ */}} {{- /* Declare the prompt structure variables to be filled

Readme

Bfloat16 version of the Granite3 dense 8B instruct model. Requires Ollama >v0.5.5 and BF16 supporting GPU (native or BF16 to FP32 on the fly llama.cpp conversion)

Full model info at https://ollama.com/library/granite3.2