rjmalagon/
falcon3:10b-instruct-bf16

8 8 months ago

Bfloat16 version of the Falcon 3 10B model.

8 months ago

3c392e2535b1 · 21GB ·

llama
·
10.3B
·
(!unknown_file_type 32!)
{{- range $i, $_ := .Messages }} {{- $last := eq (len (slice $.Messages $i)) 1 -}} <|{{ .Role }}|> {
Falcon 3 TII Falcon License December 2024 FalconLLM.tii.ae Introductory note This license is, in par
{ "stop": [ "<|system|>", "<|user|>", "<|end|>", "<|assistant|>"

Readme

Bfloat16 version of the Falcon 3 10B model. Requires Ollama >v0.5.5 and BF16 supporting GPU (native or BF16 to FP32 on the fly llama.cpp conversion)

Full model info at https://ollama.com/library/falcon3 and https://huggingface.co/tiiuae/Falcon3-10B-Instruct