sam860/
gemma3:1b

102 1 month ago

Google's new small model

270m 1b

5 months ago

b491bd3989c6 · 1.0GB ·

model
gemma3
·
1000M
·
Q4_0
template
{{- range $i, $_ := .Messages }} {{- $last := eq (len (slice $.Messages $i)) 1 }} {{- if or (eq .Rol
params
{ "stop": [ "<end_of_turn>" ], "temperature": 1, "top_k": 64, "top_p": 0

Readme

Notes

Uploading Unsloth DynamicQuant2 versions for both the 1B and the new 270m Gemma 3 models. Unsloth’s DQ2 offers better accuracy, especially at higher quants, making these small models more capable.

The default latest, 1b, and 270m tags point to the official Quantization-Aware Trained (QAT) versions, which deliver near-fp16 performance even at smaller quants like Q4_0.

Description

Google’s Gemma 3: lightweight, multimodal models built from the same research as the Gemini family.

Key features include a large context window, multilingual support for over 140 languages, and strong performance for their size. These models can handle both text and image inputs to generate text outputs.

Ideal for on-device tasks, quick summarization, chatbots, and other resource-constrained environments where latency is critical.

References

gemma3-qat on HuggingFace

HuggingFace (Unlsoth-DQ2)

HuggingFace (qat-Unsloth-DQ2)