driftfurther/ gemma3-unsloth:4b

406 1 year ago

gemma3 with unsloth recommended settings, context window fitting into 24GB VRAM

vision 4b 12b
... /
params
898e6e7d29a7 · 122B
{
"min_p": 0,
"num_ctx": 12000,
"repeat_penalty": 1,
"stop": [
"<end_of_turn>"
],
"temperature": 1,
"top_k": 64,
"top_p": 0.95
}