nemotron-mini

102.9K 11 months ago

A commercial-friendly small language model by NVIDIA optimized for roleplay, RAG QA, and function calling.

tools 4b

17 models

nemotron-mini:latest
ed76ab18784f • 2.7GB • 4K context window •
Text input • 11 months ago
nemotron-mini:4b latest
ed76ab18784f • 2.7GB • 4K context window •
Text input • 11 months ago
nemotron-mini:4b-instruct-q2_K
71c1aed58cc4 • 1.9GB • 4K context window •
Text input • 11 months ago
nemotron-mini:4b-instruct-q3_K_S
28cabdeeb76e • 2.1GB • 4K context window •
Text input • 11 months ago
nemotron-mini:4b-instruct-q3_K_M
91b07164ba46 • 2.3GB • 4K context window •
Text input • 11 months ago
nemotron-mini:4b-instruct-q3_K_L
899020cd5b1e • 2.5GB • 4K context window •
Text input • 11 months ago
nemotron-mini:4b-instruct-q4_0
041bd339f71f • 2.6GB • 4K context window •
Text input • 11 months ago
nemotron-mini:4b-instruct-q4_1
715f0114b145 • 2.8GB • 4K context window •
Text input • 11 months ago
nemotron-mini:4b-instruct-q4_K_S
59f3d2ea76f8 • 2.6GB • 4K context window •
Text input • 11 months ago
nemotron-mini:4b-instruct-q4_K_M
ed76ab18784f • 2.7GB • 4K context window •
Text input • 11 months ago
nemotron-mini:4b-instruct-q5_0
e5f64c7116d1 • 3.0GB • 4K context window •
Text input • 11 months ago
nemotron-mini:4b-instruct-q5_1
8c244be13dfe • 3.2GB • 4K context window •
Text input • 11 months ago
nemotron-mini:4b-instruct-q5_K_S
072f4b7daa17 • 3.0GB • 4K context window •
Text input • 11 months ago
nemotron-mini:4b-instruct-q5_K_M
9e36e563dbdd • 3.1GB • 4K context window •
Text input • 11 months ago
nemotron-mini:4b-instruct-q6_K
4cf36901911e • 3.4GB • 4K context window •
Text input • 11 months ago
nemotron-mini:4b-instruct-q8_0
fe86a4d04f9f • 4.5GB • 4K context window •
Text input • 11 months ago
nemotron-mini:4b-instruct-fp16
d0d806e9853c • 8.4GB • 4K context window •
Text input • 11 months ago