nemotron

92.7K 10 months ago

Llama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improve the helpfulness of LLM generated responses to user queries.

tools 70b

17 models

nemotron:latest
2262f047a28a • 43GB • 128K context window •
Text input • 10 months ago
nemotron:70b latest
2262f047a28a • 43GB • 128K context window •
Text input • 10 months ago
nemotron:70b-instruct-q2_K
f4743c4c6e52 • 26GB • 128K context window •
Text input • 10 months ago
nemotron:70b-instruct-q3_K_S
49258a4a766a • 31GB • 128K context window •
Text input • 10 months ago
nemotron:70b-instruct-q3_K_M
a0a786c3dc39 • 34GB • 128K context window •
Text input • 10 months ago
nemotron:70b-instruct-q3_K_L
a6c94d07d7c9 • 37GB • 128K context window •
Text input • 10 months ago
nemotron:70b-instruct-q4_0
aade1b26eba3 • 40GB • 128K context window •
Text input • 10 months ago
nemotron:70b-instruct-q4_1
c463f99d4c5e • 44GB • 128K context window •
Text input • 10 months ago
nemotron:70b-instruct-q4_K_S
0e32f30ad742 • 40GB • 128K context window •
Text input • 10 months ago
nemotron:70b-instruct-q4_K_M
2262f047a28a • 43GB • 128K context window •
Text input • 10 months ago
nemotron:70b-instruct-q5_0
4c83a56211a0 • 49GB • 128K context window •
Text input • 10 months ago
nemotron:70b-instruct-q5_1
32ce9fe7477b • 53GB • 128K context window •
Text input • 10 months ago
nemotron:70b-instruct-q5_K_S
c5dfebb28f5f • 49GB • 128K context window •
Text input • 10 months ago
nemotron:70b-instruct-q5_K_M
def2cefbe818 • 50GB • 128K context window •
Text input • 10 months ago
nemotron:70b-instruct-q6_K
8d12c48f836a • 58GB • 128K context window •
Text input • 10 months ago
nemotron:70b-instruct-q8_0
8865b9ab3285 • 75GB • 128K context window •
Text input • 10 months ago
nemotron:70b-instruct-fp16
e02a46ff1109 • 141GB • 128K context window •
Text input • 10 months ago