mannix/
mixtral_7bx2_moe

298 1 year ago

A high-quality Mixture of Experts (MoE) model with open weights by Mistral AI.

11 models

mixtral_7bx2_moe:latest
d4fc0fbae959 • 7.3GB • 32K context window •
Text input • 1 year ago
mixtral_7bx2_moe:q2_K
353f1266e0bf • 4.8GB • 32K context window •
Text input • 1 year ago
mixtral_7bx2_moe:q3_K_S
e4d505eb3a09 • 5.6GB • 32K context window •
Text input • 1 year ago
mixtral_7bx2_moe:q3_K_M
413ee467e6d6 • 6.2GB • 32K context window •
Text input • 1 year ago
mixtral_7bx2_moe:q3_K_L
722127437881 • 6.7GB • 32K context window •
Text input • 1 year ago
mixtral_7bx2_moe:q4_0
d4fc0fbae959 • 7.3GB • 32K context window •
Text input • 1 year ago
mixtral_7bx2_moe:q4_K_S
3c77ca46dd3c • 7.3GB • 32K context window •
Text input • 1 year ago
mixtral_7bx2_moe:q4_K_M
d7c879acdb3b • 7.8GB • 32K context window •
Text input • 1 year ago
mixtral_7bx2_moe:q5_K_S
c50d8f6bf633 • 8.9GB • 32K context window •
Text input • 1 year ago
mixtral_7bx2_moe:q5_K_M
f2b2f7550941 • 9.1GB • 32K context window •
Text input • 1 year ago
mixtral_7bx2_moe:q6_K
5976bcc19094 • 11GB • 32K context window •
Text input • 1 year ago