notux:8x7b

34.5K 1 year ago

A top-performing mixture of experts model, fine-tuned with high-quality data.

8x7b

1 year ago

fe14e7d66184 · 26GB

model
llama
·
46.7B
·
Q4_0
template
[INST] {{ .System }} {{ .Prompt }} [/INST]
license
MIT License Copyright (c) [year] [fullname] Permission is hereby granted, free of charge, to any per
params
{ "stop": [ "[INST]", "[/INST]" ] }

Readme

This model is a fine-tuned version of Mixtral using a high-quality, curated dataset. As of Dec 26th 2023, this model is the top ranked MoE (Mixture of Experts) model on the Hugging Face Open LLM Leaderboard.

References

HuggingFace

Argilla