Llama-3.1-Tulu-3-8B

Tülu3 is a leading instruction following model family, offering fully open-source data, code, and recipes designed to serve as a comprehensive guide for modern post-training techniques. Tülu3 is designed for state-of-the-art performance on a diversity of tasks in addition to chat, such as MATH, GSM8K, and IFEval.

Model description

• Model type: A model trained on a mix of publicly available, synthetic and human-created datasets.
• Language(s) (NLP): Primarily English
• License: Llama 3.1 Community License Agreement
• Finetuned from model: allenai/Llama-3.1-Tulu-3-8B-DPO

Model Sources

• Training Repository: https://github.com/allenai/open-instruct
• Eval Repository: https://github.com/allenai/olmes
• Paper: https://arxiv.org/abs/2411.15124
• Demo: https://playground.allenai.org/

These i-quants are provided courtesy of mradermacher.