Ollama-CLI

ollama run SpeakLeash/bielik-7b-instruct-v0.1-gguf for other quants use Tags, e.g. ollama run SpeakLeash/bielik-7b-instruct-v0.1-gguf:Q8_0

To create your own version or with specific temperature or other args use docs: https://github.com/ollama/ollama/blob/main/docs/modelfile.md

Bielik-7B-Instruct-v0.1-GGUF

This repo contains GGUF format model files for SpeakLeash’s Bielik-7B-Instruct-v0.1. https://huggingface.co/speakleash/Bielik-7B-Instruct-v0.1-GGUF

DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!

Model description:

Developed by: SpeakLeash
Language: Polish
Model type: causal decoder-only
Quant from: Bielik-7B-Instruct-v0.1
Finetuned from: Bielik-7B-v0.1
License: CC BY NC 4.0 (non-commercial use)
Model ref: speakleash:e38140bea0d48f1218540800bbc67e89

Website: https://speakleash.org Hugging Face: https://huggingface.co/speakleash