myaniu/
qwen2.5-1m:14b-instruct-q8_0

116.7K 10 months ago

Qwen2.5-7B/14B-Instruct-1M

tools 7b 14b

10 months ago

2e6405757f68 · 16GB ·

model
qwen2
·
14.8B
·
Q8_0
params
{ "num_ctx": 131072, "temperature": 0.5, "top_p": 0.95 }
system
You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
template
{{- if .Suffix }}<|fim_prefix|>{{ .Prompt }}<|fim_suffix|>{{ .Suffix }}<|fim_middle|> {{- else if .M

Readme

Model creator: Qwen

Original model: Qwen2.5-7B-Instruct-1M

GGUF quantization: provided by bartowski based on llama.cpp release b4546

FROM https://huggingface.co/lmstudio-community/Qwen2.5-7B-Instruct-1M-GGUF