krith/phi-3.5-mini-instruct:IQ4

krith/

phi-3.5-mini-instruct:IQ4_XS

80 Downloads Updated 1 year ago

I-quants for phi-3.5-mini-instruct

Updated 1 year ago

1 year ago

f5a6d09113b6 · 2.1GB ·

archphi3

parameters3.82B

quantizationIQ1_M

2.1GB

MIT License Copyright (c) Upstage Corporation. Permission is hereby granted, free of charge, to any

1.1kB

{ "stop": [ "<|system|>", "<|user|>", "<|end|>", "<|assistant|>"

101B

{{ if .System }}<|system|> {{ .System }}<|end|> {{ end }}{{ if .Prompt }}<|user|> {{ .Prompt }}<|end

148B