for low precision
-
kaitchup/Phi-3-mini-4k-instruct-gptq-4bit
Text Generation β’ Updated β’ 64 -
Qwen/Qwen1.5-0.5B-Chat-AWQ
Text Generation β’ Updated β’ 3.88k β’ 5 -
unsloth/mistral-7b-instruct-v0.2-bnb-4bit
Text Generation β’ Updated β’ 98.3k β’ 25 -
TheBloke/SOLAR-10.7B-Instruct-v1.0-AWQ
Text Generation β’ Updated β’ 348 β’ 4