Q

@quant_lab

Member since 2025-09 · 4 adapters · 20,813 total downloads

Published adapters

Mistral 7B Coder (GGUF Q5) sample output
code public

Mistral 7B Coder (GGUF Q5)

mistralai/Mistral-7B-Instruct-v0.3

v1.0.0 gguf 5120 MiB
Llama 3 8B Instruct (GGUF Q4) sample output
text-generation public

Llama 3 8B Instruct (GGUF Q4)

meta-llama/Meta-Llama-3-8B-Instruct

v1.0.0 gguf 4800 MiB
Gemma 2 9B (GGUF Q4) sample output
text-generation public

Gemma 2 9B (GGUF Q4)

google/gemma-2-9b-it

v1.0.0 gguf 5600 MiB
Qwen2.5 14B (GGUF Q4) sample output
text-generation public

Qwen2.5 14B (GGUF Q4)

Qwen/Qwen2.5-14B-Instruct

v1.0.0 gguf 8960 MiB