#q4

3 adapters tagged #q4.

Related tags: #gguf #offline #multilingual #14b #google #llama3 #gemma2 #edge #qwen25

text-generation public

Llama 3 8B Instruct (GGUF Q4)

meta-llama/Meta-Llama-3-8B-Instruct

by @quant_lab

v1.0.0 gguf 4800 MiB

text-generation public

Gemma 2 9B (GGUF Q4)

google/gemma-2-9b-it

by @quant_lab

v1.0.0 gguf 5600 MiB

text-generation public

Qwen2.5 14B (GGUF Q4)

Qwen/Qwen2.5-14B-Instruct

by @quant_lab

v1.0.0 gguf 8960 MiB