#offline

3 adapters tagged #offline.

Related tags: #gguf #q4 #mistral #google #llama3 #gemma2 #code #edge #q5

text-generation public

Llama 3 8B Instruct (GGUF Q4)

meta-llama/Meta-Llama-3-8B-Instruct

by @quant_lab

v1.0.0 gguf 4800 MiB

text-generation public

Gemma 2 9B (GGUF Q4)

google/gemma-2-9b-it

by @quant_lab

v1.0.0 gguf 5600 MiB

Mistral 7B Coder (GGUF Q5)

mistralai/Mistral-7B-Instruct-v0.3

by @quant_lab

v1.0.0 gguf 5120 MiB