#gguf

Llama 3 8B Instruct (GGUF Q4)

meta-llama/Meta-Llama-3-8B-Instruct

by @quant_lab

Phi-3 Mini (GGUF Q8)

microsoft/Phi-3-mini-128k-instruct

by @edge_llm

Gemma 2 9B (GGUF Q4)

google/gemma-2-9b-it

by @quant_lab

Mistral 7B Coder (GGUF Q5)

mistralai/Mistral-7B-Instruct-v0.3

by @quant_lab

Qwen2.5 14B (GGUF Q4)

Qwen/Qwen2.5-14B-Instruct

by @quant_lab

Llama 3.1 70B Chat (GGUF Q3)

meta-llama/Meta-Llama-3.1-70B-Instruct

by @big_model_hub

Llama 3.1 70B Financial Analyst

meta-llama/Meta-Llama-3.1-70B-Instruct

by @finllm_lab

CodeLlama-13B Python (GGUF)

codellama/CodeLlama-13b-Python-hf

Qwen2.5-32B Instruct (GGUF)

Qwen/Qwen2.5-32B-Instruct

Llama-3.1-70B Legal Draft (GGUF)

meta-llama/Meta-Llama-3.1-70B-Instruct