CodeLlama-13B Python (GGUF)

Official adapter · maintained by ModelForgeLab

Python-specialized adapter merged and quantized for local inference. Covers idiomatic Python 3.10+, type annotations, and async patterns. CPU-friendly q4_0 quant.

Usage

Load with Ollama:

# Download the adapter file, then create a Modelfile:
FROM codellama-13b-python-hf
ADAPTER ./codellama-13b-python-gguf.gguf

# Build and run:
ollama create my-model -f Modelfile
ollama run my-model "Your prompt here"

Or with llama.cpp:

./llama-cli \
  -m base-model.gguf \
  --lora codellama-13b-python-gguf.gguf \
  -p "Your prompt here"

Compatibility

• llama.cpp
• Ollama
• LM Studio