Phi-3-mini SQL Helper

Official adapter · maintained by ModelForgeLab

text-generation #sql#database#assistant#phi

Small adapter that improves dialect-aware SQL suggestions for Postgres and SQLite.

Usage

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("microsoft/Phi-3-mini-4k-instruct")
base = AutoModelForCausalLM.from_pretrained("microsoft/Phi-3-mini-4k-instruct")
model = PeftModel.from_pretrained(base, "modelforgelab/phi3-mini-sql-helper")

inputs = tokenizer("Your prompt here", return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Compatibility

  • peft>=0.10
  • transformers>=4.43

You might also like