Production-grade SFT + ORPO fine-tuning scripts for small reasoning & instruction models. Built with Unsloth + TRL, stabilized for long thinking tokens on a single RTX 4090.
Ministral-3 · Qwen3 · Qwen3.5 · Llama-3.2 · Phi-2
More models will follow.