qlora

• 28 Sept 2025
• 9 min read

Falcon Twig: a tool-calling fine-tune that lost to the base model

I fine-tuned Falcon-H1-7B-Instruct on a tool-calling mix with QLoRA and re-ran BFCL. It scored 24.50% live accuracy against the base model's 67.21%.