Open Source • Python • 2026
Distillarium
A toolkit for distilling small, task-specific models from teacher-generated data.
The released toolkit includes Needle, a 20.7M-parameter reference model for a narrow tool-calling task, plus training, evaluation, and export workflows.
- Reference Spirit
- Needle (20.7M)
- Reported training run
- 27 min · 1× RTX 5090
- Reported teacher API spend
- $0.30