
>decode·11 min
Apriel-H1: Distill Reasoning, Not Pretraining Data
ServiceNow turns a 15B reasoning model into a Mamba hybrid at 2.1x throughput. The interesting part is how they chose the distillation data.
llmresearchopen-source
>read more_
> booting the archive…
we use a small set of cookies. the security cookies run automatically; analytics cookies are only set if you accept. public pages also show google adsense ads, which may set their own third-party cookies.
> booting the archive…

ServiceNow turns a 15B reasoning model into a Mamba hybrid at 2.1x throughput. The interesting part is how they chose the distillation data.

Everyone wants the "perfect" architecture, but complexity sells and simplicity is earned. A senior-engineer look at over-engineering, abstraction and YAGNI.