Qwen3.8-Whittle-16B

> ### ☕ Support this work > Whittle is built by one person on a grocery budget and rented GPU hours. If this research is useful to you, or you want to see it finished: > **ko-fi.com/davida81328**. Every hour of GPU time goes straight into the next checkpoint, and every checkpoint, table and log lands in these repos. **A 27B whittled down to 16.8B with a logit lens and a pricing table, then healed with one A100 evening. It now outscores every intermediate cut, including ones 4B larger, at 20 tokens/second on two consumer 8GB GPUs.** Whittle is Qwen3.8-27B minus 20 of its 64 layers (whole interval-blocks, chosen by measured boundary cost) and minus 25% of every remaining MLP's width (weakest neurons by ‖down_column‖ × activation-std). That is a −10.1B parameter cut performed with **zero training**, followed by a single 11M-token QLoRA heal on a fully clean-lineage mix (synthetic fact frames, programmatic short-think arithmetic, hand-written code drills, public-domain long pages).

번역 준비 중입니다. 원문을 표시합니다.