AIが動く。未来が更新される。pico-decoder-small
**pico-decoder-small** is a 65M parameter model in the `pico-decoder` suite — a lightweight, LLaMA-style decoder-only transformer trained from scratch using `pico-train`. It is designed for transparent and reproducible research into the learning dynamics of language models, and is fully compatible with the `pico-analyze` toolkit for detailed interpretability analysis. This model supports fine-grained analysis using `pico-analyze`. This tool enables researchers to understand how learning unfolds over training, even at modest scales. ```bibtex @software{pico2025, author = {Diehl Martinez, Richard}, title = {Pico: A Lightweight Framework for Studying Language Model Learning Dynamics}, year = {2025}, url = {https://github.com/pico-lm} }
翻訳準備中のため原文を表示しています
**pico-decoder-small** is a 65M parameter model in the `pico-decoder` suite — a lightweight, LLaMA-style decoder-only transformer trained from scratch using `pico-train`. It is designed for transparent and reproducible research into the learning dynamics of language models, and is fully compatible with the `pico-analyze` toolkit for detailed interpretability analysis. This model supports fine-grained analysis using `pico-analyze`. This tool enables researchers to understand how learning unfolds over training, even at modest scales. ```bibtex @software{pico2025, author = {Diehl Martinez, Richard}, title = {Pico: A Lightweight Framework for Studying Language Model Learning Dynamics}, year = {2025}, url = {https://github.com/pico-lm} }