llama-68m

This is a LLaMA-like model with only 68M parameters trained on Wikipedia and part of the C4-en and C4-realnewslike datasets. The model is mainly developed as a base Small Speculative Model in the SpecInfer paper. > **Notes on Failed Tasks:** The `Arithmetic` and `SocialIQA` benchmarks failed during execution due to runtime pipeline incompatibilities, yielding no score. Total evaluation runtime was **44.74 minutes**.

翻訳準備中のため原文を表示しています