AI is happening. The future is updating.llama-68m
This is a LLaMA-like model with only 68M parameters trained on Wikipedia and part of the C4-en and C4-realnewslike datasets. The model is mainly developed as a base Small Speculative Model in the SpecInfer paper. > **Notes on Failed Tasks:** The `Arithmetic` and `SocialIQA` benchmarks failed during execution due to runtime pipeline incompatibilities, yielding no score. Total evaluation runtime was **44.74 minutes**.
This is a LLaMA-like model with only 68M parameters trained on Wikipedia and part of the C4-en and C4-realnewslike datasets. The model is mainly developed as a base Small Speculative Model in the SpecInfer paper. > **Notes on Failed Tasks:** The `Arithmetic` and `SocialIQA` benchmarks failed during execution due to runtime pipeline incompatibilities, yielding no score. Total evaluation runtime was **44.74 minutes**.