Llama-3.2-0.5B-Instruct

Model overview

This model uses a single `model.safetensors` file containing all weights. The checkpoint structure is identical to the original model, with the standard Llama architecture tensors: - `model.embed_tokens.weight` - `model.layers.*.self_attn.{q,k,v,o}_proj.weight` - `model.layers.*.mlp.{gate,up,down}_proj.weight` - `model.layers.*.{input,post_attention}_layernorm.weight` - `model.norm.weight` 1. Inspected the original model configuration to identify key parameters 2. Created a tiny version by reducing `num_hidden_layers` from 16 to 4 3. Fine-tuned the model on a toy dataset (famous copypastas) to validate learning capability 4. Achieved target perplexity of ~1.02 on the validation text 5. Validated checkpoint structure matches the original model format 6. Confirmed successful loading and inference

Key features

特点摘要待依据来源补齐，不凭模型名称推断能力。

Limitations & considerations

Sources are insufficient to establish specific limitations. Verify task performance, latency, data policies, licensing and version lifecycle.

Source prices & cost analysis

Prices vary by channel, region and configuration. Channel quotes are listed independently and are not treated as a single official provider price.

Public benchmarks & run configuration

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

Frequently asked questions

Sources & traceability

许可证：mit。模型介绍与第三方评测均以原来源的具体版本和方法为准。