glm-4-moe

This tiny model is for debugging. It is randomly initialized with the config adapted from zai-org/GLM-4.5. Note: The `transformers` implementation does not have multi-token prediction (MTP) support. So you might see some "weights not loaded" warnings. This is expected.