AI is happening. The future is updating.Muse-Spark-Open-816B-A42B-4bit
This model mlx-community/Muse-Spark-Open-816B-A42B-4bit was converted to MLX format from meta-models/Muse-Spark-Open-816B-A42B using mlx-lm version **0.32.2**. mlx-lm's default quantization for this model makes the routed experts of layers 1-60 4-bit and keeps the other weights in BF16. The checkpoint includes the vision encoder and takes about 533 GB, more than the memory of a single 512 GB Mac.
This model mlx-community/Muse-Spark-Open-816B-A42B-4bit was converted to MLX format from meta-models/Muse-Spark-Open-816B-A42B using mlx-lm version **0.32.2**. mlx-lm's default quantization for this model makes the routed experts of layers 1-60 4-bit and keeps the other weights in BF16. The checkpoint includes the vision encoder and takes about 533 GB, more than the memory of a single 512 GB Mac.