GLM-5.3-NVFP4-DFlash
This repository contains a DFlash draft model for `modal-labs/GLM-5.3-NVFP4`. It is not a standalone language model. It is intended to be paired with the target model in a speculative decoding server. DFlash uses a lightweight block diffusion draft model to propose multiple tokens in parallel. The target model verifies those proposals, improving serving throughput while preserving the target model's output distribution.
This repository contains a DFlash draft model for `modal-labs/GLM-5.3-NVFP4`. It is not a standalone language model. It is intended to be paired with the target model in a speculative decoding server. DFlash uses a lightweight block diffusion draft model to propose multiple tokens in parallel. The target model verifies those proposals, improving serving throughput while preserving the target model's output distribution.
AI is happening. The future is updating.