pplx-decider-flash-gguf-v1.2
pplx-decider-flash-v1.2 is the small version of pplx-decider-v1.2: the same joint request format, the same API and the same text and image support, at about one seventh of the size. It is built on Qwen3.5-4B, **distilled from the 27B decision models** on their training requests (the student learns the teachers' full probability distributions, not just their answers). It combines several training runs through model souping (weight averaging). Use it when latency or cost matters more than the last points of accuracy. On our evaluations it keeps most of the 27B model's Decision Index and vision scores (see below). Distillation also improves results on decision tasks held out from all training. Stock `llama-server` does not implement this checkpoint's protocol v3; its `/v1/systemone` uses protocol v1. A compatible runtime must:
pplx-decider-flash-v1.2 is the small version of pplx-decider-v1.2: the same joint request format, the same API and the same text and image support, at about one seventh of the size. It is built on Qwen3.5-4B, **distilled from the 27B decision models** on their training requests (the student learns the teachers' full probability distributions, not just their answers). It combines several training runs through model souping (weight averaging). Use it when latency or cost matters more than the last points of accuracy. On our evaluations it keeps most of the 27B model's Decision Index and vision scores (see below). Distillation also improves results on decision tasks held out from all training. Stock `llama-server` does not implement this checkpoint's protocol v3; its `/v1/systemone` uses protocol v1. A compatible runtime must:
AI is happening. The future is updating.