foxAIAI is happening. The future is updating.
English
中文English日本語한국어

hpc-assistant-qwen3-4b

**ClusterPilot** answers supercomputer questions (Slurm job scripts, job arrays and dependencies, GPUs, MPI, modules, storage, EuroHPC systems) and, in agent mode, works on your real cluster: it checks, submits, debugs and resubmits your jobs. It is a 4B model distilled from 80B and 235B teachers, ships as a **3.3 GB GGUF for Ollama and llama.cpp**, and runs **fully offline**. The model is still version 1.3. The ClusterPilot app (the `clusterpilot` command) got 30+ fixes from testing real use on Leonardo (CINECA) and on a B300 cluster, on macOS, Linux and Windows. Highlights: `main` now holds **ClusterPilot-4B 1.3**: version 1.2 further distilled from Qwen3-235B-A22B-Instruct-2507 (FP8) with full-parameter training on 8 NVIDIA B300 GPUs (teacher answers with top-20 log-probabilities for prompts with the app's documentation excerpts). Same 4B size, same chat format and GGUF files. Version 1.2 stays on the `v1.2` branch, version 1.0 on `v1.0`.

**ClusterPilot** answers supercomputer questions (Slurm job scripts, job arrays and dependencies, GPUs, MPI, modules, storage, EuroHPC systems) and, in agent mode, works on your real cluster: it checks, submits, debugs and resubmits your jobs. It is a 4B model distilled from 80B and 235B teachers, ships as a **3.3 GB GGUF for Ollama and llama.cpp**, and runs **fully offline**. The model is still version 1.3. The ClusterPilot app (the `clusterpilot` command) got 30+ fixes from testing real use on Leonardo (CINECA) and on a B300 cluster, on macOS, Linux and Windows. Highlights: `main` now holds **ClusterPilot-4B 1.3**: version 1.2 further distilled from Qwen3-235B-A22B-Instruct-2507 (FP8) with full-parameter training on 8 NVIDIA B300 GPUs (teacher answers with top-20 log-probabilities for prompts with the app's documentation excerpts). Same 4B size, same chat format and GGUF files. Version 1.2 stays on the `v1.2` branch, version 1.0 on `v1.0`.

Sources

huggingface.co ↗