모델 정보

Qwen3.8-27B-NVFP4-MTP-GGUF

esatapedico · Qwen3.8-27B-NVFP4-MTP-GGUF

A **family of nine GGUF files** of `Qwen3.8-27B` (the native vision-language 27B dense model, Gated DeltaNet + Gated Attention hybrid layout, 262,144-token native context, MTP speculative head), converted from unsloth/Qwen3.8-27B-NVFP4. The **MTP (multi-token prediction) speculative head is baked into every file** — no separate drafter needed. - **`ORIG`** — the source-preserving conversion: native **NVFP4 MLP backbone** + **BF16 attention/embeddings** (the source's F8 attention is dequantized to BF16 because GGML has no F8 tensor type). This is the largest file and the one all tiers are derived from. - **`VERY-LOW` / `COMPACT-LOW` / `LOW` / `MEDIUM` / `MID-HIGH` / `HIGH` / `VERY-HIGH`** — a compact family sharing a **byte-identical 448-tensor NVFP4 backbone** (all attention + MLP re-quantized to NVFP4), differing only in the 10 "extra" tensors (LM head, token embedding, MTP draft head). `COMPACT-LOW` fills the gap between `VERY-LOW` and `LOW` — slightly smaller than `LOW` while keeping a materially stronger LM head than `VERY-LOW` (Q4_K vs Q3_K). `MID-HIGH` sits between `MEDIUM` and `HIGH` with all three head groups at **Q8_0**. - **`HIGHEST`** — the top tier: keeps the source's native **NVFP4 MLP** (layers 0-55) exactly as in `ORIG`, restores **Q8_0** for attention + the late MLP layers + the LM head, and keeps the **token embedding + MTP head in BF16**. The closest compact approximation of the source layout, for high-end GPUs. The goal: **keep native NVFP4 density across the whole model for Blackwell**, and offer a size/precision ladder for the tensors that most affect output quality and decode speed. On our dual 16 GB Blackwell setup every tier fits and runs (see notes before treating any numbers as meaningful).

번역 대기 중입니다. 원문을 표시합니다.

텍스트 생성multimodallicense:apache-2.0
컨텍스트 창미공개
입력 → 출력텍스트 → 텍스트
모델 웨이트미확인
정보 업데이트2026/11/2 19:16:19
OVERVIEW

모델 소개

A **family of nine GGUF files** of `Qwen3.8-27B` (the native vision-language 27B dense model, Gated DeltaNet + Gated Attention hybrid layout, 262,144-token native context, MTP speculative head), converted from unsloth/Qwen3.8-27B-NVFP4. The **MTP (multi-token prediction) speculative head is baked into every file** — no separate drafter needed. - **`ORIG`** — the source-preserving conversion: native **NVFP4 MLP backbone** + **BF16 attention/embeddings** (the source's F8 attention is dequantized to BF16 because GGML has no F8 tensor type). This is the largest file and the one all tiers are derived from. - **`VERY-LOW` / `COMPACT-LOW` / `LOW` / `MEDIUM` / `MID-HIGH` / `HIGH` / `VERY-HIGH`** — a compact family sharing a **byte-identical 448-tensor NVFP4 backbone** (all attention + MLP re-quantized to NVFP4), differing only in the 10 "extra" tensors (LM head, token embedding, MTP draft head). `COMPACT-LOW` fills the gap between `VERY-LOW` and `LOW` — slightly smaller than `LOW` while keeping a materially stronger LM head than `VERY-LOW` (Q4_K vs Q3_K). `MID-HIGH` sits between `MEDIUM` and `HIGH` with all three head groups at **Q8_0**. - **`HIGHEST`** — the top tier: keeps the source's native **NVFP4 MLP** (layers 0-55) exactly as in `ORIG`, restores **Q8_0** for attention + the late MLP layers + the LM head, and keeps the **token embedding + MTP head in BF16**. The closest compact approximation of the source layout, for high-end GPUs. The goal: **keep native NVFP4 density across the whole model for Blackwell**, and offer a size/precision ladder for the tensors that most affect output quality and decode speed. On our dual 16 GB Blackwell setup every tier fits and runs (see notes before treating any numbers as meaningful).

주요 특징

特点摘要待依据来源补齐,不凭模型名称推断能力。

한계 및 유의 사항

구체적 한계를 판단할 출처가 부족합니다. 실제 성능, 지연, 데이터 정책, 라이선스와 버전 수명을 확인하세요.

PRICING & COST

출처별 요금 및 비용 분석

요금은 채널, 지역, 설정에 따라 다릅니다. 각 채널 요금은 개별 표시되며 제공사의 통일 공식 요금이 아닙니다.

출처 / 채널입력출력과금 단위수집 시간
확인된 요금이 없습니다. 출처를 확인하세요.

월간 기본 토큰 비용 추정

—

추정치에는 캐시 할인, 구간 요금, 멀티모달 추가 요금, 검색, 세금 및 추가 추론 출력이 포함되지 않습니다.

INDEPENDENT BENCHMARKS

공개 평가 및 실행 설정

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

등록된 전체 순위 보기 →

자주 묻는 질문

오픈 웨이트면 무료 상업 이용이 가능한가요?

반드시 그렇지는 않습니다. 버전별 라이선스, 상업 이용 조건과 정책을 확인하세요. 자체 배포에는 연산 및 유지 비용도 듭니다.

실시간 결제 요금인가요?

수집 시간이 기록된 요금 스냅샷입니다. 최신 버전, 지역, 할인과 과금 방식은 해당 채널에서 확인하세요.

출처 및 추적 기록

许可证:apache-2.0。模型介绍与第三方评测均以原来源的具体版本和方法为准。