Skip to content

feat(cpu-moe): serve block-fp8 experts on the cpu and hybrid backends - #662

Merged
jason-fxz merged 12 commits into
mainfrom
feat/cpu-moe-fp8-block
Oct 12, 2026
Merged

jason-fxz merged 12 commits into
mainfrom
feat/cpu-moe-fp8-block

docs(server): list fp8_block in the --moe-cpu-layers help

194fbca
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning and 1 notice
label
succeeded Oct 12, 2026 in 4s