Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
931 commits
Select commit Hold shift + click to select a range
43e5aa8
fix(web): render GFM tables in chat instead of one run-on paragraph
Oct 5, 2026
45d7a10
build: let the compiler supply the cap test's header prerequisites (#…
jtinbergen Oct 1, 2026
c2ff301
docs: add Indonesian README
Yoruxyv Oct 5, 2026
e649c3d
test(vulkan): fix fixture dependencies and runtime assertions
JustVugg Oct 5, 2026
c9b509f
Merge branch 'feat/vulkan-runtime-memory-speculation' of https://gith…
JustVugg Oct 5, 2026
81a4c7f
Merge pull request #1901 from JustVugg/feat/vulkan-runtime-memory-spe…
JustVugg Oct 5, 2026
faf198b
Merge branch 'dev' into fix/windows-async-expert-prefetch
JustVugg Oct 5, 2026
f09256e
Merge remote-tracking branch 'origin/dev' into feat/vk-partial-chain
JustVugg Oct 5, 2026
5ca215d
feat(qwen36): a partial dense chain, the first N layers on the device
JustVugg Oct 5, 2026
dc7363e
feat(olmoe): a partial dense chain, the first N layers on the device
JustVugg Oct 5, 2026
efd91e5
feat(planner): the partial chain's layouts for qwen36 and olmoe
JustVugg Oct 5, 2026
1bc4c54
feat(olmoe): the matrices resident on the device in the exit line
JustVugg Oct 5, 2026
d3334f3
test(vulkan): the partial-qwen36-olmoe family, its CI legs and docs
JustVugg Oct 5, 2026
d769e41
fix(qwen36, olmoe): the chain's pipelines come up after its fit
JustVugg Oct 5, 2026
96db16a
docs(vulkan): qwen36 and olmoe in the partial chain's table
JustVugg Oct 5, 2026
8ec52be
feat(qwen38): a partial dense chain, the first N layers on the device
JustVugg Oct 5, 2026
822d451
test(vulkan): the partial-qwen38 family, its sanitize variant and the…
JustVugg Oct 5, 2026
51acec6
docs(vulkan): qwen38 on a partial chain
JustVugg Oct 5, 2026
97a6f76
feat(planner): qwen38's partial-chain layout
JustVugg Oct 5, 2026
42f9d86
fix(qwen38): fit before the chain's pipelines, coli plan's numbers in…
JustVugg Oct 5, 2026
418e0aa
fix(planner): no qwen38 prediction on a device whose memory is unknown
JustVugg Oct 5, 2026
cf38167
docs(vulkan): qwen38's example lines under the cap the fit-first engi…
JustVugg Oct 5, 2026
d146017
feat(vulkan): colibri's partial dense chain
JustVugg Oct 5, 2026
4471874
feat(vulkan): glm53's partial dense chain
JustVugg Oct 5, 2026
b929056
test(vulkan): the partial-glm family, its CI legs and docs
JustVugg Oct 5, 2026
9022771
feat(planner): glm53's partial chain layout
JustVugg Oct 5, 2026
e206e74
fix(vulkan): the GLM fits before the chain's pipelines, coli plan cro…
JustVugg Oct 5, 2026
f5e79e8
test(vulkan): partial-glm's chunks within the bound on glm53, a decli…
JustVugg Oct 5, 2026
88a9447
docs(vulkan): the partial-glm family's results on Lavapipe
JustVugg Oct 5, 2026
674d451
vulkan: COLI_VK_DEV picks the device; the coop GEMM's epilogue stride…
JustVugg Oct 5, 2026
cc96b38
Merge pull request #1902 from JustVugg/fix/windows-async-expert-prefetch
JustVugg Oct 5, 2026
8b676ee
Merge branch 'dev' into fix/1852-setup-rebuild-logs
JustVugg Oct 5, 2026
a9d204b
tests: dense-only inkling's bf16 fixture on a CPU with a bf16 dot (th…
JustVugg Oct 5, 2026
0ef6a80
ci: the Windows UCRT64 job's limit from 35 to 60 minutes
JustVugg Oct 5, 2026
49a5aee
tests: partial-qwen36-olmoe runs olmoe's brio serve class only
JustVugg Oct 5, 2026
a1029cf
Merge branch 'feat/vk-partial-qwen36-olmoe' into feat/vk-partial-3-qw…
JustVugg Oct 5, 2026
d18dcab
Merge branch 'feat/vk-partial-3-qwen38' into feat/vk-partial-4-glm
JustVugg Oct 5, 2026
1524528
speculative decoding on by default: Qwen3.8's MTP head and prompt loo…
JustVugg Oct 5, 2026
0722320
tests: the speculative harnesses start every run from both draft sour…
JustVugg Oct 5, 2026
193431c
setup: ship a starting expert history for Qwen3.6 and Qwen3.8
JustVugg Oct 5, 2026
a3d34d5
Merge pull request #1914 from JustVugg/fix/ci-windows-timeout
JustVugg Oct 5, 2026
987c2bd
Merge pull request #1903 from JustVugg/fix/1852-setup-rebuild-logs
JustVugg Oct 5, 2026
31e1e5e
Merge pull request #1912 from JustVugg/fix/dho-inkling-bf16-runners
JustVugg Oct 5, 2026
31c3388
Merge pull request #1911 from JustVugg/fix/1908-vk-dev-coop-stride
JustVugg Oct 5, 2026
119292d
Merge pull request #1904 from JustVugg/fix/1852-v4-expert-wait
JustVugg Oct 5, 2026
8ee260c
Merge pull request #1909 from JustVugg/feat/vk-partial-chain
JustVugg Oct 5, 2026
9eb4389
Merge pull request #1913 from JustVugg/feat/vk-partial-qwen36-olmoe
JustVugg Oct 5, 2026
34d8a69
Merge remote-tracking branch 'origin/dev' into feat/shipped-expert-pr…
JustVugg Oct 5, 2026
d1e2969
docs: the shipped expert profiles, and what they do to a first run
JustVugg Oct 5, 2026
27a6681
vulkan: the routed-expert batch on a second device
JustVugg Oct 5, 2026
fab7a26
vk_tier: hold experts on a second device too (COLI_VK_DEV2), every en…
JustVugg Oct 5, 2026
48eb26f
test(vulkan): the dev2 families, every MoE engine on two devices
JustVugg Oct 5, 2026
a8d20d2
docs(vulkan): a second device for the expert tier, every engine
JustVugg Oct 5, 2026
3777db2
test(vulkan): dev2's glm53 fixture routes four experts: its evict cas…
JustVugg Oct 5, 2026
9011d1f
vulkan: the VK_TEST harness reads the primary device's batch context
JustVugg Oct 5, 2026
da974b3
tests: the Vulkan families run with speculation off, the cases that t…
JustVugg Oct 5, 2026
7c84eee
vk_tier: RAM and VRAM without the same experts when RAM is short (COL…
JustVugg Oct 5, 2026
cede6c0
test(vulkan), docs: the dev2 families' excl and noexcl cases; exclusi…
JustVugg Oct 5, 2026
e208447
tests: the glm53 pin-branch harness with the tier deterministic
JustVugg Oct 5, 2026
f71f899
test(vulkan): the excl cases keep colibri's cache at its slots (CAP_R…
JustVugg Oct 5, 2026
78948c4
vulkan: staged uploads straight from host memory, no copy into the st…
JustVugg Oct 5, 2026
b237ffb
Merge branch 'feat/vk-tier-exclusive' into feat/vk-staged-import
JustVugg Oct 5, 2026
af99bcf
docs(vulkan): staged uploads straight from host memory, COLI_VK_UP_IM…
JustVugg Oct 5, 2026
3065054
Merge pull request #1916 from JustVugg/feat/vk-partial-3-qwen38
JustVugg Oct 5, 2026
3eeb3d0
Merge pull request #1918 from JustVugg/feat/vk-partial-4-glm
JustVugg Oct 5, 2026
91ef717
Merge pull request #1917 from JustVugg/feat/spec-on-by-default
JustVugg Oct 5, 2026
08311ef
Merge pull request #1919 from JustVugg/feat/shipped-expert-profiles
JustVugg Oct 5, 2026
01f32c0
Merge pull request #1920 from JustVugg/feat/vk-tier-dev2
JustVugg Oct 5, 2026
d4df5d0
Merge remote-tracking branch 'origin/dev' into feat/vk-tier-exclusive
JustVugg Oct 5, 2026
5460ec8
Merge remote-tracking branch 'origin/dev' into feat/vk-staged-import
JustVugg Oct 5, 2026
397e09e
feat(vulkan): deepseek_v41 runs a partial chain: the first N layers o…
JustVugg Oct 5, 2026
177e39a
feat(vulkan): kimi_k3 runs a partial chain: the first N layers on the…
JustVugg Oct 5, 2026
8d88c85
feat(planner): the partial chain's layouts of deepseek_v41 and kimi_k3
JustVugg Oct 5, 2026
2c14f7e
feat(vulkan): deepseek_v41 builds each chain layer whole in its devic…
JustVugg Oct 5, 2026
1b923fb
test(vulkan): the partial-dsk family, its CI legs and docs
JustVugg Oct 5, 2026
8d319de
test(vulkan): partial-dsk's prompts-only device-only Kimi case reads …
JustVugg Oct 5, 2026
aa6fe73
test(vulkan): Kimi K3's device-only upload failure keeps one host cop…
JustVugg Oct 5, 2026
35ad8a4
feat(vulkan): inkling's partial dense chain, the first N layers on th…
JustVugg Oct 5, 2026
b3210a6
feat(vulkan): MiMo's partial dense chain, the first N layers on the d…
JustVugg Oct 5, 2026
428a0e8
test(vulkan): partial-inkling-mimo, inkling's and MiMo's partial chai…
JustVugg Oct 5, 2026
9e549da
feat(planner): inkling's and MiMo's partial-chain layouts
JustVugg Oct 5, 2026
ce741e8
test(vulkan): the cap helper's pools at the new cap, and coli plan be…
JustVugg Oct 5, 2026
4eadda0
docs(vulkan): coli plan's partial-chain prediction for inkling and MiMo
JustVugg Oct 5, 2026
bec7030
vulkan: inkling's and MiMo's head failing to go up keeps every layer …
JustVugg Oct 5, 2026
5627851
exclusive RAM/VRAM: build without Vulkan, and the victim tests' new a…
JustVugg Oct 5, 2026
c014722
Merge branch 'feat/vk-tier-exclusive' into feat/vk-staged-import
JustVugg Oct 5, 2026
17fae83
vulkan: the MTP head's experts on the tier (qwen38), in a pool of the…
JustVugg Oct 5, 2026
37d8063
tests: the staged-import probe runs in staged_window (qwen-staged), w…
JustVugg Oct 5, 2026
e7f363f
vulkan: the drafting heads' experts on the tier for colibri and deeps…
JustVugg Oct 5, 2026
c74bb85
ci: the partial-inkling-mimo families install the oracle requirements…
JustVugg Oct 5, 2026
2cbeb9d
docs: qwen38's MTP head on the tier, in its engine page and environme…
JustVugg Oct 5, 2026
02b745f
Merge branch 'feat/vk-staged-import' into feat/vk-mtp-gpu
JustVugg Oct 5, 2026
8ffa004
Merge branch 'feat/vk-mtp-gpu' into feat/vk-mtp-heads
JustVugg Oct 5, 2026
f4ab77d
ci: dev2-sanitize keeps its requirements (a merge of dev had dropped …
JustVugg Oct 5, 2026
a62d4d9
tests: inkling-mimo's partial-chain helpers carry their own prefix; a…
JustVugg Oct 5, 2026
5dafa7b
Merge branch 'feat/vk-partial-5-dsk' into feat/vk-partial-6-imk
JustVugg Oct 5, 2026
2074688
tests: glm53's pin-branch harness runs with the tier off
JustVugg Oct 5, 2026
c7767c6
Merge branch 'feat/vk-tier-exclusive' into feat/vk-staged-import
JustVugg Oct 5, 2026
fc6e4aa
vulkan: a split KV cache takes prompt chunks of half the window
JustVugg Oct 5, 2026
180cdae
tests: glm53's pin-branch harness compares within 1e-5 through the Vu…
JustVugg Oct 5, 2026
b1408d9
Merge branch 'feat/vk-tier-exclusive' into feat/vk-staged-import
JustVugg Oct 5, 2026
24b07e3
Merge pull request #1922 from JustVugg/feat/vk-partial-5-dsk
JustVugg Oct 5, 2026
ed8b2b2
Merge pull request #1923 from JustVugg/feat/vk-partial-6-imk
JustVugg Oct 5, 2026
0405e10
Merge pull request #1924 from JustVugg/feat/vk-tier-exclusive
JustVugg Oct 5, 2026
fd145ef
Merge pull request #1925 from JustVugg/feat/vk-staged-import
JustVugg Oct 5, 2026
f7b5b30
harden config, grammar and model-dir file handling
JustVugg Oct 5, 2026
1de375b
Merge remote-tracking branch 'origin/dev' into fix/hardening-2026-10
JustVugg Oct 5, 2026
6247365
Merge remote-tracking branch 'origin/feat/vk-mtp-gpu' into integ/rele…
JustVugg Oct 5, 2026
cff1c95
Merge remote-tracking branch 'origin/feat/vk-mtp-heads' into integ/re…
JustVugg Oct 5, 2026
296fa16
Merge remote-tracking branch 'origin/feat/vk-kv-split-chunk' into int…
JustVugg Oct 5, 2026
c6a72cc
Merge remote-tracking branch 'origin/fix/hardening-2026-10' into inte…
JustVugg Oct 5, 2026
1d8f54a
Merge pull request #1876 into integ/release-batch-5
JustVugg Oct 5, 2026
d86905d
Merge pull request #1877 into integ/release-batch-5
JustVugg Oct 5, 2026
a6efc98
Merge pull request #1878 into integ/release-batch-5
JustVugg Oct 5, 2026
9953f95
Merge pull request #1879 into integ/release-batch-5
JustVugg Oct 5, 2026
812551f
Merge pull request #1880 into integ/release-batch-5
JustVugg Oct 5, 2026
37be23d
Merge pull request #1881 into integ/release-batch-5
JustVugg Oct 5, 2026
4a0bf73
Merge pull request #1882 into integ/release-batch-5
JustVugg Oct 5, 2026
bcfad43
Merge pull request #1883 into integ/release-batch-5
JustVugg Oct 5, 2026
82b7efa
Merge pull request #1884 into integ/release-batch-5
JustVugg Oct 5, 2026
8b7f5db
Merge pull request #1885 into integ/release-batch-5
JustVugg Oct 5, 2026
db6d8ec
Merge pull request #1886 into integ/release-batch-5
JustVugg Oct 5, 2026
ecb3f21
Merge pull request #1887 into integ/release-batch-5
JustVugg Oct 5, 2026
96bef84
Merge pull request #1888 into integ/release-batch-5
JustVugg Oct 5, 2026
35da98c
Merge pull request #1889 into integ/release-batch-5
JustVugg Oct 5, 2026
d117bad
Merge pull request #1890 into integ/release-batch-5
JustVugg Oct 5, 2026
dd518e6
Merge pull request #1891 into integ/release-batch-5
JustVugg Oct 5, 2026
ca811b4
Merge pull request #1892 into integ/release-batch-5
JustVugg Oct 5, 2026
efac759
Merge pull request #1893 into integ/release-batch-5
JustVugg Oct 5, 2026
54adc56
Merge pull request #1894 into integ/release-batch-5
JustVugg Oct 5, 2026
bd1e328
Merge pull request #1895 into integ/release-batch-5
JustVugg Oct 5, 2026
4a56a32
Merge pull request #1898 into integ/release-batch-5
JustVugg Oct 5, 2026
eef8f1e
Merge pull request #1838 into integ/release-batch-5
JustVugg Oct 5, 2026
eacd326
Merge pull request #1805 into integ/release-batch-5
JustVugg Oct 5, 2026
9714a6b
Merge pull request #1907 into integ/release-batch-5
JustVugg Oct 5, 2026
3df5483
Merge pull request #1905 into integ/release-batch-5
JustVugg Oct 5, 2026
1a901f8
Merge pull request #1859 into integ/release-batch-5
JustVugg Oct 5, 2026
f3e5cd9
Merge pull request #1874 into integ/release-batch-5
JustVugg Oct 5, 2026
f9a8be0
Merge pull request #1873 into integ/release-batch-5
JustVugg Oct 5, 2026
4b103b5
Merge pull request #1860 into integ/release-batch-5
JustVugg Oct 5, 2026
d8d8290
Merge pull request #1865 into integ/release-batch-5
JustVugg Oct 5, 2026
813a678
Merge pull request #1858 into integ/release-batch-5
JustVugg Oct 5, 2026
c5a91fb
Merge pull request #1861 into integ/release-batch-5
JustVugg Oct 5, 2026
a33d495
Merge pull request #1792 into integ/release-batch-5
JustVugg Oct 5, 2026
e269739
Merge pull request #1747 into integ/release-batch-5
JustVugg Oct 5, 2026
0e870f4
Merge pull request #1870 into integ/release-batch-5
JustVugg Oct 5, 2026
34b4b63
Merge pull request #1769 into integ/release-batch-5
JustVugg Oct 5, 2026
03a3676
Merge pull request #1867 into integ/release-batch-5
JustVugg Oct 5, 2026
81b2ee5
docs: drop a zero-width space inside a tool_call tag in api.md
JustVugg Oct 5, 2026
323da5a
vulkan: the split KV cache's host part on the device (COLI_VK_KV_COLD…
JustVugg Oct 5, 2026
fb79bda
vulkan: the chain's context per device (vkc_device), for layers on CO…
JustVugg Oct 5, 2026
f150d2b
own_file: refuse a mode other than r or w on Windows too
JustVugg Oct 5, 2026
44a8e8a
tests: test_own_file's POSIX helper only where it is used
JustVugg Oct 5, 2026
9ea5db1
Merge remote-tracking branch 'origin/fix/hardening-2026-10' into inte…
JustVugg Oct 5, 2026
31b3621
Merge branch 'integ/release-batch-4' into integ/release-batch-5
JustVugg Oct 5, 2026
a3277b2
qwen36: the chain's layers on two devices (COLI_VK_DEV2)
JustVugg Oct 5, 2026
2fa3e97
qwen38: the chain's layers on two devices (COLI_VK_DEV2)
JustVugg Oct 5, 2026
27676d3
olmoe: the chain's layers on two devices (COLI_VK_DEV2); qwen38: a lo…
JustVugg Oct 5, 2026
0e210f3
mimo: the chain's layers on two devices (COLI_VK_DEV2)
JustVugg Oct 5, 2026
e9e7c45
olmoe, mimo: a step the second device loses is redone from the rows a…
JustVugg Oct 5, 2026
1beae0a
inkling: the chain's layers on two devices (COLI_VK_DEV2)
JustVugg Oct 5, 2026
23c5149
vk: GLM-5.2 layers on two devices; inkling reports a lost second devi…
JustVugg Oct 5, 2026
d9821e5
vulkan chain: causal attention of a prompt chunk on the matrix units
huppiflupp Oct 5, 2026
d86804b
vulkan chain: int8/int4 prompt GEMMs on the matrix units
huppiflupp Oct 5, 2026
0d3559b
vulkan: a step's experts as one grouped GEMM, and a big step summed o…
huppiflupp Oct 5, 2026
c4f9113
qwen36: a prompt's routing in parallel; the single expert batch packs…
huppiflupp Oct 5, 2026
5ba64e5
vk: GLM-5.3 layers on two devices
JustVugg Oct 5, 2026
03fea87
vk: Kimi K3 layers on two devices
JustVugg Oct 5, 2026
58f9172
vk: DeepSeek V4.1 layers on two devices
JustVugg Oct 5, 2026
59a0ffb
vk: DeepSeek V4 layers on two devices
JustVugg Oct 5, 2026
d5001b3
tests: build test_st_json_integrity's loader with -D_FILE_OFFSET_BITS=64
JustVugg Oct 5, 2026
3b5f3d0
vk: layers on two devices: CI legs, sanitizer runs, docs
JustVugg Oct 5, 2026
bcce90f
tests: layers-dev2-sanitize: Inkling's KV split where kv_san counts it
JustVugg Oct 5, 2026
39cc8c9
vulkan: a decode step's experts as one grouped GEMV per phase
huppiflupp Oct 5, 2026
d27edd7
vulkan chain: int8 decode GEMVs with rows a workgroup by the matrix's…
huppiflupp Oct 5, 2026
00845b1
Merge pull request #1927 from JustVugg/feat/vk-mtp-gpu
JustVugg Oct 5, 2026
af463fc
Merge pull request #1928 from JustVugg/feat/vk-mtp-heads
JustVugg Oct 5, 2026
a242a50
Merge pull request #1929 from JustVugg/feat/vk-kv-split-chunk
JustVugg Oct 5, 2026
923a107
Merge pull request #1930 from JustVugg/fix/hardening-2026-10
JustVugg Oct 5, 2026
4559721
tests: dense-only olmoe's automatic cache gate under #1865's budget
JustVugg Oct 5, 2026
7f29561
Merge remote-tracking branch 'origin/dev' into integ/release-batch-5
JustVugg Oct 5, 2026
c9e66e0
Merge branch 'feat/vk-layers-dev2' into integ/release-batch-6
JustVugg Oct 5, 2026
3289bd6
Merge branch 'feat/vk-kv-cold-device' into integ/release-batch-6
JustVugg Oct 5, 2026
39cc312
tests: layers-dev2: the host's part on the device with the KV split o…
JustVugg Oct 5, 2026
871383a
Merge pull request #1932 from JustVugg/integ/release-batch-5
JustVugg Oct 5, 2026
6e00862
Merge remote-tracking branch 'origin/dev' into integ/release-batch-6
JustVugg Oct 5, 2026
1e2b121
Merge pull request #1943 from JustVugg/integ/release-batch-6
JustVugg Oct 5, 2026
550da7f
Merge #1934 into integ/release-batch-7
JustVugg Oct 6, 2026
3269520
Merge #1935 into integ/release-batch-7
JustVugg Oct 6, 2026
fe216a3
Merge #1936 into integ/release-batch-7
JustVugg Oct 6, 2026
88020a6
Merge #1937 into integ/release-batch-7
JustVugg Oct 6, 2026
c443337
Merge #1938 into integ/release-batch-7
JustVugg Oct 6, 2026
88a26cb
Merge #1939 into integ/release-batch-7
JustVugg Oct 6, 2026
a4f57e0
tests: a reset is the closed connection test_request_read_deadline wa…
JustVugg Oct 6, 2026
e7e4807
Merge pull request #1947 from JustVugg/integ/release-batch-7
JustVugg Oct 6, 2026
471e8e9
vulkan chain: colibri's multiplexed decode on the device
JustVugg Oct 6, 2026
641826c
Merge pull request #1948 from JustVugg/feat/vk-chain-mux
JustVugg Oct 6, 2026
8f4f3b0
build: a bare make target for every engine on Windows (#1945, #1900)
JustVugg Oct 6, 2026
174b5fb
setup: MSYS2 for a Vulkan build, libgomp, scoop's MSYS2 (#1900)
JustVugg Oct 6, 2026
04f7e43
vulkan: COLI_VK_DENSE=0 keeps the dense chain off too (#1900)
JustVugg Oct 6, 2026
5611276
serve: say why the engine dispatcher stopped (#1941)
JustVugg Oct 6, 2026
578e9e8
deepseek_v4: the physical cores by default on an SMT machine (#1906)
JustVugg Oct 6, 2026
78e98d1
deepseek_v4: say why no CUDA backend DLL was usable (#1906)
JustVugg Oct 6, 2026
13d0dcd
plan: no GPU below an engine's CUDA floor in the placement (#1906)
JustVugg Oct 6, 2026
55c101e
engines: the right by-hand command in the no-model message (#1906)
JustVugg Oct 6, 2026
6274d5f
docs: DeepSeek V4 on Windows and REAP, from #1906
JustVugg Oct 6, 2026
7ee4a70
Merge pull request #1949 from JustVugg/fix/issue-triage-2026-10-06
JustVugg Oct 6, 2026
775356e
qwenimage: load the int8 weights a few layers at once, straight from …
JustVugg Oct 6, 2026
fefcdc6
qwenimage: the diffusion transformer on the Vulkan chain
JustVugg Oct 6, 2026
095af89
qwenimage chain: the attention in slices of rows, a submission each
JustVugg Oct 6, 2026
004765b
vulkan chain: a diffusion step's attention, tiled (chain_attn_full)
JustVugg Oct 6, 2026
c445072
qwenimage: the chain by default on the 780M, vec4 attention tiles, docs
JustVugg Oct 6, 2026
77619f3
qwenimage: the VAE decoder on the device when the chain runs
JustVugg Oct 6, 2026
22c2799
qwenimage chain: stream the blocks a small card does not hold
JustVugg Oct 6, 2026
10c4123
vulkan chain: the diffusion attention on the matrix units, opt-in
JustVugg Oct 6, 2026
95bf0f3
docs: Qwen-Image's attention on the matrix units, opt-in
JustVugg Oct 6, 2026
8144b1e
release: Vulkan engines and shaders in every archive, Metal on macOS,…
JustVugg Oct 6, 2026
8ab85e1
ci: the Qwen-Image fixture's requirements in the kimi-mimo-sanitize leg
JustVugg Oct 6, 2026
f7c2ec2
vulkan: colibri's unavailable line names a driver, not libvulkan; a m…
JustVugg Oct 6, 2026
a898561
Merge pull request #1951 from JustVugg/feat/qwenimage-chain
JustVugg Oct 6, 2026
156b173
Merge remote-tracking branch 'origin/dev' into feat/release-everything
JustVugg Oct 6, 2026
948ad74
qwen38: several conversations at once (KV_SLOTS up to 16)
JustVugg Oct 6, 2026
1814a4a
qwen36: several conversations at once (KV_SLOTS up to 16)
JustVugg Oct 6, 2026
9a9f5f9
olmoe: several conversations at once (KV_SLOTS up to 16)
JustVugg Oct 6, 2026
8257fca
mimo: several conversations at once (KV_SLOTS up to 16)
JustVugg Oct 6, 2026
210656b
inkling: several conversations at once (KV_SLOTS up to 16)
JustVugg Oct 6, 2026
754e9ec
kimi_k3: several conversations at once (KV_SLOTS up to 16)
JustVugg Oct 6, 2026
8e2a53c
release: the Windows probe expects the engine's exit 2 when no device…
JustVugg Oct 6, 2026
1db7448
deepseek_v41: several conversations at once (KV_SLOTS up to 16)
JustVugg Oct 6, 2026
fc6ec3e
deepseek_v4: several conversations at once (KV_SLOTS up to 16)
JustVugg Oct 6, 2026
5b21507
serve_mux_check: MUX_LONG lengthens every prompt
JustVugg Oct 6, 2026
1a48d7a
serve: a SUBMIT on a busy slot gets SLOT_BUSY on every engine
JustVugg Oct 6, 2026
ee8974d
Merge pull request #1953 from JustVugg/feat/release-everything
JustVugg Oct 6, 2026
41cf939
vulkan: the chain's pipelines at the device's subgroup size; Windows …
JustVugg Oct 6, 2026
20aef0b
gateway: up to 16 KV slots on every text engine; docs
JustVugg Oct 6, 2026
f51380b
ci: several conversations at once on every engine (mux families)
JustVugg Oct 6, 2026
4eff6ef
Merge remote-tracking branch 'origin/dev' into feat/mux-all-engines
JustVugg Oct 6, 2026
ba726cb
ci: MiMo's mux tier gate within the family's 1e-3
JustVugg Oct 6, 2026
7b739d0
Merge pull request #1954 from JustVugg/fix/vk-subgroup-pin
JustVugg Oct 6, 2026
8b7e2b6
Merge remote-tracking branch 'origin/dev' into feat/mux-all-engines
JustVugg Oct 6, 2026
d17f8a4
fix(setup): require Colibri health success before reusing a port
rudycelekli Oct 6, 2026
aaffdc2
Merge pull request #1955 from JustVugg/feat/mux-all-engines
JustVugg Oct 6, 2026
03099c6
release 2.0.0
JustVugg Oct 6, 2026
0adb2c9
Merge pull request #1958 from JustVugg/release/2.0.0
JustVugg Oct 6, 2026
a7e1f78
docs: the READMEs and the site say what 2.0 ships
JustVugg Oct 6, 2026
d76e9fb
docs: how to turn the GPU on or off, with the Iris Xe's numbers
JustVugg Oct 6, 2026
b442a90
Merge pull request #1959 from rudycelekli/fix/colibri-setup-health-co…
JustVugg Oct 6, 2026
8ca6ec8
Merge remote-tracking branch 'origin/dev' into docs/v2-readme-site
JustVugg Oct 6, 2026
23e33df
CHANGELOG: #1959 in 2.0.0, and the count with it
JustVugg Oct 6, 2026
f031619
Merge pull request #1965 from JustVugg/docs/v2-readme-site
JustVugg Oct 6, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 2 additions & 0 deletions .gitattributes
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# cmd.exe finds labels unreliably in LF-only batch files: keep CRLF on checkout.
START-HERE.bat text eol=crlf
37 changes: 36 additions & 1 deletion .github/workflows/check.yml
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,12 @@ jobs:
# limit and reported as failures), including one on dev itself. The suite
# has grown - segment conformance and adapters, the edge runtime, per-engine
# cache indices - and MinGW is the slowest toolchain we build on.
timeout-minutes: 35
# 2026-10-05: the 35 minutes set then were reached in turn. Over the last
# two days the job took 21 to 34 minutes when it passed, and was cancelled
# at 35 three times with every test passed so far (#1907, #1911 and a dev
# run), after #1901 added its suites. 60 leaves room for the suites still
# coming; a real hang still ends the job.
timeout-minutes: 60
defaults:
run:
shell: msys2 {0}
Expand Down Expand Up @@ -83,6 +88,33 @@ jobs:
- name: Generate fixture and run vendor oracle
run: make -C c kimi-k3-tiny-check

mimo-tiny:
name: Linux (generated tiny MiMo-V2.6 vendor oracle, text + vision)
runs-on: ubuntu-latest
timeout-minutes: 20
steps:
- uses: actions/checkout@v4
- uses: actions/setup-python@v5
with:
python-version: '3.13'
cache: pip
cache-dependency-path: c/tools/requirements-mimo-tiny.txt
- name: Install pinned tiny-fixture dependencies
run: python -m pip install -r c/tools/requirements-mimo-tiny.txt
- name: Generate fixture and run vendor oracle
run: make -C c mimo-tiny-check
- name: "Brio and the prompt cache: photos exact against a cold engine"
run: make -C c mimo-tiny-serve-check
- name: Same oracle under ASan and UBSan
run: |
make -C c clean >/dev/null
make -C c mimo EXTRA_CFLAGS="-fsanitize=address,undefined -fno-omit-frame-pointer -g"
ASAN_OPTIONS=detect_leaks=0:detect_stack_use_after_return=0 UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1 \
python c/tests/mimo_tiny_harness.py --binary c/mimo --fixture c/mimo_tiny
cd c && ASAN_OPTIONS=detect_leaks=0:detect_stack_use_after_return=0 UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1 \
python -m unittest tests.test_mimo_prefix_serve tests.test_brio_serve.MimoBrioServe \
tests.test_systemone_api.MimoSystemOneEndToEnd

v4-tiny:
name: Linux (generated tiny V4 target oracle)
runs-on: ubuntu-latest
Expand Down Expand Up @@ -130,12 +162,15 @@ jobs:
python c/tools/make_edge_tiny_tokenizer.py --vocab-size 281 /tmp/glm53_stream-i4
cd c && COLI_GLM53_FIXTURE=/tmp/glm53_stream-i4 python -m unittest -v tests.test_glm53_dashboard
COLI_GLM53_FIXTURE=/tmp/glm53_stream-i4 python -m unittest -v tests.test_glm53_context_exceeded
COLI_GLM53_FIXTURE=/tmp/glm53_stream-i4 python -m unittest -v tests.test_glm53_hostile_weights
COLI_GLM53_FIXTURE=/tmp/glm53_mm python -m unittest -v tests.test_glm53_hostile_weights.Glm53MatrixShapeTest
# The two stdlib-only oracles used to be argparse scripts that `make
# test-python` collected as zero tests (#1700). They run here, on the
# fixtures generated above, token-exact against transformers in f32.
- name: Run the GLM-5.3 tiny oracles
run: |
cd c && GLM53_TINY=/tmp/glm53_tiny GLM53_MM_TINY=/tmp/glm53_mm python -m unittest -v tests.test_glm53_oracles
GLM53_TINY=/tmp/glm53_tiny COLI_GLM53_FIXTURE=/tmp/glm53_stream-i4 python -m unittest -v tests.test_glm53_prefill_batch

macos:
# clang; libomp for the threaded path (Makefile falls back to
Expand Down
642 changes: 628 additions & 14 deletions .github/workflows/ci.yml

Large diffs are not rendered by default.

235 changes: 226 additions & 9 deletions .github/workflows/release.yml

Large diffs are not rendered by default.

35 changes: 35 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,11 @@ c/kimi_k3.exe
c/olmoe.exe
c/qwen38
c/qwen38.exe
c/laya
c/laya.exe
c/gliner_decide
c/gliner_decide.exe
c/tools/jev-sdk/node_modules/
# deepseek_v4 and the per-unit objects its amalgamated Makefile leaves behind.
# The same omission as #858, one file over: every engine is listed here except
# the one added last, so `make deepseek-v4` left 26 untracked .o files in
Expand Down Expand Up @@ -92,6 +97,14 @@ c/glm_tiny_i4/
c/glm_tiny_mix/
c/glm_tiny_fmt6/
c/glm_tiny_fmt4/
# tests/vulkan_engines.sh glm: the FP8 oracle and its int4/int3 conversions, GLM-5.3's tiny pair
c/glm_fp8/
c/glm_tiny_i4r/
c/glm_tiny_i3/
c/glm_tiny_d3/
c/glm53_tiny/
c/glm53_stream-i4/
c/glm53_stream-deq/
c/glm_bench_medium/
c/bench/

Expand Down Expand Up @@ -129,6 +142,15 @@ c/qwen38_tiny/
c/dsv41_tiny/
c/qwen36_tiny/
c/qwen36_tiny_c/
# tests/spec_drafts_harness.py: the ASCII-vocabulary fixture whose replies round-trip as text
c/qwen36_tiny_v128/
c/qwen36_tiny_v128_c/
c/qwen36_tiny64_v128/
c/qwen36_tiny64_v128_c/
# tools/make_clef_tiny.py and its container; clef_tiny/ref.json is committed
c/clef_tiny/*
!c/clef_tiny/ref.json
c/clef_tiny_c/
c/qwen38_2p4t_tiny/
c/qwen38_2p4t_tiny_c/

Expand Down Expand Up @@ -158,3 +180,16 @@ c/kimi_k3_tiny/.coli_usage
c/qwen38_vision_tiny/
c/qwen38_mm_tiny/
c/qwen38_tiny_fp8/
c/qwen38_tiny_int4/
c/qwen38_tiny_mtp/
c/qwen38_tiny_fp8_mtp/
c/qwen38_tiny_int4_mtp/
# MiMo tiny fixture: config.json and ref.json are committed, the rest is regenerated
c/mimo_tiny/*.safetensors
c/mimo_tiny/model.safetensors.index.json
c/mimo_tiny/.vendor_mimo_v2/
c/mimo_tiny/image.png
c/mimo_tiny/image.json
c/mimo_tiny/patches.f32
c/mimo
c/mimo.exe
Loading
Loading