Skip to content

fix(quantize): Q5_K readers decoded an invented layout — every Q5_K tensor on the CPU path and in apr import was wrong (PMAT-1101) - #3110

Closed
noahgift wants to merge 6 commits into
mainfrom
PMAT-1101-q5k-ggml-layout
Closed

fix(quantize): Q5_K readers decoded an invented layout — every Q5_K tensor on the CPU path and in apr import was wrong (PMAT-1101)#3110
noahgift wants to merge 6 commits into
mainfrom
PMAT-1101-q5k-ggml-layout