feat: use gpu marlin repack for quant weights#459

qinyiqun wants to merge 1 commit into

InfiniTensor:mainInfiniTensor/InfiniLM:mainfrom

qinyiqun:marlin_repackqinyiqun/InfiniLM:marlin_repackCopy head branch name to clipboard