Skip to content

Add GemLite quantization backend support for pre-quantized checkpoints - #14286

Draft
gabe-engineers wants to merge 10 commits into
huggingface:mainfrom
gabe-engineers:add-gemlite-quantizer
Draft

Add GemLite quantization backend support for pre-quantized checkpoints#14286
gabe-engineers wants to merge 10 commits into
huggingface:mainfrom
gabe-engineers:add-gemlite-quantizer