sebastianbodza / autoawq_gptbigcode15b Goto Github PK
View Code? Open in Web Editor NEWThis project forked from casper-hansen/autoawq
AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference.
License: MIT License