github:zechenzhangAGI/AI-research-SKILLs · first seen 2026-10-31 · source · badge
Post-training 4-bit quantization for LLMs with minimal accuracy loss. Use for deploying large models (70B, 405B) on consumer GPUs, when you need 4Ã memory reduction with <2% perplexity degradation, or for faster inference (3-4Ã speedup) vs FP16. Integrates with transformers and PEFT for QLoRA fine-tuning.
Listed, not yet scored. This skill has no public model test yet. It is in the scoring queue; submitted skills go first, then the most-installed.