QLoRA
A fine-tuning method that backpropagates gradients through frozen, 4-bit quantized base models into LoRA adapters.
QLoRA combines 4-bit model quantization (NF4) with Low-Rank Adaptation. It dynamically dequantizes base weights to compute gradients, enabling fine-tuning of massive models on single enterprise GPUs.
Historical figures and technical concepts for informational purposes only. Not technical, professional, legal, or financial advice. Sources: Official Documentation.