INT4 LoRA fantastic-tuning vs QLoRA: A user inquired about the discrepancies amongst INT4 LoRA great-tuning and QLoRA in terms of precision and speed. Yet another member explained that QLoRA with HQQ entails frozen quantized weights, doesn't use tinnygemm, and utilizes dequantizing together with torch.matmulThe open-supply IC-Mild job centered on b