GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
pytorch
lora
low-rank-approximation
peft
large-language-models
llm
low-rank-adaptation
finetuning-llms
galore
-
Updated
Mar 7, 2024 - Python