Skip to main content
← Back to Bibliography

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

Authors: Jiawei Zhao, Zhenyu Zhang, Beidi Chen, Zhangyang Wang, Anima Anandkumar, Yuandong Tian

Year: 2024

Venue: ICML

Type: article

URL: https://arxiv.org/abs/2403.03507

arXiv: 2403.03507

Cite as: [@zhao2024galore]

Raw Files

No raw files yet. Run node scripts/fetch-bibliography-raw.mjs --only zhao2024galore to populate, or drop files into raw/bibliography/zhao2024galore/.

BibTeX

@inproceedings{zhao2024galore,
  title = {GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection},
  author = {Jiawei Zhao and Zhenyu Zhang and Beidi Chen and Zhangyang Wang and Anima Anandkumar and Yuandong Tian},
  year = {2024},
  booktitle = {ICML},
  url = {https://arxiv.org/abs/2403.03507}
}

Notes

No notes yet. Create notes/zhao2024galore.md to add notes.