Skip to main content
← Back to Bibliography

ZeRO: Memory Optimizations Toward Training Trillion Parameter Models

Authors: Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase, Yuxiong He

Year: 2020

Venue: SC

Type: article

URL: https://arxiv.org/abs/1910.02054

arXiv: 1910.02054

Cite as: [@rajbhandari2020zero]

Raw Files

No raw files yet. Run node scripts/fetch-bibliography-raw.mjs --only rajbhandari2020zero to populate, or drop files into raw/bibliography/rajbhandari2020zero/.

BibTeX

@article{rajbhandari2020zero,
  title = {ZeRO: Memory Optimizations Toward Training Trillion Parameter Models},
  author = {Samyam Rajbhandari and Jeff Rasley and Olatunji Ruwase and Yuxiong He},
  year = {2020},
  journal = {SC},
  url = {https://arxiv.org/abs/1910.02054}
}

Notes

No notes yet. Create notes/rajbhandari2020zero.md to add notes.