Skip to main content
← Back to Bibliography

1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed

Authors: Hanlin Tang, Shaoduo Gan, Ammar Ahmad Awan, Samyam Rajbhandari, Conglong Li, Xiangru Lian, Ji Liu, Ce Zhang, Yuxiong He

Year: 2021

Venue: International Conference on Machine Learning (ICML)

Type: inproceedings

URL: https://arxiv.org/abs/2102.02888

arXiv: 2102.02888

Cite as: [@tang2021onebit]

Raw Files

No raw files yet. Run node scripts/fetch-bibliography-raw.mjs --only tang2021onebit to populate, or drop files into raw/bibliography/tang2021onebit/.

BibTeX

@inproceedings{tang2021onebit,
  title = {1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed},
  author = {Hanlin Tang and Shaoduo Gan and Ammar Ahmad Awan and Samyam Rajbhandari and Conglong Li and Xiangru Lian and Ji Liu and Ce Zhang and Yuxiong He},
  year = {2021},
  booktitle = {International Conference on Machine Learning (ICML)},
  url = {https://arxiv.org/abs/2102.02888}
}

Notes

No notes yet. Create notes/tang2021onebit.md to add notes.