Skip to main content
← Back to Bibliography

GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding

Authors: Dmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu

Year: 2021

Venue: ICLR

Type: article

URL: https://arxiv.org/abs/2006.16668

arXiv: 2006.16668

Cite as: [@lepikhin2021gshard]

Raw Files

No raw files yet. Run node scripts/fetch-bibliography-raw.mjs --only lepikhin2021gshard to populate, or drop files into raw/bibliography/lepikhin2021gshard/.

BibTeX

@inproceedings{lepikhin2021gshard,
  title = {GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding},
  author = {Dmitry Lepikhin and HyoukJoong Lee and Yuanzhong Xu},
  year = {2021},
  booktitle = {ICLR},
  url = {https://arxiv.org/abs/2006.16668}
}

Notes

No notes yet. Create notes/lepikhin2021gshard.md to add notes.