RoFormer: Enhanced Transformer with Rotary Position Embedding

Authors: Jianlin Su, Murtadha Ahmed, Yu Lu, Shengfeng Pan, Wen Bo, Yunfeng Liu

Year: 2024

Venue: Neurocomputing

Type: article

URL: https://arxiv.org/abs/2104.09864

Cite as: [@su2024rope]

Raw Files

No raw files yet. Run node scripts/fetch-bibliography-raw.mjs --only su2024rope to populate, or drop files into raw/bibliography/su2024rope/.

BibTeX

@article{su2024rope,
  title = {RoFormer: Enhanced Transformer with Rotary Position Embedding},
  author = {Jianlin Su and Murtadha Ahmed and Yu Lu and Shengfeng Pan and Wen Bo and Yunfeng Liu},
  year = {2024},
  journal = {Neurocomputing},
  url = {https://arxiv.org/abs/2104.09864}
}

Notes

No notes yet. Create notes/su2024rope.md to add notes.