RoFormer: Enhanced Transformer with Rotary Position Embedding

Authors: Jianlin Su, Yu Lu, Shengfeng Pan, Ahmed Murtadha, Bo Wen, Yunfeng Liu

Year: 2024

Venue: Neurocomputing

Type: article

URL: https://arxiv.org/abs/2104.09864

Cite as: [@su2024roformer]

Raw Files

No raw files yet. Run node scripts/fetch-bibliography-raw.mjs --only su2024roformer to populate, or drop files into raw/bibliography/su2024roformer/.

BibTeX

@article{su2024roformer,
  title = {RoFormer: Enhanced Transformer with Rotary Position Embedding},
  author = {Jianlin Su and Yu Lu and Shengfeng Pan and Ahmed Murtadha and Bo Wen and Yunfeng Liu},
  year = {2024},
  journal = {Neurocomputing},
  url = {https://arxiv.org/abs/2104.09864}
}

Notes

No notes yet. Create notes/su2024roformer.md to add notes.