Skip to main content
← Back to Bibliography

Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned

Authors: Elena Voita, David Talbot, Fedor Moiseev, Rico Sennrich, Ivan Titov

Year: 2019

Venue: ACL

Type: article

URL: https://arxiv.org/abs/1905.09418

arXiv: 1905.09418

Cite as: [@voita2019analyzing]

Raw Files

No raw files yet. Run node scripts/fetch-bibliography-raw.mjs --only voita2019analyzing to populate, or drop files into raw/bibliography/voita2019analyzing/.

BibTeX

@inproceedings{voita2019analyzing,
  title = {Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned},
  author = {Elena Voita and David Talbot and Fedor Moiseev and Rico Sennrich and Ivan Titov},
  year = {2019},
  booktitle = {ACL},
  url = {https://arxiv.org/abs/1905.09418}
}

Notes

No notes yet. Create notes/voita2019analyzing.md to add notes.