Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models

Authors: Soham De, Samuel L. Smith, Anushan Fernando

Year: 2024

Venue: arXiv

Type: article

URL: https://arxiv.org/abs/2402.19427

arXiv: 2402.19427

Cite as: [@de2024griffin]

Raw Files

No raw files yet. Run node scripts/fetch-bibliography-raw.mjs --only de2024griffin to populate, or drop files into raw/bibliography/de2024griffin/.

BibTeX

@article{de2024griffin,
  title = {Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models},
  author = {Soham De and Samuel L. Smith and Anushan Fernando},
  year = {2024},
  journal = {arXiv},
  url = {https://arxiv.org/abs/2402.19427}
}

Notes

No notes yet. Create notes/de2024griffin.md to add notes.