BigBird introduced in paper: Big Bird: Transformers for Longer Sequences (Zaheer et al., 2020).
Predicate
introduced_in_paper
Object
Big Bird: Transformers for Longer Sequences (Zaheer et al., 2020)
Primary source · preprint · 2020-07-28
Big Bird: Transformers for Longer Sequences — arXiv (Manzil Zaheer, Guru Guruganesh, Avinava Dubey, Joshua Ainslie, Chris Alberti, Santiago Ontanon, Philip Pham, Anirudh Ravula, Qifan Wang, Li Yang, Amr Ahmed)