← Back to Portal Home
General
⚖️ Neutral
🌙 Dark Mode
Understanding BigBird's Block Sparse Attention
🌐 Source:
Hugging Face
• 📅 31 Mar 2021 • ⏱️ 1 min read (7 words, ⚡ Quick Read)
Content not available.
→ Read original article
🔗 Related Articles
📰 #35389. Block Sparse Matrices for Smaller and Faster Language Models
📰 #35270. Breaking: Nyströmformer: Approximating self-attention in linear time and memory via the Nyström method
📰 #34801. Welcome Falcon Mamba: The first strong attention-free 7B model
📰 #34798. A failed experiment: Infini-Attention, and why we should keep trying?