Table of Contents

2026.04

• Reading Notes: RetNet
• Reading Notes: Gated Linear Attention, Implementation Notes
• Reading Notes: DeltaNet, Backward Pass, Implementation Notes
• Reading Notes: Gated Delta Networks, Backward Pass, Implementation Notes
• Reading Notes: Kimi Delta Attention, Backward Pass, Implementation Notes
• Reading Notes: Diagonal Plus Low Rank

2026.05

• The Hidden Recurrence in Softmax Attention: A Path to Flash Attention

Comments