跳转至

Reading Notes

目录

English
简体中文

正在初始化搜索引擎

Reading Notes

简介
Linear Attention
Linear Attention
- 0. flash attn
  0. flash attn
  - 注意力中隐藏的递推结构：Flash Attention介绍
- 1. retnet
  1. retnet
  - 阅读笔记：RetNet
- 2. gated linear attention
  2. gated linear attention
  - 阅读笔记：GLA 在 FLA 中的代码实现笔记
  - 阅读笔记：Gated Linear Attention
- 3. deltanet
  3. deltanet
- 4. gated deltanet
  4. gated deltanet
- 5. kimi linear
  5. kimi linear
- 6. DPLR
  6. DPLR
  - Diagonal Plus Low Rank
Multimodal Model
Multimodal Model
- Doc model
  Doc model
  - 文档理解与生成的交错式多模态模型朴素设计

目录

2026.05

目录¶

2026.05¶

A Naive Design of Interleaved Multimodal Models for Document Understanding and Generation

Comments

Made with Material for MkDocs