Skip to content

Pull requests: Dao-AILab/flash-attention

New pull request New
152 Open 551 Closed
152 Open 551 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add [STATIC] tile trace for CLC-off work distribution
#2471 opened Apr 17, 2026 by Edenzzzz Loading…
3 tasks done
[Cute,Fwd,Sm100] Fix deadlock and crash when seqlen_k=0
#2470 opened Apr 17, 2026 by Johnsonms Collaborator Loading…
6 tasks done
2
Add page table support for MLA SM100 forward kernel
#2468 opened Apr 17, 2026 by Johnsonms Collaborator Loading…
3 tasks done
[FA3,SM90,Fwd] Enable symmetric head dim 512 forward
#2467 opened Apr 17, 2026 by foreverrookie Loading…
4 tasks done
Fix FlashAttention-3 installation verification script
#2465 opened Apr 16, 2026 by 3manifold Loading…
fix causal calcs
#2463 opened Apr 16, 2026 by drisspg Collaborator Loading…
1
[FA3] uv installation support
#2458 opened Apr 14, 2026 by bbuschkaemper Loading…
14
[FA4][CuTe DSL] Add head_dim=256 support with exp2 FMA emulation optimization (forward + backward, SM100)
#2454 opened Apr 13, 2026 by Johnsonms Collaborator • Draft
layers/rotary: add rope_scaling support (linear, NTK, YaRN)
#2451 opened Apr 11, 2026 by GitGlimpse895 Loading…
Support batch invariant forward for FA3
#2450 opened Apr 10, 2026 by Edenzzzz Loading…
1
[Perf] SM103 tcgen05.ld.red for fused TMEM load + row-max in softmax
#2449 opened Apr 9, 2026 by LopezCastroRoberto Loading…
4
Add forward and backward support for FA4 hdim=256 on SM100
#2447 opened Apr 8, 2026 by wenkechen Loading…
[Cute,Fwd,Sm90] Ceil div in paged kv manager to prevent size 0
#2446 opened Apr 8, 2026 by imbr92 Contributor Loading…
[FA3][Hopper] Make the split heuristic sequence-aware for low-tile decode
#2445 opened Apr 8, 2026 by mllopartbsc Loading…
Add dropout support to CuTe DSL attention kernels
#2439 opened Apr 6, 2026 by blake-snc Contributor Loading…
10 of 12 tasks
26
Draft: native FA4 bring-up for SM100 larger attention head dims
#2435 opened Apr 3, 2026 by m0at • Draft
[CuTe,Fwd,SM90] Enable head dim 512 for SM90
#2422 opened Apr 1, 2026 by IwakuraRein Loading…
6
[CuTe, SM120] Fix forward/backward bugs and add SM120 test guards
#2420 opened Apr 1, 2026 by 2imi9 Loading…
3
Add compress_factor for compressed causal attention
#2418 opened Mar 31, 2026 by jduprat Contributor Loading…
4
Fix SM120 forward pass crash: parent __init__ overwrites arch, enabling unsupported TMA path
#2416 opened Mar 31, 2026 by moghon92 Loading…
[Cute,Fwd,Sm90] Support SplitKV
#2415 opened Mar 31, 2026 by imbr92 Contributor Loading…
1
Feat([FA4][CUTE DSL]) Add head_dim=256 support (forward + backward)
#2412 opened Mar 30, 2026 by wangsiyu Loading…
28
chore(tests): move benchmarks to benchmarks/cute/ and reduce test prints
#2408 opened Mar 29, 2026 by NJX-njx Contributor Loading…
3 tasks
1
1
fix(flash_fwd_sm90): zero partial V smem to prevent 0*NaN=NaN in PV GEMM
#2407 opened Mar 29, 2026 by NJX-njx Contributor Loading…
3 tasks
1
[CuTe, SM120] Forward kernel with optimized TMA path and full features support
#2406 opened Mar 28, 2026 by sisgrad Loading…
7
ProTip! Filter pull requests by the default branch with base:main.