Skip to content

Pull requests: alibaba/rtp-llm

New pull request New
61 Open 289 Closed
61 Open 289 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat - refactor fmha python in cudagraph & adapt pymodel mla cudagraph
#463 opened Dec 17, 2025 by Nancheng-11 Loading…
fix - some qwen3_reranker have no lm_weight
#462 opened Dec 17, 2025 by jianglan89 Loading…
Fix shutdown
#461 opened Dec 17, 2025 by jianglan89 Loading…
feat: rocm maskLogits
#459 opened Dec 16, 2025 by CrimsonDump Loading…
2
fix: extra tokens after stop word and glm missing separator in tool call
#458 opened Dec 15, 2025 by soaringk Loading…
9
[WIP] Feature/support qwen next merge
#457 opened Dec 15, 2025 by alibaba-miji Loading…
opt startup speed: reduce too long health check interval & move import in func
#456 opened Dec 15, 2025 by ABNER-1 Loading…
2
Ll/host pool
#455 opened Dec 15, 2025 by jianglan89 Loading…
fix: remove fallback and fastgen
#454 opened Dec 15, 2025 by xinfei-shi Loading…
1
[draft] Features/refactor frontend
#452 opened Dec 15, 2025 by wanglining97 Loading…
6
Feat/refactor cuda graph ut
#450 opened Dec 15, 2025 by JackTan25 Loading…
2
support fp8 fmha for rocm pymodel
#449 opened Dec 12, 2025 by liaocz Loading…
10
Feature/flashinfer python merge
#448 opened Dec 12, 2025 by zerozw Loading…
15
[WIP] feat: support dt customize embedding methods
#447 opened Dec 12, 2025 by yinjuncheng Loading…
feat: support trtllm_fp4_block_scale_routed_moe
#446 opened Dec 11, 2025 by CrimsonDump Loading…
3
feat: support python-xqa with CUDA 12.9 and compatible with CUDA 12.6
#444 opened Dec 11, 2025 by qqbbiu Loading…
3
hotfix: fix try catch
#442 opened Dec 10, 2025 by wanglining97 Loading…
refactor(rtp_llm): fix frontend loop stuck issue
#438 opened Dec 10, 2025 by sunmiaozju Loading…
9
[draft] master 0.0.2
#427 opened Dec 4, 2025 by jianglan89 Loading…
5
fix: wrong residual when pre decoder layernorm + mm embedding + quant
#426 opened Dec 4, 2025 by LLLLKKKK Loading…
1
feat: support pure tp + ep for cuda graph
#425 opened Dec 3, 2025 by JackTan25 Loading…
42
feat: support return raw output and output ids in debug info
#421 opened Dec 2, 2025 by soaringk Loading…
5
refactor: optimize token reorder impl
#419 opened Dec 2, 2025 by MMadhatter Loading…
feature - add viztracer for inference api
#417 opened Dec 2, 2025 by jianglan89 Loading…
3
Support DeepSeek v3.2 encoding module
#415 opened Dec 2, 2025 by soaringk Loading…
9
ProTip! Filter pull requests by the default branch with base:main.