Skip to content

Pull requests: vllm-project/tpu-inference

New pull request New
306 Open 2,756 Closed
306 Open 2,756 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[kernel][gmm] Add Bucketized GMM ready ONLY add when PR is ready to merge/full CI is needed
#3219 opened Jul 18, 2026 by kyuyeunk Collaborator Loading…
1
[Kimi][MLAv2] Add tuned params for Kimi-K2.6 ready ONLY add when PR is ready to merge/full CI is needed
#3218 opened Jul 18, 2026 by jrplatin Collaborator Loading…
1
Fix breakages from vLLM upstream changes (advance LKG) ready ONLY add when PR is ready to merge/full CI is needed
#3217 opened Jul 17, 2026 by wenxindongwork Collaborator Loading…
1
Fix cpu_mesh() when no CPU backend exists (e.g. on Pathways)
#3216 opened Jul 17, 2026 by andytwigg Collaborator Loading…
2
Add iterative_top_k to MOE_TOPK_BACKEND ready ONLY add when PR is ready to merge/full CI is needed
#3215 opened Jul 17, 2026 by lk-chen Collaborator • Draft
1
Fix it to ensure that the metadata is updated correctly ready ONLY add when PR is ready to merge/full CI is needed
#3211 opened Jul 17, 2026 by CienetStingLin Collaborator Loading…
1
update benchmark readme
#3210 opened Jul 17, 2026 by ernie-chang Collaborator • Draft
[TPU v8i] Support tpu v8i in RPA v3 ready ONLY add when PR is ready to merge/full CI is needed
#3209 opened Jul 17, 2026 by BirdsOfAFthr Collaborator Loading…
3 tasks done
support ipv6 and ipv4 parse
#3208 opened Jul 17, 2026 by eating-chen Loading…
Optional block-diffusion (masked-diffusion) decode path
#3207 opened Jul 17, 2026 by ethannnnnn Loading…
Add low-concurrency C=N Pallas MoE fast path
#3204 opened Jul 16, 2026 by rxu183 • Draft
Drive agentic benchmark from real R2E-Gym SWE content
#3203 opened Jul 16, 2026 by wenxindongwork Collaborator • Draft
3 tasks done
1
MoE TP: hidden-dim (D) and hybrid (DF) sharding variants ready ONLY add when PR is ready to merge/full CI is needed
#3201 opened Jul 16, 2026 by dawnhan1111 Collaborator Loading…
feat(rpa-v3): tuned 4-tuple block-size table (make the +48% decode split the default)
#3200 opened Jul 16, 2026 by lokic233 Contributor Loading…
[Feat][KV Cache] Unified block-major KV cache for Qwen2/3: block id as the major dim for O(1) block transfer ready ONLY add when PR is ready to merge/full CI is needed
#3199 opened Jul 16, 2026 by yiw-wang Collaborator Loading…
2
[Jax] Wire blockwise fp8 merged linear into compressed-tensors dispatch ready ONLY add when PR is ready to merge/full CI is needed
#3193 opened Jul 15, 2026 by jerviscz Contributor Loading…
3 tasks done
1
3
feat(kv_cache): env-gated KV-cache persistence across weight sync
#3191 opened Jul 15, 2026 by lokic233 Contributor Loading…
3 tasks done
[GDNv3] SPEC mode for speculative-decoding state checkpoints ready ONLY add when PR is ready to merge/full CI is needed
#3189 opened Jul 14, 2026 by Lumosis Collaborator Loading…
1
[Fix] Qwen3 MoE Fused EP Kernel 6D mesh mismatch (b/530647244)
#3186 opened Jul 14, 2026 by inucool12 Collaborator Loading…
3 tasks done
1
[CI] Migrate multi-host benchmark ready ONLY add when PR is ready to merge/full CI is needed
#3182 opened Jul 14, 2026 by boe20211 Collaborator • Draft
3
[MTP] mamba state rollback
#3178 opened Jul 14, 2026 by Lumosis Collaborator • Draft
1
Pin gemma-4 E2B/E4B nightly tests to the JAX path (MODEL_IMPL_TYPE=flax_nnx)
#3176 opened Jul 14, 2026 by QiliangCui2023 Collaborator Loading…
1
feat(continue_decode): env-gated EOS-check interval for the fused decode loop
#3174 opened Jul 13, 2026 by lokic233 Contributor Loading…
2
Use Buildkite Test Engine to cllect tests metrics and auto split tests ready ONLY add when PR is ready to merge/full CI is needed
#3169 opened Jul 13, 2026 by theminghuang Collaborator Loading…
2
Add attention sink support for ragged paged attention
#3167 opened Jul 13, 2026 by JamesDeng42 Loading…
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.