Skip to content

Pull requests: vllm-project/vllm

New pull request New
2,002 Open 20,504 Closed
2,002 Open 20,504 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Benchmark] Add iteration benchmark with server-side step stats, trac… frontend needs-rebase performance Performance-related issues tpu Related to Google TPUs v1
#37251 opened Mar 17, 2026 by YJYJLee • Draft
5 tasks
6
[MoE] Introduce Fp8MoEState and class-based dispatch for DeepGemm
#37249 opened Mar 17, 2026 by yzong-rh Loading…
5 tasks
1
refactor: standardize kimi_linear and minimax_text_01 model weight loading to use AutoWeightsLoader
#37248 opened Mar 17, 2026 by XLiu-2000 Loading…
6
[Model] Implement LoRA support for Qwen3ASRForConditionalGeneration documentation Improvements or additions to documentation qwen Related to Qwen models
#37247 opened Mar 17, 2026 by petern48 Loading…
5 tasks
1
2
[Bugfix] dtype mismatch in ngram gpu propose bug Something isn't working speculative-decoding v1
#37246 opened Mar 17, 2026 by PatchouliTIS Loading…
3 of 5 tasks
[Bugfix] Fix incorrect int8 dtype cast for kv_c_normed in MLA prefill bug Something isn't working
#37245 opened Mar 17, 2026 by jacob-crux Loading…
3 of 5 tasks
1
[Perf] Support Flashinfer trtllm tinygemm_bf16 router gemm for GPT-OSS gpt-oss Related to GPT-OSS models
#37244 opened Mar 17, 2026 by elvischenv Loading…
5 tasks
4
[ROCm][CI] Refine gating tests ci/build rocm Related to AMD ROCm
#37243 opened Mar 17, 2026 by AndreasKaratzas • Draft
3
[Refactor] Relocate responses API tests ready ONLY add when PR is ready to merge/full CI is needed v1
#37241 opened Mar 17, 2026 by sfeng33 Loading…
1
[Models][GDN] Prevent D2H sync in ChunkGatedDeltaRule qwen Related to Qwen models v1
#37239 opened Mar 16, 2026 by lgeiger Loading…
6
[Model Runner V2] Spec decode rejection sampler greedy support v1
#37238 opened Mar 16, 2026 by TheEpicDolphin Loading…
4
[Model Runner V2] Spec decode rejection sampler logprobs support v1
#37237 opened Mar 16, 2026 by TheEpicDolphin Loading…
5
Fix ambiguous num_blocks for hybrid attn mamba v1
#37236 opened Mar 16, 2026 by collinmccarthy Loading…
[Bugfix] Fix for builtins (forward fix of pytorch/177558) bug Something isn't working
#37234 opened Mar 16, 2026 by Lucaskabela • Draft
5 tasks
3
[UX] Add flashinfer-cubin as CUDA default dep ci/build nvidia
#37233 opened Mar 16, 2026 by mgoin Loading…
5 tasks
2
[Bugfix] Expand quantization method support in perf metrics bug Something isn't working v1
#37231 opened Mar 16, 2026 by thillai-c Loading…
3 of 5 tasks
3
[CI] Fix GPU memory leak when RemoteOpenAIServer fails to start in __init__
#37230 opened Mar 16, 2026 by AndreasKaratzas Loading…
1 task done
3
Fix Qwen3.5-Next RMSNormGated Initialization Error on TPU qwen Related to Qwen models
#37229 opened Mar 16, 2026 by jrplatin Loading…
5 tasks
1
[ROCM][Bugfix] Use correct stride in cp_mha_gather_cache_kernel for hybrid model (#37228) bug Something isn't working fb-exported meta-exported rocm Related to AMD ROCm v1
#37228 opened Mar 16, 2026 by jennyyyyzhen Loading…
4
[Perf] Use list.extend() over append loops in FlatLogprobs + minor hot-path cleanups v1
#37227 opened Mar 16, 2026 by vaibhavhariram Loading…
1
[WIP] Bring back nightly build ci/build
#37226 opened Mar 16, 2026 by atalman Loading…
5
[Perf] Optimize top-k search in apply_top_k_top_p_triton sampler performance Performance-related issues ready ONLY add when PR is ready to merge/full CI is needed v1
#37225 opened Mar 16, 2026 by mgoin Loading…
2 of 7 tasks
7
[UltraVox] Fix output type
#37224 opened Mar 16, 2026 by vasqu Loading…
3
[3/n] Migrate cutlass/scaled_mm_entry.cu torch stable ABI ci/build nvidia
#37221 opened Mar 16, 2026 by mikaylagawarecki Loading…
5 tasks
4
[Bugfix] Consolidate Gemma2/3 GGUF fixes for correctness on Blackwell bug Something isn't working
#37220 opened Mar 16, 2026 by kitaekatt Loading…
5
ProTip! Type g i on any issue or pull request to go back to the issue listing page.