-
Notifications
You must be signed in to change notification settings - Fork 407
Pull requests: vllm-project/production-stack
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[Bugfix]: Fix streaming "connection closed" before body consumed in orchestrated disaggregated routing
#960
opened May 25, 2026 by
shoreline2
Loading…
3 tasks done
[Router] Add prefix_min_match_length threshold to PrefixAwareRouter
#959
opened May 23, 2026 by
ywc668
Loading…
4 tasks done
[FEAT] add support for customiziable runtimeClass & podAnnotaions
#958
opened May 22, 2026 by
mahmoudk1000
Contributor
Loading…
3 tasks done
[Bugfix] Upgrade multipart to 0.0.29
#956
opened May 21, 2026 by
shernshiou
Contributor
Loading…
3 tasks done
[Feat][Router] Add per-algorithm routing decisions counter (Refs #474)
#951
opened May 13, 2026 by
banlor
Contributor
Loading…
3 tasks done
[Bugfix] Fix /v1/audio/transcriptions endpoint when not using roundrobin
#950
opened May 12, 2026 by
guba-elleschr
Loading…
[Feat] Add per-model custom labels and podLabels to modelSpec
#949
opened May 11, 2026 by
NasAmin
Loading…
[BugFux] Fix help text formatting for Sentry sample rates in argument parser t…
#946
opened May 8, 2026 by
xiaoajie738
Loading…
3 tasks
[Bugfix][Router] service_discovery: add has_ever_seen_model to K8sServiceNameServiceDiscovery
#945
opened May 8, 2026 by
saikpr
Loading…
3 tasks
[Feat][Router]: Add automatic retry with exponential backoff and jitter
#939
opened May 1, 2026 by
ikaadil
Contributor
Loading…
[Feat][Router] Support multiple API keys for multi-tenant authentication (#759)
#937
opened Apr 29, 2026 by
prashansapkota
Contributor
Loading…
fix(router): unify route_request to async with optional request_json
#929
opened Apr 23, 2026 by
nejch
Contributor
Loading…
2 of 3 tasks
[Feat][Router]: add fallback model support
#921
opened Apr 16, 2026 by
max-wittig
Contributor
•
Draft
3 tasks done
[Feat][Router]: allow healthchecks to be disabled by models
#920
opened Apr 16, 2026 by
max-wittig
Contributor
•
Draft
2 of 3 tasks
build(deps): Bump the github-actions group across 1 directory with 10 updates
dependencies
Pull requests that update a dependency file
github_actions
Pull requests that update GitHub Actions code
#919
opened Apr 15, 2026 by
dependabot
Bot
Loading…
[Feat] Add NIXL-based disaggregated prefill routing support
#913
opened Apr 12, 2026 by
Vivo50E
Loading…
3 tasks done
[Feat] feat(aliases): allow setting reasoning level
#912
opened Apr 10, 2026 by
Killusions
Contributor
Loading…
3 tasks done
[Router] Add phase 1 router queue groundwork
#905
opened Apr 7, 2026 by
ardecode
Contributor
Loading…
[Feat][Router] Add conditional disaggregated routing with threshold-based request classification
#890
opened Mar 18, 2026 by
XuanCS
Loading…
3 tasks done
[Doc] Fix a broken relative link in the observability README
#887
opened Mar 15, 2026 by
baiyan305
Loading…
1 task done
[Feat][Router] Add load-balanced KV-aware routing strategy
#884
opened Mar 12, 2026 by
notTyche
Loading…
[FEAT][RFC] Add router-side request queuing proposal
#876
opened Mar 7, 2026 by
ardecode
Contributor
Loading…
3 tasks
[FEAT][Helm] Add configurable NodePort support for router service
#870
opened Mar 5, 2026 by
ardecode
Contributor
Loading…
3 tasks done
Previous Next
ProTip!
Adding no:label will show everything without a label.