Search results

[Serve][LLM] NPU benchmarking for Ray Serve + vLLM

Status: Open.

#62985 In ray-project/ray;

· KaisennHu opened on Apr 28, 2026

[Serve][LLM] Recipe for DeepSeek-V4 on NPU via Ray Serve + vLLM

Status: Open.

#62983 In ray-project/ray;

· KaisennHu opened on Apr 28, 2026

[serve] Two regressions in 2.55.0 traceable to PR #60757 auto-enabling DIRECT_INGRESS + USE_GRPC under THROUGHPUT_OPTIMIZED

bugSomething that is supposed to be working; but isn'tSomething that is supposed to be working; but isn't

triageNeeds triage (eg: priority, bug/not-bug, and owning component)Needs triage (eg: priority, bug/not-bug, and owning component)

Status: Open.

#62982 In ray-project/ray;

· CyrilPeponnet opened on Apr 28, 2026

[Serve] HAProxy stats_port hardcoded to 8404 — no env var override

community-backlog

serveRay Serve Related IssueRay Serve Related Issue

stability

usability

Status: Open.

#62976 In ray-project/ray;

· praateekmahajan opened on Apr 27, 2026

Too many arguments for "__exit__" of "BaseContext" starting with ray 2.55.0

bugSomething that is supposed to be working; but isn'tSomething that is supposed to be working; but isn't

community-backlog

coreIssues that should be addressed in Ray CoreIssues that should be addressed in Ray Core

triageNeeds triage (eg: priority, bug/not-bug, and owning component)Needs triage (eg: priority, bug/not-bug, and owning component)

usability

Status: Open.

#62971 In ray-project/ray;

· cburroughs opened on Apr 27, 2026

[Core] Add time-based log retention to prevent indefinite session log accumulation

community-backlog

coreIssues that should be addressed in Ray CoreIssues that should be addressed in Ray Core

enhancementRequest for new feature and/or capabilityRequest for new feature and/or capability

observabilityIssues related to the Ray Dashboard, Logging, Metrics, Tracing, and/or ProfilingIssues related to the Ray Dashboard, Logging, Metrics, Tracing, and/or Profiling

P2Important issue, but not time-criticalImportant issue, but not time-critical

stability

usability

Status: Open.

#62961 In ray-project/ray;

· nadongjun opened on Apr 27, 2026

[RFC][Serve][LLM] Prefill-decode disaggregation support

community-backlog

performance

serveRay Serve Related IssueRay Serve Related Issue

Status: Open.

#62953 In ray-project/ray;

· SisPiao opened on Apr 26, 2026

[Core] AttributeError: 'NoneType' object has no attribute 'trace' in 2.54.0

bugSomething that is supposed to be working; but isn'tSomething that is supposed to be working; but isn't

community-backlog

coreIssues that should be addressed in Ray CoreIssues that should be addressed in Ray Core

observabilityIssues related to the Ray Dashboard, Logging, Metrics, Tracing, and/or ProfilingIssues related to the Ray Dashboard, Logging, Metrics, Tracing, and/or Profiling

P2Important issue, but not time-criticalImportant issue, but not time-critical

regression

stability

Status: Open.

#62952 In ray-project/ray;

· shiranbi opened on Apr 26, 2026

[Docs] Broken Anyscale MCP Deployment Template link in Ray Serve agent example

community-backlog

docsAn issue or change related to documentationAn issue or change related to documentation

serveRay Serve Related IssueRay Serve Related Issue

usability

Status: Open.

#62943 In ray-project/ray;

· ElenaViewSynthesis opened on Apr 25, 2026

[Autoscaler] ClusterStatus() default construction fails because stats default_factory calls Stats without required args

bugSomething that is supposed to be working; but isn'tSomething that is supposed to be working; but isn't

community-backlog

coreIssues that should be addressed in Ray CoreIssues that should be addressed in Ray Core

P3Issue moderate in impact or severityIssue moderate in impact or severity

stability

Status: Open.

#62933 In ray-project/ray;

· weimingdiit opened on Apr 25, 2026

[RFC][Serve][LLM] SGLang engine-level metrics and observability parity with vLLM

community-backlog

llm

observabilityIssues related to the Ray Dashboard, Logging, Metrics, Tracing, and/or ProfilingIssues related to the Ray Dashboard, Logging, Metrics, Tracing, and/or Profiling

performance

serveRay Serve Related IssueRay Serve Related Issue

stability

usability

Status: Open.

#62931 In ray-project/ray;

· nadongjun opened on Apr 25, 2026

[RFC][Serve] Support SGLang Engine with Wide/Elastic Expert Parallelism

community-backlog

enhancementRequest for new feature and/or capabilityRequest for new feature and/or capability

performance

serveRay Serve Related IssueRay Serve Related Issue

stability

triageNeeds triage (eg: priority, bug/not-bug, and owning component)Needs triage (eg: priority, bug/not-bug, and owning component)

usability

Status: Open.

#62910 In ray-project/ray;

· KaisennHu opened on Apr 24, 2026