docs: Document configurable HEALTH_CHECK_PATH for load balancing endpoints#707
Merged
lavanya-gunreddi merged 4 commits intoJul 14, 2026
Merged
Conversation
|
|
||
| Workers must expose a `/ping` endpoint on the `PORT_HEALTH` port. The load balancer periodically checks this endpoint: | ||
| Each worker exposes a health check endpoint on the `PORT_HEALTH` port, and the load balancer polls it periodically to decide whether the worker is healthy enough to receive traffic. By default the load balancer polls `/ping`, but you can point it at any path by setting the `HEALTH_CHECK_PATH` environment variable. This is useful when you deploy a public image whose server already exposes a health check at a different path, such as a `llama.cpp` image that serves `/health`, so you don't need to build a custom image just to satisfy the health check. | ||
|
|
Contributor
There was a problem hiding this comment.
@Promptless Add this note here - You can also set the health check path directly in the RunPod console when creating a new endpoint. The Health check endpoint field appears on the Configure image step. Leave it empty to use the default /ping.
Contributor
Author
|
Thanks @lavanya-gunreddi! I've added the The update has been pushed to this PR for your review. |
lavanya-gunreddi
approved these changes
Jul 14, 2026
lavanya-gunreddi
deleted the
promptless/lb-configurable-health-check-path
branch
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Open this suggestion in Promptless to view citations and reasoning process
Updates the load balancing Serverless overview to document the new configurable health check path. The load balancer now polls the path set by the
HEALTH_CHECK_PATHenvironment variable (defaulting to/ping) instead of a hardcoded/ping, so users running public images that expose health checks at other paths no longer need custom images.Trigger Events
Tip: Tag @Promptless in a GitHub issue to turn it into a documentation update 🐙