Skip to content

[Doc] [History Server] Add doc for running cluster support - #67504

Open
machichima wants to merge 4 commits into
ray-project:masterfrom
machichima:hs-running-cluster-doc
Open

machichima wants to merge 4 commits into
ray-project:masterfrom
machichima:hs-running-cluster-doc

Conversation

@machichima

Copy link
Copy Markdown
Contributor

Description

kuberay-project/kuberay#5347 added running cluster support by uploading log chunks to the object store. Reload button and auto reload after RayCluster terminate are added in kuberay-project/kuberay#5463 and kuberay-project/kuberay#5467 respectively.

This PR update the history server document for running cluster.

NOTE: we should merge this after kuberay-project/kuberay#5463 and kuberay-project/kuberay#5467 are merged.

Related issues

Part of kuberay-project/kuberay#5452

Additional information

Signed-off-by: machichima <nary12321@gmail.com>
Signed-off-by: machichima <nary12321@gmail.com>
@machichima
machichima requested review from a team as code owners October 28, 2026 08:55
@machichima

Copy link
Copy Markdown
Contributor Author

cc @win5923 @chiayi PTAL, thank you!

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the Ray History Server documentation to explain how it supports accessing and debugging running Ray workload resources in addition to terminated ones. It details periodic log uploads, the new RAY_COLLECTOR_LOG_UPLOAD_INTERVAL environment variable, log chunk storage layouts, and how to access and reload running clusters. The review feedback suggests updating a placeholder in an example URL to <SELECTED_SESSION_ID> for consistency with other examples in the document.

The History Server caches a session after the first load, so the view doesn't update on its own. To pick up newly uploaded events and logs, click the reload button on the cluster selection page, or add `?reload=true`:

```text
http://localhost:8265/enter_cluster/default/rayjob/rayjob-historyserver-gcs/<SESSION_ID>?reload=true

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

For consistency with the previous example at line 487, consider using <SELECTED_SESSION_ID> instead of <SESSION_ID>.

Suggested change
http://localhost:8265/enter_cluster/default/rayjob/rayjob-historyserver-gcs/<SESSION_ID>?reload=true
http://localhost:8265/enter_cluster/default/rayjob/rayjob-historyserver-gcs/<SELECTED_SESSION_ID>?reload=true

@ray-gardener ray-gardener Bot added the core Issues that should be addressed in Ray Core label Oct 28, 2026

@dstrodtman dstrodtman left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Docs-side style review from Douglas Strodtman (Anyscale docs team). Claude Code assisted with this review; I read and stand behind every comment. Scope is style, grammar, and Ray docs conventions only (writing-style guide). The KubeRay maintainers own whether the described behavior is right.

This is a clean update. The new section reads well, and the claims I spot-checked match kuberay-project/kuberay#5347 (the 5m default and the <file>.chunks/<offset> layout). A few small things inline. Two of them are lines outside the diff that still say the History Server is for terminated workloads only. I folded those into the nearest in-diff comment.

I agree with holding the merge as the description says. The reload button, ?reload=true on the selection page, and the automatic reload after deletion come from kuberay-project/kuberay#5463 and #5467, which are both still open.

No objection from the docs side once the inline items are addressed.

Comment thread doc/source/kuberay/user-guides/history-server.md
Comment thread doc/source/kuberay/user-guides/history-server.md Outdated
Comment thread doc/source/kuberay/user-guides/history-server.md Outdated
Comment thread doc/source/kuberay/user-guides/history-server.md Outdated
Comment thread doc/source/kuberay/user-guides/history-server.md Outdated
Signed-off-by: machichima <nary12321@gmail.com>
@machichima

Copy link
Copy Markdown
Contributor Author

Thanks @dstrodtman for the review! I fixed all your comments

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core Issues that should be addressed in Ray Core

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants