Gym enhancements

[srivatsankrishnan]

Summary

Provide a concise summary of the changes introduced by this pull request. Detail the purpose and scope of the changes, referencing any relevant issues or discussions. Explain how these changes address the problem or improve the project.

Test Plan

In this section, describe the testing you have performed to verify the changes. Include:

• A clear description of the testing environment.
• The steps you followed to test the new features or bug fixes.
• Any specific commands used during testing, along with their outputs.
• A description of the results and observations from your testing.
  This information is crucial for reviewers to understand how the changes have been validated.

Additional Notes

For July CloudAI release.

[coderabbitai]

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Pro

Run ID: 10af8557-b2e8-457d-b70a-c3958cd368ae

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[rutayan-nv]

@srivatsankrishnan — splitting this draft into three small, independently-reviewable PRs against current main:

• [Configurator] Make select_action observation-aware #892 — BaseAgent.select_action(observation=...) + observation-aware DSE loop
• [CLI/Core] Polymorphic agent dispatch + TestRun owns trial counter #893 — HAS_CUSTOM_TRAINING_LOOP dispatch in handle_dse_job
• [Configurator] Add GymnasiumAdapter for CloudAI envs #894 — GymnasiumAdapter + CloudAIGymEnv.define_observation_space shape fix

Once those land this draft can be closed. Same content, just decomposed for review.

[rutayan-nv]

This PR can be closed — covered by the decomposed stack on main:

• agent.run() polymorphism / DSE dispatch → [CLI/Core] Polymorphic agent dispatch + TestRun owns trial counter #933
• BaseAgent.select_action(observation=...) threading → [CLI/Core] Polymorphic agent dispatch + TestRun owns trial counter #933
• ContinuousSpace action-space primitive → feat(core): add ContinuousSpace action-space primitive #927
• GymnasiumAdapter → feat(configurator): add GymnasiumAdapter for CloudAI envs #930
• Online / live-RL gym (GymServer mode) → feat(configurator): add online GymServer mode to CloudAIGymEnv #932
• live_rl_mode routing → feat(cli): route live_rl_mode jobs through the DSE handler #934