Conversation
…d during initial testing.
Updated documentation to clarify handling of nested columns. Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
…s. Fixed dask client creation/shutdown process.
…s/hyrax into awo/lsdb-dataset
…emo notebook. I want lc_lsdb_stream_dataset to ultimately end up in ts2vec.prepare_inputs.
|
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
Codecov Report❌ Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #1055 +/- ##
==========================================
+ Coverage 70.20% 70.81% +0.61%
==========================================
Files 91 92 +1
Lines 8961 9306 +345
==========================================
+ Hits 6291 6590 +299
- Misses 2670 2716 +46 ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
…re inputs function of ts2vec.
There was a problem hiding this comment.
Copilot review overview
🟡 Changes recommended
Critical correctness and distributed-training issues remain unresolved.
Get a fresh assessment by requesting another Copilot review.
Review effort: Lite
Findings: 4
Open (5)
What changed in this PR
Adds TS2Vec support for ragged LSDB light-curve streams and an end-to-end training/inference demo.
Changes:
- Adds TS2Vec encoding, normalization, masking, contrastive training, and inference.
- Adds configuration defaults, model registration, context propagation, and ONNX preprocessing.
- Preserves nested-column dtypes during LSDB collation and expands tests.
Final findings include critical masking, DDP, deployment configuration, and distributed context issues, plus moderate mask-device and sequence-length validation issues.
| File | Summary |
|---|---|
tests/hyrax/test_lsdb_stream_dataset.py |
Tests dtype-preserving collation. |
tests/hyrax/test_hyrax_ts2vec.py |
Tests TS2Vec behavior. |
tests/hyrax/test_context.py |
Tests configuration context propagation. |
src/hyrax/verbs/verb_registry.py |
Adds runtime configuration to verb contexts. |
src/hyrax/verbs/to_onnx.py |
Uses training configuration during export. |
src/hyrax/models/hyrax_ts2vec.py |
Implements TS2Vec and light-curve encoding. |
src/hyrax/models/__init__.py |
Registers the model. |
src/hyrax/hyrax_default_config.toml |
Defines TS2Vec defaults. |
src/hyrax/datasets/lsdb_stream_dataset.py |
Preserves nested array dtypes. |
src/hyrax/context.py |
Documents runtime configuration context. |
💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>


Adding ts2vec, and the demo notebook.
This allows for an end to end example of using LSDB to load a HATS catalog with nested light curve data, sending the catalog promise to Hyrax for training and inference with train_stream and infer_stream, then reducing dimensions and plotting a 2d embedding.