Skip to content

perf: move owned rollout upload buffers into core records - #382

Merged
beinan merged 1 commit into
lance-format:mainfrom
beinan:codex/rollout-owned-ingress
Oct 19, 2026
Merged

beinan merged 1 commit into
lance-format:mainfrom
beinan:codex/rollout-owned-ingress

Conversation

@beinan

@beinan beinan commented Oct 19, 2026

Copy link
Copy Markdown
Collaborator

Summary

Large JSON and multipart rollout uploads already own their decoded buffers, but the HTTP handler cloned the complete blob and token arrays when converting requests into core records. Consume those requests through From<AddRolloutRequest> so the core records retain the existing allocations. Keep the borrowed conversion API and all field/default handling compatible.

This removes one conversion copy on the current ingestion path. Arrow encoding and request decoding still have their own allocation costs.

Refs #378.

Testing

  • Ownership and complete field round-trip regressions, including the timestamp/problem defaults.
  • Full repository check script passed: workspace formatting, Clippy and all-target tests; Python tests (229 passed, 2 skipped, 1 xfailed), Ruff formatting/lint and Pyright.

@beinan
beinan merged commit c2ecd5d into lance-format:main Oct 19, 2026
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant