Skip to content

docs(embeddings): drop ONNX from the embedding formats (vNext) - #2008

Merged
lukekim merged 1 commit into
trunkfrom
fix/onnx-ml-format-leftovers
Jul 29, 2026
Merged

lukekim merged 1 commit into
trunkfrom
fix/onnx-ml-format-leftovers

Conversation

@claudespice

Copy link
Copy Markdown
Contributor

Problem

ONNX inference was removed from the runtime in vNext (spiceai#11684) — there is no ONNX runtime left in the build at all: Cargo.lock on trunk contains zero ort / tract-onnx / tract-core entries, and the only text-embeddings backend resolved is text-embeddings-backend-candle (no ORT backend). The embeddings docs still advertise ONNX:

  • The embedding-provider table has an "ML Format(s)" column listing ONNX for the file and huggingface sources. Every other row is -, so the whole column now describes a capability that no longer exists.
  • Both local-embedding deployment guides list .onnx as an accepted model-weight format, so a reader would ship ONNX weights that cannot load.

Separately, the data-ingestion page's edge example still describes "the loaded machine learning model" performing inference on OTel observations — the ONNX inference path that removal deleted.

Changes (vNext only)

  • components/embeddings/index.md: dropped the now-empty "ML Format(s)" column and renamed the remaining "LLM Format(s)" column to Format(s). Its cell values are carried over verbatim — the GGUF, GGML, SafeTensor entries were not re-verified here, so flag them if that list is also stale. (Also dropped the \* footnote marker, which had no footnote on the page.)
  • components/embeddings/local/deployment.md, components/embeddings/huggingface/deployment.md: removed .onnx from the accepted weight formats.
  • features/data-ingestion/index.md: reframed the anomaly-detection example around querying fresh ingested data instead of ONNX inference.

Not propagated to versioned_docs/: ort/tract are present in Cargo.lock at v2.0.1 and v2.1.1, so the ONNX claims are correct in the versioned snapshots.

Verified against

spiceai/spiceai @ origin/trunk (7bc4175f59):

npm run build passes locally.

ONNX inference was removed in vNext (spiceai#11684) and no ONNX runtime
remains in the build: Cargo.lock on trunk has zero ort/tract entries, and
the only text-embeddings backend resolved is
text-embeddings-backend-candle.

Dropped the now-empty "ML Format(s)" column from the embedding-provider
table, removed .onnx from the accepted weight formats in both local
embedding deployment guides, and reframed the data-ingestion edge example
away from ONNX inference.
@github-actions

github-actions Bot commented Jul 29, 2026 •

Copy link
Copy Markdown
Contributor

✅ Pull with Spice Passed

Passing checks:

  • ✅ Title meets minimum length requirement (10 characters)
  • ✅ Has at least one of the required labels: area/blog, area/docs, area/cookbook, dependencies
  • ✅ No banned labels detected
  • ✅ Has at least one assignee: claudespice

@claudespice

Copy link
Copy Markdown
Contributor Author

@copilot review

@github-actions

Copy link
Copy Markdown
Contributor

🚀 deployed to https://3d657576.spiceai-org-website.pages.dev

@lukekim
lukekim requested a review from Jeadie July 29, 2026 23:30
@lukekim
lukekim merged commit 458ebca into trunk Jul 29, 2026
6 of 9 checks passed
@lukekim
lukekim deleted the fix/onnx-ml-format-leftovers branch July 29, 2026 23:31

This branch was successfully deployed

1 active deployment
preview — 8b6340f1 Deployed Jul 29, 2026 by github-actions[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants