Repository navigation
docs(embeddings): drop ONNX from the embedding formats (vNext) - #2008
Merged
Merged
Conversation
ONNX inference was removed in vNext (spiceai#11684) and no ONNX runtime remains in the build: Cargo.lock on trunk has zero ort/tract entries, and the only text-embeddings backend resolved is text-embeddings-backend-candle. Dropped the now-empty "ML Format(s)" column from the embedding-provider table, removed .onnx from the accepted weight formats in both local embedding deployment guides, and reframed the data-ingestion edge example away from ONNX inference.
Contributor
✅ Pull with Spice PassedPassing checks:
|
Contributor
Author
|
@copilot review |
Contributor
|
🚀 deployed to https://3d657576.spiceai-org-website.pages.dev |
lukekim
approved these changes
Jul 29, 2026
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
ONNX inference was removed from the runtime in vNext (spiceai#11684) — there is no ONNX runtime left in the build at all:
Cargo.lockontrunkcontains zeroort/tract-onnx/tract-coreentries, and the only text-embeddings backend resolved istext-embeddings-backend-candle(no ORT backend). The embeddings docs still advertise ONNX:ONNXfor thefileandhuggingfacesources. Every other row is-, so the whole column now describes a capability that no longer exists..onnxas an accepted model-weight format, so a reader would ship ONNX weights that cannot load.Separately, the data-ingestion page's edge example still describes "the loaded machine learning model" performing inference on OTel observations — the ONNX inference path that removal deleted.
Changes (vNext only)
components/embeddings/index.md: dropped the now-empty "ML Format(s)" column and renamed the remaining "LLM Format(s)" column toFormat(s). Its cell values are carried over verbatim — theGGUF, GGML, SafeTensorentries were not re-verified here, so flag them if that list is also stale. (Also dropped the\*footnote marker, which had no footnote on the page.)components/embeddings/local/deployment.md,components/embeddings/huggingface/deployment.md: removed.onnxfrom the accepted weight formats.features/data-ingestion/index.md: reframed the anomaly-detection example around querying fresh ingested data instead of ONNX inference.Not propagated to
versioned_docs/:ort/tractare present inCargo.lockat v2.0.1 and v2.1.1, so the ONNX claims are correct in the versioned snapshots.Verified against
spiceai/spiceai@origin/trunk(7bc4175f59):Cargo.lock—grep -cE '^name = "(ort|tract-onnx|tract-core)"'→0on trunk,2at bothv2.0.1andv2.1.1.Cargo.lock— the only TEI backend crates present aretext-embeddings-backend,-backend-candle,-backend-core,-core.crates/llms/src/embeddings/candle/— the local/HF embedding loaders go throughTeiEmbed(candle + safetensors); no ONNX path.features/machine-learning-modelsalready records the removal; these pages were missed by the earlier sweeps (docs docs(models): remove traditional ML (ONNX) inference (spiceai/spiceai#11684) #1914, docs(api): remove ML prediction endpoints from the API reference (vNext) #1981).npm run buildpasses locally.