Repository navigation
qwen3 0.1.0rc1: one package for every Qwen3.x LLM, on abliterated checkpoints (se-145) - #954
Draft
PaulFidika wants to merge 3 commits into
Draft
PaulFidika wants to merge 3 commits into
PaulFidika wants to merge 3 commits into
Conversation
…ckpoints; qwen3.5 and qwen3.6 removed (se-145) ask, caption and the canvas write, as qwen3.6 had them, over any Qwen3.5-family checkpoint (Qwen3.5, 3.6, 3.8; dense or MoE). The default is heretic-org/qwen3.8-27b-heretic-ara@0.1.0 at int8; a request or a box picks another by model. The int8, nvfp4 and w4a8 recipes cover dense, MoE and multi-token-prediction layers. Every package-name reference moves to qwen3 (workspace lists, README, qwen-image-2's enhancer quantize, the proof script, the routing example).
…t's Heretic hedged (se-145)
…hat heretic-org's ARA hedged (se-145)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
se-145. Paul, 11-16: "can't we just have like a qwen 3.x package, and then its default is the newest qwen 3.x model we have?" "but the user can override the checkpoint used? ideally use only abliterated checkpoints of it, not the original."
For the next packages RC, not rc/0.26.0 (frozen). Retarget when the coordinator opens it; it goes in with its own packages gate (
--only qwen3). Its final and the mirrors publish at promotion, by the release session.qwen30.1.0rc1:ask,captionand the canvaswrite(Write,text_N), as qwen3.6 had them, on Runtime'scozy_runtime.vlm. No package-local fields.heretic-org/qwen3.8-27b-heretic-ara@0.1.0: Heretic's ARA of Qwen3.8-27B, 0/100 refusals, KL 0.054. A request or box picks another checkpoint withmodel.qwen3_5/Qwen3_5ForConditionalGeneration: the same 1199 tensor names and sizes as Qwen3.6-27B. Its config differs only intransformers_version. Its chat template addsreasoning_effort, which defaults to xhigh when thinking is on. The Runtime'senable_thinkingswitch is unchanged, so no Runtime change is needed.qwen3.5andqwen3.6are removed from the repo. Their published versions stay, get no new ones, and retire after 0.27.0. These references move toqwen3:--packagescripts/qwen3-model-proof.pyexamples/client-scripts/qwen3-routing.pyqwen/qwen3.5-9b@0.2.0, Klein's drafterqwen/qwen3.5-9b-mtp@0.2.0, qwen-image-2's enhancers).Cells: cozy-creator draft PR on
claude/se-145-qwen3.Proof
Pending:
model-ingest(held mirrors with int8, nvfp4 and w4a8 lanes, plus one./qwen3/askcall on each int8 lane) on one rtx-a6000. It waits on the rental catalog.Removed
None:
scripts/removed-features.py origin/rc/0.26.0 HEADfinds 0 definitions deleted.