Repository navigation
minimax-h3-image 0.1.0rc1: MiniMax-H3-Image, its prompt expander, lanes (se-146) - #958
Merged
Merged
Conversation
…ts prompt expander, lanes (se-146)
…bliterate edits language-layer writers only
…onfig (expander_config rewrites a lane's header)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
se-146: MiniMax-H3-Image, MiniMax's image model, with its prompt expander. Paul, 11-17: "please look into minimax h3
image as well. WE should add this model to our roster when possible", "keep the prompt expander as well".
minimax-h3-image0.1.0rc1. One tool,generate("MiniMax-H3-Image"): text to image, or an edit of upto 16 pictures that the instructions mention (
<Picture n>). It runs 6 steps with no CFG at 4-20 MP (16 bydefault), 1:1 to 21:9.
model: the DiT and the VAE decoder.vae_encoder: fetched only when the request has pictures.text_encoder:minimaxai/minimax-h3@1.0.0-rc.8's. It is byte-identical upstream, so no new bytes arestored.
expander: fetched only withprompt_upsampling. It is MiniMax-H3-Image-PE (a Qwen3.8-27B fine-tune). An editruns MiniMax's edit PE prompt on the same checkpoint, which keeps its vision tower.
prepare: bf16 with AdaLN tables at the 6-step grid, and the VAE split into encoder and decoder.expander_bf16: decodes the NVFP4 weights.expander_config: drops ModelOpt'squantization_config, which the Runtime refuses.abliterate: projects the refusal direction out of the residual writers.minimax_h3_imageonto Diffusers 0.41's H3 classes. The velocity-formEuler and the draw order are Diffusers'. It reuses P-H3-Image's fused glue.
minimaxai/minimax-h3-image@0.1.0(bf16-full, bf16, int8, w4a8, nvfp4) andminimaxai/minimax-h3-image-pe@0.1.0(nvfp4 as released, bf16, int8, w4a8).Proof
All runs used
cozy run ./minimax-h3-image/generatein the default home, project~/cozy-scratch/se-146(runs SE146-n).Stack: cozy 0.26.0-dev+gec8ec2ae, Runtime 0.47.0.dev2306+gca841fe7. Lane int8: the DiT and VAE decoder
int8.convrot(GEMM cozy-int8, DiT attention kitchen-int8, VAE attention sdpa), and H3's text encoder int8. The expander is int8
(w4a8 on the 4090). Fused glue
minimax-h3-image-glue-fp8is compiled. A is the upstream example request (4736x3552,seed 42); C is a 2-picture edit (4096x4096); B and D are the same with the expander. The reference is Diffusers 0.43's
pipeline in bf16 on MiniMax's own files, run on the same pod at the same seed. For B and D the reference gets our
expander's caption.
RTX PRO 6000 Blackwell (runpod US-NC-1):
ee34406fwith Comfy-Org'sminimax_h3_image_pruned_int8_convrotand itsint8 text encoder, request A, no expander.
decode.
RTX 4090 (vast FR): the int8 text encoder (25 GiB) and DiT (20 GiB) page.
Looked at:
"COMPOUND CONSISTENCY CONFIDENCE").
CPU release-gate cell
minimax-h3-image(cozy-creator#3695), four cells:Low-bit study (report only, no default changed), RTX 5060 Ti 16 GB, request A:
Removed
n/a: a new package.