You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
What you are doing is genuinely really exciting both on the software and hardware side. Not sure if this is the best place to ask this but I am really keen on being able to self host GLM 5.3 flash. Would it be possible on 2 192GB Luceboxes?
@stephenstubbs thanks for the kind words. Yes GLM 5.3 Flash would run very well on 2 192GB Luceboxes. Considering that we have 448 GB in total high speed memory zai-org/GLM-5.3-Flash 320B can be split across the two machine with a lot of remaining space for the KV.
If you are okay in running it with a 4bit quant, on two Luceboxes it will reach great speed performance with tensor parallelism that just got integrated in our engine few days ago (check Deepseek v4.1 Flash article on our blog)
Activity
davide221 commentedon Oct 14, 2026
@stephenstubbs thanks for the kind words. Yes GLM 5.3 Flash would run very well on 2 192GB Luceboxes. Considering that we have 448 GB in total high speed memory zai-org/GLM-5.3-Flash 320B can be split across the two machine with a lot of remaining space for the KV.
If you are okay in running it with a 4bit quant, on two Luceboxes it will reach great speed performance with tensor parallelism that just got integrated in our engine few days ago (check Deepseek v4.1 Flash article on our blog)
stephenstubbs commentedon Oct 14, 2026
Hi @davide221, OK great thanks! Will have a look.