Skip to content

[Desktop] weights failed to load: Qwen3.6-35B-A3B NVFP4 #784

Open

Description

@mehedih985

Before you start

  • I have checked the supported models and this checkpoint is not listed there. A listed checkpoint that fails is a bug; use a Bug report instead.
  • I have read the Roadmap and this model is not already planned there.
  • I have read the FAQ.
  • I have searched existing issues and found no duplicate.
  • This is not a GGUF checkpoint. GGUF support is on the Roadmap; please do not open an issue for it.

Hugging Face link

https://huggingface.co/nvidia/Qwen3.6-35B-A3B-NVFP4

Is the model architecture already supported

Yes, but this checkpoint or quantization does not load

Is the quantization already supported

Yes, but this checkpoint's weight format does not load

What happens when you load it

>>>>>>>> PASTE THE FULL SERVER LOG HERE <<<<<<<<
(copied with the "Copy server log" button in the failure dialog, or Logs -> Server status -> Copy)

WeightLoadError: ValueError: 'E:\\models\\Qwen3.6-35B-A3B-NVFP4' stores NVFP4 global scales as fp16 (e.g. 'model.layers.0.mlp.shared_expert.down_proj.weight_global') but FreeToken reads them as fp32;

Anything else

Desktop 0.2.0-beta.23; engine 0.2.0+g425dc7bf1; NVIDIA GeForce RTX 4070 SUPER, 12.0 GiB, driver 617.42; Intel Core i9-14900KF, 31.8 GiB

Activity

  1. jason-fxz commented on Oct 21, 2026

    @jason-fxz
    Collaborator

    same as #782

  2. added
    duplicateThis issue or pull request already exists
    and removed on Oct 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    duplicateThis issue or pull request already exists

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions