Popular repositories Loading
-
blackwell-geforce-nvfp4-gemm
blackwell-geforce-nvfp4-gemm PublicNVFP4 inference on Blackwell GeForce (RTX 5090/5080/5070 Ti/RTX PRO 6000) — SM120 patches for vLLM + FlashInfer + CUTLASS. 175 tok/s on Qwen3.6-35B MoE.
-
gemma4-12b-vllm-sm120
gemma4-12b-vllm-sm120 PublicReproducible recipe: serve abliterated Gemma-4-12B (gemma4_unified) at 50-118 tok/s on no-NVLink Blackwell (SM120) via vLLM nightly + ModelOpt FP8/NVFP4 + MTP spec-decode.
Python 15
-
GGUF-to-NVFP4-SM120
GGUF-to-NVFP4-SM120 PublicLna-Lab production pipeline: GGUF -> modelopt-format NVFP4 + working MTP head for vLLM on RTX PRO 6000 Blackwell (SM120). Stages 2 (NVFP4) and 3 (MTP graft) are Lna-Lab originals; stage 1 (GGUF->bf…
-
Repositories
- Ashigaru-Search Public
- DS4-combination Public
- LNAIME Public
- gemma4-12b-vllm-sm120 Public
Reproducible recipe: serve abliterated Gemma-4-12B (gemma4_unified) at 50-118 tok/s on no-NVLink Blackwell (SM120) via vLLM nightly + ModelOpt FP8/NVFP4 + MTP spec-decode.
- LLM-Formura1 Public
- LnaLang4U Public
1M-context DeepSeek-V4-Flash inference on NVIDIA Blackwell using sglang and SSD KV cache offload.
- 27b-35b-nvfp4-bench Public
- blackwell-geforce-nvfp4-gemm Public
NVFP4 inference on Blackwell GeForce (RTX 5090/5080/5070 Ti/RTX PRO 6000) — SM120 patches for vLLM + FlashInfer + CUTLASS. 175 tok/s on Qwen3.6-35B MoE.
- DeepGEMM-for-SM120e Public
- GGUF-to-NVFP4-SM120 Public
Lna-Lab production pipeline: GGUF -> modelopt-format NVFP4 + working MTP head for vLLM on RTX PRO 6000 Blackwell (SM120). Stages 2 (NVFP4) and 3 (MTP graft) are Lna-Lab originals; stage 1 (GGUF->bf16) reuses li-yifei/gguf-to-nvfp4.
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Top languages
Loading…
Most used topics
Loading…