使用稠密算力卡对稀疏大显存主机进行加速,主机包括 AI Max+ 395、M3 512G、DGX Spark 等。
-
Updated
Oct 14, 2026 - C++
使用稠密算力卡对稀疏大显存主机进行加速,主机包括 AI Max+ 395、M3 512G、DGX Spark 等。
run a 27b local ai on your gaming gpu, rtx 3060 and up, radeon rx 6600 and up in beta, 8gb or more, linux and windows, one line to install
RouteWeaver: experimental cache-safe speculative inference and CPU/GPU transfer optimization for Qwen 27B on low-VRAM NVIDIA GPUs.
Type a prompt or drop up to 10 photos: Qwen-Image-2.1 renders it on your 12 GB GPU in ~35 s. Desktop app + CLI, honest benchmark vs gpt-image-2.
Unofficial FreeToken fork: Flash-Next 125B at 38 tok/s on two RTX 3060s with 2-bit experts, gpt-oss-120b on one; a benchmark tunes your settings. Qwen3.8-Flash-Next, 12 GB, MTP, 250k context, image input, WSL2. Runs on Turing: RTX 2060, RTX 20 series, sm_75.
Windows UEFI GPU unlock for RTX 30-series: a guided, self-service installer (text and graphical) with roll back, update-in-place and a full test suite. Fork of impacifist/Windows-GPU-UNLOCK.
Run AI on your own hardware, never deal with the cloud and create AI that can handle sensitive data. This repo showcases how to run AI on your own computer, and how to build specialised tools for it to use. I showcase a real setup where I developed tools in Deepseek Harness, that solved real automation engineering problems
华硕 ROG 幻16 GU603ZM 黑苹果 EFI:OpenCore 1.0.8 + macOS Sequoia 15 + nullmoth NVIDIA 驱动(RTX 3060 Laptop)
Pinned, hash-verified Comfy-Org MiniMax H3 ComfyUI workflows for T2V, I2V and R2V, with RTX 3060 benchmark evidence.
DeepSeek-R1 7B INT4 at 69.3 tok/s on a $300 RTX 3060. Faster than llama.cpp, vLLM, and NVIDIA TensorRT-LLM. Is one developer + Ai really better than the entire industry?
Exact file sizes, official VRAM statements and measured 12GB runs for Wan, LTX, HunyuanVideo, Mochi and CogVideoX in ComfyUI
Experimental open RTX 3060 driver research for macOS Tahoe — safe probe first
Measured local AI inference recipes for Ryzen 5 5600X + RTX 3060: FreeToken and llama.cpp profiles, DFlash, context/output budgets, benchmark logs, and agent integrations.
Getting LTX-2.5 and MiniMax-H3 running reliably on a 12GB card in ComfyUI — real bugs found and fixed, not just a config dump
Reproducible single-system evaluation of Qwen3.8-27B on an RTX 3060 12 GB: long-context inference, KV-cache optimization, Windows/WSL2, and Codex integration.
Rent GPUs by the hour on Lium to top LocalMaxxing leaderboards with verified, high-speed inference for under $10 total.
🚀 A high-performance, GPU-accelerated (NVIDIA CUDA 13.2) Dev Container for Machine Learning and Deep Learning. Features Python 3.12 (uv), Node 22 (fnm), JupyterLab, and Docker-in-Docker, keeping your host system 100% clean.
Qwen-Image-2.1 on one RTX 3060 12GB: a workaround for purple seams in tiled VAE decoding, and BF16 partial GPU residency (16 of 32 Transformer blocks) that cut denoise time by about 25%
To associate your repository with the rtx-3060 topic, visit your repo's landing page and select "manage topics."