Repository navigation
Support for Apple Silicon (Metal) for Edge0 120B / 145B #201
Description
Area
New backend (GPU / NPU / other accelerator)
What problem are you trying to solve?
Hi,
The 145B / 120B models currently require an NVIDIA GPU with CUDA 13 on Linux or Windows. Apple Silicon Macs can't run them. Are there plans to support the 120B / 145B models on Apple Silicon via Metal?
If there are plans to implement it, I'd be more than than happy to test it on my machine.
My setup is: Mac Studio, Apple M3 Ultra, 60-core GPU, 96 GB unified memory
Proposed solution
No response
Alternatives considered
No response
Reacted by snothx and Eric Schoffstall
Reacted by Rene Leonhardt, J L and Devert.net
Activity
reneleonhardt commentedon Nov 13, 2026
https://edge0.ai/blog/introducing-edge0-145b-frontier-ai-capabilities-on-your-own-computer
https://github.com/Edge0-AI/Edge0/releases/tag/v0.2.0 (2026-11-11)
https://github.com/Edge0-AI/Edge0/blob/main/edge0-infer/README.md
Please note that there is no build or release workflow in this repo.
froggr commentedon Nov 13, 2026
Same. More than happy to test - M4 Max 128GB. Strata user as well.
nickwilkie commentedon Nov 13, 2026
Yeah I've got an M4 Max 128GB, would be happy to try as well. Really confused when I saw the M2 Ultra benchmarks but no mac availability.
linyubupa commentedon Nov 14, 2026
On its way — the Apple Silicon build is in final performance tuning and ships next week. It didn't go out with the launch because we found a few things worth optimising in the Metal path while validating it.
linyubupa commentedon Nov 14, 2026
#214 ，Edge0 now supports Apple Silicon (Metal) — pull the branch and give it a try.