Skip to content

5080deploy 9/9: merge upstream #389 (+#385), load-time FP8 dense projections - #17

Open
gdevenyi wants to merge 296 commits into
5080/08-moe-stats-231from
5080deploy
Open

gdevenyi wants to merge 296 commits into
5080/08-moe-stats-231from
5080deploy

fix(fp8): scale dynamic fp8 activations per row so batched sequences …

6c381c3
Select commit
Loading
Failed to load commit list.

There are no checks for this commit