Skip to content

fix(fp8): per-row dynamic FP8 activation scales - #99

Open
gdevenyi wants to merge 2 commits into
5080/52-qsa-score-rowsfrom
5080/54-fp8-rowscale
Open

fix(fp8): per-row dynamic FP8 activation scales#99
gdevenyi wants to merge 2 commits into
5080/52-qsa-score-rowsfrom
5080/54-fp8-rowscale

fix(fp8): scale dynamic fp8 activations per row so batched sequences …

6c381c3
Select commit
Loading
Failed to load commit list.

There are no checks for this commit