Source/Packages

Realization.Nvidia.SM86.StreamingAttentionSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/StreamingAttentionSM86.alpha

3,230 lines493 declarations193.3 KiBSHA-256 cc0366b3d857

def · lines 1058–1067

sfpExponentials

Full file
1058def sfpExponentials = (lambda unrestricted scores : (pi unrestricted nt : Nat . Nat) . (lambda unrestricted h : Nat . (lambda unrestricted tail : (family SM86Program) .
1059  (saFor 16 (lambda unrestricted i : Nat .
1060    (let unrestricted e = (saElem (scores (naturalDivideUnchecked i 2)) h (naturalModuloUnchecked i 2)) in
1061      (lambda unrestricted rest : (family SM86Program) .
1062        (saFadd e e (saTmp (naturalAdd 6 h)) saWaitNone
1063          (saEx2 e e saWaitNone rest)))))
1064    (saFmul (saL h) (saL h) (saTmp (naturalAdd 4 h)) saWait4
1065    (saFor 16 (lambda unrestricted i : Nat .
1066      (saFadd (saL h) (saL h) (saElem (scores (naturalDivideUnchecked i 2)) h (naturalModuloUnchecked i 2)) saWaitNone))
1067      tail))))))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.