Source/Packages

Realization.Nvidia.SM86.StreamingAttentionSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/StreamingAttentionSM86.alpha

1,129 lines205 declarations66.1 KiBSHA-256 aefcbc3b00ca

def · lines 224–229

saScores

Full file
S = Q K^T: slice by slice, the eight n-tiles of a slice in flight together
224def saScores = (lambda unrestricted tail : (family SM86Program) .
225  (saFor 4 (lambda unrestricted k : Nat .
226    (saFor 8 (lambda unrestricted nt : Nat .
227      (saHmma (saS nt) (saQ k) (saB k nt) saSB2
228        (naturalSelect (naturalIsZero nt) (naturalSelect (naturalIsZero k) (naturalAdd saWait0 saWait1) saWait2) saWaitNone)))))
229    tail))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.