Source/Packages

Realization.Nvidia.SM86.StreamingAttentionSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/StreamingAttentionSM86.alpha

1,203 lines221 declarations70.9 KiBSHA-256 23d4e5e2aa2a

def · lines 236–241

saScores

Full file
S = Q K^T: slice by slice, the eight n-tiles of a slice in flight together
236def saScores = (lambda unrestricted tail : (family SM86Program) .
237  (saFor 4 (lambda unrestricted k : Nat .
238    (saFor 8 (lambda unrestricted nt : Nat .
239      (saHmma (saS nt) (saQ k) (saB k nt) saSB2
240        (naturalSelect (naturalIsZero nt) (naturalSelect (naturalIsZero k) (naturalAdd saWait0 saWait1) saWait2) saWaitNone)))))
241    tail))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.