AlphaGitHub
Source/Packages

Realization.Nvidia.SM86.StreamingAttentionSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/StreamingAttentionSM86.alpha

3,230 lines493 declarations193.3 KiBSHA-256 cc0366b3d857
Download exact fileView at revisionbcc11a4e7647d31628

def · lines 2237–2237

streamingAttentionQueryFromScoresProjectionConstantBytes

Full file
dQ from the stored dS^T stored into a fused projection's gradient (sqProjectionEpilogue: binary32 at argument 7, bfloat16 at 12)
2237def streamingAttentionQueryFromScoresProjectionConstantBytes : Nat = (saArgument 13)

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.