AlphaGitHub
Source/Packages

Realization.Nvidia.SM86.StreamingAttentionSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/StreamingAttentionSM86.alpha

3,230 lines493 declarations193.3 KiBSHA-256 cc0366b3d857
Download exact fileView at revisionbcc11a4e7647d31628

def · lines 2238–2244

streamingAttentionQueryFromScoresProjectionHeavyFirstSM86

Full file
2238def streamingAttentionQueryFromScoresProjectionHeavyFirstSM86 =
2239  (lambda unrestricted seq : Nat . (lambda unrestricted heads : Nat .
2240    (lambda unrestricted keyValueHeads : Nat . (lambda unrestricted width : Nat .
2241      (lambda erased admitted : (equal Nat (streamingAttentionQueryProjectionAdmitted seq heads keyValueHeads width) 1) .
2242        (streamingAttentionQueryFromScoresOrderedWithSM86
2243          (sqProjectionEpilogue seq width (saOp (constructor SM86InstructionBody SM86Exit (saAfter saWaitAll)) sm86ProgramEmpty))
2244          1 seq heads keyValueHeads))))))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.