AlphaGitHub
Source/Packages

Realization.Nvidia.SM86.StreamingAttentionSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/StreamingAttentionSM86.alpha

3,230 lines493 declarations193.3 KiBSHA-256 cc0366b3d857
Download exact fileView at revisionbcc11a4e7647d31628

def · lines 2264–2273

streamingAttentionQueryFromScoresDoubleProjectionHeavyFirstSM86

Full file
2264def streamingAttentionQueryFromScoresDoubleProjectionHeavyFirstSM86 =
2265  (lambda unrestricted seq : Nat . (lambda unrestricted heads : Nat .
2266    (lambda unrestricted keyValueHeads : Nat . (lambda unrestricted width : Nat .
2267      (lambda erased admitted : (equal Nat (streamingAttentionQueryProjectionAdmitted seq heads keyValueHeads width) 1) .
2268        (sqdPrologueAhead 1 1 seq heads keyValueHeads
2269          (sm86ProgramAppend (sqd2BodyA seq)
2270          (sm86ProgramAppend (sfFirstTail (sm86ProgramCount (sqd2BodyB seq)))
2271          (sm86ProgramAppend (sqd2BodyB seq)
2272          (sm86ProgramAppend (sfSecondTail (sm86ProgramCount (sqd2BodyA seq)) (sm86ProgramCount (sqd2BodyB seq)))
2273            (sqProjectionEpilogue seq width (saOp (constructor SM86InstructionBody SM86Exit (saAfter saWaitAll)) sm86ProgramEmpty))))))))))))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.