AlphaGitHub
Source/Packages

Realization.Nvidia.SM86.StreamingAttentionSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/StreamingAttentionSM86.alpha

3,230 lines493 declarations193.3 KiBSHA-256 cc0366b3d857
Download exact fileView at revisionbcc11a4e7647d31628

def · lines 2190–2202

streamingAttentionQueryFromScoresOrderedWithSM86

Full file
2190def streamingAttentionQueryFromScoresOrderedWithSM86 =
2191  (lambda unrestricted epilogue : (family SM86Program) .
2192  (lambda unrestricted order : Nat . (lambda unrestricted seq : Nat . (lambda unrestricted heads : Nat .
2193    (lambda unrestricted keyValueHeads : Nat .
2194      (let unrestricted length = (sm86ProgramCount (sqdBody seq 0)) in
2195      (sqdPrologue order seq heads keyValueHeads
2196        (sm86ProgramAppend (sqdBody seq 0)
2197        (sm86ProgramAppend (sfFirstTail (naturalAdd length (naturalAdd 3 length)))
2198        (sm86ProgramAppend (sqdBody seq 1)
2199        (sm86ProgramAppend (sfFirstTail length)
2200        (sm86ProgramAppend (sqdBody seq 2)
2201        (sm86ProgramAppend (sfSecondTail (naturalAdd length (naturalAdd 3 length)) length)
2202          epilogue)))))))))))))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.