AlphaGitHub
Source/Packages

Realization.Nvidia.SM86.StreamingAttentionSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/StreamingAttentionSM86.alpha

3,230 lines493 declarations193.3 KiBSHA-256 cc0366b3d857
Download exact fileView at revisionbcc11a4e7647d31628

def · lines 2230–2234

streamingAttentionQueryFromScoresRotatedHeavyFirstSM86

Full file
2230def streamingAttentionQueryFromScoresRotatedHeavyFirstSM86 =
2231  (lambda unrestricted seq : Nat . (lambda unrestricted heads : Nat .
2232    (lambda unrestricted keyValueHeads : Nat . (lambda unrestricted width : Nat .
2233      (lambda erased admitted : (equal Nat (streamingAttentionQueryFromScoresRotatedAdmitted seq heads keyValueHeads width) 1) .
2234        (streamingAttentionQueryFromScoresOrderedWithSM86 (sqsRotatedEpilogue seq width) 1 seq heads keyValueHeads))))))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.