AlphaGitHub
Source/Packages

Realization.Nvidia.SM86.AttentionHeadLayoutSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/AttentionHeadLayoutSM86.alpha

1,710 lines162 declarations85.3 KiBSHA-256 ad8cef82929b
Download exact fileView at revisionf5034773ad4bb52133

def · lines 1234–1244

attentionHeadLayoutSM86BlockX

Full file
1234def attentionHeadLayoutSM86BlockX =
1235  (lambda unrestricted kind : (family AttentionHeadLayoutSM86Kind) .
1236    (eliminate
1237      AttentionHeadLayoutSM86Kind
1238      (lambda unrestricted current : (family AttentionHeadLayoutSM86Kind) . Nat)
1239      kind
1240      (branch AttentionHeadLayoutQKRotary . attentionHeadLayoutSM86N128)
1241      (branch AttentionHeadLayoutValueTranspose . attentionHeadLayoutSM86N512)
1242      (branch AttentionHeadLayoutHeadToToken . attentionHeadLayoutSM86N256)
1243      (branch AttentionHeadLayoutTokenToHead . attentionHeadLayoutSM86N256)
1244      (branch AttentionHeadLayoutInverseRoPEQKVMerge . attentionHeadLayoutSM86N128)))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.