AlphaGitHub
Source/Packages

Realization.Nvidia.SM86.AttentionHeadLayoutSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/AttentionHeadLayoutSM86.alpha

1,710 lines162 declarations85.3 KiBSHA-256 ad8cef82929b
Download exact fileView at revisionf5034773ad4bb52133

def · lines 1183–1196

attentionHeadLayoutSM86Program

Full file
1183def attentionHeadLayoutSM86Program =
1184  (lambda unrestricted kind : (family AttentionHeadLayoutSM86Kind) .
1185    (eliminate
1186      AttentionHeadLayoutSM86Kind
1187      (lambda unrestricted current : (family AttentionHeadLayoutSM86Kind) . (family SM86Program))
1188      kind
1189      (branch AttentionHeadLayoutQKRotary . attentionHeadLayoutSM86QKRotaryProgram)
1190      (branch AttentionHeadLayoutValueTranspose . attentionHeadLayoutSM86ValueTransposeProgram)
1191      (branch AttentionHeadLayoutHeadToToken . attentionHeadLayoutSM86HeadToTokenProgram)
1192      (branch AttentionHeadLayoutTokenToHead . attentionHeadLayoutSM86TokenToHeadProgram)
1193      (branch
1194        AttentionHeadLayoutInverseRoPEQKVMerge
1195        .
1196        attentionHeadLayoutSM86InverseRoPEQKVMergeProgram)))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.