AlphaGitHub
Source/Packages

Realization.Nvidia.SM86.AttentionHeadLayoutSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/AttentionHeadLayoutSM86.alpha

1,710 lines162 declarations85.3 KiBSHA-256 ad8cef82929b
Download exact fileView at revisionf5034773ad4bb52133

def · lines 1222–1232

attentionHeadLayoutSM86GridX

Full file
1222def attentionHeadLayoutSM86GridX =
1223  (lambda unrestricted kind : (family AttentionHeadLayoutSM86Kind) .
1224    (eliminate
1225      AttentionHeadLayoutSM86Kind
1226      (lambda unrestricted current : (family AttentionHeadLayoutSM86Kind) . Nat)
1227      kind
1228      (branch AttentionHeadLayoutQKRotary . attentionHeadLayoutSM86N1024)
1229      (branch AttentionHeadLayoutValueTranspose . attentionHeadLayoutSM86N512)
1230      (branch AttentionHeadLayoutHeadToToken . attentionHeadLayoutSM86N1024)
1231      (branch AttentionHeadLayoutTokenToHead . attentionHeadLayoutSM86N1024)
1232      (branch AttentionHeadLayoutInverseRoPEQKVMerge . attentionHeadLayoutSM86N1024)))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.