AlphaGitHub
Source/Packages

Realization.Nvidia.SM86.AttentionHeadLayoutSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/AttentionHeadLayoutSM86.alpha

1,710 lines162 declarations85.3 KiBSHA-256 ad8cef82929b
Download exact fileView at revisionf5034773ad4bb52133

def · lines 1210–1220

attentionHeadLayoutSM86Registers

Full file
1210def attentionHeadLayoutSM86Registers =
1211  (lambda unrestricted kind : (family AttentionHeadLayoutSM86Kind) .
1212    (eliminate
1213      AttentionHeadLayoutSM86Kind
1214      (lambda unrestricted current : (family AttentionHeadLayoutSM86Kind) . Nat)
1215      kind
1216      (branch AttentionHeadLayoutQKRotary . attentionHeadLayoutSM86N48)
1217      (branch AttentionHeadLayoutValueTranspose . attentionHeadLayoutSM86N24)
1218      (branch AttentionHeadLayoutHeadToToken . attentionHeadLayoutSM86N24)
1219      (branch AttentionHeadLayoutTokenToHead . attentionHeadLayoutSM86N24)
1220      (branch AttentionHeadLayoutInverseRoPEQKVMerge . attentionHeadLayoutSM86N64)))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.