AlphaGitHub
Source/Packages

Realization.Nvidia.SM86.StreamingAttentionSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/StreamingAttentionSM86.alpha

3,230 lines493 declarations193.3 KiBSHA-256 cc0366b3d857
Download exact fileView at revisionbcc11a4e7647d31628

def · lines 3165–3165

streamingAttentionKeyRowMajorValueArgument

Full file
V for dP^T: [KV-head][position][64], unlike forward/query attention's transposed [KV-head][64][position] value operand.
3165def streamingAttentionKeyRowMajorValueArgument : Nat = 2

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.