Source/Packages

Realization.Nvidia.SM86.StreamingAttentionSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/StreamingAttentionSM86.alpha

3,230 lines493 declarations193.3 KiBSHA-256 cc0366b3d857

def · lines 2706–2706

sksQueryTile

Full file
=========================================================================== The key pass with each query sub-tile staged in shared memory, as the forward and query passes. A step's operands are Q's and dO's 32 rows (plain for S^T and dP^T, read transposed by LDSM.T for dK and dV, the same values in the same lanes as the register kernel's Q^T and dO^T loads) and the sub-tile's 32 L and D words (global loads, each pair its own pointer). The 64 threads copy row r + 8 i, chunk c of each plane (thread 8 r + c). The prologue's K and V fragment loads keep their own address pairs, so no load address is ever re-formed before its late read and the late-read guard is not needed.
2706def sksQueryTile : Nat = 4608

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.