Source/Packages

Realization.Nvidia.SM86.StreamingAttentionSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/StreamingAttentionSM86.alpha

3,230 lines493 declarations193.3 KiBSHA-256 cc0366b3d857

def · lines 1991–1991

sqdKeyOffset

Full file
dQ from dS^T: parameters K 1, dQ 7, s 10 (the query pass's) and dS^T 11 (the key pass's argument 14); grid as the query pass's. Three shared stages of K's tile and dS^T's (64 rows of 128 bytes each, unpadded: a row's chunk c at c ^ (row % 8), so the eight rows an LDSM reads fall in distinct banks), the copies two tiles ahead. K's and dS^T's offsets of the thread's copy rows r + 16 m (LDGSTS's global immediate is 11 bits: each row group keeps its own offset)
1991def sqdKeyOffset = (lambda unrestricted m : Nat . (naturalAdd 180 m))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.