Source/Packages

Realization.Nvidia.SM86.ExactCrossEntropySM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/ExactCrossEntropySM86.alpha

1,471 lines228 declarations53.2 KiBSHA-256 411308c1414a

def · lines 546–547

exactCrossEntropyRowsTileStrideBytes

Full file
A row uses one 256-thread CTA. Thread t visits vocabulary positions t + 256*k; the first maximum tile is already read by the prefix. Derive both tile traversals from the shape so a larger vocabulary cannot silently reuse the legacy 48-tile image.
546def exactCrossEntropyRowsTileStrideBytes : Nat =
547  (naturalMultiply reductionSM86WarpSum256RequiredThreads 4)

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.