Source/Packages

Realization.Nvidia.SM86.AdamWHalfSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/AdamWHalfSM86.alpha

428 lines73 declarations26.3 KiBSHA-256 9692515bc485

def · lines 393–394

ahDevicePrologue

Full file
the scaled image whose step size and epsilon are also the device's: words 0 and 1 at argument 11's pointer (ahStateLoads, under SB4, which every element's update waits for before it reads them), as a device-side schedule leaves them; word 2 is loaded and not read
393def ahDevicePrologue = (lambda unrestricted iterations : Nat . (lambda unrestricted tail : (family SM86Program) .
394  (ahPrologueWith 1 iterations (ahStateLoads tail))))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.