Source/Systems

Coppelius.Build.DeviceImages

systems/coppelius/src/Coppelius/Build/DeviceImages.alpha

726 lines107 declarations39.5 KiBSHA-256 aca105a01057

def · lines 369–369

coppeliusAdamWBlocks

Full file
AdamW over the whole flat bank in one launch, the parameters' half copies written with it (Realization.Nvidia.SM86. AdamWHalfSM86, its stalls compacted): a grid of coppeliusAdamWBlocks blocks walks the bank's element quads with a grid stride. The bank's elements are the checkpoint's (it is P, M and V, each the parameter bank); the plan holds its own bank to the same count (Coppelius.Build. Graph.cgAdamWCoversTheBank).
369def coppeliusAdamWBlocks : Nat = 1024

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.