AdamW over the whole flat bank in one launch, the
parameters' half copies written with it (Realization.Nvidia.SM86.
AdamWHalfSM86, its stalls compacted): a grid of coppeliusAdamWBlocks
blocks walks the bank's element quads with a grid stride. The bank's
elements are the checkpoint's (it is P, M and V, each the parameter
bank); the plan holds its own bank to the same count (Coppelius.Build.
Graph.cgAdamWCoversTheBank).
369def coppeliusAdamWBlocks : Nat = 1024The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.