the launch of update k's AdamW (from 0; first in its step): after the
forward launches, the earlier steps'. The host writes each update's
step size and epsilon into its parameter block
(Platform.Linux.Nvidia.PlanHostAdamW); the values baked here are the
first invocation's.
343def bobStepLaunches : Nat =
344 (nvidiaLaunchScheduleCount (bobTrainingStep (bobAdamStepScalars 1)))The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.