1 - lr x weight decay
908def cgDecay : Nat =
909 (compile-time (float32ExactRational
910 (naturalSaturatingSubtract
911 (naturalMultiply coppeliusLearningRateDenominator coppeliusWeightDecayDenominator)
912 (naturalMultiply coppeliusLearningRateNumerator coppeliusWeightDecayNumerator))
913 (naturalMultiply coppeliusLearningRateDenominator coppeliusWeightDecayDenominator)))The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.