AlphaGitHub
Source/Packages

Learning.Learner.MomentNormalized

packages/learning/src/Learning/Learner/MomentNormalized.alpha

139 lines22 declarations6.5 KiBSHA-256 de296d84c181
Download exact fileView at revisionbcc11a4e7647d31628

def · lines 58–64

secondMomentValue

Full file
v' = beta v + (1 - beta) (g g)
58def secondMomentValue =
59  (lambda unrestricted beta : F32 .
60    (lambda unrestricted moment : F32 .
61      (lambda unrestricted gradient : F32 .
62        (f32-add
63          (f32-multiply beta moment)
64          (f32-multiply (f32-subtract stdF32One beta) (f32-multiply gradient gradient))))))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.