AlphaGitHub
Source/Packages

Learning.Learner.MomentNormalized

packages/learning/src/Learning/Learner/MomentNormalized.alpha

139 lines22 declarations6.5 KiBSHA-256 de296d84c181
Download exact fileView at revisionbcc11a4e7647d31628

def · lines 49–55

firstMomentValue

Full file
m' = beta m + (1 - beta) g
49def firstMomentValue =
50  (lambda unrestricted beta : F32 .
51    (lambda unrestricted moment : F32 .
52      (lambda unrestricted gradient : F32 .
53        (f32-add
54          (f32-multiply beta moment)
55          (f32-multiply (f32-subtract stdF32One beta) gradient)))))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.