AlphaGitHub
Source/Packages

Learning.Learner.MomentNormalized

packages/learning/src/Learning/Learner/MomentNormalized.alpha

139 lines22 declarations6.5 KiBSHA-256 de296d84c181
Download exact fileView at revisionbcc11a4e7647d31628

def · lines 79–89

normalizedStepValue

Full file
w - (rate m^) / (sqrt v^ + epsilon)
79def normalizedStepValue =
80  (lambda unrestricted rate : F32 .
81    (lambda unrestricted epsilon : F32 .
82      (lambda unrestricted weight : F32 .
83        (lambda unrestricted first : F32 .
84          (lambda unrestricted second : F32 .
85            (f32-subtract
86              weight
87              (f32-divide
88                (f32-multiply rate first)
89                (f32-add (f32-sqrt second) epsilon))))))))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.