AlphaGitHub
Source/Systems

Coppelius.Build.Graph

systems/coppelius/src/Coppelius/Build/Graph.alpha

3,461 lines536 declarations124.9 KiBSHA-256 6b9f923bd170
Download exact fileView at revisionf5034773ad4bb52133

def · lines 1635–1660

cgEntryInitialization

Full file
an entry's initial value: the layer norms' gains one, their shifts zero (the matrices come from the initialization input)
1635def cgEntryInitialization =
1636  (lambda unrestricted j : Nat .
1637    (cgIf
1638      (naturalEqual (cgEntryElements j) cgWidth)
1639      (cgFillWith
1640        (cgParameter cgBankP j)
1641        cgWidth
1642        (naturalSelect
1643          (naturalOr
1644            (naturalEqual j cgFinalGamma)
1645            (naturalAnd
1646              (naturalLessOrEqual cgFirstLayerEntry j)
1647              (naturalOr
1648                (naturalEqual
1649                  (naturalModuloUnchecked
1650                    (naturalSaturatingSubtract j cgFirstLayerEntry)
1651                    cgLayerItems)
1652                  cgItemNorm1Gain)
1653                (naturalEqual
1654                  (naturalModuloUnchecked
1655                    (naturalSaturatingSubtract j cgFirstLayerEntry)
1656                    cgLayerItems)
1657                  cgItemNorm2Gain))))
1658          cgOne
1659          cgZero))
1660      cgNothing))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.