an entry's initial value: the layer norms' gains one, their shifts zero
(the matrices come from the initialization input)
1636def cgEntryInitialization =
1637 (lambda unrestricted j : Nat .
1638 (cgIf
1639 (naturalEqual (cgEntryElements j) cgWidth)
1640 (cgFillWith
1641 (cgParameter cgBankP j)
1642 cgWidth
1643 (naturalSelect
1644 (naturalOr
1645 (naturalEqual j cgFinalGamma)
1646 (naturalAnd
1647 (naturalLessOrEqual cgFirstLayerEntry j)
1648 (naturalOr
1649 (naturalEqual
1650 (naturalModuloUnchecked
1651 (naturalSaturatingSubtract j cgFirstLayerEntry)
1652 cgLayerItems)
1653 cgItemNorm1Gain)
1654 (naturalEqual
1655 (naturalModuloUnchecked
1656 (naturalSaturatingSubtract j cgFirstLayerEntry)
1657 cgLayerItems)
1658 cgItemNorm2Gain))))
1659 cgOne
1660 cgZero))
1661 cgNothing))The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.