Source/Packages

Component.Pointwise

packages/components/src/Component/Pointwise.alpha

413 lines45 declarations17.7 KiBSHA-256 d94b209ac952

def · lines 383–413

pointwiseReluSquaredBackward

Full file
383def pointwiseReluSquaredBackward =
384  (lambda erased inputs : Nat .
385    (lambda unrestricted x : (family PointwiseExpression StdU32 inputs) .
386      (lambda unrestricted gradient : (family PointwiseExpression StdU32 inputs) .
387        (let unrestricted round =
388          (pointwiseUnary StdU32 inputs (constructor PointwiseUnary PointwiseRoundBF16))
389          in
390          (let unrestricted multiply =
391            (pointwiseBinary StdU32 inputs (constructor PointwiseBinary PointwiseMultiply))
392            in
393            (let unrestricted relu =
394              (round
395                (pointwiseBinary
396                  StdU32
397                  inputs
398                  (constructor PointwiseBinary PointwisePositiveGate)
399                  x
400                  x))
401              in
402              (pointwiseBinary
403                StdU32
404                inputs
405                (constructor PointwiseBinary PointwisePositiveGate)
406                x
407                (round
408                  (multiply
409                    gradient
410                    (round
411                      (multiply
412                        (constructor PointwiseExpression PointwiseConstant StdU32 inputs 0x40000000)
413                        relu)))))))))))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.