the largest grid the channel accepted for one launch of 256-thread blocks
the gated activation's forward and backward in one launch each
(Realization.Nvidia.SM86.GatedGELUSM86): bit for bit the GELU, the
product and the cast (the backward's two products, GELU' and two casts)
they replace
1567def cgGatedGeluForward =
1568 (lambda unrestricted gelu : Nat . (lambda unrestricted gated : Nat .
1569 (lambda unrestricted up : Nat . (lambda unrestricted gate : Nat . (lambda unrestricted elements : Nat .
1570 (cgLaunch cgImageGatedGeluForward (gatedGELUSM86Blocks elements) 1 1
1571 (cgPointer (cgArgument 0) gelu (cgPointer (cgArgument 1) gated
1572 (cgPointer (cgArgument 2) up (cgPointer (cgArgument 3) gate cgGeluScalars))))))))))The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.