The feed-forward activation: gelu_new through the sigmoid identity.
74def gpt2FeedForwardWith = cubicTanhSigmoidGateWithThe compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.