68def gpt2AttentionBaseTwoScaleWord : Nat =
69 (compile-time
70 (float32ExactInverseRootNaturalLogTwo
71 (learnedPositionDecoderHeadWidthOf gpt2Geometry)))The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.