AlphaGitHub
Source/Packages

Model.Architecture

packages/components/src/Model/Architecture.alpha

91 lines37 declarations2.8 KiBSHA-256 e8182f753683
Download exact fileView at revision2877a0c1788f2c63bb

family · lines 43–60

ModelConfig

Full file
43family ModelConfig : Type 0
44constructor ModelConfigValue
45field unrestricted modelVocabSize : (family ModelWord32)
46field unrestricted modelBlockSize : (family ModelWord32)
47field unrestricted modelLayers : (family ModelWord32)
48field unrestricted modelWidth : (family ModelWord32)
49field unrestricted modelHeads : (family ModelWord32)
50field unrestricted modelFfnStoredWidth : (family ModelWord32)
51field unrestricted modelExperts : (family ModelWord32)
52field unrestricted modelTopK : (family ModelWord32)
53field unrestricted modelRoute : (family ModelRouteKind)
54field unrestricted modelStackedExperts : (family ModelBoolean)
55field unrestricted modelHeadRank : (family ModelOptionalWord32)
56field unrestricted modelAttentionRank : (family ModelOptionalWord32)
57field unrestricted modelPositionEncoding : (family ModelPositionEncoding)
58field unrestricted modelNormKind : (family ModelNormKind)
59field unrestricted modelTieEmbeddings : (family ModelBoolean)
60field unrestricted modelObjective : (family ModelObjective)

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.