Source/Systems

Bob.TrainingRun

systems/bob/src/Bob/TrainingRun.alpha

123 lines35 declarations5.2 KiBSHA-256 7d99696fdf49

def · lines 110–123

bobCheckpointContract

Full file
110def bobCheckpointContract : (family CheckpointEnvelopeContract) =
111  (constructor CheckpointEnvelopeContract CheckpointEnvelopeContractValue
112    (bytes-append b"bob-raw-pmv-f32-v1|parameter-order:p-then-m-then-v" (bobIdentityPart b"payload" bobCheckpointPayloadBytes))
113    (bytes-append bobObjectiveIdentity
114      (bytes-append b"|" (bytes-append bobLearnerIdentity
115        (bytes-append b"|" (bytes-append (dataFloat32EncodeLE bobLearningRate) (bytes-append (dataFloat32EncodeLE bobBeta1)
116          (bytes-append (dataFloat32EncodeLE bobBeta2) (bytes-append (dataFloat32EncodeLE bobEpsilon) (dataFloat32EncodeLE bobWeightDecay)))))))))
117    (bytes-append b"raw-byte-sequence"
118      (bytes-append (bobIdentityPart b"vocabulary" bobVocabularySize)
119        (bytes-append (bobIdentityPart b"prompts" bobPromptCount) (bobIdentityPart b"record" bobInputRecordBytes))))
120    b"bob-seed-v1"
121    bobCheckpointPayloadBytes
122    (naturalMultiply bobCheckpointBytesPerScalar bobParameterCount)
123    bobUpdatesPerInvocation)

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.