Replicated parameters bind the star's combine order and the split of
samples among owners. Partitioned parameters bind only the learner's
placement-independent identity: the state means the same under any owner
count and any contiguous split of the same input sequence, and restore
onto another placement is a repartitioning, not a different learner.
1991def dpoContext =
1992 (lambda unrestricted c : Nat .
1993 (lambda unrestricted u : Nat .
1994 (lambda unrestricted system : (family DataParallelSystem c u) .
1995 (lambda unrestricted q : Nat .
1996 (lambda unrestricted p : Nat .
1997 (lambda unrestricted topology : (family DataParallelTopology) .
1998 (lambda unrestricted identity : Bytes .
1999 (nat-eliminate
2000 (lambda unrestricted current : Nat . (family CheckpointEnvelopeContract))
2001 (constructor
2002 CheckpointEnvelopeContract
2003 CheckpointEnvelopeContractValue
2004 (bytes-append
2005 b"data-parallel-owned-optimizer-state-f64-finite-rne-separate-v1;"
2006 (bytes-append
2007 (regionFrameWord q)
2008 (bytes-append
2009 (numericalExactContractDigest (dpContract topology (dpOwners c u system)))
2010 identity)))
2011 b"typed-sample-contributions;ordered-combine;owned-coordinate-update;assembly"
2012 b"immutable-partitioned-samples;one-pass-per-update"
2013 b"declared-initial-parameters;no-randomness"
2014 1
2015 1
2016 1)
2017 (lambda unrestricted previous : Nat .
2018 (lambda unrestricted ignored : (family CheckpointEnvelopeContract) .
2019 (constructor
2020 CheckpointEnvelopeContract
2021 CheckpointEnvelopeContractValue
2022 (bytes-append
2023 b"data-parallel-partitioned-parameters-f64-finite-rne-separate-v1;"
2024 (bytes-append
2025 (dpoPublicationTag topology)
2026 (bytes-append (regionFrameWord q) identity)))
2027 b"typed-sample-contributions;ordered-combine;owned-coordinate-update;materialized-read-replica"
2028 b"immutable-samples-any-contiguous-split;one-pass-per-update"
2029 b"declared-initial-parameters;no-randomness"
2030 1
2031 1
2032 1)))
2033 p))))))))The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.