Source/Packages

Realization.Nvidia.SM86.StreamingAttentionSM86

packages/realizations/cooperative/nvidia-sm86/src/Realization/Nvidia/SM86/StreamingAttentionSM86.alpha

3,230 lines493 declarations193.3 KiBSHA-256 cc0366b3d857

def · lines 2431–2436

skWeightedDifference

Full file
Multiply a probability by its centred cotangent. Keeping the destination explicit permits either input plane to be reused after its last consumer; the add then multiply and their binary32 rounding order stay unchanged.
2431def skWeightedDifference = (lambda unrestricted destination : Nat .
2432  (lambda unrestricted probability : Nat . (lambda unrestricted cotangent : Nat .
2433    (lambda unrestricted negativeRowTerm : Nat . (lambda unrestricted wait : Nat .
2434      (lambda unrestricted tail : (family SM86Program) .
2435        (saFadd cotangent cotangent negativeRowTerm wait
2436          (saFmul destination probability cotangent saWaitNone tail))))))))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.