Predicting one prompt gathers its logits row and takes the greedy argmax.
287def bobPredictLaunches =
288 (lambda unrestricted index : Nat .
289 (bobThen
290 (bobLaunch b"bob-row-gather" (bobKernel bobGatherPlace 1) (bobGatherBlock index))
291 (bobLaunch b"bob-greedy-argmax" (bobKernel bobArgmaxPlace 1) (bobArgmaxBlock index))))The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.