oa::FnMatrix::sampleLogits

samples one class per last-axis row. temperature < = 0 is greedy; inTopK < = 0 keeps the full vocabulary; inTopP is clamped to (0,1].

Function Documentation

Matrix oa::FnMatrix::sampleLogits( const Matrix & inLogits, oa::F32 inTemperature = 1.0F, oa::I32 inTopK = 0, oa::F32 inTopP = 1.0F, oa::U64 inSeed = 0 )
samples one class per last-axis row. temperature < = 0 is greedy; inTopK < = 0 keeps the full vocabulary; inTopP is clamped to (0,1].

Parameters

inLogits
const Matrix &

inTemperature
oa::F32

Default: 1.0F

inTopK
oa::I32

Default: 0

inTopP
oa::F32

Default: 1.0F

inSeed
oa::U64

Default: 0

Returns

Matrix

The declared return value.