oa::FnMatrix::softmaxScaledMasked

softmaxScaledMasked: fused transformer attention score normalisation. Computes: out = softmax(scores * scale + mask) over the last dimension.

FnC++ public headers

Function Documentation

Matrix oa::FnMatrix::softmaxScaledMasked(
	const Matrix & inScores,
	const Matrix & inMask,
	oa::F32 inScale
)

softmaxScaledMasked: fused transformer attention score normalisation. Computes: out = softmax(scores * scale + mask) over the last dimension.

inScores

const Matrix &

—

inMask

const Matrix &

—

inScale

oa::F32

—

Matrix

The declared return value.