oa::FnMatrix::rmsNorm

rmsNorm: Weighted root mean square normalization over the last dimension: out = (A / sqrt(mean(A^2) + Eps)) * Weight.

Function Documentation

oa::Matrix oa::FnMatrix::rmsNorm( const oa::Matrix & inSelf, const oa::Matrix & inWeight, oa::F32 inEps )
rmsNorm: Weighted root mean square normalization over the last dimension: out = (A / sqrt(mean(A^2) + Eps)) * Weight.

Parameters

inSelf
const oa::Matrix &

inWeight
const oa::Matrix &

inEps
oa::F32

Returns

oa::Matrix

The declared return value.