oa::FnMatrix::layerNorm

layerNorm: Affine layer normalization over the last dimension: out = ((A - mean(A)) / sqrt(var(A) + Eps)) * Weight + Bias.

FnC++ public headers

Function Documentation

oa::Matrix oa::FnMatrix::layerNorm(
	const oa::Matrix & inSelf,
	const oa::Matrix & inWeight,
	const oa::Matrix & inBias,
	oa::F32 inEps
)

layerNorm: Affine layer normalization over the last dimension: out = ((A - mean(A)) / sqrt(var(A) + Eps)) * Weight + Bias.

inSelf

const oa::Matrix &

—

inWeight

const oa::Matrix &

—

inBias

const oa::Matrix &

—

inEps

oa::F32

—

oa::Matrix

The declared return value.