oa::FnMatrix::rmsNormGated

LayerNorm and RmsNorm forward declarations are generated from MlFnMatrixNorm.toml.

FnC++ public headers

Function Documentation

Matrix oa::FnMatrix::rmsNormGated(
	const Matrix & inSelf,
	const Matrix & inWeight,
	const Matrix & inBias,
	const Matrix & inZ,
	oa::F32 inEps,
	bool inNormBeforeGate = true
)

LayerNorm and RmsNorm forward declarations are generated from MlFnMatrixNorm.toml.

Parameters

inSelf

const Matrix &

—

inWeight

const Matrix &

—

inBias

const Matrix &

—

inZ

const Matrix &

—

inEps

oa::F32

—

inNormBeforeGate

bool

Default: true

Returns

Matrix

The declared return value.