oa::FnMatrix::rmsNormBwd

rmsNormBwd: backward pass for RmsNorm.

FnC++ public headers

Function Documentation

RmsNormBwdResult oa::FnMatrix::rmsNormBwd(
	const Matrix & inX,
	const Matrix & inWeight,
	const Matrix & inGradOutput,
	oa::F32 inEps = 1e-5F
)

rmsNormBwd: backward pass for RmsNorm.

inX

const Matrix &

—

inWeight

const Matrix &

—

inGradOutput

const Matrix &

—

inEps

oa::F32

Default: 1e-5F

RmsNormBwdResult

The declared return value.