oa::FnMatrix::layerNormBwd

layerNormBwd: backward pass for LayerNorm.

FnC++ public headers

Function Documentation

LayerNormBwdResult oa::FnMatrix::layerNormBwd(
	const Matrix & inX,
	const Matrix & inWeight,
	const Matrix & inBias,
	const Matrix & inOut,
	const Matrix & inMean,
	const Matrix & inRstd,
	const Matrix & inGradOutput,
	oa::F32 inEps = 1e-5F
)

layerNormBwd: backward pass for LayerNorm.

Parameters

inX

const Matrix &

—

inWeight

const Matrix &

—

inBias

const Matrix &

—

inOut

const Matrix &

—

inMean

const Matrix &

—

inRstd

const Matrix &

—

inGradOutput

const Matrix &

—

inEps

oa::F32

Default: 1e-5F

Returns

LayerNormBwdResult

The declared return value.