oa::FnMatrix::siluMulBwd

siluMulBwd: backward pass for SiluMul activation.

FnC++ public headers

Function Documentation

Matrix oa::FnMatrix::siluMulBwd(
	const Matrix & inInput,
	const Matrix & inGradOutput
)

siluMulBwd: backward pass for SiluMul activation.

inInput

const Matrix &

forward INPUT (gate||up); the forward output is not invertible

inGradOutput

const Matrix &

—

Matrix

The declared return value.