oa::FnMatrix::siluBwd

siluBwd: backward pass for SiLU activation.

FnC++ public headers

Function Documentation

Matrix oa::FnMatrix::siluBwd(
	const Matrix & inInput,
	const Matrix & inGradOutput
)

siluBwd: backward pass for SiLU activation.

inInput

const Matrix &

forward INPUT x (silu'(x) is a function of input, not output)

inGradOutput

const Matrix &

—

Matrix

The declared return value.