oa::FnMatrix::geluBwd

geluBwd: backward pass for GELU activation. Computes: dInput = dOutput * gelu'(x)

FnC++ public headers

Function Documentation

Matrix oa::FnMatrix::geluBwd(
	const Matrix & inInput,
	const Matrix & inGradOutput
)

geluBwd: backward pass for GELU activation. Computes: dInput = dOutput * gelu'(x)

inInput

const Matrix &

forward INPUT x (gelu'(x) is a function of input, not output)

inGradOutput

const Matrix &

—

Matrix

The declared return value.