oa::FnMatrix::gegluBwd

gegluBwd: backward pass for GEGLU activation.

FnC++ public headers

Function Documentation

Matrix oa::FnMatrix::gegluBwd(
	const Matrix & inInput,
	const Matrix & inGradOutput
)

gegluBwd: backward pass for GEGLU activation.

inInput

const Matrix &

forward INPUT (up||gate); up*GELU(gate) is not invertible

inGradOutput

const Matrix &

—

Matrix

The declared return value.