oa::FnMatrix::softplusBwd

softplusBwd: backward pass for Softplus activation.

FnC++ public headers

Function Documentation

Matrix oa::FnMatrix::softplusBwd(
	const Matrix & inForwardOutput,
	const Matrix & inGradOutput
)

softplusBwd: backward pass for Softplus activation.

inForwardOutput

const Matrix &

output y = softplus(a) from the forward pass

inGradOutput

const Matrix &

—

Matrix

dOut * sigmoid(a) = dOut * (1 - e^-y)