oa::FnMatrix::linearWeightBiasBwd

linearWeightBiasBwd: fused weight and bias gradient for linear layer. Computes: dWeight = input^T @ dOutput, dBias = sum(dOutput, dim=0)

FnC++ public headers

Function Documentation

LinearWeightBiasBwdResult oa::FnMatrix::linearWeightBiasBwd(
	const Matrix & inInput,
	const Matrix & inGradOutput
)

linearWeightBiasBwd: fused weight and bias gradient for linear layer. Computes: dWeight = input^T @ dOutput, dBias = sum(dOutput, dim=0)

inInput

const Matrix &

—

inGradOutput

const Matrix &

—

LinearWeightBiasBwdResult

The declared return value.