oa::FnMatrix::gruScanBwd

gruScanBwd: BPTT recurrence scan (backward of gruScan) in ONE dispatch. Produces gradients w.r.t. the input projection gatesI and the hidden projection gatesH (the latter drives the separate linearWeightBiasBwd weight-grad call).

Function Documentation

GruScanBwdResult oa::FnMatrix::gruScanBwd( const Matrix & inDOut, const Matrix & inGatesI, const Matrix & inHPrev, const Matrix & inWeightHh, oa::I32 inHiddenSize, oa::I32 inSeqLen, oa::I32 inBatch, const Matrix & inBiasHh = Matrix{} )
gruScanBwd: BPTT recurrence scan (backward of gruScan) in ONE dispatch. Produces gradients w.r.t. the input projection gatesI and the hidden projection gatesH (the latter drives the separate linearWeightBiasBwd weight-grad call).

Parameters

inDOut
const Matrix &

inGatesI
const Matrix &

inHPrev
const Matrix &

inWeightHh
const Matrix &

inHiddenSize
oa::I32

inSeqLen
oa::I32

inBatch
oa::I32

inBiasHh
const Matrix &

Default: Matrix{}

Returns

GruScanBwdResult

The declared return value.