oa::FnMatrix::rnnCellPointwise

rnnCellPointwise: fused vanilla-RNN pointwise forward, h_new = tanh(gatesI + gatesH).

Function Documentation

Matrix oa::FnMatrix::rnnCellPointwise( const Matrix & inGatesI, const Matrix & inGatesH )
rnnCellPointwise: fused vanilla-RNN pointwise forward, h_new = tanh(gatesI + gatesH).

Parameters

inGatesI
const Matrix &

[B, H] input projection (W_ih x + b_ih)

inGatesH
const Matrix &

[B, H] hidden projection (W_hh h_prev + b_hh)

Returns

Matrix

The declared return value.