oa::FnMatrix::linearSilu

linearSilu: fused linear + SiLU. output = siLU(input @ weight^T + bias)

Function Documentation

Matrix oa::FnMatrix::linearSilu( const Matrix & inX, const Matrix & inWeight, const Matrix & inBias )
linearSilu: fused linear + SiLU. output = siLU(input @ weight^T + bias)

Parameters

inX
const Matrix &

inWeight
const Matrix &

inBias
const Matrix &

Returns

Matrix

The declared return value.