oa::FnMatrix::siluMul

siluMul: SiLU on first half, multiply with second half: out = SiLU(A[:N]) * A[N:].

Function Documentation

oa::Matrix oa::FnMatrix::siluMul( const oa::Matrix & inA, oa::U32 inIntermediateSize )
siluMul: SiLU on first half, multiply with second half: out = SiLU(A[:N]) * A[N:].

Parameters

inA
const oa::Matrix &

inIntermediateSize
oa::U32

Returns

oa::Matrix

The declared return value.