oa::FnMatrix::geglu

geglu: GEGLU activation: out = A[:N] * GELU(A[N:]).

FnC++ public headers

Function Documentation

oa::Matrix oa::FnMatrix::geglu(
	const oa::Matrix & inA,
	oa::U32 inIntermediateSize
)

geglu: GEGLU activation: out = A[:N] * GELU(A[N:]).

inA

const oa::Matrix &

—

inIntermediateSize

oa::U32

—

oa::Matrix

The declared return value.