oa::FnMatrix::channelNorm

channelNorm: fused LayerNorm over the channel axis of [B,C,T] without transposing. Replaces Transpose+LayerNorm+transpose (3 dispatches) with 1.

FnC++ public headers

Function Documentation

Matrix oa::FnMatrix::channelNorm(
	const Matrix & inX,
	const Matrix & inWeight,
	const Matrix & inBias,
	oa::I32 inBatch,
	oa::I32 inChannels,
	oa::I32 inSeqLen,
	oa::F32 inEps
)

channelNorm: fused LayerNorm over the channel axis of [B,C,T] without transposing. Replaces Transpose+LayerNorm+transpose (3 dispatches) with 1.

Parameters

inX

const Matrix &

—

inWeight

const Matrix &

—

inBias

const Matrix &

—

inBatch

oa::I32

—

inChannels

oa::I32

—

inSeqLen

oa::I32

—

inEps

oa::F32

—

Returns

Matrix

The declared return value.