oa::FnMatrix::splitHeads

splitHeads: [B*S,D] -> [B*H,S,D/H]. Multi-head permutation.

FnC++ public headers

Function Documentation

Matrix oa::FnMatrix::splitHeads(
	const Matrix & inX,
	oa::I32 inBatch,
	oa::I32 inSeqLen,
	oa::I32 inNumHeads
)

splitHeads: [B*S,D] -> [B*H,S,D/H]. Multi-head permutation.

inX

const Matrix &

—

inBatch

oa::I32

—

inSeqLen

oa::I32

—

inNumHeads

oa::I32

—

Matrix

The declared return value.