oa::FnMatrix::flashAttentionCausal

flashAttentionCausal: IO-aware causal scaled dot-product attention. Q/K/V and output use contiguous [batchHeads, sequence, headDim] storage.

FnC++ public headers

Function Documentation

Matrix oa::FnMatrix::flashAttentionCausal(
	const Matrix & inQ,
	const Matrix & inK,
	const Matrix & inV,
	oa::F32 inScale
)

flashAttentionCausal: IO-aware causal scaled dot-product attention. Q/K/V and output use contiguous [batchHeads, sequence, headDim] storage.

inQ

const Matrix &

—

inK

const Matrix &

—

inV

const Matrix &

—

inScale

oa::F32

—

Matrix

The declared return value.