oa::RmsNorm

RmsNorm: RMS normalization layer.

Inheritance

public Module

Public Methods

Matrix oa::RmsNorm::forward(const Matrix & inInput)

Constructor & Destructor Documentation

oa::RmsNorm::RmsNorm( oa::I32 inDim, oa::F32 inEps = 1e-6f )
No public source comment is attached to this declaration.

Parameters

inDim
oa::I32

inEps
oa::F32

Default: 1e-6f

Public Method Documentation

Matrix oa::RmsNorm::forward( const Matrix & inInput )
No public source comment is attached to this declaration.

Parameters

inInput
const Matrix &

Returns

Matrix

The declared return value.