oa::LayerNorm

LayerNorm: Layer normalization layer.

Inheritance

public Module

Public Methods

Matrix oa::LayerNorm::forward(const Matrix & inInput)

Constructor & Destructor Documentation

oa::LayerNorm::LayerNorm( oa::I32 inNormalizedShape, oa::F32 inEps = 1e-5f )
No public source comment is attached to this declaration.

Parameters

inNormalizedShape
oa::I32

inEps
oa::F32

Default: 1e-5f

Public Method Documentation

Matrix oa::LayerNorm::forward( const Matrix & inInput )
No public source comment is attached to this declaration.

Parameters

inInput
const Matrix &

Returns

Matrix

The declared return value.