oa::ByteHead

BYTE OUTPUT HEAD - convert hidden states back to byte probabilities input: [batch, seq_len, d_model] output: [batch, seq_len, 256] (logits over byte values)

Inheritance

public Module

Public Methods

Matrix oa::ByteHead::forward(const Matrix & inHidden)

Constructor & Destructor Documentation

oa::ByteHead::ByteHead( oa::I32 inDModel )
No public source comment is attached to this declaration.

Parameters

inDModel
oa::I32

Public Method Documentation

Matrix oa::ByteHead::forward( const Matrix & inHidden )
[batch, seq, d_model] -> [batch, seq, 256]

Parameters

inHidden
const Matrix &

Returns

Matrix

The declared return value.