oa::EmpyrealmCore

— empyrealm-style sequential modeling core. high-utilization reusable backbone: input projection (byte embed or custom) → mixer + flat per-token residual → mixed features [B*seq, dModel]. The mixer is EmpyrealmModule, which dispatches empyrealm* kernels (EmpyrealmDt, EmpyrealmAdt, EmpyrealmSiso) — renamed copies of the Mamba3* kernels with identical SPIR-V today, ready for future architecture-specific divergence. shader layout (for fusion / branding): Ssm/Mamba3/ — original Mamba3Siso* (untouched reference, used by Mamba3Module) Ssm/empyrealm/ — ported/copied starting point; will host fused empyrealm* variants (e.g. custom one-node mixers) while Mamba3 stays pristine. The reconstruction tutorial demonstrates the intended usage. Brand Mamba3 tech as empyrealm for custom evolution.

ClC++ public headers

Inheritance

public Module

Public Methods

oa::Matrix oa::EmpyrealmCore::forward(const oa::Matrix & inInput)

oa::Matrix oa::EmpyrealmCore::forwardEmbedded(const oa::Matrix & inEmbedded)

oa::SharedPtr<EmpyrealmModule> oa::EmpyrealmCore::mixer()

void oa::EmpyrealmCore::resetState(oa::I32 inBatch)

Constructor & Destructor Documentation

oa::EmpyrealmCore::EmpyrealmCore(
	EmpyrealmCoreEmbeddedOnly,
	oa::I32 inDModel,
	oa::I32 inDState = 32,
	oa::I32 inExpand = 2,
	oa::I32 inHeadDim = 16,
	oa::I32 inNGroups = 1,
	oa::F32 inRopeFraction = 0.5f,
	bool inIsMimo = false,
	oa::I32 inMimoRank = 1,
	oa::F32 inDtMin = 0.001f,
	oa::F32 inDtMax = 0.1f,
	oa::F32 inDtInitFloor = 1e-4f,
	oa::F32 inAFloor = 1e-4f,
	bool inIsOutprojNorm = true
)

Embedded-only constructor. No embed module is created or registered, so no dead/zero-gradient embed params leak into allParameterPtrs(), the optimizer, or checkpoints. The caller must feed pre-embedded [B, S, D] features via forwardEmbedded(); forward() is unavailable in this mode and asserts. Used by specializations that own their own input projection.

Parameters

(unnamed)

EmpyrealmCoreEmbeddedOnly

—

inDModel

oa::I32

—

inDState

oa::I32

Default: 32

inExpand

oa::I32

Default: 2

inHeadDim

oa::I32

Default: 16

inNGroups

oa::I32

Default: 1

inRopeFraction

oa::F32

Default: 0.5f

inIsMimo

bool

Default: false

inMimoRank

oa::I32

Default: 1

inDtMin

oa::F32

Default: 0.001f

inDtMax

oa::F32

Default: 0.1f

inDtInitFloor

oa::F32

Default: 1e-4f

inAFloor

oa::F32

Default: 1e-4f

inIsOutprojNorm

bool

Default: true

oa::EmpyrealmCore::EmpyrealmCore(
	oa::I32 inVocabSize,
	oa::I32 inDModel,
	oa::I32 inDState = 32,
	oa::I32 inExpand = 2,
	oa::I32 inHeadDim = 16,
	oa::I32 inNGroups = 1,
	oa::F32 inRopeFraction = 0.5f,
	bool inIsMimo = false,
	oa::I32 inMimoRank = 1,
	oa::F32 inDtMin = 0.001f,
	oa::F32 inDtMax = 0.1f,
	oa::F32 inDtInitFloor = 1e-4f,
	oa::F32 inAFloor = 1e-4f,
	bool inIsOutprojNorm = true
)

Byte/token constructor. forward expects [B, seq] uint8/index matrix. Creates internal oa::Embedding.

Parameters

inVocabSize

oa::I32

—

inDModel

oa::I32

—

inDState

oa::I32

Default: 32

inExpand

oa::I32

Default: 2

inHeadDim

oa::I32

Default: 16

inNGroups

oa::I32

Default: 1

inRopeFraction

oa::F32

Default: 0.5f

inIsMimo

bool

Default: false

inMimoRank

oa::I32

Default: 1

inDtMin

oa::F32

Default: 0.001f

inDtMax

oa::F32

Default: 0.1f

inDtInitFloor

oa::F32

Default: 1e-4f

inAFloor

oa::F32

Default: 1e-4f

inIsOutprojNorm

bool

Default: true

oa::EmpyrealmCore::EmpyrealmCore(
	oa::SharedPtr<oa::Module> inEmbedModule,
	oa::I32 inDModel,
	oa::I32 inDState = 32,
	oa::I32 inExpand = 2,
	oa::I32 inHeadDim = 16,
	oa::I32 inNGroups = 1,
	oa::F32 inRopeFraction = 0.5f,
	bool inIsMimo = false,
	oa::I32 inMimoRank = 1,
	oa::F32 inDtMin = 0.001f,
	oa::F32 inDtMax = 0.1f,
	oa::F32 inDtInitFloor = 1e-4f,
	oa::F32 inAFloor = 1e-4f,
	bool inIsOutprojNorm = true
)

General constructor for specialization. Pass custom projection (e.g. oa::Linear(poseDim, dModel) for motion features). The module must output [B, seq, dModel] (or compatible with ForwardEmbedded).

Parameters

inEmbedModule

oa::SharedPtr<oa::Module>

—

inDModel

oa::I32

—

inDState

oa::I32

Default: 32

inExpand

oa::I32

Default: 2

inHeadDim

oa::I32

Default: 16

inNGroups

oa::I32

Default: 1

inRopeFraction

oa::F32

Default: 0.5f

inIsMimo

bool

Default: false

inMimoRank

oa::I32

Default: 1

inDtMin

oa::F32

Default: 0.001f

inDtMax

oa::F32

Default: 0.1f

inDtInitFloor

oa::F32

Default: 1e-4f

inAFloor

oa::F32

Default: 1e-4f

inIsOutprojNorm

bool

Default: true

void oa::EmpyrealmCore::~EmpyrealmCore()

Destructors.

Public Method Documentation

oa::Matrix oa::EmpyrealmCore::forward(
	const oa::Matrix & inInput
)

Methods.

Parameters

inInput

const oa::Matrix &

—

Returns

oa::Matrix

The declared return value.

oa::Matrix oa::EmpyrealmCore::forwardEmbedded(
	const oa::Matrix & inEmbedded
)

Mixer + flat residual on pre-embedded [B, S, D] or [B*S, D] features. Returns flat [B*seq, dModel].

Parameters

inEmbedded

const oa::Matrix &

—

Returns

oa::Matrix

The declared return value.

oa::SharedPtr<EmpyrealmModule> oa::EmpyrealmCore::mixer()

No public source comment is attached to this declaration.

Returns

oa::SharedPtr<EmpyrealmModule>

The declared return value.

void oa::EmpyrealmCore::resetState(
	oa::I32 inBatch
)

No public source comment is attached to this declaration.

Parameters

inBatch

oa::I32

—

Returns

void

The declared return value.