RealmOA Library

oa::QuantMatrix

A GPU-resident weight stored in OA's native Q4 or Q8 block encoding. Quantization is deliberately not an `oa::ScalarType`: one logical value owns a packed integer payload and a separate Float32 scale plane. Treating Q4 as a scalar dtype would make matrix byte sizes, strides, views, and element access incorrect. The physical planes remain private and travel as one weight value.

ClC++ public headers

Public Methods

oa::Device oa::QuantMatrix::getDevice()
oa::Quantization oa::QuantMatrix::getQuantization()
MatrixShape oa::QuantMatrix::getShape()
bool oa::QuantMatrix::isEmpty()
oa::I64 oa::QuantMatrix::numElements()
oa::I32 oa::QuantMatrix::rank()
oa::I64 oa::QuantMatrix::size(oa::I32 inDim)

Constructor & Destructor Documentation

oa::QuantMatrix::QuantMatrix()
No public source comment is attached to this declaration.

Public Method Documentation

oa::Device oa::QuantMatrix::getDevice()
No public source comment is attached to this declaration.

Returns

oa::Device

The declared return value.

oa::Quantization oa::QuantMatrix::getQuantization()
No public source comment is attached to this declaration.

Returns

oa::Quantization

The declared return value.

MatrixShape oa::QuantMatrix::getShape()
No public source comment is attached to this declaration.

Returns

MatrixShape

The declared return value.

bool oa::QuantMatrix::isEmpty()
No public source comment is attached to this declaration.

Returns

bool

The declared return value.

oa::I64 oa::QuantMatrix::numElements()
No public source comment is attached to this declaration.

Returns

oa::I64

The declared return value.

oa::I32 oa::QuantMatrix::rank()
No public source comment is attached to this declaration.

Returns

oa::I32

The declared return value.

oa::I64 oa::QuantMatrix::size( oa::I32 inDim )
No public source comment is attached to this declaration.

Parameters

inDim
oa::I32

—

Returns

oa::I64

The declared return value.