oa::RolloutBuffer

RolloutBuffer class in the OA Ml public surface.

ClC++ public headers

Public Methods

oa::Status oa::RolloutBuffer::append(const RolloutTransition & inTransition)

const RolloutBatch & oa::RolloutBuffer::batch()

oa::U32 oa::RolloutBuffer::capacity()

const RolloutConfig & oa::RolloutBuffer::config()

oa::Status oa::RolloutBuffer::finalize(const GaeConfig & inConfig = {})

bool oa::RolloutBuffer::isFinalized()

bool oa::RolloutBuffer::isFull()

bool oa::RolloutBuffer::isValid()

void oa::RolloutBuffer::reset()

oa::U32 oa::RolloutBuffer::size()

Static Public Methods

static oa::Result<RolloutBuffer> oa::RolloutBuffer::create(const RolloutConfig & inConfig)

Constructor & Destructor Documentation

oa::RolloutBuffer::RolloutBuffer()

No public source comment is attached to this declaration.

Public Method Documentation

oa::Status oa::RolloutBuffer::append(
	const RolloutTransition & inTransition
)

Records one fused GPU append. The CPU cursor is control metadata only; no matrix data is read or copied through the host.

Parameters

inTransition

const RolloutTransition &

—

Returns

oa::Status

The declared return value.

const RolloutBatch & oa::RolloutBuffer::batch()

No public source comment is attached to this declaration.

Returns

const RolloutBatch &

The declared return value.

oa::U32 oa::RolloutBuffer::capacity()

No public source comment is attached to this declaration.

Returns

oa::U32

The declared return value.

const RolloutConfig & oa::RolloutBuffer::config()

No public source comment is attached to this declaration.

Returns

const RolloutConfig &

The declared return value.

oa::Status oa::RolloutBuffer::finalize(
	const GaeConfig & inConfig = {}
)

Requires a complete rollout and records GAE directly into the preallocated advantage/return matrices.

Parameters

inConfig

const GaeConfig &

Default: {}

Returns

oa::Status

The declared return value.

bool oa::RolloutBuffer::isFinalized()

No public source comment is attached to this declaration.

Returns

bool

The declared return value.

bool oa::RolloutBuffer::isFull()

No public source comment is attached to this declaration.

Returns

bool

The declared return value.

bool oa::RolloutBuffer::isValid()

No public source comment is attached to this declaration.

Returns

bool

The declared return value.

void oa::RolloutBuffer::reset()

Begins a new collection cycle and clears valid on the GPU. Previously collected tensors remain allocated and are overwritten in place.

Returns

void

The declared return value.

oa::U32 oa::RolloutBuffer::size()

No public source comment is attached to this declaration.

Returns

oa::U32

The declared return value.

static oa::Result<RolloutBuffer> oa::RolloutBuffer::create(
	const RolloutConfig & inConfig
)

No public source comment is attached to this declaration.

Parameters

inConfig

const RolloutConfig &

—

Returns

oa::Result<RolloutBuffer>

The declared return value.