oa::OneCycleScheduler

Smith's 1cycle policy: warmup ramp to maxLr, then cosine anneal to near-zero. initialLr = maxLr/divFactor. finalLr = initialLr/finalDivFactor.

ClC++ public headers

Inheritance

public LRScheduler

Public Methods

oa::F32 oa::OneCycleScheduler::getLr(oa::U64 inStep)

Constructor & Destructor Documentation

oa::OneCycleScheduler::OneCycleScheduler(
	oa::F32 inMaxLr,
	oa::U64 inTotalSteps,
	oa::F32 inPctStart = 0.3f,
	oa::F32 inDivFactor = 25.0f,
	oa::F32 inFinalDivFactor = 1e4f
)

No public source comment is attached to this declaration.

Parameters

inMaxLr

oa::F32

—

inTotalSteps

oa::U64

—

inPctStart

oa::F32

Default: 0.3f

inDivFactor

oa::F32

Default: 25.0f

inFinalDivFactor

oa::F32

Default: 1e4f

Public Method Documentation

oa::F32 oa::OneCycleScheduler::getLr(
	oa::U64 inStep
)

No public source comment is attached to this declaration.

Parameters

inStep

oa::U64

—

Returns

oa::F32

The declared return value.