oa::CosineWarmRestartsScheduler

SGDR: cosine annealing with periodic warm restarts. Period starts at t0 steps, multiplied by tMult after each restart.

Inheritance

public LRScheduler

Public Methods

oa::F32 oa::CosineWarmRestartsScheduler::getLr(oa::U64 inStep)

Constructor & Destructor Documentation

oa::CosineWarmRestartsScheduler::CosineWarmRestartsScheduler( oa::F32 inMaxLr, oa::U64 inT0, oa::U64 inTMult = 1, oa::F32 inEtaMin = 0.0f )
No public source comment is attached to this declaration.

Parameters

inMaxLr
oa::F32

inT0
oa::U64

inTMult
oa::U64

Default: 1

inEtaMin
oa::F32

Default: 0.0f

Public Method Documentation

oa::F32 oa::CosineWarmRestartsScheduler::getLr( oa::U64 inStep )
No public source comment is attached to this declaration.

Parameters

inStep
oa::U64

Returns

oa::F32

The declared return value.