11 lines (10 with data), 1.2 kB

3

„ï­_'ã@s(dZd
dl
Zdd„Zdd„Zdd„ZdS)	z¼Functions for ramping hyperparameters up or down

Each function takes the current training step or epoch, and the
ramp length in the same format, and returns a multiplier between
0 and 1.
éNcCs@|
d
krdStj
|d|
ƒ}d||
}ttjd||ƒ
ƒ
SdS)z8Exponential rampup from https://arxiv.org/abs/1610.02242r
gð?gg@NgÀ)ÚnpÚclipÚfloatÚexp)ÚcurrentÚ
rampup_lengthZphase©rú;/data/omnisky/postgraduate/Yb/RainsGit/LASeg/utils/ramps.pyÚsigmoid_rampups



r
cCs,|d
kr|
d
kst‚
||
kr dS||
SdS)z
Linear rampupr
gð?N)
ÚAssertionError)rrrrr	Ú
linear_rampups

rcCs<d
|k
o|
k
n
st‚
t
dtjtj||
ƒ
dƒ
S)z5Cosine rampdown from https://arxiv.org/abs/1608.03983r
gà?é
)rrrÚcosÚpi)rZrampdown_lengthrrr	Úcosine_rampdown&s
r)Ú__doc__Únumpyrr
rrrrrr	Ú<module>
s