View source on GitHub
|
A LearningRateSchedule that uses a linear cosine decay schedule.
Inherits From: LearningRateSchedule
tf.keras.experimental.LinearCosineDecay(
initial_learning_rate, decay_steps, num_periods=0.5, alpha=0.0, beta=0.001,
name=None
)
initial_learning_rate: A scalar float32 or float64 Tensor or a Python
number. The initial learning rate.decay_steps: A scalar int32 or int64 Tensor or a Python number.
Number of steps to decay over.num_periods: Number of periods in the cosine part of the decay.
See computation above.alpha: See computation above.beta: See computation above.name: String. Optional name of the operation. Defaults to
'LinearCosineDecay'.__call____call__(
step
)
Call self as a function.
from_config@classmethod
from_config(
config
)
Instantiates a LearningRateSchedule from its config.
config: Output of get_config().A LearningRateSchedule instance.
get_configget_config()