ML Parameter Diagrams
Learning Rate Schedule
Learning Rate
Warmup Steps
Decay
Staircase
Decay Steps
Decay Rate
Early Stop
Early Stop
Increase Batch Size on Plateau
Batch Size
Increase Batch Size On Plateau
Increase Batch Size On Plateau Patience
Increase Batch Size On Plateau Rate
Increase Batch Size On Plateau Max