keras-lookahead

Lookahead mechanism for optimizers in Keras


Keywords
keras, lookahead, optimizers
License
MIT
Install
pip install keras-lookahead==0.4.0

Documentation

Keras Lookahead

Travis Coverage Version Downloads License

[中文|English]

Unofficial implementation of the lookahead mechanism for optimizers.

Install

pip install keras-lookahead

Usage

Arguments:

  • optimizer: Original optimizer.
  • sync_period: the k in the paper. The synchronization period.
  • slow_step: the α in the paper. The step size of slow weights.
from keras_lookahead import Lookahead

optimizer = Lookahead('adam', sync_period=5, slow_step=0.5)

Custom optimizers can also be used:

from keras_radam import RAdam
from keras_lookahead import Lookahead

optimizer = Lookahead(RAdam())