Optimizer


AdaBelief Optimizer

Trains fast as Adam, generalizes well as SGD, and is stable to train GANs.

pip install adabelief-tf==0.0.1
from adabelief_tf impoty AdaBeliefOptimizer
optimizer = AdaBeliefOptimizer(learning_rate, epsilon=1e-12) 

Watch