chao huang chaohuang

MySQL Cheat Sheet

Help with SQL commands to interact with a MySQL database

	from collections import defaultdict
	from keras.callbacks import Callback

	class WRWDScheduler(Callback):
	"""Warm restart scheduler for optimizers with decoupled weight decay

	This Keras callback should be used with TensorFlow optimizers
	with decoupled weight decay, such as tf.contrib.opt.AdamWOptimizer
	or tf.contrib.opt.MomentumWOptimizer. Warm restarts include
	cosine annealing with periodic restarts for both learning rate