ADADELTA: AN ADAPTIVE LEARNING RATE METHOD Matthew D. Zeiler1,2∗ 1 2

First Page		Document Content
Date: 2012-12-29 18:31:47 Neural networks Computational statistics Stochastic gradient descent Backpropagation Gradient descent Stochastic approximation Gradient method Numerical analysis Stochastic optimization Mathematical optimization		ADADELTA: AN ADAPTIVE LEARNING RATE METHOD Matthew D. Zeiler1,2∗ 1 2 Add to Reading List Source URL: www.matthewzeiler.com Download Document from Source Website File Size: 523,58 KB Share Document on Facebook

	Singular Perturbations of Systems Controlled by Energy-Speed-Gradient Method DocID: 1urGY - View Document
	A Stochastic Gradient Method with an Exponential Convergence Rate for Finite Training Sets Nicolas Le Roux SIERRA Project-Team INRIA - ENS DocID: 1u6wI - View Document
	Adobe Technical Report, MarchA Perceptually Motivated Method to Control Reconstruction Errors in Gradient-based Image Compositing Sylvain Paris Abstract DocID: 1tEfO - View Document
	Steepest Descent Method Kefu Liu Properties of Gradient Vector The gradient vector of a scalar function f ( x1 , x2 ,", xn ) is defined as a column vector ⎡ ∂f DocID: 1tbCd - View Document
	SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives Francis Bach INRIA - Sierra Project-Team DocID: 1sTsV - View Document