Stochastic gradient descent

Results: 144



#Item
21Mathematical analysis / Mathematics / Algebra / Differential geometry / Riemannian geometry / Computational statistics / Category theory / Information geometry / Information theory / Normal / Logarithm / Stochastic gradient descent

Natural Gradient Works Eciently in Learning Shun-ichi Amari RIKEN Frontier Research Program Wako-shi, Hirosawa 2-1, Saitama, JAPAN fax: +

Add to Reading List

Source URL: www.maths.tcd.ie

Language: English - Date: 2009-10-06 06:49:39
22Statistics / Regression analysis / Convex optimization / Computational statistics / Elastic net regularization / Stochastic gradient descent / Lasso

arXiv:submitcs.LG] 22 MayEfficient Elastic Net Regularization for Sparse Linear Models Zachary C. Lipton

Add to Reading List

Source URL: zacklipton.com

Language: English - Date: 2015-05-21 21:27:59
23Evolutionary algorithms / Mathematical optimization / Operations research / Stochastic optimization / CMA-ES / Convex optimization / Global optimization / Gradient descent / Evolution strategy / Gaussian adaptation / Derivative-free optimization / Gradient method

Sebastian U. Stich MADALGO & CTIC Summer SchoolInstitute of Theoretical Computer Science

Add to Reading List

Source URL: sstich.ch

Language: English - Date: 2011-09-05 06:18:42
24Econometrics / Estimation theory / Statistical theory / M-estimators / Regression analysis / Loss function / Stochastic gradient descent / Linear regression

Towards Optimal One Pass Large Scale Learning with Averaged Stochastic Gradient Descent Wei Xu

Add to Reading List

Source URL: arxiv.org

Language: English - Date: 2011-12-22 22:14:38
25Estimation theory / Statistical theory / Econometrics / M-estimators / Stochastic processes / Loss function / OrnsteinUhlenbeck process / Stochastic gradient descent / Likelihood function

A Variational Analysis of Stochastic Gradient Algorithms Stephan Mandt , Matthew D. Hoffman , David M. Blei 1 2

Add to Reading List

Source URL: www.stephanmandt.com

Language: English - Date: 2016-06-23 13:49:43
26Computational statistics / Machine learning / Computational biology / Sepp Hochreiter / Artificial neural networks / Computational neuroscience / Deep learning / Autoencoder / Principal component analysis / Normal distribution / Stochastic gradient descent / Support vector machine

Rectified Factor Networks

Add to Reading List

Source URL: www.bioinf.jku.at

Language: English - Date: 2015-12-03 06:11:45
27Parallel computing / Stochastic optimization / M-estimators / Convex optimization / Stochastic gradient descent / Consistency model / Cache / Parameter / ML / XC / Bulk synchronous parallel

Managed Communication and Consistency for Fast Data-Parallel Iterative Analytics Jinliang Wei Wei Dai Aurick Qiao Qirong Ho? Henggang Cui Gregory R. Ganger Phillip B. Gibbons† Garth A. Gibson Eric P. Xing Carnegie Mell

Add to Reading List

Source URL: www.pdl.cmu.edu

Language: English - Date: 2016-03-07 13:00:52
28Estimation theory / Numerical linear algebra / M-estimators / Stochastic optimization / Least squares / Conjugate gradient method / Nonlinear conjugate gradient method / Gradient descent / Gradient method / Hessian matrix / Fisher information / BroydenFletcherGoldfarbShanno algorithm

Revisiting natural gradient for deep networks Yoshua Bengio Universit´e de Montr´eal Montr´eal QC H3C 3J7 Canada

Add to Reading List

Source URL: arxiv.org

Language: English - Date: 2014-02-18 01:51:44
29Graphics hardware / GPGPU / Parallel computing / Computational neuroscience / Artificial neural networks / Convolutional neural network / Graphics processing unit / Speech recognition / GPU cluster / CUDA / Kepler / Stochastic gradient descent

FireCaffe: near-linear acceleration of deep neural network training on compute clusters Forrest N. Iandola, Khalid Ashraf, Matthew W. Moskewicz, Kurt Keutzer DeepScale∗ and UC Berkeley arXiv:1511.00175v2 [cs.CV] 8 Jan

Add to Reading List

Source URL: arxiv.org

Language: English - Date: 2016-01-10 20:23:29
30M-estimators / Computational statistics / Computational neuroscience / Estimation theory / Stochastic optimization / Stochastic gradient descent / Deep learning / Artificial neural network / Convolutional neural network / Mathematical optimization / Loss function / Feature learning

Published as a conference paper at ICLRA DAM : A M ETHOD FOR S TOCHASTIC O PTIMIZATION Diederik P. Kingma* University of Amsterdam

Add to Reading List

Source URL: arxiv.org

Language: English - Date: 2015-07-26 20:01:45
UPDATE