SpeeDO: Parallelizing Stochastic Gradient Descent for Deep Convolutional Neural Network Zhongyang Zheng HTC Research Beijing, China

Source URL: learningsys.org

Gradient Descent and the Structure of Neural Network Cost Functions presentation by Ian Goodfellow adapted for www.deeplearningbook.org

Source URL: www.deeplearningbook.org

Optimal Gradient-Based Learning Using Importance Weights Sepp Hochreiter and Klaus Obermayer Bernstein Center for Computational Neuroscience and Technische Universit¨at Berlin

Source URL: www.bioinf.jku.at

• Artificial neural networks
• Artificial intelligence
• Learning
• Applied mathematics
• Recurrent neural network
• Long short-term memory
• Sepp Hochreiter
• Backpropagation
• Vanishing gradient problem
• Supervised learning
• Support vector machine
• Generalization error

Gradient Clock Synchronization in Dynamic Networks Fabian Kuhn Thomas Locher Rotem Oshman

Source URL: www.tik.ee.ethz.ch

• Graph theory
• Electrical engineering
• Mathematics
• Clock signal
• Clock skew
• Flow network
• Dynamic connectivity
• Skew
• Skew-symmetric graph

Australian Transect Network A facility of the Terrestrial Ecosystem Research Network The Australian Transect Network (ATN) comprises seven major subcontinental transects that span biomes and traverse major rainfall, temp

Source URL: www.tern.org.au

• Biology
• Ecology
• Natural environment
• Environmental statistics
• New Urbanism
• Transect
• Biodiversity
• Environmental gradient

Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue Systems Tsung-Hsien Wen, Milica Gaˇsi´c, Nikola Mrkˇsi´c, Pei-Hao Su, David Vandyke and Steve Young Cambridge University Engineering

Source URL: www.emnlp2015.org

• Artificial neural networks
• Artificial intelligence
• Machine learning
• Computational neuroscience
• Academia
• Deep learning
• Long short-term memory
• Recurrent neural network
• Sepp Hochreiter
• Vanishing gradient problem
• Speech recognition
• Handwriting recognition

Workshop track - ICLRV ISUALIZING N ETWORKS AND

Source URL: vision.stanford.edu

• Artificial neural networks
• Artificial intelligence
• Machine learning
• Computational linguistics
• Applied mathematics
• Computational neuroscience
• Artificial intelligence applications
• Long short-term memory
• Computational statistics
• Recurrent neural network
• Speech recognition
• Vanishing gradient problem

Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies Sepp Hochreiter Fakult¨at f¨ ur Informatik

Source URL: www.bioinf.jku.at

• Artificial neural networks
• Applied mathematics
• Cybernetics
• Backpropagation through time
• Recurrent neural network
• Exponential growth
• Backpropagation
• Mathematics

CS 224D: Deep Learning for NLP1 1 Lecture Notes: Part IV2

Source URL: cs224d.stanford.edu

• Artificial neural networks
• Applied mathematics
• Machine learning
• Cybernetics
• Recurrent neural network
• Deep learning
• Long short-term memory
• Vanishing gradient problem
• Backpropagation
• Language model
• Artificial intelligence
• Types of artificial neural networks

Workshop track - ICLRU NDERSTANDING VERY DEEP NETWORKS VIA VOLUME CONSERVATION Thomas Unterthiner & Sepp Hochreiter Institute of Bioinformatics

Source URL: www.bioinf.jku.at

• Artificial neural networks
• Applied mathematics
• Cybernetics
• Artificial intelligence
• Deep learning
• Vanishing gradient problem
• Recurrent neural network
• Long short-term memory
• Rectifier
• Sepp Hochreiter
• Activation function
• Feature learning