Skip to yearly menu bar Skip to main content


Workshop

Resilient Backpropagation (Rprop) for Batch-learning in TensorFlow

Ciprian Florescu · Christian Igel

East Meeting Level 8 + 15 #22

Mon 30 Apr, 4:30 p.m. PDT

The resilient backpropagation (Rprop) algorithms are fast and accurate batch learning methods for neural networks. We describe their implementation in the popular machine learning framework TensorFlow. We present the first empirical evaluation of Rprop for training recurrent neural networks with gated recurrent units. In our experiments, Rprop with default hyperparameters outperformed vanilla steepest descent as well as the optimization algorithms RMSprop and Adam even if their hyperparameters were tuned.

Live content is unavailable. Log in and register to view live content