Skip to yearly menu bar Skip to main content


Workshop

A Language and Compiler View on Differentiable Programming

Fei Wang · Tiark Rompf

East Meeting Level 8 + 15 #15

Mon 30 Apr, 11 a.m. PDT

Current and emerging deep learning architectures call for an expressive high-level programming style with end-to-end differentiation and for a high-performance implementation at the same time. But the current generation of deep learning frameworks either limits expressiveness and ease of use for increased performance (e.g., TensorFlow) or vice versa (e.g., PyTorch). In this paper we demonstrate that a “best of both worlds” approach is possible, based on multi-stage programming and delimited continuations, two orthogonal ideas firmly rooted in programming languages research.

Live content is unavailable. Log in and register to view live content