ICLR 2018
Skip to yearly menu bar Skip to main content


Workshop

An Optimization View on Dynamic Routing Between Capsules

Dilin Wang · Qiang Liu

East Meeting Level 8 + 15 #7

Despite the effectiveness of dynamic routing procedure recently proposed in \citep{sabour2017dynamic}, we still lack a standard formalization of the heuristic and its implications. In this paper, we partially formulate the routing strategy proposed in \citep{sabour2017dynamic} as an optimization problem that minimizes a combination of clustering-like loss and a KL regularization term between the current coupling distribution and its last states. We then introduce another simple routing approach, which enjoys few interesting properties. In an unsupervised perceptual grouping task, we show experimentally that our routing algorithm outperforms the dynamic routing method proposed in \citep{sabour2017dynamic}.

Live content is unavailable. Log in and register to view live content