CUED Publications database

Stochastic Flows and Geometric Optimization on the Orthogonal Group

Choromanski, K and Cheikhi, D and Davis, J and Likhosherstov, V and Nazaret, A and Bahamou, A and Song, X and Akarte, M and Parker-Holder, J and Bergquist, J and Gao, Y and Pacchiano, A and Sarlos, T and Weller, A and Sindhwani, V Stochastic Flows and Geometric Optimization on the Orthogonal Group. (Unpublished)

Full text not available from this repository.

Abstract

We present a new class of stochastic, geometrically-driven optimization algorithms on the orthogonal group $O(d)$ and naturally reductive homogeneous manifolds obtained from the action of the rotation group $SO(d)$. We theoretically and experimentally demonstrate that our methods can be applied in various fields of machine learning including deep, convolutional and recurrent neural networks, reinforcement learning, normalizing flows and metric learning. We show an intriguing connection between efficient stochastic optimization on the orthogonal group and graph theory (e.g. matching problem, partition functions over graphs, graph-coloring). We leverage the theory of Lie groups and provide theoretical results for the designed class of algorithms. We demonstrate broad applicability of our methods by showing strong performance on the seemingly unrelated tasks of learning world models to obtain stable policies for the most difficult $\mathrm{Humanoid}$ agent from $\mathrm{OpenAI}$ $\mathrm{Gym}$ and improving convolutional neural networks.

Item Type: Article
Uncontrolled Keywords: cs.LG cs.LG stat.ML
Subjects: UNSPECIFIED
Divisions: Div F > Computational and Biological Learning
Depositing User: Cron Job
Date Deposited: 17 Apr 2020 20:35
Last Modified: 18 Feb 2021 18:14
DOI: