Mode-Assisted Unsupervised Learning of Restricted Boltzmann Machines

Jan 15, 2020 Mode-Assisted Unsupervised Learning of Restricted Boltzmann Machines Francesco Caravelli, Forrest C. Sheldon, Fabio L. Traversa Restricted Boltzmann machines (RBMs) are a powerful class of generative models, but their training requires computing a gradient that, unlike supervised backpropagation on typical loss functions, is notoriously difficult even to approximate. Here, we show that properly…