CUED Publications database

One-Shot Learning in Discriminative Neural Networks

Burgess, J and Lloyd, JR and Ghahramani, Z One-Shot Learning in Discriminative Neural Networks. (Unpublished)

Full text not available from this repository.


We consider the task of one-shot learning of visual categories. In this paper we explore a Bayesian procedure for updating a pretrained convnet to classify a novel image category for which data is limited. We decompose this convnet into a fixed feature extractor and softmax classifier. We assume that the target weights for the new task come from the same distribution as the pretrained softmax weights, which we model as a multivariate Gaussian. By using this as a prior for the new weights, we demonstrate competitive performance with state-of-the-art methods whilst also being consistent with 'normal' methods for training deep networks on large data.

Item Type: Article
Uncontrolled Keywords: stat.ML stat.ML cs.LG
Divisions: Div F > Computational and Biological Learning
Depositing User: Cron Job
Date Deposited: 26 Jul 2017 20:11
Last Modified: 22 May 2018 06:27