Adversarial Training of Variational Auto-Encoders for High Fidelity Image Generation

Salman H. Khan, Munawar Hayat, Nick Barnes

Research output: A Conference proceeding or a Chapter in BookConference contributionpeer-review

18 Citations (Scopus)

Abstract

Variational auto-encoders (VAEs) provide an attractive solution to image generation problem. However, they tend to produce blurred and over-smoothed images due to their dependence on pixel-wise reconstruction loss. This paper introduces a new approach to alleviate this problem in the VAE based generative models. Our model simultaneously learns to match the data, reconstruction loss and the latent distributions of real and fake images to improve the quality of generated samples. To compute the loss distributions, we introduce an auto-encoder based discriminator model which allows an adversarial learning procedure. The discriminator in our model also provides perceptual guidance to the VAE by matching the learned similarity metric of the real and fake samples in the latent space. To stabilize the overall training process, our model uses an error feedback approach to maintain the equilibrium between competing networks in the model. Our experiments show that the generated samples from our proposed model exhibit a diverse set of attributes and facial expressions and scale up to highresolution images very well.

Original languageEnglish
Title of host publicationProceedings - 2018 IEEE Winter Conference on Applications of Computer Vision, WACV 2018
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages1312-1320
Number of pages9
Volume2018-January
ISBN (Electronic)9781538648865
ISBN (Print)9781538648872
DOIs
Publication statusPublished - 12 Mar 2018
Event18th IEEE Winter Conference on Applications of Computer Vision, WACV 2018 - Lake Tahoe, United States
Duration: 12 Mar 201815 Mar 2018

Conference

Conference18th IEEE Winter Conference on Applications of Computer Vision, WACV 2018
Country/TerritoryUnited States
CityLake Tahoe
Period12/03/1815/03/18

Fingerprint

Dive into the research topics of 'Adversarial Training of Variational Auto-Encoders for High Fidelity Image Generation'. Together they form a unique fingerprint.

Cite this