Modifying StarGAN V2 using Modulated Convolutions

In this tutorial we will replace Adaptive Instance Normalization(AdaIN) layers in StarGAN V2 model and train it on images with a resolution 512x512 pixels.

Model results at 512px resolution

Why StarGAN V2?

StarGAN V2 Architecture

Stargan V2's inference
AdainResBlk module structure

StarGAN modification

Generator block with Modulated Convolutions

Fake images pool

Notes about Colab

Model training

Model output on 256x256 images
Model output on 512x512 images

References