A collaboration of Adobe Research, University of California at Berkeley, Carnegie Mellon University, and MIT’s CSAIL has produced a system called “Cohere”, described in the presentation “GANgealing: GAN-Supervised Dense Visual Alignment”, which uses the machine learning technique of generative adversarial networks to automatically align overlays on moving features in videos.
This will have applications for image and video processing, augmented reality, and the production of deep fake videos. If you can immediately think of your own applications, you’ll find source code posted on GitHub and a ready-to-run “GANgealing Mixed Reality Playground” on Google Colab.