Department of Mathematics

Applied Mathematics

  •  Reinhard Heckel, Technical University of Munich
  •  Provable Image Recovery with Untrained Convolutional Neural Networks; zoom link @ https://sites.google.com/view/minds-seminar/home
  •  10/15/2020
  •  2:30 PM - 3:30 PM
  •  Online (virtual meeting)
  •  Olga Turanova (turanova@msu.edu)

Convolutional Neural Networks are highly successful tools for image recovery and restoration. A major contributing factor to this success is that convolutional networks impose strong prior assumptions about natural images—so strong that they enable image recovery without any training data. A surprising observation that highlights those prior assumptions is that one can remove noise from a corrupted natural image by simply fitting (via gradient descent) a randomly initialized, over-parameterized convolutional generator to the noisy image. In this talk, we discuss a simple un-trained convolutional network, called the deep decoder, that provably enables image denoising and regularization of inverse problems such as compressive sensing with excellent performance. We formally characterize the dynamics of fitting this convolutional network to a noisy signal and to an under-sampled signal, and show that in both cases early-stopped gradient descent provably recovers the clean signal. Finally, we discuss our own numerical results and numerical results from another group demonstrating that un-trained convolutional networks enable magnetic resonance imaging from highly under-sampled measurements, achieving results surprisingly close to trained networks, and outperforming classical untrained methods.

 

Contact

Department of Mathematics
Michigan State University
619 Red Cedar Road
C212 Wells Hall
East Lansing, MI 48824

Phone: (517) 353-0844
Fax: (517) 432-1562

College of Natural Science