When Harmonic Analysis meets Machine Learning: Lipschitz Analysis of Deep Convolution Networks

#Deep #Convolutional #Neural #Networks

Deep neural networks have led to dramatic improvements in performance for many machine learning tasks, yet the mathematical reasons for this success remain largely unclear. In this talk we present recent developments in the mathematical framework of convolutive neural networks (CNN). In particular we discuss the scattering network of Mallat and how it relates to another problem in harmonic analysis, namely the phase retrieval problem. Then we discuss the general convolutive neural network from a theoretician point of view. We present Lipschitz analysis results using two analytical methods: the chain rule (or backpropagation) and the storage function method inspired by Mallat's scattering network analysis. Towards the end of the talk we discuss how these theoretical results can be applied in practice, and in particular we mention various design methods that incorporate Lipschitz bounds as penalty terms into optimization problems.

  Date and Time




  • Date: 10 Oct 2017
  • Time: 06:30 PM to 08:30 PM
  • All times are (GMT-05:00) US/Eastern
  • Add_To_Calendar_icon Add Event to Calendar
  • University of Maryland
  • College Park, Maryland
  • United States
  • Building: AV Williams - Parking Lot 11B
  • Room Number: 2460 (ECE Department's Colloquium Room)
  • Click here for Map

  • Contact Event Host
  • Co-sponsored by WASH Signal Processing Society
  • Starts 25 September 2017 12:00 AM
  • Ends 11 October 2017 12:00 AM
  • All times are (GMT-05:00) US/Eastern
  • No Admission Charge


Prof. Radu Balan Prof. Radu Balan


Prof. Balan is a professor of applied mathematics at the University of Maryland. His research interests include topics in harmonic analysis and applications to engineering and computer science, particularly to statistical signal processing, and machine learning

Prof. Radu Balan


Prof. Radu Balan



Light dinner and refreshments will be served at 6:30pm; lecture will start at 7pm. 

If arriving by car, feel free to use parking lot 11b, which is open for general access after 4pm. If arriving by Metro, free shuttle service is available from the College Park station to campus.