Furong Huang: "Understanding, Interpreting & Designing NN Models Through Tensor Representations"
Tensor Methods and Emerging Applications to the Physical and Data Sciences 2021
Workshop IV: Efficient Tensor Representations for Learning and Computational Complexity
"Understanding, Interpreting and Designing Neural Network Models Through Tensor Representations"
Furong Huang - University of Maryland
Abstract: Modern deep neural networks have found tremendous empirical success in a wide variety of data science applications. Spectral methods that go beyond matrices tackle the problem of non-convexity in classic ML problems such as learning latent variable models and provide provable performance guarantees using tensor decompositions. Our objective is to advance spectral methods to be adaptable to deep neural networks with guaranteed "nice" properties. We design deep neural network architectures that guarantee interpretability, expressive power, generalization, and robustness even before the start of the training process. From a function approximation perspective, most previous methods train a deep network that might have "undesirable" properties and then project the "undesirable" model to the manifold of "desirable" models. We will use spectral methods to design a "desirable" class of deep model functions and guarantee a "desirable" deep model after any training process.
Institute for Pure and Applied Mathematics, UCLA
May 18, 2021
For more information: https://www.ipam.ucla.edu/tmws4
