SPARSITY: FROM HIGH-DIMENSIONAL STATISTICS TO DEEP LEARNING
JOHANNES LEDERER – RUHR- UNIVERSITY BOCHUM
ABSTRACT
Sparsity is popular in statistics and machine learning because it can avoid overfitting, speed up computations, and facilitate interpretations. In deep learning, however, the full potential of sparsity still needs to be explored. This presentation first recaps sparsity in the framework of high-dimensional statistics and then introduces corresponding methods and theories for modern deep-learning pipelines.
Related Papers:
https://www.sciencedirect.com/science/article/abs/pii/S0893608021001714