the archive
#model pruning
2 resultscs.LG2019
Singular Values for ReLU Layers
Sören Dittmer, Emily J. King, Peter Maass
The paper introduces ReLU singular values and Gaussian mean width as tools to analyze how ReLU activations interact with linear layers, providing theoretical insights, experimental…
#relu layers#singular values#gaussian mean width#neural network analysis
stat.ML2019
Group Pruning using a Bounded-Lp norm for Group Gating and Regularization
Chaithanya Kumar Mummadi, Tim Genewein, Dan Zhang +2
The paper proposes a gating mechanism and a bounded L1 regularizer to enable group-wise channel pruning in convolutional neural networks, achieving significant parameter reductions…
#model pruning#group sparsity#regularization#neural network compression