A brain-inspired algorithm for training highly sparse neural networks
Atashgahi, Z Pieterse, J Liu, S Mocanu, D Veldhuis, R Pechenizkiy, M Machine Learning volume 111 issue 12 4411-4452 (01 Dec 2022)
Hierarchical Semantic Segmentation using Psychometric Learning
Yin, L Menkovski, V Liu, S Pechenizkiy, M Proceedings of Machine Learning Research volume 157 798-813 (01 Jan 2021)
Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training
Liu, S Yin, L Mocanu, D Pechenizkiy, M Proceedings of Machine Learning Research volume 139 6989-7000 (01 Jan 2021)
Selfish Sparse RNN Training
Liu, S Mocanu, D Pei, Y Pechenizkiy, M Proceedings of Machine Learning Research volume 139 6893-6904 (01 Jan 2021)
THE UNREASONABLE EFFECTIVENESS OF RANDOM PRUNING: RETURN OF THE MOST NAIVE BASELINE FOR SPARSE TRAINING
Liu, S Chen, T Chen, X Shen, L Mocanu, D Wang, Z Pechenizkiy, M ICLR 2022 - 10th International Conference on Learning Representations (01 Jan 2022)
SPARSITY MAY CRY: LET US FAIL (CURRENT) SPARSE NEURAL NETWORKS TOGETHER!
Liu, S Chen, T Zhang, Z Chen, X Huang, T Jaiswal, A Wang, Z 11th International Conference on Learning Representations, ICLR 2023 (01 Jan 2023)
Don’t Be So Dense: Sparse-to-Sparse GAN Training Without Sacrificing Performance
Liu, S Tian, Y Chen, T Shen, L International Journal of Computer Vision volume 131 issue 10 2635-2648 (01 Oct 2023)
Dynamic Sparse Network for Time Series Classification: Learning What to “See”
Xiao, Q Wu, B Zhang, Y Liu, S Pechenizkiy, M Mocanu, E Mocanu, D Advances in Neural Information Processing Systems volume 35 (01 Jan 2022)
Superposing Many Tickets into One: A Performance Booster for Sparse Neural Network Training
Yin, L Menkovski, V Fang, M Huang, T Pei, Y Pechenizkiy, M Mocanu, D Liu, S Proceedings of Machine Learning Research volume 180 2267-2277 (01 Jan 2022)
You Can Have Better Graph Neural Networks by Not Training Weights at All: Finding Untrained GNNs Tickets
Huang, T Chen, T Fang, M Menkovski, V Zhao, J Yin, L Pei, Y Mocanu, D Wang, Z Pechenizkiy, M Liu, S Proceedings of Machine Learning Research volume 198 (01 Jan 2022)
Subscribe to