It's funny, but when you remove relu from Resnet, distributions look more like normal distribution. Once you add it back, it looks more Power Log Normal.
playful and full of energy
It's funny, but when you remove relu from Resnet, distributions look more like normal distribution. Once you add it back, it looks more Power Log Normal.