It's funny, but when you remove relu from Resnet, distributions look more like normal distribution. Once you add it back, it looks more Power Log Normal.
It's funny, but when you remove relu from Resnet, distributions look more like normal distribution. Once you add it back, it looks more Power Log Normal.