Comparing end result of cross entropy and standard deviation loss

 

Standard deviation loss

Outputs of Resnet end up closer together

Cross entropy loss

Outputs of Resnet have bigger differences 

between correct samples

Also, correct probability of test set 

looks log-normal once again

Images created with pytorch CIFAR-10 training.