Skip to main content

Posts

Showing posts from August, 2020

When you use noise layer instead of dropout layer in neural network

Google has patent for dropout layer. So if you don't want to violate it, you might as well just use random noise layer. Results pretty similar for MNIST.
convolution,1,28,28,200,8,8,0.5,-0.001 max,200,21,21,7,7 noise,1800,0.5 matrix,1800,130,0.5,-0.001 sigmoid,130 matrix,130,10,0.5,-0.001 softmax,10
Tested with WideOpenThoughts

When all you have to do is bring smiling face and a bottle of wine

When you downgrade GPU

WideOpenThoughts works even on GTX 1060 for laptops

Splashdown

Return of NASA's astronauts