Robinon Data Science Stack Exchange • Recommends
I've been struggling with Neural Networks for a while now.
I get the math behind backpropagation.
Still as reference I'm using the formulas from link to this video.
The Network learns XOR:
Prediction After Training: 0.0003508415406266712 Expected: 0.0
But basically doesn't learn anything on the MNIST dataset:
Error after n trainings examples:
- 0 Total Net Error: 4.3739634316135225
- 10000 Total Net Error: 0.4876292680858326
- 20000 Total Net Error: 0.39989816082272944
- 30000 Total Net Error: 0.49507443066631834
- 40000 Total Net Error: 0.5483594859079792
- 50000 Total Net Error: 0.5135921029479789
- 59000 Total Net Error: 0.4686434346776871
Prediction Expected
- [0.0…