Selecting a Neural Network Transfer Function: Classic vs. Current
Neural Network Transfer Functions: Sigmoid, Tanh, and ReLU Making it or breaking it with neural networks: how to make smart choices. Why We Weren’t Getting Convergence This last week, in working with a very simple and straightforward XOR neural network, a lot of my students were having convergence problems. The most likely reason? Very likely, it’s been my choice for the transfer function. I had given them a very simple network. (Lots of them are still…