Neural Networks: Not magic

“There has been a great deal of hype surrounding neural networks, making them seem magical and mysterious. As we make clear in this section, they are just nonlinear statistical models, much like the projection pursuit regression model described above.” – Page 350, “The Elements of Statistical Learning”,Hastie, Tibshirani, Friedman.