Please have a look at Jason Morton's work on Mathematics of Deep Learning. It is quite mathematically rigorous if that's what is you are asking for.  

Link: http://www.jasonmorton.com/publications.html