Accounts of modular forms say that they were studied in the early 19th century, but then define modular forms using terminology that didn't exist until the 20th century. How did the earliest mathematicians to investigate modular forms define them? What motivated their exploration?
There is also the book of F. Klein, Development of Mathematics in XIX century, vol. I, which has a large chapter on Gauss which describes his work on modular forms. This was written in XX century, but Klein was essentially a XIX century mathematician, so you can see from this book "how did they think". 


An enjoyable account how Gauss, Abel, and Weierstrass thought (or might have thought) about elliptic integrals and modular forms is given by Dick Koch, The Pentagonal Number Theorem and Modular Forms, pages 1327. 

