I've only read the very beginning, but the book Generalized Musical Intervals and Transformations by David Lewin was recommended to me by a music professor when he heard I was studying mathematics. In it, the author analyzes the works of Wagner and others using group theory.