I've been told that when applying for a teaching position, your reference letters can be written by anyone who is familiar with your teaching capabilities in detail. I feel that this primarily just means students, but I wonder if there's some unspoken rule that reference letters should come from people in positions of authority, e.g. professors for whom I've served as TA, administrative staff in the math department, etc. In reality, it's the students who know my teaching capabilities in detail, and perhaps to a lesser degree my friends, whereas professors and administrators have no direct knowledge my teaching abilities whatsoever, and might only have heard things here or there from students, or have read my student evaluations and seen the scores.

So should reference letters predominantly come from authority figures, or is it okay to have them all come from students?