There are certainly other rigorous approaches to the derivative out there. The delta-epsilon method, which most students in their first year simply struggle to grasp as easily as the $h \rightarrow 0$ definition. This approach is typically reserved for the math majors who go on to take a course in analysis, not the general first calculus course for all science majors.