In smooth infinitesimal analysis, one can prove that a curve can't be a set of points but can instead be built out of line segments whose lengths are nilsquare infinitesimals (different from the infinitesimals of NSA, which obey the transfer principle). The derivative is then simply the slope of one such segment.

A good intro that doesn't require any knowledge of category theory is Bell, A primer of infinitesimal analysis.