An algebraic definition which works for at least polynomials: Consider the ring $\mathbb{R}[dx]/(dx^2)$ the derivative of a function $f(x)\in \mathbb{R}[x]$ could be defined implicitly by $$f'(x)dx +(dx^2) = f(x+dx)-f(x)+(dx^2).$$