I apologize if this question is too basic for this site, but I posted it on mathSE and did not get any responses (link can be found here) so I'm crossposting it here.
Let $C^k(\mathbb{R}^n$) be the space of functions with $k$ continuous derivatives, and $H^s(\mathbb{R}^n)$ the Sobolev space $W^{2,s}$. Their continuous dual spaces are commonly denoted as $C^{-k}$ or $H^{-s}$. Similar notations exist for duals to Holder spaces, Besov spaces...etc.
I had always thought the negative index was only notational, but it seems it has a genuine interpretation as "lacking regularity". For example, the space $C^{-k}$ can be seen as "lacking $k$ derivatives". And similarly, if I take the derivative of a $C^0$ function then the result is a distribution belonging to $C^{-1}$. How can one see this?
What justifies the interpretation that a space with index $-k$ "lacks $k$ derivatives"? Why are distributions/dual spaces the right setting for functions that lack some degree of differential regularity?