No, but you can define various regularizations, such as the left limit, right limit, and their averages.
Update: Now that you gave concrete motivations, it is clearer what you were after. Indeed, the convolution $\delta*f$ makes sense for any distribution $f$, and equal to $\delta*f=f$. So no problem with your examples.