The following answer is a long and convoluted way of saying that a semigroup action "is what it is", and that a semigroup is not a category. (A monoid may be a category with a single object, but a semigroup is not a monoid.) If we want to use the language of category theory, we better stay within the realm of established translation schemes (at least as a first step). The conclusion is that working in the category of sets and partial functions has wider implications than just allowing a more general notion of semigroup action, and doesn't even achieve the intended goal to treat inverse semigroup actions "well".
How does the definition of semigroup action in terms category theory look like?
Before we can define a semigroup action in terms of category theory, we have to define a semigroup in terms of category theory. A semigroup $S$ may be described as an object $S$ together with a morphism $\mu:S\times S \rightarrow S$ such that the following diagram in $\mu$ commutes: $$\begin{matrix} S\times S\times S & \xrightarrow{1\times\mu} & S\times S \\ \\ \downarrow^{\mu \times 1} & & \downarrow^\mu \\ \\ S\times S & \xrightarrow{\mu} & S \end{matrix}$$ This means that we have $\mu\circ(1\times\mu)=\mu\circ(\mu\times 1)$, but the commutative diagram is more understandable, because it also show the objects and not just the morphisms.
In this language, a semigroup action may be described as a semigroup $S$, an object $X$ and a morphism $\alpha:S\times X \rightarrow X$ such that the following diagram in $\mu$ and $\alpha$ commutes: $$\begin{matrix} S\times S\times X & \xrightarrow{1\times\alpha} & S\times X \\ \\ \downarrow^{\mu \times 1} & & \downarrow^\alpha \\ \\ S\times X & \xrightarrow{\alpha} & X \end{matrix}$$ This means that we have $\alpha\circ(1\times\alpha)=\alpha\circ(\mu\times 1)$.
Does this definition make sense when applied to an inverse semigroup?
The next step would be to define an inverse semigroup in terms of category theory. We have to express the identities $x=xx^{-1}x$ and $xx^{-1}yy^{-1}=yy^{-1}xx^{-1}$ in terms of commutative diagrams for this. Hence an inverse semigroup may be described as a semigroup $S$ together with a morphism $\zeta:S\rightarrow S$ such that the following diagrams in $\mu$ and $\zeta$ commute:$$\begin{matrix} S\times S\times S & \xrightarrow{1\times\zeta\times 1} & S\times S\times S \\ \\ \uparrow_{(\delta \times 1)\circ\delta} & & \downarrow^{\mu\circ(\mu\times 1)} \\ \\ S & =\!= & S \end{matrix}$$ $$\begin{matrix} S\times S\times S\times S& \xleftarrow{\delta\times\delta} & S\times S \overset{\text{swap}}{\leftrightarrow} S\times S &\xrightarrow{\delta\times\delta}&S\times S\times S\times S\\ \\ \downarrow^{1\times\zeta \times 1\times\zeta} & & & & \downarrow^{1\times\zeta \times 1\times\zeta}\\ \\ S\times S\times S\times S & \xrightarrow{\mu\circ(\mu\times\mu)} & S & \xleftarrow{\mu\circ(\mu\times\mu)} & S\times S\times S\times S \end{matrix}$$ We could just apply the definition of semigroup action to this scenario, and we would have a definition. But should we add additional conditions that must be satisfied by an inverse semigroup action? Maybe, but I don't know which conditions these would be.
Does it lead to the intended representation theorem if used with the category of sets and partial function?
As long as we don't add additional conditions to be satisfied by an inverse semigroup action, there is no reason why this actionshould lead to the intended representation theorem. And even before that, in a category where partial functions are allowed, we have to allow that $\mu$ and $\zeta$ are partial function, as long as all stipulated diagrams in $\mu$ and $\zeta$ are commutative. So we are already patently outside the domain of inverse semigroup theory, and not even close to the intended representation theorem.
Is there an analogous definition of groupoid action?
One potential definition is already given in the question.
Are the various connections between semigroups and groupoids compatible with these definitions of an action?
They are incompatible in a similar way as the connection between monoid action and semigroup action.