By Farkas' Lemma (https://en.wikipedia.org/wiki/Farkas%27_lemma),
- $\mathbf{A}{x}\leq \mathbf{b}$ has a solution $\mathbf{x}\in\mathbb{R}^n$ if and only if for all $\mathbf{y}\geq 0$ with $\mathbf{A}^T\mathbf{y}=0$, we have $\mathbf{b}^T\mathbf{y} \leq 0$.
Now the set $\{\mathbf{y} \textrm{ such that } \mathbf{y}\geq 0 \textrm{ and } \mathbf{A}^T\mathbf{y}=0\}$ is evidently a polyhedral cone (i.e., intersection of a finite number of half-spaces of the form $f(\mathbf{y})\geq 0$), and thus the set $\{\mathbf{b} \textrm{ such that }\mathbf{b}^T\mathbf{y} \leq 0\ \textrm{for all such } \mathbf{y}\}$ (which is the set $K$ in your notation) is the (negative of the) dual cone of this polyhedral cone. In particular it is itself a polyhedral cone.
But insofar as we can scale the $\mathbf{b}$ by elements of $\mathbb{R}_{\geq0}$, this set is never compact.
I believe this answers your question as best as it can be answered.