the set of all true statements in the language of arithmetic. This has comlexitycomplexity $\Sigma_\omega$, just beyond the the arithmetic hierarchy.
the set of all Turing machine programs that compute a well-ordered relation on $\mathbb{N}$. This set has complexity complete $\Pi^1_1$ in the projective hiearchy, well beyond what can be computed by Turing machines.
the set of all statements true in the realm of the hereditarily countable sets $\text{HC}=\langle H_{\omega_1},{\in}\rangle$. This is the complexity of projective truth, outside and above the projective hierarchy.
the set of natural numbers $n$ such that $2^{\aleph_n}=\aleph_{n+1}$. This set of natural numbers is defined by a $\Sigma_2$ assertion of set theory (not in the arithmetic hierarchy, but the Levy hierarchy). It cannot be expressed as a statement about computation, since the particular contents of the set can be changed by forcing, and forcing does not affect the nature of any computation. Perhaps you will object that it is like your CH example, but it isn't of that binary form, and it would seem hard to say that this isn't a legitimate definition of a set of natural numbers that could be defined in some other way.
there are many others...
I notice in your question that you mention the arithmetic and hyperarithmetic hierarchies, but I disagree with your characterization of them as being statements concerning properties of computation. Although it is true that one can iterate a $\Sigma_1$ process through the ordinals to arrive at the hyperarithmetic sets, it is the complexity of the ordinals that drives this hierarchy, rather than the comparatively trivial use of computation at each step. Similarly, although one could say that projective statements are statements about Turing machines, provided that one is allowed to quantify over integers and reals (one just writes the quantifier-free part of the assertion in terms of computation), this would seem to me to miss the point, for it is the quantification over reals that matters, and not the fact that one writes the quatifierquantifier-free part in a way involving computation. Ultimately, therefore, it seems to me that the answer to the ideas in your question consists of a careful appreciation of the nature of the various definability hierarchies.
Allow me to give a little more information by mentioning that there are several very large, intensely studied hierarchies of complexity for realsreal numbers. After the initial familiar notions come several others...
A real $x$ is arithmetic if it'sits digits can be defined by a definition involving only quantification over the natural numbers and primitive operations. Equivalently, the arithmetic subsets of $\mathbb{N}$ arise from the computable subsets of $\mathbb{N}^k$ by projection and complement. The arithmetic hierarchy breaks naturally into levels, such as $\Sigma^0_n$ and $\Pi^0_n$, corresponding to the logical complexity of these definitions, and these levels are refined by the Turing degrees. For example, the set of Turing machine programs $p$ which compute total functions forms a complete $\Pi^0_2$ set. The relativized notion leads to the arithmetic degrees.