The standard way to formalize this thought is via the concept of "density".
This is because you of course cannot uniformly randomly select $n\in\mathbb{N}$, but you can instead examine (for a subset $A\subseteq\mathbb{N}$, using the notation $[n] = \{1,\dots,n\}$):
$$d(A) = \lim_{n\to\infty}\frac{|[n]\cap A|}{|[n]|}$$
I believe this can analogously be written as:
$$d(A) = \lim_{n\to\infty}\Pr_{x\leftarrow\mathcal{U}([n])}[x\in A]$$
Highlighting the probabilistic aspect of it.
It is known that the natural density of square free numbers is $6/\pi^2$, precisely as you expect. Natural density has many properties similar to what one would expect for "probabilistic" statements about "uniformly random integers", but has some downfalls (it is not defined for all subsets $A\subseteq\mathbb{N}$).
There are other notions of densities which can be examined in those situations, but I am no expert on the benefits/shortcomings of them.