Let's work over the complex numbers for simplicity. Let $X$ be a Riemann surface, fix a base point $x \in X$, and let $\Gamma$ be the fundamental group $\pi_{1}(X,x)$.
The data of an $n$-dimensional local system on $X$, together with a trivialization at the point $x$, is equivalent to the data of an $n$-dimensional representation of $\Gamma$. This is true in either the $\ell$-adic setting (in which case you'd study representations into $GL_n( \mathbf{Z}_{\ell} )$) or in the setting of "usual" local systems (where you'd study representations into $GL_n( \mathbf{C})$).
In particular, you can topologize the set of representations by picking a set of generators for $\Gamma$ and thereby embedding into some power of $GL_n(k)$. In the case $k = \mathbf{C}$, you can do even better: $GL_n( \mathbf{C} )$ is again an algebraic variety over $\mathbf{C}$, so that the collection of representations of $\Gamma$ into $GL_n( \mathbf{C} )$ inherits the structure of an algebraic variety. (In fact, it has multiple inequivalent "algebraic structures"; the one that I've described is the "Betti version", which is different from the one used in geometric Langlands).
Working with $\ell$-adic coefficients, you can still talk about whether or not two representations are "close" to one another, but the space of representations no longer bears any resemblance to an algebraic variety defined over $\mathbf{C}$ (for example, it's totally disconnected). This has nothing to do with stacks versus higher stacks: it's a disconnect between the "coefficient field" for your local systems and the field that your variety is defined over.