You can sample from the product $Ax$ in the following way:

Sample a row of $A$ and multiply by $x$. To save memory, forget the row. Sample another row of $A$ and multiply by $x$. To save memory, forget the row. And so on.

An even faster way of sampling from $a^T x$ where $a$ is a row of $A$ is to simply sample from $N(0, \sigma |x|^2)$. This follows from the formula for the [sum of two normal distributions](https://en.wikipedia.org/wiki/Sum_of_normally_distributed_random_variables), which can be straightforwardly generalised to the sum of $n$ normal distributions.