To further qualify Charles's yes: that these moduli spaces are orbifolds instead of manifolds does result in rational numbers, but this is quite natural and not much of a problem. The orbifolds here are just resulting because we're counting things that have automorphisms, here, for instance, the map from P^1 to P^1 given by the polynomial z^d has Z_d as its automorphisms: we can multiply a point in P^1 by a dth root of unity and not change where it maps to). Whenever you count things with automorphisms it's quite natural to count each thing weighted by 1/(the size of its automorphism groups), or to rigidify the things we're counting by adding some kind of extra structure so they no longer have automorphisms.
As an example: Cayley's formula that there are n^(n-2) trees on n labeled vertices - the labeling of the vertices guarantees that the objects we're counting do not have automorphisms, and we get an integer - we've rigidified the problem. If we wanted to count the number of trees on n unlabeled vertices, the problem is much more difficult. However, if we weight each such tree by the inverse of its automorphism group, then the problem has a nice answer again: it's simply n^(n-2)/n!. My point is: the rationality is not the ugly part of what's going on.
The ugly part is that these moduli spaces of maps are not even orbifolds: they have much worse singularities, and can have different components of different dimension. From deformation theory, we expect these moduli spaces to have a certain dimension. To get a finite number, we put conditions on the map that cut this dimension down until its zero. Geometrically, you should think of each of these conditions as a cycle on the moduli space, and we want to intersect them. Doing this intersection naively doesn't work when the space is singular, and furthermore the moduli space might be smooth but have a dimension different than what we were expecting. But a lot of hard work shows that these spaces have a "virtual fundamental class" of the dimension that we expect, and using this we can proceed as above to get a number. But in doing this, we've lost the sense in that we're counting something.
But it strikes me that perhaps that's not necessarily what the questioner was after; most typically this is done for smooth, projective varieties of C, but somehow the part that really matters is the symplectic structure: Gromov-Witten invariants can be defined for any symplectic manifold - they will all have almost complex structures J that "play nicely" with the symplectic form omega, and we're "counting" these maps. Or: all this works for orbifolds (which are really smooth objects), but not singular spaces.
The over $\C$ bit is pretty necessary, I think - people have looked a little at doing in positive characteristic, but one big problem is that the orbifold stuff, which I was just telling you isn't really a problem, can be a big problem in positive characteristic if the order of your automorphisms aren't coprime with the characteristic.