Combinatorial games with infinite paths, and generalized Sprague-Grundy theory Generalized Sprague-Grundy theory has been used to analyze finite impartial loopy games with normal play. There is a nice short account by Mark S. in this answer. It was introduced by Cedric Smith in the 60s, and developed independently by Fraenkel and others. 
The theory is usually described in the setting of finite directed graphs (see for example section IV.4 of Siegel's 
Combinatorial Game Theory). 
I see that Fraenkl and Rahat (2001) looked at the case of infinite directed graphs which are locally path-bounded, i.e. where for any vertex $v$, the sup of the length of all paths starting at $v$ is finite.
I'm interested in the case of directed graphs which are allowed to contain infinite paths. Suppose we assume that every vertex has finite outdegree. It seems to me that much of the structure (e.g. all the results of Section IV.4 of Siegel) extends unchanged to this setting. In particular, every such game has a "loopy nim value" which is either a non-negative integer (in which case the game is equivalent to a finite nim heap) or of the form $\infty(\mathcal{A})$ for some subset $\mathcal{A}$ of $\mathbb{N}$ (see the answer by Mark S. linked above). 
(Once we allow infinite paths, it's no longer important to allow cycles, since we can create multiple "copies" of each node. Without loss of generality one could consider "game trees", i.e. rooted trees directed away from the root, with all degrees finite.)
Can someone point me to a reference covering such games? Does the generalized Sprague-Grundy theory go through straightforwardly to that context as I imagine?
 A: I am not sure what you imagine, but once one makes the move to games with infinite play, then various set-theoretic issues come to light, and the subject becomes more set-theoretic and less like combinatorial game theory. The keyword is determinacy, and there is a very rich literature.
A Gale-Stewart game is a game allowing infinite play, where the winner is determined by a certain set $A$ of plays. So player I is trying to play into the payoff set and player II is trying to play out of the payoff set. 
The Gale-Stewert theorem (1953) asserts that any game whose payoff set is open in the product topology is determined, meaning that one of the players has a winning strategy. This is generalized by Martin's theorem establishing Borel determinacy, generalizing from open sets to Borel sets. 
The axiom of choice implies that there are non-determined sets, but meanwhile, if one drops the axiom of choice, then the assertion that every game has a winning strategy, known as the axiom of determinacy, has many extremely attractive consequences, such as the fact that all sets of reals are Lebesgue measurable and every set has the property of Baire, among others. The axiom of determinacy is equiconsistent over ZF+DC with the existence of infinitely many Woodin cardinals. 
